Does anyone happen to have a tap (or anything else really, in any state of development) that reads arbitrary XML files? Pandas gladly skips nested fields, which might not be optimal. Just gliding into the new year like a bird towards a window here… 😬

Did you ever come up with any ideas for this? I need to bring some XML with a predictable hierarchical structure, so not quite the same situation you were in. It seems like it would be a good starting point, though.

I was fortunately able to offload the entire mess to some other poor soul, who made a much more custom solution. My draft solution was to use an xslt (or whatever it is called), basically a markup file that specifies a mapping from xml to a more sensible format, and let python parse that. That way, the tap can be generic and simply take the xslt(?) file as an config. I have absolutely no code for it though.

The best possible solution. Thanks though, I was also looking down the route of using a xslt to flatten it out.