python-dateutil is slow, pendeulum is much faster....
# singer-target-development
v
python-dateutil is slow, pendeulum is much faster. vizviewer in thread See https://github.com/closeio/ciso8601#benchmark for a nice benchmark! I had no idea
message has been deleted
Everytime I was parsing dates for this target (was slow for a few tables this one had 8 date fields)
Can't help but wonder if time would be better served running targets in multiple threads (during batches as well)
Just switching to pendulum didn't speed me up much, not a silver bullet I guess shucks!
And it gets deeper https://pendulum.eustace.io/blog/the-road-to-pendulum-2-0.html
Copy code
pendulum also relies on C-extensions for some parts of the library that require improved performances, like parsing datetime strings. However, the C-API Python provides are different between Python 2.7 and Python 3.6 so that adds to the difficulty of maintaining both major versions.
50% increase with the ciso8601 library