My Battle with Datetimes in Prod
datacompose.io
My Battle with Datetimes in Prod
1–3 of 3 posts
Re: My Battle with Datetimes in Prod
#2I spent 8 hours debugging datetime parsing in a PySpark migration. Every solution failed… built-in functions returned silent NULLs, UDFs took 6 hours to run, pandas UDFs still failed on 8% of rows.
Re: My Battle with Datetimes in Prod
#3>> Date inference is genuinely hard—there’s no universal standard
Umm, ISO is the universal standard