Viewing profile — karbarcca

No worries, it doesn't come off that aggressive ;) Yes, I've definitely been involved in other projects where a single core developer can do a little too much "imposing" of their w…

Unfortunately almost exclusively via http rest apis. It's not great, but it's the lowest common denominator between the vast "ingestion" service we've built (connectors to web apis…

The biggest difference in these benchmarks comes down to how multiple threads are leveraged; (disclaimer: primary CSV.jl author here). In CSV.jl, it was relatively straightforward …

I agree; if I needed to parse CSVs in python and could utilize the arrow format, I would definitely use pyarrow. I actually recently finished support for reading/writing the arrow …

Take a deep look at Julia! Adding multithreaded parsing capabilities to CSV.jl was really a joy; basically just chunking up the file and spawning threaded tasks to process each chu…

It's always a transcendental experience to move data from CSV into any more structured/flexible format!

One advantage I've noticed at least (having been a contributor to the Julia language itself), is that it at least makes contributing to the language very approachable. Granted you …

No worries. The CSV.jl package has just been around for 5 years now, has some 700 issues opened/resolved, has built up a pretty extensive test suite, and is used in production by a…

It can make huge amounts of difference in a production system; where I work, we process terabytes of csv data every day; saving minutes per file can add up to enormous differences …

As the primary author of CSV.jl, I can help clarify on the posted issues: * #720: ended up not being an issue at all, but a misconfigured environment * #714: there was indeed a cor…

I made https://github.com/JuliaData/Strapping.jl , which is part of an ORM; i.e. it does the translating between Julia objects/vectors of objects and 2D tables. But it doesn't do s…

Nice lineup! Can't wait to nerd out for a week. Had a great time last year rubbing shoulders with a lot of smart people and the hack nights were great too.

We're actually lucky it's this good! It was as good as our audio/visual dept could edit it; we definitely didn't prepare as much as we should in this area and next year will be muc…