How To Open and Manipulate Large CSV Files On A Mac
alecdibble.com
How To Open and Manipulate Large CSV Files On A Mac
1–10 of 57 posts
Re: How To Open and Manipulate Large CSV Files On A Mac
#2Why do you want to do that?
Use cat, pipe, grep, awk. Problem solved.
Re: How To Open and Manipulate Large CSV Files On A Mac
#3Why do you want to do that? Use cat, pipe, grep, awk. Problem solved.
I personally am not a huge fan of awk, I've never built a great mental model around its syntax and it doesn't really solve the problem I was talking about, which is getting a spreadsheet-like editing experience. Thanks for bringing it up, I should definitely add it to the article.
Re: How To Open and Manipulate Large CSV Files On A Mac
#4Sublime Text and VSCode work fine with 1GB files in my experience.
Re: How To Open and Manipulate Large CSV Files On A Mac
#5No mention of vi or Sqlite? While I'm no vi expert it's a great tool for working with big files when you want to browse around without grep. And Sqlite is similarly ubiquitous and capable of crunching large files.
Re: How To Open and Manipulate Large CSV Files On A Mac
#6Was SequelPro trying impute any field types? That could have been causing the crash when faced with a large file.
Re: How To Open and Manipulate Large CSV Files On A Mac
#7Sublime Text and VSCode work fine with 1GB files in my experience.
I've had pretty good experiences with both of those editing the raw files. However, neither of them give capabilities like moving columns or doing filtering. But for basic editing or viewing, they definitely work.
Re: How To Open and Manipulate Large CSV Files On A Mac
#8No mention of vi or Sqlite? While I'm no vi expert it's a great tool for working with big files when you want to browse around without grep. And Sqlite is similarly ubiquitous and capable of crunching large files.
vi is an editor so it doesn't really solve my requirement of getting spreadsheet-like editing capabilities. SQlite is a good idea, I never thought of that. I will investigate that and add it to the article. Thanks!
Re: How To Open and Manipulate Large CSV Files On A Mac
#9Was SequelPro trying impute any field types? That could have been causing the crash when faced with a large file.
I don't believe so as it was a CSV export from Sequel Pro. I could be wrong, but the import worked fine using the same file truncated to the first few thousand rows.
Re: How To Open and Manipulate Large CSV Files On A Mac
#10Python + Pandas