21–30 of 69 posts
I hear a lot of talk about using python for data analysis. I gave up after trying to find a library to do cross tabs. Is there something to make custom tables in python other than prettytables?
I hear a lot of talk about using python for data analysis. I gave up after trying to find a library to do cross tabs. Is there something to make custom tables in python other than prettytables?
What's wrong with using Pandas? http://pandas.pydata.org/pandas-docs/version/0.17.0/generate...
My 2 cents: I would not recommend basing any new work on MRjob. As someone who inherited and has been maintaining a bunch of code that depends on it, the library seems to be barely maintained, support for VPC is only partial and not very well documented, the auditing tools stopped working quite a while ago and tracking the progress/status of EMR jobs is extremely painful (to be fair, this is more of an issue with Ela…
Do you know of any good alternatives? Any way to write MapReduces in python?
Earlier quoted context omitted.
Do you know of any good alternatives? Any way to write MapReduces in python?
https://hadoop.apache.org/docs/r1.2.1/streaming.html
Natsort is a lifesaver when working with filenames numbered by humans (like file1, file2 ... file11), those will be sorted correctly. Beats asking people to "Please add leading 0's oh and when you suspect you will pass 100, add 2 leading 0's."
FWIW, the sort method (and sorted keyword) take a 'key' keyword, where you can pass a function to use to calculate the key to sort the sequence with. So in your file11 case, you can do: sorted(files, key=lambda x: int(x[4:]) , and it will do the right thing. Although with natsort, you don't have to parse the actual strings yourself.
Earlier quoted context omitted.
What's wrong with using Pandas? http://pandas.pydata.org/pandas-docs/version/0.17.0/generate...
Perhaps I should have been more clear. I want to present the results in pdf or html. Like xtables, tables and stargazer packages in R.
Here is an interesting ipython notebook with some examples:
http://nbviewer.jupyter.org/gist/chris1610/f2f4a2e9181f6ec22...
My 2 cents: I would not recommend basing any new work on MRjob. As someone who inherited and has been maintaining a bunch of code that depends on it, the library seems to be barely maintained, support for VPC is only partial and not very well documented, the auditing tools stopped working quite a while ago and tracking the progress/status of EMR jobs is extremely painful (to be fair, this is more of an issue with Ela…
Do you know of any good alternatives? Any way to write MapReduces in python?
I've used PrettyTable on a few projects and found it to be very easy to use. Highly recommended!