An Introduction to Scientific Python – Pandas
datadependence.com
An Introduction to Scientific Python – Pandas
1–10 of 43 posts
Re: An Introduction to Scientific Python – Pandas
#2Pandas is certainly excellent -- be aware of it's NA type promotion behavior before you start designing data analysis programs, however. I learned this the hard way:
http://pandas.pydata.org/pandas-docs/stable/gotchas.html#nan...
Re: An Introduction to Scientific Python – Pandas
#3Pandas is certainly excellent -- be aware of it's NA type promotion behavior before you start designing data analysis programs, however. I learned this the hard way: http://pandas.pydata.org/pandas-docs/stable/gotchas.html#nan...
That's a good point, I've ran into problems with that before too. Thanks.
Re: An Introduction to Scientific Python – Pandas
#4This is typical of what passes for 'exploratory data analysis' these days:
> You can also see that UK’s rainfall is significantly less than Japan’s, and people say UK rains a lot!
Well duh, Japan is about 50% larger than the UK.
Re: An Introduction to Scientific Python – Pandas
#5This is typical of what passes for 'exploratory data analysis' these days: > You can also see that UK’s rainfall is significantly less than Japan’s, and people say UK rains a lot! Well duh, Japan is about 50% larger than the UK.
Yeah it's 1.5 times larger. It was a joke though because Japanese people always say it never stops raining in the UK, it's like the first thing they always say.
Re: An Introduction to Scientific Python – Pandas
#6This is typical of what passes for 'exploratory data analysis' these days: > You can also see that UK’s rainfall is significantly less than Japan’s, and people say UK rains a lot! Well duh, Japan is about 50% larger than the UK.
The rainfall is given in 'mm', right - this means area has been controlled for?
I.e. its the amount of rain, in milimeters, that would fall in a given area. This is how rainfall is normally measured.
Unless you are trying to say something more subtle, or making a joke?
Re: An Introduction to Scientific Python – Pandas
#7This is typical of what passes for 'exploratory data analysis' these days: > You can also see that UK’s rainfall is significantly less than Japan’s, and people say UK rains a lot! Well duh, Japan is about 50% larger than the UK.
Yeah it's 1.5 times larger. It was a joke though because Japanese people always say it never stops raining in the UK, it's like the first thing they always say.
That's what everyone seems to say about the UK.
Re: An Introduction to Scientific Python – Pandas
#8Earlier quoted context omitted.
Yeah it's 1.5 times larger. It was a joke though because Japanese people always say it never stops raining in the UK, it's like the first thing they always say.
That's what everyone seems to say about the UK.
That's true haha. It rains a fair amount but it's definitely over exaggerated.
Re: An Introduction to Scientific Python – Pandas
#9pandas is very good for scientific computing and data analysis, but beware, the documentation quite frankly sucks. Stack overflow seems to be the best way to learn things
Re: An Introduction to Scientific Python – Pandas
#10I usually do this kind of processing by linux pipes, head, tail, cut, sort, uniq, and inline Perl. It is kind of similar to using monads, but you have to handle the formatting to and from text. A few ones of my own creation are a tool for counting and a tool for generating histograms in text. I often chain 5 or 10 of these commands together. My basic data type is similar to CSV, but using "|" instead of comma as separator because it tends not to appear in text as much. On the other hand, not being put in a binary format, my data is very accessible.