What about the other way around? I'm from an engineering background, going in the direction of data scientist. Sometimes I find that my math skills could be stronger, and I try to read up on things when I encounter them, but still it sometimes feels like there is an infinite amount to learn. Maybe I could use some more systematic approach to it. Anyone else who has walked this path, and could come with some useful ad…
Are you talking about self-studying mathematics or going back into higher education? I can give recommendations on books for the former but not the latter.
Mathematicians becoming data scientists
41–50 of 122 posts
Re: Mathematicians becoming data scientists
#42Earlier quoted context omitted.
This is the wrong comparison. Read the second footnote. An intern is a developer in training. The post is talking about mathematicians (who spent a decade or more learning a highly technical field) going to work in an environment where, largely, their peers, boss and consumers of their work do not know, have no interest in and and will never learn the most basic concepts of their field.
I suspect the majority of programmers work in that kind of environments...? The startups and Googles of this world are the exception when it comes to employer tech-savviness.
Second, programmers at companies almost never work in isolation from other programmers, and in most open office environments are close enough they could touch another one from their desk. On the other hand, a startup with five to ten engineers may be hiring you as their first data scientist, and bigger companies may be putting you on an embedded team, with the nearest data scientist a hallway or floor away. And this isn't a big deal in terms of teamwork, but most data scientists don't have a PhD in mathematics, so if you find higher level mathematical ideas and notation to be the most efficient way for you to think about a problem, your colleagues may not. That's also not a math specific thing though -- an economist, statistician, mathematician, computer scientist, physicist, etc. are all going to have slightly different ways they think about things internally.
Re: Mathematicians becoming data scientists
#43I've been encouraging my daughter, a statistics major, to pursue data science by including Python/R in her studies and then possibly heading back for an MBA. But not sure if an MBA would be a benefit. Thoughts from actual data scientists?
I would not be able to do my job at all if I didn't know Python, R, and JavaScript well (and know my way around various Linux flavors). The modeling is fun, but it comes at the end of a long pipeline requiring a lot of skills that are more engineering oriented.
Rarely do my tasks sound like "model this weekly and give me the result."
Often, they sound like, "I need you to pull together data from these 5 sources, model it, and produce a weekly report showing these derived KPIs. And I need to be able to access it in a web browser so that I can send links to colleagues. And it needs to be secure. And generating a report across an arbitrary date range needs to take less than a minute."
By the way, that is a request that I've gotten at three different jobs. To give you a sense of what this looks like: most recently, I wrote Python scripts to harvest and ETL the data into a Postgres database (running on Google Cloud) and a BigQuery table, then wrote a Flask app to accept the arbitrary report requests and query the database, run models, store computed results in a local SQLite database for fast future retrieval... finally producing dynamic Reveal.js slide decks available through the Flask app.
That's a long-winded way of saying that I strongly suggest that your daughter get some practical experience with the data engineering side of data science, preferably using Python for fetching, manipulating, storing, cleaning, and preparing data. It's the most flexible tool for the job and it easily the most important tool in my data science toolkit.
Re: Mathematicians becoming data scientists
#44>. A big thing about the transition to tech is that you possibly start communicating with people who don’t really know what a vector space is. Be ready to have those conversations. Honestly ask yourself if you’re OK with having those conversations. This is so snobbish. What here is even think about ?
When you interface with non-specialists, you can't rely on the shared specialized vocabulary. This means you have to do a lot of work to distill which insights are key and figure out how to communicate them (along with supporting ideas) to an audience whose highest insight resolution is going to be varying and who may each bring their own language to the table.
So on top of building your problem domain model, you're going to have to build a model of how the people you're working with can understand it. And you will have to do this over and over.
You can be snobby about that, and say that it's soooo hard being so much smarter in your specialized field than non-specialists are, but you don't have to be snobby to realize that this is a dimension of the work that you might not enjoy or may even not be cut out for.
And of course, you don't have to be a mathematician to have experienced this. It's certainly sufficient, but not necessary. If you've been a developer in a company that has non-dev coworkers and you've never hit this turbulent boundary, you've either been remarkably well insulated, or you're so remarkably natural at that kind of job that you definitely should be doing it. :)
Re: Mathematicians becoming data scientists
#45What about the other way around? I'm from an engineering background, going in the direction of data scientist. Sometimes I find that my math skills could be stronger, and I try to read up on things when I encounter them, but still it sometimes feels like there is an infinite amount to learn. Maybe I could use some more systematic approach to it. Anyone else who has walked this path, and could come with some useful ad…
Are you talking about self-studying mathematics or going back into higher education? I can give recommendations on books for the former but not the latter.
Re: Mathematicians becoming data scientists
#46I've been encouraging my daughter, a statistics major, to pursue data science by including Python/R in her studies and then possibly heading back for an MBA. But not sure if an MBA would be a benefit. Thoughts from actual data scientists?
I'm a data scientist with a stats background. I'm also a self-taught programmer (going on 15 yrs of programming in various languages). There are very few data science jobs that I am aware of where somebody will hand you a tidy data set and ask you to start creating models. For those jobs, it's great to go straight from stats/math to data science, as long as you learn a bit of R and some SAS along the way. Most data s…
Register as a Twitter dev (free) and get the tokens, etc. needed to access the public API. Pick a topic of interest -- hockey, for example, or whatever floats your boat -- and write scripts to harvest all tweets coming off of the public API related to the topic. Design a relational schema for the tweets and push them into a SQLite database. I suggest SQLite because it's ubiquitous and has a low barrier to entry. Something like MongoDB also works well for dumping everything straight off of the API. You can then have another script pull out of MongoDB and push into SQLite, for example. Once you're collecting tweets, storing them, etc... try some unsupervised clustering; k-means, for example, or a decision tree. If you feel up to it, go through 1000 or so of the tweets manually and label them according to some target variable of interest to the project. Then, use that labeled data set to run supervised models. Maybe start with a binary target variable and run a simple logistic regression. Then, visualize the data. There are a lot of ways to go about this, but I suggest trying to use something JavaScript based, such as D3 or p5.js, since it allows you to create interactive web-based visuals. Create a public GitHub repo and push work to it as you progress through the project. When done, use GitHub pages to put a summary of the project online.
Twitter data is great because there are tons of variables. It's horrifying because it's like reading the refuse of language, littered with abbreviations, emoji, and other weird characters. However, it's the terrible part of it that makes it great for learning.
There are other similar public APIs that would accommodate similar projects. Having a few self-initiated projects similar to this under your belt will really help you when it comes time to apply to graduate school or to jobs. If nothing else, it will give you something to talk about in interviews.
Re: Mathematicians becoming data scientists
#47What about the other way around? I'm from an engineering background, going in the direction of data scientist. Sometimes I find that my math skills could be stronger, and I try to read up on things when I encounter them, but still it sometimes feels like there is an infinite amount to learn. Maybe I could use some more systematic approach to it. Anyone else who has walked this path, and could come with some useful ad…
Just take statistic, especially Multivariate for big data (big data for statisticians is huge predictors not petabyte of observations).
Math people can do so much in data science. I think statistic is better for a non math person and it's much better suited for data. Since statistic is all about data.
Re: Mathematicians becoming data scientists
#48I've been encouraging my daughter, a statistics major, to pursue data science by including Python/R in her studies and then possibly heading back for an MBA. But not sure if an MBA would be a benefit. Thoughts from actual data scientists?
I'd recommend she become familiar with Python/R, go work in the data-science/tech industry for a few years, and then head back for an MBA, which might even be sponsored by her company. IMO, an MBA proves most powerful when backed by real-world experience.
The reason for the MBA was so she had a sense of the business value of the analyses she was performing, and, was more 'promotable' to executive positions.
Re: Mathematicians becoming data scientists
#49Re: Mathematicians becoming data scientists
#50I've been encouraging my daughter, a statistics major, to pursue data science by including Python/R in her studies and then possibly heading back for an MBA. But not sure if an MBA would be a benefit. Thoughts from actual data scientists?
I'm a data scientist with a stats background. I'm also a self-taught programmer (going on 15 yrs of programming in various languages). There are very few data science jobs that I am aware of where somebody will hand you a tidy data set and ask you to start creating models. For those jobs, it's great to go straight from stats/math to data science, as long as you learn a bit of R and some SAS along the way. Most data s…
As mentioned separately, I suggested a data science boot camp after getting the Stats BS, work a couple of years as a data scientist, then go back for the MBA. My thinking RE the MBA was to give a sense of the business value of the analyses she's performing, and, to make it easier to promote her to executive positions.
Maybe that's old school thinking, I know that the MBA in general gets a mixed reception these days, but we can look more closely at it after she's out of school.