Live data from Hacker News

What You Need to Know Before Considering a PhD

fast.ai

81–90 of 195 posts

Re: What You Need to Know Before Considering a PhD

#81
post #69

I have a PhD in aerospace engineering. I loved grad school. Loved loved loved it. I wouldn't give up the worst day I had in grad school for almost anything. And I love having the skills it taught me. I am a much better engineer and researcher than I could possibly have been had I taken almost any other route. I was given freedom in grad school that just would not have been present in most industry jobs. I was given a…

As a current PhD student in CS -- seconded. I'm fortunate to have a great advisor, and my research career so far has been largely fun and productive as a result. I have also seen equally (or more) talented and hard-working students have worse experiences because of worse advisors. It's just hard to become a good researcher without good mentorship. As far as practical advice for finding good advisors, track records of…

recently minted Chemistry PhD here -- Thirded.

Grad school was one of my best decisions. I went to a great school that was what I call the Goldilocks size, big enough to have a great faculty, equipment, and decent funding but small enough so that collaboration was the norm and the crazy horror stories of maniacal hours and/or cutthroat competition were normally self induced. My PI was an incredibly good guy and still a close friend. I met my business partner and co-founder while working with him the lab and we're now building a company that expands on the work we did in grad school.

That being said, I saw plenty of people not having the experience I did. This was almost always because i) they didn't really like research and didn't know it until they were there or ii) they picked a PI (PI = professor/boss) that was a really bad match for their work style and personality. Finding a lab & PI that matches your personal expectations about the PhD I would say is more important than the research focus. Don't choose something you'll hate learning about but ultimately the PhD can be more about learning how to teach yourself than the skills you learn during research.

YMMV

Re: What You Need to Know Before Considering a PhD

#83
Part I.

I'll try to give an answer and a response more generally to the material in the OP.

Background. I got a BS in pure math with nearly a second major in physics and worked in computing and applied math for problems in US national security around DC. Jobs were very easy to get; at one time my annual salary was 6 times what a new high end Camaro cost; much of the work was challenging for both the computing and the applied math; I was learning a lot of both computing, e.g., algorithms in Knuth, and applied math on the job and also especially math in independent study on evenings and weekends. Soon I got a call from a college friend to join FedEx. I used my background in computing, with a little applied math, to write some software, in six weeks, to schedule the fleet. The results pleased the BoD, enabled crucial funding, and saved the company. Later the BoD wanted some revenue projections. I formulated and solved

y'(t) = k y(t) (b - y(t))

for time t, revenue y(t) at time t, rate of growth y'(t) = d/dt y(t) at time t, and full revenue potential b. The BoD was pleased, and ..., to make a long story short, I saved the company again.

Then I got a Ph.D. in applied math from the engineering school of a famous, high end research university.

Now I'm doing an Internet startup, a Web site, basically a new and very different search engine -- for the, IMHO, very large part of search handled at best poorly by the existing Web sites and well known techniques.

For the startup, my applied math background is crucial: The crucial, enabling core of the startup is some original applied math I derived based on some advanced pure math prerequisites I got both in grad school and in independent study. I already knew enough computing except had to learn how to bring up a Web site that has been easy for the user interface but due to the core math somewhat tricky on the server side. I learned Microsoft's Visual Basic .NET (for the programming language -- I like it), ADO.NET (for the Web pages), and ASP.NET for the (relatively meager) use of SQL Server. The main difficulty was working through 5000+ Web pages of documentation. The first code is the first production code, 100,000 lines of typing, 24,000 programming language statements, and lots of documentation. The code seems to run as intended, but I need to add some data.

Some lessons:

(1) Math. IMHO, the key to powerful, valuable, new applications of computing is applied math. That is, if we accept that the big opportunity is to exploit and apply current computing, then we might notice that whatever we code to put out data users will like, as information, entertainment, whatever, is necessarily mathematically something, understood or not, powerful and valuable or not. So, in some sense, from 100,000 feet up, it should help to proceed mathematically, with possibly advanced prerequisites, some new results focused on the application in mind, and complete with theorems and proofs. Just IMHO. But I don't know anyone with a yacht over 100' long that did that; I suspect that very few people agree with me. Maybe what I am saying is a hopeless wild goose chase or a great green field opportunity -- you judge.

(2) Getting a Ph.D. In a nutshell, the three most important parts of getting a Ph.D., in no particular order, are research, research, and research. Yes, there can be courses, credits, grades, teaching assistant positions, weekly research seminars, qualifying exams, etc., but at a research university what can "cut through", dominate, and trump all or nearly all of that is research. The research should be publishable in a good peer-reviewed journal of original research; if there is any question, then send it in.

The criterion for a Ph.D. dissertation may be something like "An original contribution to knowledge worthy of publication." -- so, in case of some doubt, publish the thing.

The usual criteria for publication are that the work be (i) new, (ii) correct, and (iii) significant.

Now for a non-standard observation and recommendation: Go for applied math in an engineering school. Start with a real problem, hopefully a significant real problem, likely from outside academics, hopefully identified before or early in the Ph.D. program. Do some new math to get the first good or a much better solution to the real problem. So, the math is "new" -- got (i)! Since the work is math, with theorems and proofs, it's easy enough to check for "correct" -- got (ii)! Since have the first good or much better solution for the real problem which is hopefully significant, get "significant" -- got (iii). Note: The math may not, just as stand alone pure math, be seen as significant -- so, likely have not proved the Riemann hypothesis, shown that P = NP, etc. But compared with a lot of pure math, are already ahead by one point -- have one real world application!

In my case, I started with a problem I had identified in industry before grad school. I found an intuitive and rough solution on an airplane ride. In my first year in grad school, one course I took let me make solid math out of my intuitive solution; I did that independently in my first summer, walked out of the library with an 80 page manuscript that had all the actual research for my dissertation.

Then I encountered some of the nasty nonsense as in the OP: There was a prof who didn't like me. He thought of rows, columns, and layers, lines, stay within the lines, rules, etc. and resented that I'd basically written my dissertation independently within 12 months of arriving on campus and before taking the qualifying exams.

Well, a course had a question but no answer. I did a good enough literature search and saw that likely there was no answer known -- since it was a very narrow question, it was easy to do the literature search. I got a reading course approved to address the question and write a paper, maybe just expository and maybe without a solution. Just before getting the reading course approved, in a few evenings I found a rough solution. So, got the course approved -- shook hands with the prof. Then I cleaned up my first solution, mostly sitting beside my wife on our bed while she watched TV and I worked on the problem, and found a much better solution and a general result that was surprising, even shocking, and settled some related questions. That took two weeks into the reading course. I submitted my manuscript of about 20 pages, and I was done with the reading course. Fast course. The course also had three credits and gave me the last credits I needed for an MS. News of my work spread through the department; my favorite prof walked up to me in the hall, "I heard about your result. It also says that ....". Yup, clearly it did.

The result was clearly publishable; later I did publish it -- no problem, accepted right away.

The biggie, practical result was that suddenly I had a halo and a coat of Kevlar armor against any criticism; any of the faculty would have loved to have done what I did. To defend against the abuse as in the OP, I recommend -- do some publishable RESEARCH.

(3) Handling Ph.D. Qualifying Exams. At least at one time, the Web page of the math department at Princeton stated, IIRC (if I remember correctly):

"Students are expected to prepare for the qualifying exams on their own. Graduate courses are introductions to research by experts in their fields. No courses are given for preparation for the qualifying exams."

In part, the qualifying exams are like a foot race, but in this race you can get a head start and be 1 foot from the finish line when the starting gun goes off.

I consider that Princeton policy to be somewhat wise. So, prepare for the qualifying exams on your own (to be able to do this in math, a good ugrad pure math major should be sufficient to let you know how to study and learn, make good progress, and not get stuck or lost). To do this preparation, get the best, focused information you can on what will be asked. So, get recommended texts, copies of old exams, maybe chat with some profs and some students who have taken, hopefully passed, the exams, syllabi of any relevant courses, etc., maybe all before applying to the Ph.D. program. Then study. Use some judgment on how deep to cut and how many proofs to memorize -- cut deep enough but not so deep you take too long or just quit.

Then show up as a first year Ph.D. student, do well in some courses, do well on the qualifying exams, complete your research, listen to Pomp and Circumstance, get your degree, and LEAVE.

(4) Academic Career. If you want an academic career, then maybe don't leave the grad program so soon. Instead, publish some papers, get some streams of promising research going, meet people at research seminars and conferences, get known by the Editors in Chief of the journals or conferences where you publish, if invited to give a talk at a conference, do so, do the usual meet and greet and publicity, build your own professional network, etc., hopefully some of your profs will help you get some job interviews, etc. Learn how the academic games are played -- there are some really important academic games, and you very much should learn how they are played. Then you will be in an academic career.

One possible prof slot is in a B-school. Consider that. Someone with a good applied math background has a heck of an advantage in a B-school. Papers that make progress on practical problems are commonly considered good research in B-schools. People who want to hire consultants tend to regard B-school profs as more practical , i.e., motivated by money, than more pure profs.

Re: What You Need to Know Before Considering a PhD

#84
post #83

Part I. I'll try to give an answer and a response more generally to the material in the OP. Background. I got a BS in pure math with nearly a second major in physics and worked in computing and applied math for problems in US national security around DC. Jobs were very easy to get; at one time my annual salary was 6 times what a new high end Camaro cost; much of the work was challenging for both the computing and the…

Part II.

My wife was fatally injured in her Ph.D. program. The OP outlines a lot of just what happened to her. To have time to try to help her, for a while I took a slot as a B-school prof. It didn't work -- lost her anyway.

I never for even a milli, micro, nano, pico, femto second wanted to be a prof. Instead, I wanted to be solving problems in business, the money making kind.

(5) Non-Academic Career. Then I tried to get my career going again, outside academics. Bluntly, that didn't work very well.

I made a mistake: I should have returned to DC and gotten back into applied math and computing for US national security. I guessed that there would be opportunities as an employee in business; I was wrong.

Bluntly, my view is that US business and Ph.D. holders mix less well than oil and water.

Part of why:

(A) Business is still a lot like Ford in Henry's day: The manager knows more, and the subordinate is there to add muscle to the work of the manager. A manager has no use for a subordinate who knows much and resents or feels threatened by such a person.

Supposedly lawyers have a solution: A working level lawyer should work only for a lawyer. Period.

Well, a working level Ph.D. should work only for another Ph.D., and that criterion would eliminate nearly all jobs for a Ph.D. in business.

Not even a CEO wants a Ph.D. around except maybe tucked away in some side organization, out of the main work of the business. E.g., the CEO is plenty sure that he is the only really important person in the company and, thus, certainly doesn't need a Ph.D. or some academic background he (the CEO) doesn't have!

(B) Business regards Ph.D. holders as blue sky dreamers out in the ozone who refuse to contribute to the business, who really want to publish a lot of papers and get a prof slot in academics.

(C) If a Ph.D. person does anything original relevant to anything in business, usually the business will regard this person as a threat.

(D) Suppose a Ph.D. takes on a practical business problem:

(i) If the Ph.D. successfully uses their advanced knowledge to get a good solution, e.g., one that makes a lot of money for the business, then everyone else in the business, even the CEO and the BoD, will feel threatened and/or jealous.

(ii) If the Ph.D. fails to get a good solution, then everyone else will take the opportunity to denigrate both the person and the Ph.D. degree -- "I always thought that a Ph.D. was just a useless, hopeless, worthless impractical dreamer out in the ozone, and now we know for sure.".

(6) A Ph.D. in a business research division. Yes, some businesses, say, ones with some loose cash, might set up a research division, hire a Ph.D. as the director, and hope for something good. If nothing good happens, well, the company could afford the wasted money.

Generally, connections about the actual business between the research division and the rest of the company are more awkward than a skunk at a Victorian garden party. The rest of the company doesn't want to be bothered, sees various threats, etc.

Here are some of the reasons for such a research division:

(A) Luster. Use the research division to impress the public, for good PR, to impress customers, to cover the rear exhaust port of both the CEO and the BoD, etc.

(B) As a patent shop. So, the research division can develop a patent portfolio, maybe dozens, hundreds, thousands of patents. Then some specialized lawyers can use that patent portfolio as a, call it, battering ram against any would be competitors. There can be cross licensing deals, revenue, etc.

(7) Career direction. It's your career. In this career, there will necessarily be some directions you will be pursuing. Some directions are good; most are not. It's up to you, and maybe your family, closest, trusted friends, etc. to pick, at least try to pick, a good direction(s).

If you just look for a job, get some offers, and take the best offer, then likely you will be following the direction of your employer, especially your immediate supervisor. That direction was not picked by you; likely it is not a very good direction for you or anyone; likely in that job you will have quite limited opportunities to change the direction to be something good for you.

Bluntly, you will want income enough to provide for food, clothing, shelter, transportation, medical care, insurance against risk, recreation, a house you own, a family, education and other needs for your kids, and retirement, with some security, i.e., low risk, and at least a comfortable life style. That obvious goal is surprisingly difficult to achieve, especially if you are working just for a salary for a manager in a company, small, medium, or large.

(8) Blunt US Fact of Life. IMHO, nearly all the people in the US doing well supporting a family get their money from owning part or all of a business that makes the money needed to pay the bills for that family.

For this, can use some strategy: E.g., run the most popular Italian restaurant in a radius of 50 miles. Then you have:

(A) A strong geographical barrier to entry, that is, a restaurant more than 50 miles away will be little or no competition for you. You have a better "Buffett moat" than any of IBM, Cisco, Intel, etc.

(B) Your business is unlikely to be killed off by changes in technology.

(C) We can be sure lots of people will still want a good Italian restaurant 10, 50, 100 years from now. You have a business more stable than any of IBM, Cisco, Microsoft, Facebook, Google, Intel, etc. Good economy or poor, people will still want to go for a dinner at an Italian restaurant -- you are relatively immune from changes in the economy. You have a very wide variety of customers, i.e., are not vulnerable to some one or few customers going broke, leaving town, etc.

(D) Your family, spouse, children, can help in the restaurant and learn the business and continue running it as you grow old.

(E) Working as an employee, you can be fired by a manager who, for whatever reason, doesn't like you. If you are the owner, then you can't be fired.

(F) No one can please all the people all the time, and some managers can never be pleased. But in a good Italian restaurant, one unhappy customer occasionally can usually be mollified by an apology, a free glass of wine, just tearing up the check, etc. You DO have to do good work and please nearly everyone nearly all the time, but you can't be run out of business by just one unhappy customer.

All or nearly all of (A)-(F) apply with no more than small modifications to a huge range of Main Street US family businesses. In your career, you should aim to do at least that well.

(9) Ph.D. Entrepreneur. Okay, you have a STEM field Ph.D. and want to own your own business. If you work hard and smart, find that your Ph.D. is a great technological advantage (e.g., you can stir up powerful, valuable, new secret sauce), have some good luck, avoid too much bad luck, get well informed, consider strategy, ..., etc. then you might do really well. Your Ph.D. could be a terrific advantage.

(10) Warning. Generally, if want to use your Ph.D. to help you be an entrepreneur in something relatively new, i.e., not an Italian restaurant, then likely you need to be darned careful and insightful.

In this sense, I will say:

(A) I believe strongly in the potential of some original applied math based on some powerful pure math prerequisites.

(B) I regard current work in artificial intelligence (AI) and machine learning (ML) as not very promising. Some people may yet have good careers there, or quickly get rich from some stock, invest the money in an index fund, and essentially retire, but generally my view is that the math is not powerful enough to be very promising and 90+% of what is being done in those fields now is based on wild, blue sky dreams with little real hope and a lot of hype, PR, maybe patent games, etc.

Why: So far too much of the AI/ML work is too close to empirical curve fitting.

(i) For small amounts of data, we've been able to do, and often have done, such curve fitting going back decades to the first transistor computers. At one point in my career, inside GE I did a lot of consulting for that work. So there was, and still are, SPSS, SAS, Matlab, R, etc. I never saw such people in yacht clubs.

(ii) What appears to be new is curve fitting for large amounts of data. Well, we don't expect to have a lot of such data collections and promising corresponding problems.

For more, I'd guess that self-driving cars are not very promising: For now, for current traffic on current roads, driving occasionally, and too often, needs real human intelligence. E.g., chimpanzee intelligence is not enough, and AI/ML are a long way short of chimpanzee intelligence. There is a chance for self-driving cars on roads that have a lot of new engineering, but that will be very expensive, IMHO, for a long time, too expensive. Self driving might work on some large farms, in a big open pit copper mine, some military tasks, and some other situations much less challenging than Manhattan traffic, I-95, etc.

The general lesson: One of the keys to success is good initial problem selection. Most of the problems people have selected are not good. So, we have to try quite hard to select a good problem.

Your mileage will likely vary widely.

Re: What You Need to Know Before Considering a PhD

#85

This gets it right, I think. And I say that as someone who does not regret taking five years to get a PhD. A PhD is too long, narrow, and frustrating to do just to get a slightly fatter paycheck. For some reason, that deep dive clicked with me, and I’m grateful for all the personal growth that came from that. But for the vast majority of people, I think it could easily end as an exercise in frustration.

Five years is a super long PhD. If you can get it done in two or three years it makes more sense.

That’s only true in Europe, the U.K. and non Canada Commonwealth. North America is different.

Re: What You Need to Know Before Considering a PhD

#86
post #12

Earlier quoted context omitted.

Five years is a super long PhD. If you can get it done in two or three years it makes more sense.

In computer science in the US, this is just false. Four years is the usual "officially expected" length of a PhD straight out of a bachelors' (which is the most common way to do a PhD in CS in the US). In practice it usually takes longer, sometimes much longer (seven+ years is not unheard of). In the UK and Europe, shorter PhDs are much more common, in part because you're expected to do a master's before a PhD. Even…

> In the UK and Europe, shorter PhDs are much more common, in part because you're expected to do a master's before a PhD.

That’s true of Europe but it’s quite common to go straight from a Bschelor’s to a doctorate in the U.K. and many other former British Empire countries.

Re: What You Need to Know Before Considering a PhD

#87
I'm in a similar boat thinking about getting a PhD in AI/ML. I have a masters degree and in 2 years of my current job (research based) have already published 2 conference papers one of which I'm a lead author. My work colleagues who aren't research oriented suggested me to get a PhD instead because of the effort I put in reading papers and spending hours on solving a problem. It makes sense to me at times because not many people in my company have a hardcore ML background and when I'm stuck reading a paper or solving a ML problem, it's difficult to find someone to discuss it with. I end up spending most time in figuring it out or eventually giving it up. This when I miss academia the most. I'm on H1B visa and have money constraints so giving up a 6 figure salary and living on stipend is something freaks me out.

I'd really appreciate if anyone reading this comment have something to suggest. Thanks a lot HN community, you've been a great support.

Re: What You Need to Know Before Considering a PhD

#88
It is even worse in Europe where you are often required to have Master's degree before you can even start a PhD.

People in my country usually start PhD. at 25 and take at least 6 years to finish, because the universities use them as cheap workforce and aren't incentivised to allow students graduate quickly.

Re: What You Need to Know Before Considering a PhD

#89

A PhD is a license to do deep research. Deep research careers are very rare, but for the right kind of person, they're great. However, deep research by definition means it probably won't work, and there's just a lot more money in doing things that will probably work vs things that probably won't. So it helps to be extremely talented at deep research if you want to pursue the PhD. Also, most engineering PhD's are bogu…

> Also, most engineering PhD's are bogus because most engineering "research" is actually not deep research.

Hello! Engineering researcher here. I toy with things that are both wildly theoretical (information bounds for algorithms, inference in stochastic dynamical systems, etc.) to things that are fantastically and directly useful (design of photonic structures for LIDAR, (much) better AR/VR lenses, etc.).

While you're possibly right that I might be "building prototypes that aren't quite useful but not quite that novel," I disagree that they're "[not] interesting." In fact, I'd be absolutely surprised if in a few years, much of the applied "engineering" work our lab does (in contrast to the theoretical work) is not in constant use for on-chip photonics and fabrication of optical structures.

Re: What You Need to Know Before Considering a PhD

#90

I'm in a similar boat thinking about getting a PhD in AI/ML. I have a masters degree and in 2 years of my current job (research based) have already published 2 conference papers one of which I'm a lead author. My work colleagues who aren't research oriented suggested me to get a PhD instead because of the effort I put in reading papers and spending hours on solving a problem. It makes sense to me at times because not…

Is it possible for you to align PhD. and your current job?

I am in a similar position as you. My PhD. topic is focused on the same research area as my job in tech company so I can do both together.

If it is not possible I would advise not pursuing PhD. and continue self-learning. The opportunity cost of PhD. is not worth it in my opinion.

Post reply on HN