Live data from Hacker News

Sabotaging projects by overthinking, scope creep, and structural diffing

kevinlynagh.com

51–60 of 159 posts

Re: Sabotaging projects by overthinking, scope creep, and structural diffing

#51
I found that setting deadlines solves most scope creep problems. Anecdotally, I am more likely to complete a project for a game jam or programming contest (which come with hard deadlines) than finishing an open-ended project.

See also "Why does the C++ standard ship every three years" (as opposed to ship when the desired features are ready):

https://news.ycombinator.com/item?id=20428703 (2019-07-13, 220 comments)

Re: Sabotaging projects by overthinking, scope creep, and structural diffing

#52

Earlier quoted context omitted.

> You have to take a topic you find interesting and read all possible related work in it This is definitely the wrong way of going about a research project, and I have rarely seen anyone approach research projects this way. You should read two or at most three papers and build upon them. You only do a deep review of the research literature later in the project, once you have some results and you have started writing…

The usual justification is that if you don't do at least a breadth-first literature review, you can get burned by missing a paper that already does substantially what you do in your work. I've heard of extreme case where it happens a week before someone goes to defend their dissertation!

Excuse my naivety, but isn't it good if the same results get proofed in slightly different ways? This is effectively a replication, but instead of just the appliance of the experiments, you also replicate the thought process by having a slightly different approach.

Re: Sabotaging projects by overthinking, scope creep, and structural diffing

#53

Earlier quoted context omitted.

Day 1: We aim to demonstrate the effectiveness of an existing industrial catalyst in a novel application that has not seen commercial usage, potentially lowering cost of production of precursors for essential medications Day 400: Having thoroughly described a universal theory of everything, we set out to build an experimental apparatus in orbit at a Lagrange point capable of detecting a universal particle which acts…

Damn, that's an incredible amount of progress in just 400 days

That is the power of AI.

Re: Sabotaging projects by overthinking, scope creep, and structural diffing

#54

Earlier quoted context omitted.

The usual justification is that if you don't do at least a breadth-first literature review, you can get burned by missing a paper that already does substantially what you do in your work. I've heard of extreme case where it happens a week before someone goes to defend their dissertation!

Excuse my naivety, but isn't it good if the same results get proofed in slightly different ways? This is effectively a replication, but instead of just the appliance of the experiments, you also replicate the thought process by having a slightly different approach.

For the humanity? Yes, it's generally good. For that particular researcher's career? Not really. Who wants to pay for research into something that's already known?

Re: Sabotaging projects by overthinking, scope creep, and structural diffing

#55

Earlier quoted context omitted.

The usual justification is that if you don't do at least a breadth-first literature review, you can get burned by missing a paper that already does substantially what you do in your work. I've heard of extreme case where it happens a week before someone goes to defend their dissertation!

Excuse my naivety, but isn't it good if the same results get proofed in slightly different ways? This is effectively a replication, but instead of just the appliance of the experiments, you also replicate the thought process by having a slightly different approach.

It would be good (especially with the replication crisis), but historically to earn a PhD, especially at a top-tier institution, the criteria is conducting original research that produces new knowledge or unique insights.

Replicating existing results doesn't meet that criteria so unknowingly repeating someone's work is an existential crisis for PhD students. It can mean that you worked for 4-6 years on something that the committee then can't/won't grant a doctorate for and effectively forcing you to start over.

Theoretically, your advisor is supposed to help prevent this as well by guiding you in good directions, but not all advisors are created equal.

Re: Sabotaging projects by overthinking, scope creep, and structural diffing

#56
post #54

Earlier quoted context omitted.

Excuse my naivety, but isn't it good if the same results get proofed in slightly different ways? This is effectively a replication, but instead of just the appliance of the experiments, you also replicate the thought process by having a slightly different approach.

For the humanity? Yes, it's generally good. For that particular researcher's career? Not really. Who wants to pay for research into something that's already known?

My imagination was leaning more into the educational side than the research side of university. I see how that wouldn't be appreciated by a patron, but when you get search grants, isn't the topic discussed before starting and paying for the research? Also that is kind of the point, why topics are cleared with the chair-holding professor, which is expected to be already experienced in the subject to know where the knowledge needs to be expanded.

Re: Sabotaging projects by overthinking, scope creep, and structural diffing

#57

Incidentally, this describes what I believe to be the great difficulty of PhD research. You have to take a topic you find interesting and read all possible related work in it, which tends to result in significant scope creep as you realize just how much there is that already does you want to do. Having exhausted your initial energy and excitement for the project, you have to force yourself the remaining 20-30% of he…

The majority of PhD candidates deal with this because the point of a PhD is to prove you can to “normal science” [1] which boils down to “how do I make this system go from 1% observable to 1.001% observable” which is just a gate for being in the academic career field.

You’ll almost never see a PhD thesis that has anything particularly interesting, novel or directly applicable to the sciences.

[1] https://en.wikipedia.org/wiki/Normal_science

Re: Sabotaging projects by overthinking, scope creep, and structural diffing

#59
As usual it's not so black and white and is all about balance.

Project where the sole user is you in your kitchen? Sure, hack it together.

Project where you actually want other people to use the product? A research phase matters and helps here.

Consider what the goal is and the amount of effort to invest typically becomes more evident.

Re: Sabotaging projects by overthinking, scope creep, and structural diffing

#60
post #47

I'm _exactly_ in this situation right now with a side project. It's in a field that I have little experience with (Information Retrieval). So there is obviously prior art that I could learn from or even integrate with. This article motivates me further to learn things by focusing on building my own and peek into prior art as I go, when I'm stuck or need ideas. Recently a Clojure documentary came out and the approach…

> Recently a Clojure documentary came out and the approach of Rich Hickey was seemingly the opposite: Deep research of prior art, papers, other languages over a long period of time.

That was also on my mind thanks to the documentary. Then I followed up with "Easy made Simple" and "Hammock Driven Development", and it makes me want to learn Clojure.

Clojure documentary on CultRepo channel: https://www.youtube.com/watch?v=Y24vK_QDLFg

Simple Made Easy: https://www.youtube.com/watch?v=SxdOUGdseq4

Hammock Driven Development: https://www.youtube.com/watch?v=f84n5oFoZBc

Post reply on HN