Live data from Hacker News

Consider working on genomics

claymcleod.dev

171–180 of 299 posts

Re: Consider working on genomics

#172
post #113

heh, you think scientists automatically understand computing nature? You’ll be the janitor cleaning up their 20k LoC, one file Python with zero abstraction. If this is already a thing at a FAANG, it will be worse at a pure science shop.

You'll be lucky if it's python, most likely thousands of lines of R by someone who doesn't know how to write a function or declare dependencies.

Re: Consider working on genomics

#173
I work at at a SynBio company and heartily second this. If you're looking for interesting work where you can make an impact, it's an incredible field to be in.

I'm a nerd about everything - I love learning, and this field is incredible for it. The complexity and depth of biological systems dwarfs what we're doing in the software industry. I work with brilliant people doing absolutely fascinating work, and I get to learn more every day. At the same time, I get to build things that make a genuine contribution to the people I'm working with - I can see the value and impact of my skillset in a way that was a lot harder when I was working at a software company. The leverage that good software folks can provide to folks outside the industry is almost impossible to overstate - our ability to scale up what the practitioners in the field are doing can offer an almost category change in what they can attempt.

At the same time, there's still really, really knotty software problems to be had - computer science has benefited quite a lot from our ability to segment and structure our problems, but biology doesn't allow for that - everything that we're working with is operating at every scale, from molecular interactions up through genomics into protein design and folding and into metabolic modelling. Add to that that the data structures you're dealing with can vary from a few characters up to a couple megabytes (within the same represented "object"), distant elements within the same object can interact meaningfully, the objects themselves tend to be embedded in larger structures with which they meaningfully interact, and you've got some fiendishly complex problems.

And at the end of all that, you've got a field which offers a legitimate possibility of helping us move past petrochemicals; an enormous expansion in the kinds, potency, and specificity of healthcare; and a new and novel set of tools for shaping our world. It's an incredibly exciting place to be, and I've found people are genuinely thrilled to have good software folks along.

Re: Consider working on genomics

#174
post #98

Earlier quoted context omitted.

Can you elaborate with some anecdotes? Why is their current workflow wrong? Why would an organization hire someone to build software if they can achieve goals with spreadsheets?

The fact they renamed human genes because they were importing it in Excel in a way it thought they were dates and was changing them says a lot. Can you really trust the scientific results if they depend on software made by people who don't care about code quality?

>renamed human genes because they were importing it in Excel in a way it thought they were dates

Just at your shop, or the field in general?

Re: Consider working on genomics

#175
I'm a software engineer who works on genomics. I see a lot of negativity in this thread, which mirrors my experience: in most places, you'll be paid like a researcher with the respect of a lab assistant – unless you have a PhD and a postdoc.

That said, it's possible find work that's respected and pays well. Most of that kind of work is happening in the context of startups or freelancing. My favorite example of this is Robert Edgar: he's a freelance computational biologist with over 100k citations who has made a living for the past 20 years by selling licenses to his bioinformatics software (https://scholar.google.com/citations?user=RzVMRc0AAAAJ).

To find those kinds of jobs, I'd try YC's Work at a Startup, Flagship Pioneering's portfolio companies, and emailing founders of companies that have a bioinformatics component (my email is in my profile!).

I think the issues with the field are because it's a new and growing space. We do need better tooling, respect for engineering, and established best practices, but that seems to have been the case in the past for other domains that moved from research to industry – including software engineering itself.

Re: Consider working on genomics

#176
post #11

Science programming jobs suck. You get all the bad parts of academia, including less money, plus you're seen as a janitor rather than an engineer, and you get to deal with scientists all day. Tooling roles in SWE in every other field are highly regarded. Why not here?

Because it's not what sells. It's literally a tool, and if you don't deliver the level of perfection they're used to get from sequencing, NMR or assay testing machines, you're the PITA. You really have to bring something very interesting to the table to earn some status, and software engineering just doesn't. It's too far from the core business. Think of the attitude SWEs have towards sales people...

Re: Consider working on genomics

#177

20 years ago I got interested in "bioinformatics." I loved learning something about molecular biology, after all those years of hearing about DNA and not understanding it. And "Molecular Biology of the Cell" is, hands down, the greatest textbook ever written. That said: a lot of the comments are spot on. You're working in a field where the hard scientists and business people rule and you're a helper. Maybe they're gr…

[deleted]

Re: Consider working on genomics

#178
post #162

Earlier quoted context omitted.

Molecular Biology of the Cell got me extremely excited about genetics and bioinformatics, highly, highly recommend this book to any software person I meet who is interested in biology. As to the work environment, it seems to be extremely varied depending on the lab and team your on. I came from a number of years doing web development in marketing and finance before joining an R1 university research lab, and in many w…

Any particular edition of Molecular Biology of the Cell you’d recommend? I just looked up the 7th edition on Amazon (seems like the latest) and it’s $300 USD. Oof.

I'm on #3.

An awful lot has changed since 2000. RNA is now a Thing, where it was just a poor stepchild before. Protein folding, of course.

But yeah. The pictures are shining examples of what a scientific diagram can be.

Re: Consider working on genomics

#179

Can you provide a list of the top problems in that space? Much rather try to understand them deeply myself and build a company solving them than just getting a job.

This please. I would love to start working on (or create from scratch) some software that helps people in that field.

Creating pipelines is still a problem. Typically one needs to call a bunch of other tools in order to get to the final result. There could be map/reduce behavior in the middle where chunks of data are processed in parallel in order to gain speed. And you need some kind of data management/tracking as well (putting samples in groups, ingesting raw data, exporting results). And sane monitoring especially if something breaks/fails.

There are probably 100s of tools written for this but no clear winner so far. The traditional software engineering approaches like git, ci/cd seem too heavyweight (or rather too low-level) especially during development. IMHO there could be space for a fully remote/cloud solution where one would code/debug/deploy from the browser optimized for writing/maintaining pipelines.

Re: Consider working on genomics

#180
post #73

I recently switched from software engineering on ads and web performance at a FAANG to (meta)genomics at a nonprofit startup; happy to answer questions

Are there any open source tools/projects worth contributing to that don't need specialized infrastructure, proprietary data, or a PhD in the field to understand?

Almost certainly yes. For example, lots of things don't have tests and really should. But I'm not too sure about priorities, or about which projects would welcome that work.
Post reply on HN