Viewing profile — glomgril

one man's exfiltration is another man's distillation `¯\_(ツ)_/¯` you could say they're playing by a different set of rules, but distilling from the best available model is the curr…

Check out this recent benchmark MTOB (Machine Translation from One Book) -- relevant to your comment, though the book does have parallel passages so not exactly what you have in mi…

Very cool. Got a silly sci-fi question for you. IIUC, with current technology it would take on the order of tens of thousands of years for a vessel to physically travel to the clos…

looks like it's there now

Models like this are experimentally pretrained or tuned hundreds of times over many months to optimize the datamix, hyperparams, architecture, etc. When they say "ran parallel trai…

He is coming from the perspective of a long-running debate on symbolic versus statistical/data-driven approaches to modeling language structure and use. It seems in recent years he…

Savor it while you can. As a former academic, for me the lack of intrinsic motivation to "create value for shareholders" is the hardest part of working in industry.

As painful as it can be at times, it is a truly beautiful phase of life during which your main obligations are to become an expert in something that interests you and to make enoug…

This is just brilliant. Brings back memories, some fond others less so. Only addition I'd suggest is a subplot involving teaching/TAing duties and/or money problems. Good to be occ…

That's an insane story. As much as I hate flying, modern aviation infrastructure is one of mankind's most impressive feats.

For those interested, there is a podcast about this book and some cases it's been relevant in: https://podcasts.apple.com/us/podcast/hit-man/id1449636432

Yeah that is consistent with my experience for sure. Probably true for lots of others too. I'm pretty neurotic about dumb shit on a day-to-day basis, but the few times something ac…

That's kinda how the pandemic felt to a degree. A happier than average time in my personal life, despite (or perhaps due in part to?!) all the carnage and pandemonium throughout th…

Big shouts to visidata -- very underrated tool imo.

The consistency of descriptions is particularly surprising to me. Like you got a roughly circular collection of seemingly random scribbles, but they can tell you exactly which part…

I have a very similar plan involving a Raspberry Pi, I agree that it's a great middle ground. IMO screentime that only involves video calls with family is perfectly fine, especiall…

Is migrating domains from Gandi to somewhere else easy/possible? I've had the same domain for years, I used to pay like $20 for five years, but then I forgot to renew, and because …

Incredible post. I laughed when I saw the title, snickered at the first paragraph, and then proceeded to be blown away by the rest of it. Thought I was in for a joke and instead I'…

Training code won't get you much if you don't have the infra/money to gather a suitable dataset or actually execute training. Plus if your goal is to "steal" or riff on the base mo…

Hopefully so, would really like to know what else is lost by nerfing potentially offensive responses. Can't imagine a project I'd rather work on. I think open-assistant.io has a ch…

This is the best advice on the topic that I've seen.

Yeah I think iPhone is a very apt analogy: certainly not the first product of its kind, but definitely the first wildly successful one, and definitely the one people will point to …

I'm shocked that I've never heard this argument before. Very interesting and indeed, disturbing as well.

Yeah this is pretty much my line of thinking. Not making any grand claims, just questioning the conventional wisdom. No doubt that the material conditions, health, and conveniences…