Viewing profile — jwuphysics

Have a PhD in physics/astronomy, so—full disclosure—I'm not an expert here... I skimmed the paper and I have no idea what he's talking about. Given that half of his eight reference…

Could you say a bit more about how so?

Incredible, well-documented work -- this is an amazing effort! Two things that caught my eye were (i) your loss curves and (ii) the assessment of dead latents. Our team also studie…

You can get a nice sample of papers using VVV data using the Astrophysics Database System [0]. I mostly study other galaxies, which usually aren't variable on human lifespan-like t…

> Why not just say "incoherent output"? Because the biggest problem with hallucinations is that the output is usually coherent but factually incorrect. I agree that "hallucination"…

Have you looked into TinyCorp [0]/tinygrad [1], one of the latest endeavors by George Hotz? I've been pretty impressed by the performance. [2] [0] https://tinygrad.org/ [1] https:/…

PBMs hold an incredible amount of power. The Acquired podcast did a marvelous breakdown of the American pharmaceutical industry while covering Novo Nordisk ( https://www.acquired.f…

That makes sense and I'll run a few evals. Many thanks for open sourcing your work!

How much do you expect auto-context and clustering+re-ranking to help for cases in which documents already have high-quality summaries? For context, I parse astrophysics research p…

I am an astronomer and was at a conference when this headline broke. Obviously we ignored this and read the actual papers, e.g. https://arxiv.org/abs/2404.03002 . There you can see…

Oof, yeah that's not a very good response. But I guess color is actually a technical term in research astronomy: it refers to the difference in two specified magnitudes (usually ph…

UniverseTBD ( https://universetbd.org ) is also making great strides in the space of large language models and astronomy.

Thanks for your spectacular resources! I see that you began an Annotated Mamba repository -- any chance you could share when that blog page might go live?

I would be surprised if this is the case. Neural scaling laws are well known and are used by all big industry players to extrapolate experiments.

Hi Jeremy & Eric, great to see your newest endeavor. I hope that Answer.AI builds on the success and impact that fast.ai has already enjoyed. Given new developments in hardware (by…

Duplicate: https://news.ycombinator.com/item?id=38614232

You can read the [50 Years of Text Games]( https://if50.substack.com/archive ) newsletter that preceded the book. I highly recommend it!

There is indeed lots of uncertainty, and all Milky Way mass estimates are model dependent. Also, the ~10^12 solar mass figure referred to above is an estimate of the total galaxy +…

> The idea that AI might transform scientific practice is therefore feasible. But the main barrier is sociological: it can happen only if human scientists are willing and able to u…

> why did you loose an interest? Two reasons: 1. The posts I'd find most interesting in the site are ones related to astronomy and applied machine learning. If there wasn't anythin…

Although not the point of my comment (I don't want to sign in at all ) -- I personally like a username/password the best.

As others have said, forcing a login is a huge barrier. I wanted to see if any astronomy posts were on the front page, and when I didn't see any, I tried to check out the categorie…

Fascinating! I dug into the Wikipedia article, which cites a Scholarpedia article; the LLM answer seems to originate from a reference to this sentence [1]: > So, MOND reduces the d…

In terms of the actual article -- really nice finding. Or I guess, nice set of experiments to decipher what lots of LLM researchers have been finding! I've noticed somewhat similar…