Viewing profile — vibe42

Meta released their own 4-bit quant of this model for devices with 24GB VRAM. That's a modern gaming laptop; cheapest I see in the US with 24GB is $3.5k. Should be quite a bit fast…

I'm using the pi-mono coding agent (open source, free) without any extensions and very simple prompts. The 3.6 27B model (BF16, 250k context) uses 67GB VRAM on an RTX PRO 9000. It'…

[dead]

It can indeed cause some models to try too hard to come up stuff, but the next verification prompt does counteract it. E.g. some findings first classified as moderate priority ofte…

Something I've had good progress with using local models and simple open-source harnesses is to repeat, in a new context, simple verification prompts. I'd run the following 5-10 ti…

Many crypto wallets use a key derivation function (KDF) to add an amount of computation (and memory usage) per password tried - to mitigate brute force of weak passwords. The incre…

I run both MoE and dense models on laptops. One set of models run on 8GB VRAM / 16GB RAM and another set runs on 24GB VRAM / 64GB RAM. Both are very useful for easy and easy-to-mod…

https://old.reddit.com/r/LocalLLaMA/ Bit of a hype madhouse whenever a new model is released, but it's pretty easy to filter out simple hype from people showing reproducible experi…

Outside Trading.

This. And when possible, first asking the AI to add more granular logging around the code where the problem is - then re-run the code and feed the new log in a new context. I've us…

Keep it simple and run a fresh, new context for each prompt. I use the pi-mono coding agent with several different new open models running locally. The simpler and more precise the…

With the pi-mono coding agent (running local, open models) this works very well: "Do not modify any code; only describe potential changes." I often add it to the end when prompting…

Q4-Q5 quants of this model runs well on gaming laptops with 24GB VRAM and 64GB RAM. Can get one of those for around $3,500. Interesting pros/cons vs the new Macbook Pros depending …

Both are possible; increasing demand and bubble collapse. The way this could happen is if model commoditization increases - e.g. some AI labs keep publishing large open models that…

That's a very good point! And an opportunity for game worlds; extrapolate those blind spots by assuming small planets and planets further out from their stars are more common than …

Thanks for the link! Looks like pretty useful tools. I'm playing with a space game idea of physics simulation somewhere between the fidelity of KSP and Eve Online. More robust ship…

Their latest open models are pretty competitive with other open models, and some innovation around the smaller sizes (2-4 GB). They're helping close to the distance to realistic qu…

The pics of the cooling system is pretty good sci-fi / cyberpunk / steampunk inspo. If the whole AI bubble spectularly collapes, at least we got a lot of cool pics of custom hardwa…

Training their own, closed, internal models on their own data sets? Probably a good way to squeeze out some market trading signals.

Something related and fun is parsing a simple CSV file of exoplanets. https://exoplanetarchive.ipac.caltech.edu/cgi-bin/TblView/np... Download Table -> All Columns, All Rows. Tried…

A parcel of land. A few robot legs and arms, big battery, off-the-shelf GPU. Solar panels. Prompt: "Take care of all this land within its limits and grow some veggies."

If Starship puts some kind of fully-fueled, modular stage in LEO, and Orion docks with it, how fast could Orion then fly to and from Mars?

Space Weather still looks calm: https://www.swpc.noaa.gov/

NASA's rendering of the flyby: https://svs.gsfc.nasa.gov/vis/a000000/a005500/a005536/a2_fly... Hope we get to see something like this in 4K !