Viewing profile — andreybaskov

As someone who built a niche SaaS I can see both sides of this. If you are looking to replicate the exact same feature set of an existing product - buying would almost always be a …

Curious, how did you deal with inspections and building codes? Or is it in a county with no building codes?

Finally, now I know I'm not the only one! These sharp edges constantly cut into my wrists to the point I was thinking of doing the same, or glueing some kind of kind soft padding t…

Sadly, memory bandwidth is abysmal compared to Apple chips - 273 GB/s vs 614 GB/s on M5 Max for similar price. Even though fp4 compute is faster, it doesn't help for all the decode…

Reading this was a roller coaster for me. Because of a bad habit reading comments before the link I knew it was AI. I read it regardless, and... I still enjoyed it! I'm very much n…

Just wanted to say that I've felt the same about the images. To me it's likely was the text that for some reason had AI-feel to it. Great story though, I was in awe learning it was…

In basic scenarios agree it’s possible. I’ve similarly toyed with building a small language and LLM picks it up. But that’s an additional context and it’s never felt like it worked…

Synthetic codebases are certainly an option, but if top models remain closed I don’t see them building datasets for every new language.

That's cool! Do you have any info on how manufacturing is done in the US?

It's a legitimate question to ask about any new language post AI - given there is no training dataset, any other language would work better with AI. The bigger problem is maintaina…

Agentic coding increasingly removes humans from the process of picking libraries. To me it always had some "human" touch - you'd look at the library, core maintainers, follow them …

Great summary of the current state of AI coding, without all the hype. I wonder though if we are fundamentally limited by LLMs architecture to come up with some novel architecture.…

I'm testing ground heat rejection system that dumps heat into the ground. It needs a lot of space, but you need it for panels anyways.

Solar-powered data center in a desert. Fully off-grid using solar, batteries and Starlink for uplink. Focusing on AI inference at the beginning. Currently building our first protot…

Original Apple II manuals written by Chris Espinosa and Jef Raskin are a treat to read. Would highly recommend, just to get a sense of what it was like to get onboarded on Apple II…

Out of all things I'm actually surprised they went straight to custom silicon, but gotta respect that decision. It's likely the only way to compete with Tesla right now.

Thank you for saying this. It's almost like others are saying we should stop trying things because they are hard and challenging. I wish we could dream a bit bigger rather than com…

I don't think we need that for 1,000x. We can building more solar, nuclear and there is still room for at least 10x improvement in efficiency for the chips. We are far far away fro…

I agree scaling alone is not enough, and transformers itself is a proof of that - it was an iteration on the attention mechanism and a few other changes. But no matter what the nex…

> What high quality data sources are not already tapped? Synthetic data? Video? > Where does the next 1000x flops come from? Even with Moore's law dead, we can easily build 1,000x …

I see LLMs in a similar way - a new UI paradigm that "clicks the right buttons" when you know what you need, but don't know exact names of the buttons to click. And from my experie…

Say we discover a new architecture breakthrough like Yann LeCun's proposed JEPA. Won't scaling laws apply to it anyway? Suppose training is so efficient that you can train state of…

Thanks! That's a great way to analyze it by comparing to open source models. Though I wonder if they use the same hardware for gpt-oss-120b and Claude Opus.

Does anyone know or have a guess on the size of this latest thinking models and what hardware they use to run inference? As in how much memory and what quantization it uses and if …

Exactly. It's software - `curl` or LLM. It's a function that accepts input and produces output. One is much more sophisticated that the other, but it's made out of the same machine…