Viewing profile — clusterhacks

Running locally for me is mainly about learning, maintaining control+privacy, and helping shift my coding+design process to leverage LLMs. I guess if you made me boil it down to a …

On the one hand, sure, why not have a default install throw a bunch of bells+whistles via skills and extensions. But I like pi precisely because it is so minimal. I want understand…

This may be too naive, but I created a user on my linux box who doesn't have very many permissions. Then I sudo to that user, use firejail to start pi in a dev project directory, a…

FTA's conclusion: "Is this decline a distinct change from the recent behavior of the labor share in the U.S.? Along the two key dimensions we investigate, our answer is no. ... and…

Huh. Same problem, and I run with llama.cpp. In my case, Gemma4-31B (4-bit quant though) will just stop sometimes.

Gotcha. I'm past the point of having any confident thoughts about what happens to their share price at IPO. What about the idea that there is a high likelihood that the potential s…

I used to agree with you but now do not. I now think the floor for this market is probably no worse than the annual revenue of cell phone plans in the US market. So say, $250 billi…

--what this means for the valuation of the AI companies Probably nothing. Most users have no idea what an LLM is or how it runs. Anecdotally speaking, I see many LLM users default …

Appreciate the anecdote and your other comments on HN. But I strongly suspect you are incredibly atypical based on your background and previous work experience in ways that would t…

Check out the Taulbee survey results: "In 2023–24, Bachelor’s degree production fell 5.5% compared to the previous year across CS, CE, and I departments. Among departments reportin…

"I personally dropped $20k on a high end desktop . . . " This is where I think current hackers should be headed. I grew up with lots of family who were backyard mechanics, wrenchin…

--> I can spot a person's social media app of choice is in 5 minutes. I find this sadly hilarious. What are the current tells you see? I'm similar in that I read a lot of HN and do…

Very cool - thanks for the info. That you are writing AI agents for a living is fascinating to hear. We aren't even really looking at how to use agents internally yet. I think loca…

Good grief. I'm here cautiously telling my workplace to buy a couple of dgx sparks for dev/prototyping and you have better hardware in hand than my entire org. What kind of experim…

Wow, thanks for the link to Texerau. I had no idea a pdf was floating around and have wanted this book for some time. You video looks interesting, especially the part around Ronchi…

Watch your local craigslist or facebook marketplace. With a little patience, you will probably find a good 8" or 10" dobsonian at a great price. I picked up a lovely 8" dob for les…

Sorry, I don't much track or keep up with those specifics other than knowing I'm not spending much per week. My typical scenario is to spin up an instance that costs less than $2/h…

No, I don't blog. But I just followed the docs for starting an instance on lambda.ai and the llama.cpp build instructions. Both are pretty good resources. I had already setup an SS…

I ran ollama first because it was easy, but now download source and build llama.cpp on the machine. I don't bother saving a file system between runs on the rented machine, I build …

You know, I haven't even been thinking about those AMD gpus for local llms and it is clearly a blind spot for me. How is it? I'd guess a bunch of the MoE models actually run well?

All those choices seem to have very different trade-offs? I hate $5,000 as a budget - not enough to launch you into higher-VRAM RTX Pro cards, too much (for me personally) to just …

>whole point of the time compression is to spread the grades out I suspect that is true for standardized tests like the SAT, ACT, or GRE. I suspect in classroom environments that t…

Sure, but that answer doesn't address the questions of the value of time limits on assessment. What if instead we are talking about a paper or project? Why isn't time-to-complete p…

I share your paranoia. My kids use personal computing devices for school, but their primary platform (just like their friends) is locked-down phones. Combining that usage pattern w…

Why? How strong is the argument that a student completing a test in 1 hour with the same score as a student who took 10 hours that the first student performed "better" or had a gre…