Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: What default model do you use and why?

news.ycombinator.com

Post reply on HN
Print view View original

101–104 of 104 posts

Re: Ask HN: What default model do you use and why?

#101

Post by tmikaeld »

hgoel wrote: post #75
oidar wrote: post #69

Earlier quoted context omitted.

> on a GB10 cluster I'd love to hear more about your setup. I have a single GB10 and am thinking about adding an additional one.

I'm coming up on a month with my 2x GB10 cluster. I was at 1x for a week before I pulled the trigger for the second. Initial setup was a tad annoying because I had to update their firmwares and then power cycle them to get the 200GbE link working at full speed. After setting that up, it has been pretty smooth. I don't directly deal with the cluster, usually I just have the LLM itself handle updates/stopping to load d…

How much does it cost per month, which provider and what do you get out of it?

Re: Ask HN: What default model do you use and why?

#102

Post by Jordan-117 »

I subscribed to ChatGPT for a few years, but over the holidays noticed that it was making frequent errors and hallucinations when dealing with more obscure Linux and Firefox issues. Trying Gemini as a backup produced much better answers, to the point I switched my subscription. I do everything through the app/website rather than the API; I understand this is pricier but I like having convenient access, a searchable history, memory, etc.

I try the ChatGPT free tier as a backup second opinion sometimes, but find their newest model to be painfully rambling.

I want to like Claude and might consider subscribing to it instead, but am put off by reports of its tight usage limits. With Gemini, though, I never hit a limit unless I conduct a few Deep Research queries at the highest level.

Post reply on HN