Live data from Hacker News

Using an open model feels surprisingly good

matthewsaltz.com

81–90 of 157 posts

Re: Using an open model feels surprisingly good

#81
post #26

Earlier quoted context omitted.

https://en.wikipedia.org/wiki/Blog

?? Edit: I see, had typo last word of sentence was meant to be “blog”

As in, the post is a blog, which is often literally someone's diary.

Also, if you don't like a submission, flag it and move on. Commenting that you don't like it doesn't add anything to the discussion.

Re: Using an open model feels surprisingly good

#82
post #62
post #7

Earlier quoted context omitted.

Rolling your own Linux is nearly free and could be done on any computer you had lying around. Dropping >$5k on a computer to run a local model (badly) doesn't really scratch my "hacker" itch. The author of this article works for an AI infrastructure company and ran Kimi K3 on their infrastructure - this post reads like marketing.

The inflation-adjusted cost for getting one of the early personal computers to do some BASIC programming was probably a lot higher than $5k today, and you could still go cheaper. Local AI is still (expensive) hobby territory. A capable local AI machine runs for about as much as a good mountainbike.

And in many regions, you'll be adding significantly to your electricity bill to run it. It's not just the initial outlay for the hardware.

Re: Using an open model feels surprisingly good

#84
post #49

Earlier quoted context omitted.

You can run a small model on almost any hardware, for free, and just play around. It doesn’t need to be some “frontier” (whatever the hell that means) model by any means. Grab some new tech and slap it on whatever hardware you have laying around, see what you think. Making it about the hardware costs is not the play, they’re not an actual barrier.

I don't want to use a crappy model that can't do any of the things I want it to. I'm not coding with Claude cause I enjoy the inherent novelty of LLMs. I'm doing it cause it's enabling me to quickly solve problems without getting stuck on the hitches that have deterred me from bothering with dozens of side projects my entire life.

Sure, that's fine. But some people like to play around and hack just for the sake of hacking. If you don't like that, that's cool, no issue with that. But some people do.

(FWIW, I have the same attitude/preference as you do. Until I can run SOTA models on my own hardware without taking out a second mortgage, I'll pay our AI overlords for the privilege.)

Re: Using an open model feels surprisingly good

#85
post #19

The reason Claude code is so popular is because it’s really good at taking super vague human prose “Claude build me a million dollar SaaS”-type prompts and spitting out thousands of lines of code which cover tons of surface-level edge cases, build in tons of functionality, etc The smaller/open models are less good at that. But that’s not how software development is done. You don’t prompt a whole app and be done with…

This is what I've found and would likely be the consenses of the HN community. This has lowered the barrier of entry for many non-SWEs. I'm primarily a data scientist myself in the environmental sector with limited front end development. My partner proposed an idea to help manage her horses and over the course of several weeks we fleshed out an android app that would enable/assist her with horse care. I spent a few d…

> We now have a fully developed app that we are testing but found several features missing.

This is my experience with using AI to generate tailored apps too. The first 80% makes me really excited but then it either only kind of works, has bugs, or has missing features. Even when I do eventually get it working I feel dirty using it because I just know it's badly implemented. Of the dozens I've created I don't think I still use any of them. I have a few glue scripts still in use.

Re: Using an open model feels surprisingly good

#87

This is an ad. I know the author has a long history here and I'm sure the post is a genuine reflection. But how is posting "I used my own product and it felt really good" anything other than self promotion?

So all the blog posts, every 10s on HN, shilling for Anthropic are not ads but this is?

Re: Using an open model feels surprisingly good

#88

It surprises me that this concept took as long as it did to gain traction in… hacker news. 15 years ago folks here were compiling kernels and gentoo distros. Lately it’s been “you should just pay the man, it’s cheaper than running these things yourself”

True, I see so many posts along the lines of 'I am a quasi programming god with no time on my hands (apart from time wasted here) so I will gladly pay $10,000 a month to Anthropic if it makes me 1% more effective than if I were to use GLM'

Re: Using an open model feels surprisingly good

#89
post #87

This is an ad. I know the author has a long history here and I'm sure the post is a genuine reflection. But how is posting "I used my own product and it felt really good" anything other than self promotion?

So all the blog posts, every 10s on HN, shilling for Anthropic are not ads but this is?

The author works for a company that provides Kimi. It’s different.

It doesn’t mean the post doesn’t accurately reflect the author’s views - it probably does. And the conflict of interest is well disclosed in the brief post. In fact, it’s quite natural for somebody who likes open models to work somewhere associated with them.

So personally I don’t find any impropriety going on here - but yes, it’s an ad.

Re: Using an open model feels surprisingly good

#90
post #89
post #87

Earlier quoted context omitted.

So all the blog posts, every 10s on HN, shilling for Anthropic are not ads but this is?

The author works for a company that provides Kimi. It’s different. It doesn’t mean the post doesn’t accurately reflect the author’s views - it probably does. And the conflict of interest is well disclosed in the brief post. In fact, it’s quite natural for somebody who likes open models to work somewhere associated with them. So personally I don’t find any impropriety going on here - but yes, it’s an ad.

Huh? He says he works at Modal, not Moonshot. Are they connected?
Post reply on HN