Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: What AI assistants are already bundled for Linux?

news.ycombinator.com

Post reply on HN
Print view View original

61–64 of 64 posts

Re: Ask HN: What AI assistants are already bundled for Linux?

#61

Post by lukan »

AlienRobot wrote: post #56
lukan wrote: post #42

Earlier quoted context omitted.

"You have a bunch of files in folders and you want the AI to tell you what exactly?" For example: "show me the folder(s), where my old University projects are stored" "Sort this folder into programming projects, general notes, pictures, music, videos and install files" "Find me the folder where I made notes about a novel sorting algorithm"

It sounds like you want... folders. Genuinely. Or a tag system. Or some other metadata. Like, take this query for example: show me the folder(s), where my old University projects are stored. How would an AI, however powerful, know what are "university projects" if they aren't tagged as such? And if they were, why is the AI necessary? One approach I've tried before is: if you have a folder /projects/ with so many proj…

Well, but they ain't tagged or sorted. And an AI could know, because of the context. If it knew what year I studied and what courses etc then this information would be enough to separate content. But I am aware, that this tech ain't there yet.

Re: Ask HN: What AI assistants are already bundled for Linux?

#63

Post by luke-stanley »

ghthor wrote: post #59
luke-stanley wrote: post #39

Earlier quoted context omitted.

I'd love this to be true, and it might be for some specific well tested situations with a narrow set of data that you can be confident about. But that's a bit wishful, isn't it?

I’m using StarCoder3B on my rtx 2080 using tabbyml and I consistently get good code suggestions.

That is an example of a good, narrow task area that a small model could be good at, with current tech, which differs from general AI assistants like GPT-4. Using mixture of experts with task specific fine-tuning, I can see it being possible, but I was mainly saying Phi 2 ain't it. It may be a good starting place! Also, a code completion model could totally end up easily installed in a major Linux distro's default package manager soon, if not already.
Post reply on HN