Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Yi-Coder: A Small but Mighty LLM for Code

01-ai.github.io

Post reply on HN
Print view View original

21–30 of 117 posts

Re: Yi-Coder: A Small but Mighty LLM for Code

#21

Post by karagenit »

theshrike79 wrote: post #3

> Continue pretrained on 2.4 Trillion high-quality tokens over 52 major programming languages. I'm still waiting for a model that's highly specialised for a single language only - and either a lot smaller than these jack of all trades ones or VERY good at that specific language's nuances + libraries.

Yep, been waiting for the same thing. Maybe at some point it’ll be possible to use a large multilingual model to translate the dataset into one programming language, then train a new smaller model on just that language?

Re: Yi-Coder: A Small but Mighty LLM for Code

#22

Post by terminalcommand »

karagenit wrote: post #21
theshrike79 wrote: post #3

> Continue pretrained on 2.4 Trillion high-quality tokens over 52 major programming languages. I'm still waiting for a model that's highly specialised for a single language only - and either a lot smaller than these jack of all trades ones or VERY good at that specific language's nuances + libraries.

Yep, been waiting for the same thing. Maybe at some point it’ll be possible to use a large multilingual model to translate the dataset into one programming language, then train a new smaller model on just that language?

Isn't microsoft phi specifically trained for Python? I recall that Phi 1 was advertised as a Python coding helper.

It's a small model trained only by quality sources (ie textbooks).

Re: Yi-Coder: A Small but Mighty LLM for Code

#23

Post by Y_Y »

richardw wrote: post #14
kamphey wrote: post #12

Earlier quoted context omitted.

I wonder what those 52 languages are.

According to the repo README: 'java', 'markdown', 'python', 'php', 'javascript', 'c++', 'c#', 'c', 'typescript', 'html', 'go', 'java_server_pages', 'dart', 'objective-c', 'kotlin', 'tex', 'swift', 'ruby', 'sql', 'rust', 'css', 'yaml', 'matlab', 'lua', 'json', 'shell', 'visual_basic', 'scala', 'rmarkdown', 'pascal', 'fortran', 'haskell', 'assembly', 'perl', 'julia', 'cmake', 'groovy', 'ocaml', 'powershell', 'elixir',…

They're playing a dangerous game if they assume that a single language or even family of similar languages is referred to by e.g. "assembly", "shell", "lisp".

(I also note that several of these are markup or config languages which are explicitly not for programming.)

Re: Yi-Coder: A Small but Mighty LLM for Code

#24

Post by dotancohen »

yumraj wrote: post #16
dsp_person wrote: post #13

Earlier quoted context omitted.

DeepSeek sounds really good, but the terms/privacy policy look a bit sketch (e.g. grant full license to use/reproduce inputs and outputs). Is there anywhere feasible to spin up the 240B model for a similarly cheap price in private? The following quotes from a reddit comment here https://www.reddit.com/r/LocalLLaMA/comments/1dkgjqg/comment... > under International Data Transfers (in the Privacy Policy): """ The person…

There’s no company info on DeepSeek’s website. Looking at the above, and considering that, it seems very sketchy indeed. Maybe OK for trying out stuff, a big no no for real work.

Might be good for contributing to open source projects. But not for clients' projects.

Re: Yi-Coder: A Small but Mighty LLM for Code

#25

Post by mtrovo »

I'm new to this whole area and feeling a bit lost. How are people setting up these small LLMs like Yi-Coder locally for tab completion? Does it work natively on VSCode?

Also for the cloud models apart from GitHub Copilot, what tools or steps are you all using to get them working on your projects? Any tips or resources would be super helpful!

Re: Yi-Coder: A Small but Mighty LLM for Code

#26

Post by cassianoleal »

mtrovo wrote: post #25

I'm new to this whole area and feeling a bit lost. How are people setting up these small LLMs like Yi-Coder locally for tab completion? Does it work natively on VSCode? Also for the cloud models apart from GitHub Copilot, what tools or steps are you all using to get them working on your projects? Any tips or resources would be super helpful!

You can run this LLM on Ollama [0] and then use Continue [1] on VS Code.

The setup is pretty simple:

* Install Ollama (instructions for your OS on their website - for macOS, `brew install ollama`)

* Download the model: `ollama pull yi-coder`

* Install and configure Continue on VS Code (https://docs.continue.dev/walkthroughs/llama3.1 [0] https://ollama.com/

[1] https://www.continue.dev/

Re: Yi-Coder: A Small but Mighty LLM for Code

#27

Post by littlestymaar »

redeyedtreefrog wrote: post #20
willvarfar wrote: post #18

Earlier quoted context omitted.

Google's Gemini does. I can't find a post that I remember Google published just after all the ChatGPT SQL generation hype happened, but it felt like they were trying to counter that hype by explaining that most complex LLM-generated code snippets won't actually run or work, and that they were putting a code-evaluation step after the LLM for Bard. (A bit like why did they never put an old fashioned rules-based grammar…

That's interesting! Where it says that is will "learn iteratively from the results until it arrives at a final output" I assume it's therefore trying multiple LLM generations until it finds one that works, which I didn't know about before. However, AFAIK it's only ever at inference time, an interpreter isn't included during LLM training? I wonder if it would be possible to fine tune a model for coding with an interpr…

> Though if noone has done it yet there is presumably a good reason why not.

The field is vast, moving quickly and there are more directions to explore than researchers working at top AI labs. There's lots of open doors that haven't been explored yet but that doesn't mean it's not worth it, it's just not done yet.

Re: Yi-Coder: A Small but Mighty LLM for Code

#28

Post by NKosmatos »

It would be good if LLMs were somehow packaged in an easy way/format for us "novice" (ok I mean lazy) users to try them out.

I'm not interested so much with the response time (anyone has a couple of spare A100s?), but it would be good to be able to try out different LLMs locally.

Re: Yi-Coder: A Small but Mighty LLM for Code

#30

Post by rfoo »

yumraj wrote: post #16
dsp_person wrote: post #13

Earlier quoted context omitted.

DeepSeek sounds really good, but the terms/privacy policy look a bit sketch (e.g. grant full license to use/reproduce inputs and outputs). Is there anywhere feasible to spin up the 240B model for a similarly cheap price in private? The following quotes from a reddit comment here https://www.reddit.com/r/LocalLLaMA/comments/1dkgjqg/comment... > under International Data Transfers (in the Privacy Policy): """ The person…

There’s no company info on DeepSeek’s website. Looking at the above, and considering that, it seems very sketchy indeed. Maybe OK for trying out stuff, a big no no for real work.

> There’s no company info on DeepSeek’s website.

It's backed solely by a hedge fund who do not want to draw attention to their business. So yeah, as sketchy as DESRES.

Post reply on HN