Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Yi-Coder: A Small but Mighty LLM for Code

01-ai.github.io

Post reply on HN
Print view View original

51–60 of 117 posts

Re: Yi-Coder: A Small but Mighty LLM for Code

#51

Post by viraptor »

rty32 wrote: post #50
viraptor wrote: post #45

Earlier quoted context omitted.

Have you seen https://www.swebench.com/ ? Once you engage agentic behaviour, it can take you way further than just the chats. We're already in the "resolving JIRA tickets" area - it's just hard to setup, not very well known, and may be expensive.

Looks like the definition of "resolving a ticket" here is "come up with a patch that ensures all tests pass", which does not necessarily include "add a new test", "make sure the patch is actually doing something meaningful", "communicate how this is fixed". Based on my experience and what I saw in the reports in the logs, a solution could be just hallucinating completely useless code -- as long as it doesn't fail a t…

Some are happy with creating tests as well, but you probably want to mostly write them yourself. I mean, only you know the real world context - if the ticket didn't explain it well enough, LLMs can't do magic.

Actually the poorly documented and poorly written is not a huge issue in my experience. The under tested is way more important if you want to automate that work.

Re: Yi-Coder: A Small but Mighty LLM for Code

#52

Post by samstave »

suprjami wrote: post #32
mtrovo wrote: post #25

I'm new to this whole area and feeling a bit lost. How are people setting up these small LLMs like Yi-Coder locally for tab completion? Does it work natively on VSCode? Also for the cloud models apart from GitHub Copilot, what tools or steps are you all using to get them working on your projects? Any tips or resources would be super helpful!

If you have a project which supports OpenAI API keys, you can point it at a LocalAI instance: https://localai.io/ This is easy to get "working" but difficult to configure for specific tasks due to docs being lacking or contradictory.

Can you post screens/configs on how setup success?

Or at least state what you configured toward and how?

Re: Yi-Coder: A Small but Mighty LLM for Code

#53

Post by mark_l_watson »

theshrike79 wrote: post #3

> Continue pretrained on 2.4 Trillion high-quality tokens over 52 major programming languages. I'm still waiting for a model that's highly specialised for a single language only - and either a lot smaller than these jack of all trades ones or VERY good at that specific language's nuances + libraries.

I get your point. Models that support many dozens of human languages seem not what I personally need because I only speak English.

However, I enjoy using various Lisp languages and I was pleased last night when I set up Emacs + ellama + Ollama + Yi-Coder. I experimented with Cursor last weekend, and it was nice for Python, not so great for Common Lisp.

Re: Yi-Coder: A Small but Mighty LLM for Code

#54

Post by bilekas »

dsp_person wrote: post #13
mythz wrote: post #4

Claude 3.5 Sonnet still holds the LLM crown for code which I'll use when wanting to check the output of the best LLM, however my Continue Dev, Aider and Claude Dev plugins are currently configured to use DeepSeek Coder V2 236B (and local ollama DeepSeek Coder V2 for tab completions) as it offers the best value at $0.14M/$0.28M which sits just below Claude 3.5 Sonnet on Aider's leaderboard [1] whilst being 43x cheaper…

DeepSeek sounds really good, but the terms/privacy policy look a bit sketch (e.g. grant full license to use/reproduce inputs and outputs). Is there anywhere feasible to spin up the 240B model for a similarly cheap price in private? The following quotes from a reddit comment here https://www.reddit.com/r/LocalLLaMA/comments/1dkgjqg/comment... > under International Data Transfers (in the Privacy Policy): """ The person…

> """ The personal information we collect from you may be stored on a server located outside of the country where you live. We store the information we collect in secure servers located in the People's Republic of China . """

Is that even legal in regards to EU users ?

Re: Yi-Coder: A Small but Mighty LLM for Code

#55

Post by crimsoneer »

Palmik wrote: post #31

The difference between (A) software engineers reacting to AI models and systems for programming and (B) artists (whether it's painters, musicians or otherwise) reacting to AI models for generating images, music, etc. is very interesting. I wonder what's the reason.

I mean, it's supply and demand right.

- There is a big demand for really complex software development, and an LLM can't do that alone. So software devs have to do lots of busywork, and like the opportunity to be augmented by AI

- Conversely, there is a huge demand for not very high level art. - eg, lots of people want a custom logo or a little jingle, but no many people want to hire a concert pianist or comission the next Salvadore Dali.

So most artists spend a lot of time doing a lot of low level work to pay the bills, while software devs spend a lot of time doing low level code monkey work so they can get to the creative part of their job.

Re: Yi-Coder: A Small but Mighty LLM for Code

#56

Post by rty32 »

theshrike79 wrote: post #3

> Continue pretrained on 2.4 Trillion high-quality tokens over 52 major programming languages. I'm still waiting for a model that's highly specialised for a single language only - and either a lot smaller than these jack of all trades ones or VERY good at that specific language's nuances + libraries.

I don't know if that will happen, but there are tools that at least try to improve performance for specific languages, especially "underrepresented" languages, e.g. https://sourcegraph.com/blog/enhancing-code-completion-for-r...

Re: Yi-Coder: A Small but Mighty LLM for Code

#58

Post by onli »

bilekas wrote: post #54
dsp_person wrote: post #13

Earlier quoted context omitted.

DeepSeek sounds really good, but the terms/privacy policy look a bit sketch (e.g. grant full license to use/reproduce inputs and outputs). Is there anywhere feasible to spin up the 240B model for a similarly cheap price in private? The following quotes from a reddit comment here https://www.reddit.com/r/LocalLLaMA/comments/1dkgjqg/comment... > under International Data Transfers (in the Privacy Policy): """ The person…

> """ The personal information we collect from you may be stored on a server located outside of the country where you live. We store the information we collect in secure servers located in the People's Republic of China . """ Is that even legal in regards to EU users ?

Of course not.

Re: Yi-Coder: A Small but Mighty LLM for Code

#59

Post by JediPig »

I tested this out on my workload ( SRE/Devops/C#/Golang/C++ ). it started responding about non-sense on a simple write me boto python script that changes x ,y,z value.

Then I tried other questions in my past to compare... However, I believe the engineer who did the LLM, just used the questions in benchmarks.

One instance after a hour of use ( I stopped then ) it answered one question with 4 different programming languages, and answers that was no way related to the question.

Re: Yi-Coder: A Small but Mighty LLM for Code

#60

Post by yard2010 »

onli wrote: post #58
bilekas wrote: post #54

Earlier quoted context omitted.

> """ The personal information we collect from you may be stored on a server located outside of the country where you live. We store the information we collect in secure servers located in the People's Republic of China . """ Is that even legal in regards to EU users ?

Of course not.

Well, good luck prosecuting Winnie the Pooh
Post reply on HN