Live data from Hacker News

Next-generation AI models

tabnine.com

51–60 of 139 posts

Re: Next-generation AI models

#51
post #47

Earlier quoted context omitted.

We owe a lot to the smart people working there

Quoted post unavailable.

Feel free to elaborate -- this is hacker news not script kiddie news. Excess cynicism aside, while I think there's always plenty to be critical of I think between Leslie Lamport, Excel, and Windows XP I'd say it's not all bad.

Re: Next-generation AI models

#54

Earlier quoted context omitted.

I used Tabnine before GitHub Copilot and I never looked back. It feels a bit like upgrading from GPT2 to GPT3.

I mean, that's literally what happened. At least initially Tabnine was based on the GPT2 model trained on code. Then GitHub launched Copilot using the OpenAI Codex model which is based on GPT3. I guess this is why several people have commented on the marked improvement when adopting GitHub Copilot. I have no idea how Tabnine builds their models today, and how they perform compared to Copilot. I guess one advantage co…

There's a decent comparison outlining the differences by Tabnine's CEO here (disclaimer - I work there). https://twitter.com/drorwe/status/1539293063117516801

Re: Next-generation AI models

#55
I might be a super weird use case BUT believe it or not I use both Tabnine and Copilot and I kinda like the combo. Here's how it works:

I use Copilot for its multi-line code generation. It's vastly superior. (Sorry Tabnine). Gotta give credit to Tabnine for kicking off this space -- they had a multi-year headstart on Copilot and it was pretty cool when it first launched, but it just doesn't come close to Copilot. OpenAI is kicking butt here.

Having said that, I still find value out of Tabnine -- I keep it installed it powers the pop-up autocomplete (eg Intellisense replacement). The Tabnine suggestions are immediate (as opposed to Copilot which takes a few seconds), and in a lot of cases it's super helpful for completing a variable name after 1 character, etc.

If I ESC out of the Tabnine suggestion, then Copilot takes over and a few seconds later I get a full line/multi-line suggestion.

I dunno - it's been working really well for me. Peaceful coexistence :)

Re: Next-generation AI models

#56
The problem I had with Tabnine was insane memory consumption to the point where my Mac crawled to a halt. I had to keep killing Tabnine process or just uninstall the plugin. Copilot has been a breeze. I really want to give Tabnine a shot again but I doubt if they can get it to perform as well as Copilot does.

Re: Next-generation AI models

#57

Having just purchased copilot and a user of Tabnine in the past (using Phpstorm) here is my own personal opinion. The suggestions offered by Tabnine weren't anywhere good as copilot - not even by a long shot (at least for PHP and Javascript). But almost an year has passed since I used this so I don't know if they have had a major update and the results are improved, but previously 1 out of 10 tabnine suggestions were…

Hi, Tabnine's DevRel here. The past 12 months have been quite a journey, and a lot has changed. To make a long story short: We've trained 12 standalone models that are now used to serve highly accurate code completions based on current project & file context. I encourage you to give it another go.

Tabnine CEO Dror Weiss, wrote this detailed thread explaining some of the key differences (both in technology and user-approach) between Tabnine and Copilot: https://twitter.com/drorwe/status/1539293063117516801

Re: Next-generation AI models

#58
I consider myself pretty advanced user of Tabnine, having purchased the first version from Jacob just when it appeared. I haven't used (and don't plan to) its full-function code completion and only briefly evaluated Copilot. Some thoughts:

- Tabnine's local per-repository model shines best when used on big monolithic repos with lots of similar or boilerplate code. By learning on the same code it's used for it IMO does much better job at detecting local patterns. Also local-model means pretty "safe" from security POV for corporate use (I can't imagine big corps like Google and Amazon allowing use of Copilot for proprietary code).

- Back in they free tier of Tabnine was pretty useless compared to Pro because it severely limited model size. If it's still the case now I hope they have a long evaluation period.

- From usability POV, unfortunately it doesn't provide non-intrusive experience out of the box, which is very annoying and I believe is a reason for many users abandoning it pretty quickly. I had to modify both VSCode extension and VSCode itself (!) so that Tabnine's completion suggestions won't interfere with others.

Re: Next-generation AI models

#59
post #49

Assume coPilot proposes a function that can be found in 90% of GPLv3 software. Should all software written by coPilot be GPLv3 as well?

This is a really good question and is tangent to attribution in art-generating packages as well. It's a part of the process that gets ignored because nobody wants to deal with the unethical implications.

If software is doing it, it can't be bad, I guess.

Re: Next-generation AI models

#60
post #42

Earlier quoted context omitted.

There are some things in your comment that are wrong, or don't quite follow. > Copilot’s architecture is monolithic: “one model to rule them all.” It is also completely centralized - only Microsoft can train the model It's true that only Microsoft can train the model—for now. But GPT-3 is a monolithic model, and OpenAI allows fine-tuning. There's nothing about the architecture that prohibits Microsoft from offering c…

I fail to see how in the screenshot you provided Copilot suggests code _in the middle_ of the line. What I see is Copilot suggesting an entire line. Or does the suggestion start on the Err line with the "{" ?

On the highlighted line I typed `panic!("Error while ` and Copilot suggested finishing the line I started with `converting GeoJSON geometry to geometry: {}", e);`
Post reply on HN