Live data from Hacker News

Next-generation AI models

tabnine.com

131–139 of 139 posts

Re: Next-generation AI models

#131
post #129

Earlier quoted context omitted.

Listen to how you're talking about it. That's why the need to go. They're poison. They poison everything.

I'm talking about it like someone who has used alternatives and came to like it after many years. It allows me to manage 250 users comfortably with 1 admin in a decently high turnover environment and spend my time actually getting work done rather than fiddling with APIs and random connectors. I don't have to even think about it and it's worth every penny.

Glad it works for you. Fossil fuels work great, too.

Re: Next-generation AI models

#132
post #129

Earlier quoted context omitted.

I'm talking about it like someone who has used alternatives and came to like it after many years. It allows me to manage 250 users comfortably with 1 admin in a decently high turnover environment and spend my time actually getting work done rather than fiddling with APIs and random connectors. I don't have to even think about it and it's worth every penny.

Glad it works for you. Fossil fuels work great, too.

What exactly is your problem with Microsoft? Are you just an edgy "I use Linux guy?" I use Linux too, it's my daily driver. But when you're managing office workers and sales people that have to interface with regular people inside and outside the org, your OSS utopia falls apart. I'm making some assumptions here, but clearly, you don't work in a space where the average person (non tech) needs to collaborate. You drive a car. I drive a school bus.

Re: Next-generation AI models

#133
post #132

Earlier quoted context omitted.

Glad it works for you. Fossil fuels work great, too.

What exactly is your problem with Microsoft? Are you just an edgy "I use Linux guy?" I use Linux too, it's my daily driver. But when you're managing office workers and sales people that have to interface with regular people inside and outside the org, your OSS utopia falls apart. I'm making some assumptions here, but clearly, you don't work in a space where the average person (non tech) needs to collaborate. You driv…

This is going to really make me sound like a real ass, but I dont own a car! I ride a bike everywhere. Haha. West coast is turning me into a hippy.

And yeah, Im afraid I dont buy your perspective that only Microsoft can do everything. Seems to me like that can't do anything without being shitty in some way - from their very inception (stealing and suing). I personally think the world would be better without mega corporations that act like bad citizens like Microsoft, Google, Facebook and especially Apple. Since I can't have that, I mostly wish they werent allowed to advertise everywhere all the time.

Re: Next-generation AI models

#134

Earlier quoted context omitted.

I think it's mostly about having deeper pockets than being clever or original when it comes to A.I. (though these guys just got $15m fwiw). But this is one thing that worries me about A.I speaking as an indiehacker. Being scrappy won't soon cut it anymore. Right now you can bootstrap a solid product for $15K, at least a MVP. Soon with the amount of GPU and other resources required to train these models you'll need a…

Cost wise the biggest spend is building the large model (CODEX for Copilot). While CODEX is close sourced there are a number of other good open source transformer models from SFDC (T5), AI21, Meta that are the foundational models we use. Going forward we will continue to partner with the community to enable these large models to reach developers in code-time.

Just out of curiosity since you are so knowledgeable in this area.. what would be like a very approx ballpark figure to develop something like codex?

Re: Next-generation AI models

#135

Earlier quoted context omitted.

Cost wise the biggest spend is building the large model (CODEX for Copilot). While CODEX is close sourced there are a number of other good open source transformer models from SFDC (T5), AI21, Meta that are the foundational models we use. Going forward we will continue to partner with the community to enable these large models to reach developers in code-time.

Just out of curiosity since you are so knowledgeable in this area.. what would be like a very approx ballpark figure to develop something like codex?

Ballpark guess is that to build CODEX it would be ~$10M.

Re: Next-generation AI models

#136

For this specific comparison, it’s essential to start from the technology, as many of the product differences stem from the differences in approach, architecture, and technology choices. Microsoft and OpenAI view AI for software development almost as just another use case for GPT-3, the behemoth language model. Code is text, so they took their language model, fine-tuned it on code, and called the gargantuan 12-billio…

Thank you for laying out facts for us, at least from Tabnine perspective. I didn't use Tabnine but anecdotally heard it is not as good to guess whole methods the way Copilot is. Now I understand why. The only suggestion I would make, maybe lower the price, MS is bigger player, they pretty much set the standard now, if they have lower price even symbolically, it would hurt you more. I personally am happy with Copilot,…

Good feedback and thank you for taking the time to share

Re: Next-generation AI models

#137
post #132

Earlier quoted context omitted.

What exactly is your problem with Microsoft? Are you just an edgy "I use Linux guy?" I use Linux too, it's my daily driver. But when you're managing office workers and sales people that have to interface with regular people inside and outside the org, your OSS utopia falls apart. I'm making some assumptions here, but clearly, you don't work in a space where the average person (non tech) needs to collaborate. You driv…

This is going to really make me sound like a real ass, but I dont own a car! I ride a bike everywhere. Haha. West coast is turning me into a hippy. And yeah, Im afraid I dont buy your perspective that only Microsoft can do everything. Seems to me like that can't do anything without being shitty in some way - from their very inception (stealing and suing). I personally think the world would be better without mega corp…

I never said only Microsoft can do everything. The provide the easiest solution that just automatically ties everything together. My company builds actual things, we don't want to spend time fiddling with custom software integrations.

Re: Next-generation AI models

#139

I remember when Jacob Jackson’s (this kid is nothing less of a genius) tabnine project was posted on HN. Codota then bought tabnine and now they renamed themselves after this acquisition. Got me interested what Jacob is doing now. Looks like after his stint at OpenAI this is his new project: https://same.energy/

No post body was provided.
Post reply on HN