Live data from Hacker News

GitHub Models: A new generation of AI engineers building on GitHub

github.blog

1–10 of 16 posts

Re: GitHub Models: A new generation of AI engineers building on GitHub

#3
> One data pack costs $5 per month, and provides a monthly quota of 50 GiB for bandwidth and 50 GiB for storage. You can purchase as many data packs as you need. For example, if you need 150 GB of storage, you'd buy three data packs.

They really need to move on from this pricing structure. It's too expensive to host and distribute large binary files from GitHub.

Re: GitHub Models: A new generation of AI engineers building on GitHub

#4

So the tl;dr is they're now competing directly with Hugging Face?

Yes and no. It’s indeed a playground to test out various models and gives you an endpoint to play with it, but it’s not that developers can upload their own custom models. Instead, it’s currently only a curated library of certain popular models like those from OpenAI, Microsoft, and Meta.

(I don’t work at GitHub but was quoted in the article).

Re: GitHub Models: A new generation of AI engineers building on GitHub

#5
I'm not sure what the point of this is. Aren't there enough LLM playgrounds out there?

Maybe if they wanted to develop it into a useful feature it would create unique LLM benchmarks from your pull requests and issues, so you can easily test which model performs best on your codebase. Then augment that with fine-tuning to your code style, etc.

Re: GitHub Models: A new generation of AI engineers building on GitHub

#6
post #5

I'm not sure what the point of this is. Aren't there enough LLM playgrounds out there? Maybe if they wanted to develop it into a useful feature it would create unique LLM benchmarks from your pull requests and issues, so you can easily test which model performs best on your codebase. Then augment that with fine-tuning to your code style, etc.

The point is to funnel users into spending money on Azure, like most of Microsoft's dev tools these days.

"And finally, go to production with Azure AI by replacing your GitHub personal access token with an Azure subscription and credential."

Re: GitHub Models: A new generation of AI engineers building on GitHub

#7
"We believe every developer can be an AI engineer with the right tools and training [...] GitHub is the creator network for the age of AI. [...] Just in the last year, more than 100K generative AI projects were created on GitHub. [...] In the years ahead, we will continue to democratize access to AI technologies to generate a groundswell of one billion developers."

If I've learned one thing in the software industry, then that with a sufficiently creative definition of the word 'engineer' everything is possible. It feels like every week the AI "industry" turns more into some sort of cursed influencer economy. I guess if you've got to explain to your shareholders how you're gonna make the 10 billion back you spent on graphics cards you gotta be optimistic.

Post reply on HN