Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GitHub Models: A new generation of AI engineers building on GitHub

github.blog

Post reply on HN
Print view View original

11–16 of 16 posts

Re: GitHub Models: A new generation of AI engineers building on GitHub

#11

Post by ZeroCool2u »

Seems like this is a sales funnel for Azures OpenAI/LLM gateway with GitHub as a proxy(?). It's a bit unclear. Regardless, I'd be pretty wary of adding either Azure or GitHub as a core dependency to any of my apps at this point with how poor uptime seems to be at both lately.

Also, the pricing is pretty shady. It seems like your GitHub PAT gives you free limited access, but if you ever want to move to a paid model, you have to transition to Azure. The shady part is that it's pretty hidden. You have to go to a specific model in the Marketplace, (for example: https://github.com/marketplace/models/azureml-mistral/Mistra...), then go to the bottom of the "Chapters" to the "Going beyond rate limits" section. There it just directs you straight to the Azure portal.

Re: GitHub Models: A new generation of AI engineers building on GitHub

#13

Post by ganyu »

daralthus wrote: post #12

Is this just Azure AI Studio? My experience is that Azure OpenAI is waay behind on API and model parity compared to the same thing from OpenAI.

AOAI literally has these compliance stuff (or what they market as 'enterprise-level security' features) so they're constantly 1-3 months behind OAI.

And no. This is not Azure AI Studio. You can't get a decent free trial working in it without getting through a pack of resource creation wizards.

Re: GitHub Models: A new generation of AI engineers building on GitHub

#14

Post by simonw »

Best explanation I found was this video: https://www.youtube.com/watch?v=WiBB8Lsgl7I

It's three things, all currently waitlisted:

1. A new model playground (like the ones by OpenAI and Anthropic) that lets you try prompts against a large range of models

2. Client libraries for the same using what looks like a universal API proxy, though I think these are existing Azure libraries

3. A "gh models run" command (similar to my LLM CLI tool) that lets to interact with models on the command line

So it's mostly a wrapper around existing Azure stuff that makes it MUCH easier to use, because GitHub are better than Azure at things like authentication systems that don't strike fear into your mortal soul.

Re: GitHub Models: A new generation of AI engineers building on GitHub

#15

Post by benreesman »

simonw wrote: post #14

Best explanation I found was this video: https://www.youtube.com/watch?v=WiBB8Lsgl7I It's three things, all currently waitlisted: 1. A new model playground (like the ones by OpenAI and Anthropic) that lets you try prompts against a large range of models 2. Client libraries for the same using what looks like a universal API proxy, though I think these are existing Azure libraries 3. A "gh models run" command (similar…

I hate to bag on Azure because competition in cloud is critical and they keep at least some price pressure on AWS, but god damn is it near impossible to even log in on a new machine.

And it’s not like AWS is winning any UX competitions.

Re: GitHub Models: A new generation of AI engineers building on GitHub

#16

Post by meiraleal »

Barrin92 wrote: post #7

"We believe every developer can be an AI engineer with the right tools and training [...] GitHub is the creator network for the age of AI. [...] Just in the last year, more than 100K generative AI projects were created on GitHub. [...] In the years ahead, we will continue to democratize access to AI technologies to generate a groundswell of one billion developers." If I've learned one thing in the software industry,…

I find the gatekeeping of the term engineer a much more interesting phenomena. People planning, building, launching things are engineering things.
Post reply on HN