Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

IBM Granite: A Family of Open Foundation Models for Code Intelligence

github.com

Post reply on HN
Print view View original

61–70 of 78 posts

Re: IBM Granite: A Family of Open Foundation Models for Code Intelligence

#61

Post by mhh__ »

propter_hoc wrote: post #14
mhh__ wrote: post #12

Earlier quoted context omitted.

IBM do a mixture of shovelware and extremely hardcore tech so they could honestly go either way with this.

> mixture of shovelware and extremely hardcore tech Citation needed All I've seen from them in my professional experience is actually legacy mainframe maintenance.. Not shovelware, but very far from hardcore tech.

Those mainframes are actually pretty modern and interesting.

If IBM split off half of their mainframe division and let some competition get going I think the segment could actually be something to contend with.

The basic idea of the IBM mainframe is almost perfect for what a lot of companies actually need (massively reliable hardware to support lots of middling software; most work is shunting data around) but everyone knows they're going to get locked into IBM.

Re: IBM Granite: A Family of Open Foundation Models for Code Intelligence

#62

Post by CamperBob2 »

maccard wrote: post #52
bayindirh wrote: post #44

Earlier quoted context omitted.

What if I told you the supposedly clean "The Stack" dataset contains at least one GPL repository inside, just because their license detection tool bugged out? IBM and other big players are vigilant about these things, and this is what companies pay for. Their software may not be better in some metrics, but they're cleaner in some and their support contracts allows people to sleep tight at night. This is what money bu…

> IBM and other big players are vigilant about these things, and this is what companies pay for. And more importantly, IBM will guarantee it in the case that they're wrong. _That's_ what companies pay for.

And more importantly, IBM will guarantee it in the case that they're wrong.

So will OpenAI, according to Sam Altman. Can they be trusted?

Re: IBM Granite: A Family of Open Foundation Models for Code Intelligence

#63

Post by huijzer »

dusanh wrote: post #55

I'm a complete newb when it comes to AI, and I am getting pretty ashamed of it too. How do I take a model like this and use it in my day to day? Can I somehow use in, say, VSCode? How do I point it at my code base, and use it to help me write new code?

https://github.com/TabbyML/tabby can run self-hosted AI coding assistants. I tried it a while ago and it worked with Nvim pretty easily. There is a VS code extension too. The extension will just sort of "read" with you and provide suggestions from time to time. Anytime the suggestion is good you can press some key ( by default) to accept it. It's basically autocomplete on steroids.

Re: IBM Granite: A Family of Open Foundation Models for Code Intelligence

#64

Post by bayindirh »

CamperBob2 wrote: post #62
maccard wrote: post #52

Earlier quoted context omitted.

> IBM and other big players are vigilant about these things, and this is what companies pay for. And more importantly, IBM will guarantee it in the case that they're wrong. _That's_ what companies pay for.

And more importantly, IBM will guarantee it in the case that they're wrong. So will OpenAI, according to Sam Altman. Can they be trusted?

IBM has a track record going back to automatically price calculating cheese cutters [0], but Sam does not.

IBM has proven itself in various ways over the years, OpenAI hasn't.

While IBM is a behemoth of a money making machine, they put money where their mouth is. OpenAI does not.

So I'll trust IBM, but not OpenAI.

[0]: https://youtu.be/z8VhNF_0I5c

Re: IBM Granite: A Family of Open Foundation Models for Code Intelligence

#65

Post by throwaway290 »

As usual, license/copyright violation:

> Our process to prepare code pretraining data involves several stages. First, we collect a combination of publicly available datasets (e.g., GitHub Code Clean, Starcoder data), public code repositories, and issues from GitHub

Re: IBM Granite: A Family of Open Foundation Models for Code Intelligence

#66

Post by doctorpangloss »

bayindirh wrote: post #44
doctorpangloss wrote: post #34

Earlier quoted context omitted.

What if I told you that a lot of freely licensed code on GitHub is not clean? That the authors may have read something and rewritten it in a way that wasn’t transformative? So it basically has the same problems.

What if I told you the supposedly clean "The Stack" dataset contains at least one GPL repository inside, just because their license detection tool bugged out? IBM and other big players are vigilant about these things, and this is what companies pay for. Their software may not be better in some metrics, but they're cleaner in some and their support contracts allows people to sleep tight at night. This is what money bu…

Indemnity is moving the goal posts, no? So you’re conceding that their data isn’t clean. But they say it’s clean.

This support contract stuff: what are you talking about? You download these models, you use them. What would you pay for? It’s not clean data, they say it’s clean: why would I pay liars? Let’s game out the indemnity idea. I pay $10k/mo for 12 months. Then OpenAI loses v. NYTimes, ruled LLM training is not fair use, need express permission. IBM pulls the models. What the hell did I pay $120k for? And by the way, you can pay a law student 1 beer to tell you OpenAI is going to lose because of Warhol v Goldsmith. You can do whatever you want with your money, but I personally would not waste it on worthless indemnity.

Re: IBM Granite: A Family of Open Foundation Models for Code Intelligence

#67

Post by homarp »

everforward wrote: post #56
dusanh wrote: post #55

I'm a complete newb when it comes to AI, and I am getting pretty ashamed of it too. How do I take a model like this and use it in my day to day? Can I somehow use in, say, VSCode? How do I point it at my code base, and use it to help me write new code?

You run most of these models in something that wraps them in an HTTP API. I use Ollama, which I think is the most popular but I’m not in a great position to judge. My impression is that it handles running models on CPU better. So you’d basically install Ollama, download one of the versions of this model off HuggingFace, create a Modelfile since this isn’t in the default Ollama repo, and then Ollama can answer prompts…

if you can compile stuff, then looking at llama.cpp (what ollama uses) is also interesting: https://github.com/ggerganov/llama.cpp

the server is here: https://github.com/ggerganov/llama.cpp/tree/master/examples/...

And you can search for any GGUF on huggingface

Re: IBM Granite: A Family of Open Foundation Models for Code Intelligence

#68

Post by bayindirh »

doctorpangloss wrote: post #66
bayindirh wrote: post #44

Earlier quoted context omitted.

What if I told you the supposedly clean "The Stack" dataset contains at least one GPL repository inside, just because their license detection tool bugged out? IBM and other big players are vigilant about these things, and this is what companies pay for. Their software may not be better in some metrics, but they're cleaner in some and their support contracts allows people to sleep tight at night. This is what money bu…

Indemnity is moving the goal posts, no? So you’re conceding that their data isn’t clean. But they say it’s clean. This support contract stuff: what are you talking about? You download these models, you use them. What would you pay for? It’s not clean data, they say it’s clean: why would I pay liars? Let’s game out the indemnity idea. I pay $10k/mo for 12 months. Then OpenAI loses v. NYTimes, ruled LLM training is not…

First of all, "The Stack" is the dataset that models like StarCoder is trained upon. I don't know what's the data source for IBM Granite family.

I know the Stack is not clean, because they included my fork of GDM's greeter, which is GPL licensed.

My words about IBM was in general. I can't tell anything about their models, because I didn't see mention of "The Stack", and I don't know what their models are based on.

On the other hand, IBM doesn't like risks from my experience, so they would play it way safer than other companies.

If their data is not clean to begin with, then shame on them, and hope their AI efforts burn to the ground.

BTW, LLM training is not fair use. For start, Fair Use's definition automatically excludes "for profit" usage. Just because OpenAI has a non-profit part and training done here doesn't make them immune to consequences of for profit operations.

Re: IBM Granite: A Family of Open Foundation Models for Code Intelligence

#69

Post by [deleted] »

bayindirh wrote: post #68
doctorpangloss wrote: post #66

Earlier quoted context omitted.

Indemnity is moving the goal posts, no? So you’re conceding that their data isn’t clean. But they say it’s clean. This support contract stuff: what are you talking about? You download these models, you use them. What would you pay for? It’s not clean data, they say it’s clean: why would I pay liars? Let’s game out the indemnity idea. I pay $10k/mo for 12 months. Then OpenAI loses v. NYTimes, ruled LLM training is not…

First of all, "The Stack" is the dataset that models like StarCoder is trained upon. I don't know what's the data source for IBM Granite family. I know the Stack is not clean, because they included my fork of GDM's greeter, which is GPL licensed. My words about IBM was in general . I can't tell anything about their models, because I didn't see mention of "The Stack", and I don't know what their models are based on. O…

[deleted]

Re: IBM Granite: A Family of Open Foundation Models for Code Intelligence

#70

Post by hustwindmaple1 »

kkielhofner wrote: post #42
breezeTrowel wrote: post #40

Earlier quoted context omitted.

These are open weight models released under an Apache 2.0 license. There's nothing to buy.

IBM is a sales and services org. Their customers aren’t going to build their own RAG and agent frameworks, vector DBs, data ingest pipelines, finetunes, high scale inference serving solutions, etc, etc. There’s an incredible amount of stuff to buy.

Right, but they can just use Llama/Mistral for free, instead of their inferior models, which I'm sure take quite a bit of resources to train in the first place.
Post reply on HN