Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

InternLM – new open source 7B LLM

github.com

Post reply on HN
Print view View original

61–70 of 93 posts

Re: InternLM – new open source 7B LLM

#61

Post by seanhunter »

cubefox wrote: post #24
gnrlst wrote: post #3

Is this also censored/nerfed? I'd love to play with a "raw" unnerfed model to fully grasp what an LLM can do (and see how biased it is). Does anyone have any recommendations for unnerfed models to try out?

The most powerful available foundation model is code-davinci-002, a.k.a. GPT-3.5. It's only available on Azure since OpenAI removed it from their own Playground and API for some reason.

All 3 text-davinci models are available on openAI's api. including 3 (which is the GPT-3.5 gen). Code-davinci-002 is a code-tuned model, You can see a nice visual summary of the relationships between the openAI models at https://yaofu.notion.site/How-does-GPT-Obtain-its-Ability-Tr...

Or the official source is https://platform.openai.com/docs/model-index-for-researchers

Re: InternLM – new open source 7B LLM

#62

Post by getmeinrn »

ohgodplsno wrote: post #51
version_five wrote: post #36

Earlier quoted context omitted.

So you don't use open source software? You should try it, there's a great ecosystem of free software, including lots written by academics who are happy to have their work add value to industry

I do. And I also don't use open-source software with a commercial license for my job, because I respect the wishes of the author. It doesn't make the projects, tools and libraries any less good. OP is just looking to quickly cash in to something he didn't put an ounce of effort in. AGPL & Dual-licensing are the way forward, because of leeches.

The entitlement and audacity of people who consume open source blows me away. I've maintained a project for 12 years and recently someone wanted me to help them implement the software in their system. I politely told them that since this wasn't a bug, they would need to purchase a support package. They then accused me of trying to "sell open source software" and closed the issue. People are unbelievable. Fuck me for trying to make a living providing you personal development time, using my software that I've supported for free for over a decade.

Re: InternLM – new open source 7B LLM

#63

Post by brucethemoose2 »

cubefox wrote: post #41
cubefox wrote: post #31

Earlier quoted context omitted.

It is available in the sense that it is accessible. The weights are not available for download of course, but the OP wanted to "play around" with it, for which only access is required. There is no other accessible foundation model that can compete with GPT-3.5.

Why are you guys downvoting me?

Because GPT 3.5 not very good compared to LLaMA 65b or even 33b finetunes, from my testing.

Also because 3.5 is not really available?

Re: InternLM – new open source 7B LLM

#64

Post by brucethemoose2 »

wilonth wrote: post #53
yieldcrv wrote: post #25

why is 7B parameters seemingly a magic number?

7B params would take 14gb of gpu RAM at fp16 precision. So it would be able to run on 16gb GPUs with 2gb to spare for other small things.

But in practice, no one is running inference at FP16. int8 is more like the bare minimum.

Re: InternLM – new open source 7B LLM

#65

Post by seanhunter »

cubefox wrote: post #43
alach11 wrote: post #38

Earlier quoted context omitted.

Maybe you mean gpt-3.5-turbo or text-davinci-003? Or GPT-4 (technically in beta so not fully available to everyone)?

No, those are all fine-tuned models which are "nerfed" in the terminology of the OP. I mean code-davinci-002, the GPT-3.5 base model.

code-davinci models are finetuned on code so I don't think that's what the OP wants. For reference the family tree is here https://platform.openai.com/docs/model-index-for-researchers

Re: InternLM – new open source 7B LLM

#67

Post by squeaky-clean »

cubefox wrote: post #50
squeaky-clean wrote: post #49

Earlier quoted context omitted.

Is that what nerfed means? I usually see "nerfed" used in a way that means that it will refuse to answer certain topics. "I can't answer that as it would violate copyright" and such.

The fine-tuned models are certainly censored and not "raw".

But doesn't code-davinci-002 also have OpenAI's filters in between you and the model?

Re: InternLM – new open source 7B LLM

#68

Post by WoodenChair »

YetAnotherNick wrote: post #47
exizt88 wrote: post #30

Earlier quoted context omitted.

You do understand that academics are usually funded by taxpayers? Obviously, not by me, as I don't pay taxes in China, but it's not like academics are doing this work for free. Society pays them for their work so that it can benefit from its results.

Is there any breakdown of private vs government funding for general purpose academic research. I was under the impression that most of the funds in field like ML come from fees from undergrads and donations by alumnus, or by private companies.

> I was under the impression that most of the funds in field like ML come from fees from undergrads and donations by alumnus, or by private companies.

In the United States, tuition makes up less than 35% of most universities' revenue.[0] Donations are significant, but if we were to just look at research funding, it would mostly be government grants.

"The federal government is by far the largest funder of academic R&D..." [1]

[0] https://nces.ed.gov/programs/coe/indicator/cud [1] https://ncses.nsf.gov/pubs/nsb20202/academic-r-d-in-the-unit...

Re: InternLM – new open source 7B LLM

#69

Post by alach11 »

cubefox wrote: post #43
alach11 wrote: post #38

Earlier quoted context omitted.

Maybe you mean gpt-3.5-turbo or text-davinci-003? Or GPT-4 (technically in beta so not fully available to everyone)?

No, those are all fine-tuned models which are "nerfed" in the terminology of the OP. I mean code-davinci-002, the GPT-3.5 base model.

> I mean... the GPT-3.5 base model

That would be text-davinci-003, I believe.

Re: InternLM – new open source 7B LLM

#70

Post by hutzlibu »

potency wrote: post #58
airgapstopgap wrote: post #11

Note that this is apparently a 7B version of a 104B model trained with the intention of competing with OpenAI offerings on the Chinese market [1]. There is a number of those projects: Baichuan, ChatGLM2, InternLM and some more iirc, and they all have small-scale opensource versions. For what it's worth, I've tried out ChatGLM2-6B and Baichuan converted to LLaMA (the architecture is literally identical in that case).…

I don't know anything about what you're talking about. Where do I start to learn some of the AI terminology, models, benefits and drawbacks of each, etc?

The most patient lecturer would probably be ChatGPT itself ...
Post reply on HN