Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Apple/OpenELM: Efficient Open-Source Family Language Models

huggingface.co

Post reply on HN
Print view View original

11–16 of 16 posts

Re: Apple/OpenELM: Efficient Open-Source Family Language Models

#11

Post by vulcan01 »

orra wrote: post #9
orra wrote: post #8

Earlier quoted context omitted.

I presume they're releasing it because they traibed it using the just-announced CoreNet library. However, the model is proprietary. I'm tired of the open washing.

I retract the claim of proprietary. I misunderstood some of the licence wording. The license appears to be well accepted as a permissive open source license. https://spdx.org/licenses/AML.html

Yep, AML is basically MIT + some stuff about patents. One wonders why they do not use the Apache license instead.

Re: Apple/OpenELM: Efficient Open-Source Family Language Models

#13

Post by SushiHippie »

vineyardmike wrote: post #12
sunflowerfly wrote: post #10

Any idea how much ram this requires?

The model sizes are: > 270M, 450M, 1.1B and 3B parameters Which roughly translates to 3GB for the highest end one, depending on context length used.

* ~3GB with 8bit quantization. Without quantization it is ~6GB [0].

8 bits = 1 byte

3 billion * 1 byte = 3 gigabyte

+ Some memory for the context of the LLM

[0]

3b-instruct has a total file size of 4.94GB + 1.13GB which is 6.07GB which can be seen here:

https://huggingface.co/apple/OpenELM-3B-Instruct/tree/main

A bit of overhead will always be there, as you probably want to store some metadata next to the raw weights.

Re: Apple/OpenELM: Efficient Open-Source Family Language Models

#16

Post by Roshni1990r »

OpenELM, a family of Efficient Language Models Developed by Apple, is trending on Hugging Face!

OpenELM offers models with 270M to 3B parameters, pre-trained and instruction-tuned, with Good results across various benchmarks.

My Feedback:

First Phi 3, now OpenELM. It's great to see these small models improving. I know they're not ready for production in all cases, but they're really great for specific tasks.

I see small open-source models as the future because they offer better speed, require less compute, and use fewer resources, making them more accessible and practical for a wider range of applications.

What do you think about this? Do you consider using small opensource. If yes what you are thinking to make?

I am going to use it on my smartphone

Post reply on HN