Gemma 3 270M: Compact model for hyper-efficient AI
developers.googleblog.com
Gemma 3 270M: Compact model for hyper-efficient AI
1–10 of 325 posts
Re: Gemma 3 270M: Compact model for hyper-efficient AI
#2Hi all, I built these models with a great team. They're available for download across the open model ecosystem so give them a try! I built these models with a great team and am thrilled to get them out to you.
From our side we designed these models to be strong for their size out of the box, and with the goal you'll all finetune it for your use case. With the small size it'll fit on a wide range of hardware and cost much less to finetune. You can try finetuning them yourself in a free colab in under 5 minutes
For picking a Gemma size this is a video I recorded for the 1b to 27b sizes earlier this year, 270m being the newest addition
https://www.youtube.com/watch?v=qcjrduz_YS8
Hacker News Disclaimer I really like working at Google so with that; All my opinions here are my own, I'm a researcher so I'll largely focus on technical questions, and I'll share what I can.
Re: Gemma 3 270M: Compact model for hyper-efficient AI
#3Hi all, I built these models with a great team. They're available for download across the open model ecosystem so give them a try! I built these models with a great team and am thrilled to get them out to you. From our side we designed these models to be strong for their size out of the box, and with the goal you'll all finetune it for your use case. With the small size it'll fit on a wide range of hardware and cost…
How does the 270 perform with coding?
I use Gemma27b currently with a custom agent wrapper and its working pretty well.
Re: Gemma 3 270M: Compact model for hyper-efficient AI
#4I’ve had great luck with all gemma 3 variants, on certain tasks it the 27B quantized version has worked as well as 2.5 flash. Can’t wait to get my hands dirty with this one.
Re: Gemma 3 270M: Compact model for hyper-efficient AI
#5This is cool. I'm looking forward to trying it - I wonder what it'll be useful for.
Re: Gemma 3 270M: Compact model for hyper-efficient AI
#6Hi all, I built these models with a great team. They're available for download across the open model ecosystem so give them a try! I built these models with a great team and am thrilled to get them out to you. From our side we designed these models to be strong for their size out of the box, and with the goal you'll all finetune it for your use case. With the small size it'll fit on a wide range of hardware and cost…
Awesome work! I’m really bullish on small models and think they have the most potential to change our daily lives. Can’t wait to play around with this
Re: Gemma 3 270M: Compact model for hyper-efficient AI
#7Never thought I'd run an LLM released in 2025, on my phone, in full BF16.
With ~80tps on an iPhone 16 pro btw.
Re: Gemma 3 270M: Compact model for hyper-efficient AI
#8Hi all, I built these models with a great team. They're available for download across the open model ecosystem so give them a try! I built these models with a great team and am thrilled to get them out to you. From our side we designed these models to be strong for their size out of the box, and with the goal you'll all finetune it for your use case. With the small size it'll fit on a wide range of hardware and cost…
How does the 270 perform with coding? I use Gemma27b currently with a custom agent wrapper and its working pretty well.
I’d be stunned if a 270m model could code with any proficiency.
If you have an iPhone with the semi-annoying autocomplete that’s a 34m transformer.
Can’t imagine a model (even if it’s a good team behind it) to do coding with 8x the parameters of a next 3/4 word autocomplete.
Re: Gemma 3 270M: Compact model for hyper-efficient AI
#9Hi all, I built these models with a great team. They're available for download across the open model ecosystem so give them a try! I built these models with a great team and am thrilled to get them out to you. From our side we designed these models to be strong for their size out of the box, and with the goal you'll all finetune it for your use case. With the small size it'll fit on a wide range of hardware and cost…
Great job. Do you know how well it performs in sanity checks with NER since it is on the press release page?
Re: Gemma 3 270M: Compact model for hyper-efficient AI
#10Never thought I'd run an LLM released in 2025, on my phone, in full BF16. With ~80tps on an iPhone 16 pro btw.
How do you actually run this on an iPhone?