Live data from Hacker News

Show HN: Code to run Gemma2-2B on a Mac – a powerful model with GPT 3.5 perf

1–3 of 3 posts

Show HN: Code to run Gemma2-2B on a Mac – a powerful model with GPT 3.5 perf

Post by notnotrishi » Thu, Aug 01, 2024, 7:13 PM UTC

I’ve used Gemma2-2B from GDM for a day, and it's a really solid model for its size from my experience. So I built a CLI app for a Mac.

More notes here: https://x.com/notnotrishi/status/1819085403728875557

Show HN: Code to run Gemma2-2B on a Mac – a powerful model with GPT 3.5 perf
github.com

Re: Show HN: Code to run Gemma2-2B on a Mac – a powerful model with GPT 3.5 perf

Post by terryops » Fri, Aug 02, 2024, 4:38 PM UTC

I tried to let it add punctuations to a list of words from asr, but it changes the words no matter how I tweak the prompt. lol.

Re: Show HN: Code to run Gemma2-2B on a Mac – a powerful model with GPT 3.5 perf

Post by notnotrishi » Sat, Aug 03, 2024, 5:50 PM UTC

terryops wrote: post #2

I tried to let it add punctuations to a list of words from asr, but it changes the words no matter how I tweak the prompt. lol.

lol mind sharing an example?

also in case you haven't already, can try with other models too by changing it from the code to see if they do better

Post reply on HN