Are there any AI speech-to-text model that can run locally on Mobile devices?

Post by imshashank » Tue, Jun 04, 2024, 9:39 AM UTC

Post by imshashank » Tue, Jun 04, 2024, 10:30 AM UTC

jaggs wrote: post #2

Layla Lite? App.

Post by jaggs » Tue, Jun 04, 2024, 10:44 AM UTC

imshashank wrote: post #3

jaggs wrote: post #2

Layla Lite? App.

Wow, so it's possible. Any idea how are they doing this?

Post by imshashank » Sat, Jun 08, 2024, 10:50 AM UTC

jaggs wrote: post #5

imshashank wrote: post #3

Earlier quoted context omitted.

Wow, so it's possible. Any idea how are they doing this?

Maybe a really tiny LLM? Like this? https://huggingface.co/openbmb/MiniCPM-Llama3-V-2_5-gguf/blo... [Edit: just checked Reddit and it's apparently a 3B model (phi 2)] https://www.reddit.com/r/LocalLLaMA/comments/1bpw9c7/running...