Show HN: A macOS Client for HuggingFace Chat • Hacker News Board

Re: Show HN: A macOS Client for HuggingFace Chat

#11

Post by archiv » Wed, Oct 23, 2024, 8:04 PM UTC

isodev wrote: post #10

archiv wrote: post #9

Earlier quoted context omitted.

Yes but you now have the ability to run queries with a shortcut from your Mac, as well as switch to a local model using a dedicated keyboard shortcut. See demo: https://x.com/cyrilzakka/status/1838618605648490974

Sorry, this link is not accessible for me. It would be nice to add some more information to the repo’s readme.

@isodev sorry about that! Just uploaded a video to the README

Re: Show HN: A macOS Client for HuggingFace Chat

#12

Post by rahimnathwani » Wed, Oct 23, 2024, 8:08 PM UTC

Slightly off topic: some of the tools in HuggingChat don't work, even one of the official ones (Image Editor):

  Error calling tool Image Editor
  Parameters
  image: output_2_0.webp
  prompt: add a smiling emoji
  Error
  An error occurred while calling the tool edit_image: No API found


  Error calling tool TTS (fast)
  Parameters
  text: hello
  description: Laura's voice is monotone yet slightly fast in delivery, with a very close recording that almost has no background noise.
  Error
  An error occurred while calling the tool gen_tts_fast: Error: Error: Could not resolve app config.

Re: Show HN: A macOS Client for HuggingFace Chat

#13

Post by Mystery-Machine » Wed, Oct 23, 2024, 9:13 PM UTC

I'm using Raycast AI (paid subscription) to interact with AI models through the use of hotkeys. It can even act upon selected text. I've got several hotkeys set up: - translate (selected text) to English/Spanish/Italian (3 hotkeys) - fix (selected text) English/Spanish/Italian grammar (3 hotkeys) - add (selected text) to current chat prompt where I can continue typing

There's also a built-in "Summarize webpage" AI action that I assigned a hotkey to and I can get a nice summary of the currently opened webpage without having to read the whole article.

These save me so much time and help me better my language skills. Especially when fixing grammar. When fixing grammar, it shows you the diff so you can see what you wrote incorrectly and how to write it correctly.

It also allows you to paste the text, from the app window into the last used app simply by pressing ENTER. I also use this a lot.

Just some feedback.

Re: Show HN: A macOS Client for HuggingFace Chat

#14

Post by talldayo » Wed, Oct 23, 2024, 9:34 PM UTC

SimianSci wrote: post #7

Id personally be interested to know how this compares to a solution such as Ollama, which I have been using to run local models.

Linux users have a pretty excellent native Ollama client called Alpaca, it's well worth checking out: https://flathub.org/apps/com.jeffser.Alpaca

It's still early in development but supports multimodal and some nice looking code blocks.

Re: Show HN: A macOS Client for HuggingFace Chat

#15

Post by Sidnicious » Wed, Oct 23, 2024, 10:28 PM UTC

archiv wrote: post #9

isodev wrote: post #8

What does it do? Isn’t HuggingChat already available as a dedicated web app ( https://huggingface.co/chat/ )?

Yes but you now have the ability to run queries with a shortcut from your Mac, as well as switch to a local model using a dedicated keyboard shortcut. See demo: https://x.com/cyrilzakka/status/1838618605648490974

Would it be possible to let you run local models without an account?

Re: Show HN: A macOS Client for HuggingFace Chat

#16

Post by privacyis1mp » Wed, Oct 23, 2024, 11:23 PM UTC

Congrats! I noticed it was initially closed-source and now it's opened, nice! Is it a project funded by HuggingFace? (Not immediately clear to me).

I've built a macOS assistant too (more advanced though), with focus on privacy and easy of use (https://getfluid.app). I'd love to open-source it, but not sure about sustainability of such business model. Right now I'm experimenting with a fully private paid Llama hosting (for GPU poors).

Good luck :)