Earlier quoted context omitted.
Does it work in "not a browser" though? Because that's the last place I need this, I really want this in Typora, VS Code, etc. instead.
Not right now. Looking into a mac app. This was just a quick and dirty first go at it.
Scramble: Open-Source Alternative to Grammarly
151–160 of 174 posts
Re: Scramble: Open-Source Alternative to Grammarly
#152They proclaim "privacy-respecting" but all your keystrokes go to OpenAI. Horrific and genuinely upsetting. Edit: The author replied to another comment that there is an intent to add local AI. If that is the plan, then fix the wording until it can actually be considered privacy-respecting: https://news.ycombinator.com/item?id=41579144
Lol, this was my second thought immediately after my first, which was one of excitement. Hope the author does add a option for local. Wonder how that would work as a Chrome extension. Doesn't seem like a good idea for extensions to be accessing local resources though.
To the best of my knowledge all localhost connections are exempt from CORS and that's in fact how the 1Password extension communicates with the desktop app. I'd bet Bitwarden and KeePassXC behave similarly
Re: Scramble: Open-Source Alternative to Grammarly
#153Grammarly is a lifesaver for my day-to-day writing. All it does is correct spelling and punctuation or give rephrase suggestions. But Grammarly does it so unreasonably well that nothing else compares. Grammarly's core functionality is not even LLM-based; it's older than that. Recently, they've crammed in some LLM features that I don't care a snoot about compared to its core functionality. This tool, like any other "G…
Re: Scramble: Open-Source Alternative to Grammarly
#154For me the huge part of Grammarly's magic is that it's not just in the browser, but in any text input on desktop with their desktop app (with some exceptions). Having it only in only in one application just doesn't cut it, especially since it's not my browser of choice. Are there any plans regarding desktop integration. Linux is woefully underserved in this space with all major offerings (Grammarly, Languagetool) hav…
I have developed a system-wide writing assistant like you're describing. By design, it has no exceptions to where it works. Currently, it's only for Mac, but I'm working on an Electron version too (though it's quite challenging). Check out https://steerapp.ai/
Re: Scramble: Open-Source Alternative to Grammarly
#155Earlier quoted context omitted.
FWIW I’ve found local models to be essentially useless for coding tasks.
Really? Maybe your models are too small?
While I don't think they're completely useless (though its close), calling them fantastic replacements feels like an egregious overstatement of their value.
EDIT: Also wanted to note that I think this becomes as much an expectations-setting exercise as it is evaluation on raw programming performance. Some people are incredibly impressed by the ability to assist in building simple web apps, others not so much. Experience will vary across that continuum.
Re: Scramble: Open-Source Alternative to Grammarly
#156Earlier quoted context omitted.
> How do you propose to get into the underlying structure of the OpenAPI API? The fact that you can’t is the point of the comment. You could get into the underlying structure of other things , like the C interpreter of a scripting language.
But what about the microcode inside the CPU?
Re: Scramble: Open-Source Alternative to Grammarly
#157Re: Scramble: Open-Source Alternative to Grammarly
#158Re: Scramble: Open-Source Alternative to Grammarly
#159Re: Scramble: Open-Source Alternative to Grammarly
#160They proclaim "privacy-respecting" but all your keystrokes go to OpenAI. Horrific and genuinely upsetting. Edit: The author replied to another comment that there is an intent to add local AI. If that is the plan, then fix the wording until it can actually be considered privacy-respecting: https://news.ycombinator.com/item?id=41579144
Edit the 'background.js' file in the extension and replace the openAI endpoint with
'http://your.local.ip.addr:5001/v1/chat/completions'
Set anything you want as an API key. Now you have a truly local version.
* https://github.com/LostRuins/koboldcpp/releases
* https://huggingface.co/bartowski/Meta-Llama-3.1-8B-Instruct-...
* https://github.com/LostRuins/koboldcpp/blob/concedo/kcpp_ada...