Do we need OpenAI for this? Can’t we have an LLM sitting locally work?
Scramble: Open-Source Alternative to Grammarly
141–150 of 174 posts
Re: Scramble: Open-Source Alternative to Grammarly
#142Earlier quoted context omitted.
Well, as we see with AI applications like "Leo AI" and "Continue", using a locally run LLM can be fantastic replacements for proprietary offerings.
FWIW I’ve found local models to be essentially useless for coding tasks.
Really? Maybe your models are too small?
Re: Scramble: Open-Source Alternative to Grammarly
#143One strong point of Grammarly comes from its friendly display of diffs (which is somewhat similar to what Cursor does).
This project simply uses some predefined prompts to generate text and then replaces it. There are countless plugins that can achieve this, such as the OpenAI translator.
If this tool really wants to compete with Grammarly.
Re: Scramble: Open-Source Alternative to Grammarly
#144Earlier quoted context omitted.
> But if I had to get into the underlying structure, I could. How do you propose to get into the underlying structure of the OpenAPI API? Breach their network and steal their code and models? I don't understand what you're arguing.
> How do you propose to get into the underlying structure of the OpenAPI API? The fact that you can’t is the point of the comment. You could get into the underlying structure of other things , like the C interpreter of a scripting language.
But what about the microcode inside the CPU?
Re: Scramble: Open-Source Alternative to Grammarly
#145Earlier quoted context omitted.
Without marketing speak can I ask why anyone would have a need for a service like grammerly, I always thought it was odd trying to sell a subscription based spell checker (AI is just a REALLY good spell checker).
Without marketing speak, can I ask why anyone would have a need for a service like Grammarly? --- Manual corrections here, but maybe they give a clue?
They aren't a native English speaker and would like a hand with phrasing.
Re: Scramble: Open-Source Alternative to Grammarly
#146I have been using LanguageTool[1] for years as "an open source alternative to [old school] Grammarly". It doesn't do that fancy "make this text more professional" AI stuff like this or Grammarly can now do, but they offer a self-hosted version so you don't need to send everything you write to OpenAI. If all you want is a better spelling/grammar checker, I highly recommend it. [1] - https://github.com/languagetool-org…
You can also run your own local instance for the in-browser checking, which is handy for me as I need to be careful about sending text off to another company in another country (due to both client security requirements and personal paranoia!). You don't get the AI based extras like paraphrasing, and the other bits listed in as premium only ( https://languagetool.org/premium_new ), but if you install the n-gram DB for…
Replying to self as I'm too late to edit: I left the wrong link for ngram info, the download location instead of the instructions for use which are at https://dev.languagetool.org/finding-errors-using-n-gram-dat...
Re: Scramble: Open-Source Alternative to Grammarly
#147Earlier quoted context omitted.
You can also run your own local instance for the in-browser checking, which is handy for me as I need to be careful about sending text off to another company in another country (due to both client security requirements and personal paranoia!). You don't get the AI based extras like paraphrasing, and the other bits listed in as premium only ( https://languagetool.org/premium_new ), but if you install the n-gram DB for…
I've downloaded 'ngrams-en-20150817'. Please drop link that can teach me how to apply ngrams file. Thanks.
I dropped the wrong link in the original post. The instructions for use are at https://dev.languagetool.org/finding-errors-using-n-gram-dat...
Re: Scramble: Open-Source Alternative to Grammarly
#148People really should stop calling a glorified openAI API as an open-source software.
[deleted]
Re: Scramble: Open-Source Alternative to Grammarly
#149Re: Scramble: Open-Source Alternative to Grammarly
#150Earlier quoted context omitted.
I don't think the point here should be the cost, but the fact that you are sending everything you write to OpenAI to train their models on your information. The option of a local model allows you to preserve the privacy of what you write. I like that.
Openai does not train models on data that comes in from the API. https://openai.com/policies/business-terms/
Assuming for the moment that they aren't saying that with their fingers crossed behind their back, that doesn't change the fact that they store the inputs they receive and swear they'll protect it (Paraphrasing from the Content section of the above link). Even if it's not fed back into the LLM, the fact that they store the inputs anywhere for a period of time is a huge privacy risk -- after all a breach is a matter of "when", not "if".