Forget ChatGPT: why researchers now run small AIs on their laptops

Post by oneshtein » Sun, Sep 22, 2024, 9:45 AM UTC

pimeys wrote: post #110

Has anybody found a good way to utilize ollama with an editor such as zed to do things like "generate rustdoc to this method" etc. I use ollama daily for a ton of things, but for code generation, completion and documentation 4o is still much better than any of the local models...

  /// An enum representing possible errors during CRUD operations.
  #[derive(Error, Debug)]
  enum CrudError {
    /// Indicates an error occurred while interacting with the SQLite database.
    /// 
    /// This variant wraps a `rusqlite::Error`, providing details about the specific SQLite error.
    #[error("SQLite error: {0}")]
    SqliteError(rusqlite::Error),

    /// Indicates an error related to input/output operations.
    /// 
    /// This variant wraps a `std::io::Error`, giving information about the specific IO problem encountered.
    #[error("IO error: {0}")]
    IoError(std::io::Error),
  }

Post by cl3misch » Sun, Sep 22, 2024, 10:37 AM UTC

whatindaheck wrote: post #287

schmidtleonard wrote: post #109

Earlier quoted context omitted.

Button-toggled voice notes in the iPhone Notes app are a godsend for taking measurements. Rather than switching your hands between probe/equipment and notes repeatedly, which sucks badly, you can just dictate your readings and maaaaybe clean out something someone said in the background. Over the last decade, the microphones + speech recognition became Good Enough for this. Wake-word/endpoint models still aren't there…

> Button-toggled voice notes in the iPhone Notes app Is this a physical button or on-screen? I’ve been rewatching Twin Peaks recently and would love a high-tech implementation of Cooper’s tape recorder.

Post by bluerooibos » Sun, Sep 22, 2024, 11:15 AM UTC

draebek wrote: post #254

toddmorey wrote: post #102

I narrate notes to myself on my morning walks[1] and then run whisper locally to turn the audio into text... before having an LLM clean up my ramblings into organized notes and todo lists. I have it pretty much all local now, but I don't mind waiting a few extra seconds for it to process since it's once a day. I like the privacy because I was never comfortable telling my entire life to a remote AI company. [1] It fee…

For people on macOS, the free app Aiko on the App Store makes it easy to use Whisper, if you want a GUI: https://sindresorhus.com/aiko

Post by [deleted] » Sun, Sep 22, 2024, 11:24 AM UTC

unethical_ban wrote: post #175

vunderba wrote: post #170

Earlier quoted context omitted.

If you're gonna go with a VS code extension and you're aiming for privacy, then I would at least recommend using the open source fork VS Codium. https://vscodium.com/

It is true that VS Code has some non-optional telemetry, and if VS Codium works for people, that is great. However, the telemetry of VSCode is non-personal metrics, and some of the most popular extensions are only available with VSCode, not with Codium.

Post by ENGNR » Sun, Sep 22, 2024, 11:27 AM UTC

qwezxcrty wrote: post #229

unethical_ban wrote: post #175

Earlier quoted context omitted.

It is true that VS Code has some non-optional telemetry, and if VS Codium works for people, that is great. However, the telemetry of VSCode is non-personal metrics, and some of the most popular extensions are only available with VSCode, not with Codium.

From the documentation ( https://code.visualstudio.com/docs/getstarted/telemetry ) it seems there is a supported way to completely turn off telemetry. Is there something else in VSCode that doesn't respect this setting?