Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

iTerm2 3.5.0

iterm2.com

Post reply on HN
Print view View original

81–90 of 167 posts

Re: iTerm2 3.5.0

#81

Post by soraminazuki »

jchoelt wrote: post #66

It's a shame their "OpenAI" integration doesn't let you specify the Base URL and model. Then it could have worked locally with ollama (or with any other OpenAI compatible API if that matters: mistral, groq, ...) It's a bit of a shame to see an open source product makes an "OpenAI" only integration when they could have make it work with minimal effort with the free and open alternatives (ignorance maybe). Hopefully I…

Settings > Advanced > Experimental Features > URL for AI API

https://gitlab.com/gnachman/iterm2/-/blob/master/sources/iTe...

Re: iTerm2 3.5.0

#82

Post by flohofwoe »

joshstrange wrote: post #70
flohofwoe wrote: post #42

I'm really disappointed that iTerm2 is adding AI gimmicks :/ Last place I want that crap integrated is in the terminal. Next disappointment is that there's no obvious checkbox for disabling it.

Are you joking? Just don’t put in an API key and it will never do anything AI related. People getting all up in arms over an optional feature…

The Settings dialog is not at all clear about whether the AI features are enabled or disabled. The only indicator is an empty OpenAI Key text entry field and that also doesn't say that the feature isn't activated unless a key is provided (e.g. I would assume that the OpenAI REST API is free until some quota is exhausted?)

Re: iTerm2 3.5.0

#83

Post by flohofwoe »

MissTake wrote: post #63
flohofwoe wrote: post #42

I'm really disappointed that iTerm2 is adding AI gimmicks :/ Last place I want that crap integrated is in the terminal. Next disappointment is that there's no obvious checkbox for disabling it.

Because it’s not enabled by default? One has to not only enable it but also provide an API key first. I’m failing to see how “off by default” is a worse option here…

I haven't found a checkbox or anything similar to clearly enable/disable the feature.

There's an empty API key text field and a prepopulated OpenAI URL. It's not clear at all that an empty API key means that no requests will be made.

Re: iTerm2 3.5.0

#84

Post by ogotai »

joshstrange wrote: post #75

The comments in this thread are depressing, I expected much better from HN. The AI features are but 1 minor aspect of this release, they are optional, you can change the URL to point to a local LLM, yet people are pretending like all your data is going to be sent to OpenAI if you update. I’m not sure if people are being intentionally daft or are just not reading anything past the word “AI” (which, again, isn’t even l…

Depends on the vantage point. Have you worked in any regulated industries? I can see iTerm joining internal software ban lists because of its AI integration (even if it's off by default).

Security departments of these corps are constantly pleading with their staff to "please stop sharing corp data with LLMs, you're not allowed to do that", all the while staff feel under pressure to deliver faster, and reaching for whatever tools are available.

The temptation to use it will be irresistible to many, especially juniors/temps competing for limited positions and promotions.

From a regulated corp point of view, why would they risk it, and rely on individual staff conscience, knowledge, and ability to estimate risk? Better to neutralise the risk from the outset by banning use of the software. Plenty of other terminals where this can't be enabled at all by any over-excited staff.

Re: iTerm2 3.5.0

#85

Post by flohofwoe »

pdpi wrote: post #62
swiftcoder wrote: post #46

Earlier quoted context omitted.

I don't think "it's fine, I unchecked the OpenAI checkbox" is going to make my HIPAA/SOC2 auditor very happy

You don't "uncheck the OpenAI checkbox". You check the box if you want to use it, and you provide an API key. Hooking genAI up to your terminal is sort of one of the obvious use cases for this tech, and they're just providing you with the hooks to use it if you like. As much as I dislike the current trend of "AI ALL THE THINGS", I don't think supporting it as a completely optional feature is in any way problematic.

> You don't "uncheck the OpenAI checkbox". You check the box if you want to use it

There is no checkbox for that, at least I can't find any and I've been looking quite hard.

There is:

- a text input field for the OpenAI API key (by default empty)

- a text input field named "AI Prompt"

- a "Model" dropdown (which doesn't have a "None" option)

- ...and a Token Limit number input field

...that's it. It also doesn't say anywhere that the key field being empty means that the feature is disabled.

A better UI design would have been a checkbox at the top that's disabled by default, and all the detailed UI fields being greyed out and disabled until that checkbox is enabled.

Re: iTerm2 3.5.0

#86

Post by hiyer »

swiftcoder wrote: post #32

So what are the good Mac-centric alternatives for folks who don't want OpenAI snooping around their terminal? Warp already went all-in on AI and cloud, now iTerm headed down that same path. Alacritty? Kitty? Hyper?

Wezterm is pretty good. There's little to choose between the two, but I use wezterm because it's cross-platform and I like to have the same experience on Mac and Linux.

Re: iTerm2 3.5.0

#87

Post by joshstrange »

flohofwoe wrote: post #82
joshstrange wrote: post #70

Earlier quoted context omitted.

Are you joking? Just don’t put in an API key and it will never do anything AI related. People getting all up in arms over an optional feature…

The Settings dialog is not at all clear about whether the AI features are enabled or disabled. The only indicator is an empty OpenAI Key text entry field and that also doesn't say that the feature isn't activated unless a key is provided (e.g. I would assume that the OpenAI REST API is free until some quota is exhausted?)

The iTerm release notes clearly spell out that you need a key to make this feature work.

I guess if you knew nothing about iTerm2, OpenAI, or the myriad of open source tools that use OpenAI and/or are compatible with its API structure (aka, can use something like ollama/LMStudio/etc) you could think that there was some free tier or iTerm2 was footing the bill for the first X requests. Having used iTerm2 for many years and knowing how these types of features work (and knowing OpenAI itself doesn’t have a free tier) it was immediately clear that this was a “bring your own key”-type feature and a “it’s not going to do anything unless you supply a key”.

Re: iTerm2 3.5.0

#88

Post by klaustopher »

jchoelt wrote: post #67
terhechte wrote: post #20

Earlier quoted context omitted.

You can set a custom URL to use Ollama which is OpenAI API compatible. Llama3 8b runs quite fast for me on a M1 Max. I'll be making use of this feature I think (haven't tried it yet).

No, unfortunately it's not possible to set a custom URL... OpenAI is either hard coded or using a configuration option that isn't exposed.

Advanced settings -> "URL for AI API"

Re: iTerm2 3.5.0

#89

Post by jarpineh »

jchoelt wrote: post #67
terhechte wrote: post #20

Earlier quoted context omitted.

You can set a custom URL to use Ollama which is OpenAI API compatible. Llama3 8b runs quite fast for me on a M1 Max. I'll be making use of this feature I think (haven't tried it yet).

No, unfortunately it's not possible to set a custom URL... OpenAI is either hard coded or using a configuration option that isn't exposed.

It is exposed from Advanced tab under "URL for AI API". You do have to change the model name from the preselected and offered OpenAI GPT model names. Otherwise this AI API URL isn't used. Haven't yet tested with local OAI compatible model yet, though, but did manage to break it using bad address :)

Re: iTerm2 3.5.0

#90

Post by flohofwoe »

megatavu wrote: post #74
swiftcoder wrote: post #32

So what are the good Mac-centric alternatives for folks who don't want OpenAI snooping around their terminal? Warp already went all-in on AI and cloud, now iTerm headed down that same path. Alacritty? Kitty? Hyper?

Nothing in the changelog indicated that “OpenAI is now snooping around”. There is an optional feature that you need to set up yourself if you want to use it. Why do you feel like you need to deliberately misunderstand the post as soon as you read the term “AI” somewhere?

None of that is remotely clear when updating through the iTerm2 auto-update popup for a minor version update.

The Preferences panel doesn't have a single indicator which says whether the AI integration is activated or not. It's probably just bad UI design and not mischief, but I was instantly put off by what initially looked like a dark pattern.

PS: even the changelog doesn't explicitly state that the feature is disabled by default, only indirectly by stating that one needs an OpenAI key because requests cost money.

Post reply on HN