Live data from Hacker News

ChatGPT Pro

openai.com

301–310 of 1001 posts

Re: ChatGPT Pro

#301

Question, what stops openai from downgrading existing models so that you're pushed up the subscription tiers to ever more expensive models? I'd imagine they're currently losing a ton of money supplying everyone with decent models with a ton of compute behind them because they want us to become addicted to using them right? The fact that classic free web searching is becoming diluted by low quality AI content will mak…

competition is what stops them from downgrading the existing stuff

Re: ChatGPT Pro

#302
post #221

Earlier quoted context omitted.

If a model is good enough (I’m not saying this one is that level) I could imagine individuals and businesses paying 20,000 a month. If they’re answering questions at phd level (again, not saying this one is) then for a lot of areas this makes sense

Let me know when the models are actually, verifiably, this good. They're barely good enough to replace interns at this point.

Let me know what kind of intern you can keep around 24/7 for a total monthly outlay of $200, and then we can compare notes.

Re: ChatGPT Pro

#303

Earlier quoted context omitted.

Am I wrong that Anthropic doesn't really have a match yet to ChatGPT's o1 model (a "reasoning" model?)

Is a "reasoning" model really different? Or is it just clever prompting (and feeding previous outputs) for an existing model? Possibly with some RLHF reasoning examples? OpenAI doesn't have a large enough database of reasoning texts to train a foundational LLM off it? I thought such a db simply does not exist as humans don't really write enough texts like this.

It's trained via reinforcement learning on essentially infinite synthetic reasoning data. You can generate infinite reasoning data because there are infinite math and coding problems that can be created with machine-checkable solutions, and machines can make infinite different attempts at reasoning their way to the answer. Similar to how models trained to learn chess by self-play have essentially unlimited training data.

Re: ChatGPT Pro

#304
Price doesn't make any sense in the context of nothing between $20 and $200 (unless you just use the API directly which for a large subset of people would be very inconvenient). Assuming they didn't change the limit from o1-preview to o1 of 50 a week it's obnoxious to not easily have an option to just get 100 a week for $40 a month or after you hit 50 just pay per request. When I last looked at API pricing for o1-preview I estimated most of my request/responses were around 8 cents. 50 a week is actually more than it sounds as long as you just don't default to o1 for all interactions and use it more strategically. If you pay for $20 a month plan and spent the other $180 on api o1 responses that is likely more than 2000 additional queries. Not sure what subset of people this $200 plan is good value for (60+ o1 queries, or really just all chatGPT queries) every day is an awful lot outside of a scenario where you are using it as an API for some sort of automated task.

Re: ChatGPT Pro

#305

Question, what stops openai from downgrading existing models so that you're pushed up the subscription tiers to ever more expensive models? I'd imagine they're currently losing a ton of money supplying everyone with decent models with a ton of compute behind them because they want us to become addicted to using them right? The fact that classic free web searching is becoming diluted by low quality AI content will mak…

competition?

Re: ChatGPT Pro

#306

Question, what stops openai from downgrading existing models so that you're pushed up the subscription tiers to ever more expensive models? I'd imagine they're currently losing a ton of money supplying everyone with decent models with a ton of compute behind them because they want us to become addicted to using them right? The fact that classic free web searching is becoming diluted by low quality AI content will mak…

It's definitely not impossible. I think the increase competition they've begun to face over the last year is helping as a deterrent. If people notice GPT 4 sucks now and they can get Claude 3.5 Sonnet for the same price, they'll move. If the user doesn't care enough to move, they weren't going to upgrade anyway.

Re: ChatGPT Pro

#307

Earlier quoted context omitted.

>Whether LLM's help you at your work is extremely domain-dependent. I really doubt that, actually. The only thing that LLMs are truly good for is to create plausible-sounding text. Everything else, like generating facts, is outside of its main use case and known to frequently fail.

That opinion made sense two years ago. It's plain weird to still hold it today.

There was a study recently that made it clear the use of LLMs for coding assistance made people feel more productive but actually made them less productive.

EDIT: Added links.

https://www.cio.com/article/3540579/devs-gaining-little-if-a...

https://web.archive.org/web/20241205204237/https://llmreport...

(Archive link because the llmreporter site seems to have an expired TLS certificate at the moment.)

No improvement to PR throughput or merge time, 41% more bugs, worse work-life balance...

Re: ChatGPT Pro

#309

Earlier quoted context omitted.

Or Anthropic will follow suit.

Am I wrong that Anthropic doesn't really have a match yet to ChatGPT's o1 model (a "reasoning" model?)

Claude Sonnet 3.5 has outperformed o1 in most tasks based on my own anecdotal assessment. So much so that I'm debating canceling my ChatGPT subscription. I just literally do not use it anymore, despite being a heavy user for a long time in the past

Re: ChatGPT Pro

#310

Earlier quoted context omitted.

> In other words, it's a con. A con like that wouldn't last very long. This is for people who rely enough on ChatGPT Pro features that it becomes worth it. Whether they pay for it because they're freelance, or their employer does. Just because an LLM doesn't boost your productivity, doesn't mean it doesn't for people in other lines of work. Whether LLM's help you at your work is extremely domain-dependent.

I think this is probably right but so far it seems that the areas in which an LLM is most effective do fine with the lower power models. Example: the 4o or Claude are great for coding, summarizing and rewriting emails. So which domains require a slightly better model? I suppose if the error rate in code or summary goes down even 10%, it might be worth $180/month.

I bet users won't pay for the power, but for a guarantee of access! I always hear about people running out of compute time for ChatGPT. Obvious answer is charge more for a higher quality service.
Post reply on HN