ChatGPT Pro • Hacker News Board

Re: ChatGPT Pro

#551

Post by Melatonic » Thu, Dec 05, 2024, 10:48 PM UTC

fudged71 wrote: post #482

vessenes wrote: post #461

Earlier quoted context omitted.

Agreed on the strategy questions. It's interesting to tie back to IBM; my first reaction was that openai has more consumer connectivity than IBM did in the desktop era, but I'm not sure that's true. I guess what is true is that IBM passed over the "IBM Compatible" -> "MS DOS Compatible" business quite quickly in the mid 80s; seemingly overnight we had the death of all minicomputer companies and the rise of PC desktop…

The new pricing tier suggests they're taking the Jobs approach - betting that their technology integration and reliability will justify premium positioning. But they face more intense commoditization pressure than either IBM or Apple did, given the rapid advancement of open-source models. The critical question is timing - if they wait too long to establish their enterprise position, they risk being overtaken by commo…

The Apple partnership and iOS integration seems pretty damn big for them - that really corners a huge portion of the consumer market.

Agreed on enterprise - Microsoft would have to roll out policies and integration with their core products at a pace faster than they usually do (Azure AD for example still pales in comparison to legacy AD feature wise - I am continually amazed they do not priorities this more)

Re: ChatGPT Pro

#552

Post by Melatonic » Thu, Dec 05, 2024, 10:49 PM UTC

dudus wrote: post #512

Someone1234 wrote: post #496

Why doesn't Pro include longer context windows? I'm a Plus member, and the biggest limitation I am running into by far is the maximum length of a context window. I'm having context fall out of scope throughout the conversion or not being able to give it a large document that I can then interrogate. So if I go from paying $20/month for 32,000 tokens, to $200/month for Pro, I expect something more akin to Enterprise's…

The longer the context the more backtracking it needs to do. It gets exponentially more expensive. You can increase it a little, but not enough to solve the problem. Instead you need to chunk your data and store it in a vector database so you can do semantic search and include only the bits that are most relevant in the context. LLM is a cool tool. You need to build around it. OpenAI should start shipping these other…

Seems like a good candidate for a "dumb" AI you can run locally to grab data you need and filter it down before giving to OpenAI

Re: ChatGPT Pro

#553

Post by ec109685 » Thu, Dec 05, 2024, 10:50 PM UTC

JCharante wrote: post #176

the first 10 grants = $2000/mo? Seems a bit, odd to even mention

Agreed, feels like virtue signaling.

Re: ChatGPT Pro

#554

Post by Al-Khwarizmi » Thu, Dec 05, 2024, 10:51 PM UTC

A_D_E_P_T wrote: post #445

rahimnathwani wrote: post #433

Earlier quoted context omitted.

Would you mind sharing any favourite example chats?

Give me a prompt and I'll share the result.

I'd like to see how it performs on the test of https://aclanthology.org/2023.findings-emnlp.966/, even though in theory it's no longer valid due to possible data contamination.

The prompt is:

Write an epic narration of a single combat between Ignatius J. Reilly and a pterodactyl, in the style of John Kennedy Toole.

Re: ChatGPT Pro

#555

Post by itissid » Thu, Dec 05, 2024, 10:51 PM UTC

Replacing people can never and should never be the goal of this though. How is that of any use to anyone? It will just create socio economic misery given how the economy functions.

If some jobs do easily get automated away the only way that can be remidied is government intervention on upskilling(if you are in europe you could even get some support), if you are in the US or most developing capitalist(or monopolistic/rent etc) economies its just your bad luck, those jobs WILL be gone or reduced.

Re: ChatGPT Pro

#556

Post by tompetry » Thu, Dec 05, 2024, 10:52 PM UTC

Is the $200 price tag there to simply steer you to the $20 plan rather than the free plan?

Re: ChatGPT Pro

#557

Post by dartos » Thu, Dec 05, 2024, 10:54 PM UTC

gcr wrote: post #549

dudus wrote: post #512

Earlier quoted context omitted.

The longer the context the more backtracking it needs to do. It gets exponentially more expensive. You can increase it a little, but not enough to solve the problem. Instead you need to chunk your data and store it in a vector database so you can do semantic search and include only the bits that are most relevant in the context. LLM is a cool tool. You need to build around it. OpenAI should start shipping these other…

This isn't true. Transformer architectures generally take quadratic time wrt sequence length, not exponential. Architectural innovations like flash attention also mitigate this somewhat. Backtracking isn't involved, transformers are feedforward. Google advertises support for 128k tokens, with 2M-token sequences available to folks who pay the big bucks: https://blog.google/technology/ai/google-gemini-next-generat...

During inference time, yes, but training time does scale exponentially as backpropagation still has to happen.

You can’t use fancy flash attention tricks either.

Re: ChatGPT Pro

#558

Post by j45 » Thu, Dec 05, 2024, 10:55 PM UTC

gorgoiler wrote: post #548

danpalmer wrote: post #515

Earlier quoted context omitted.

The problem is that OpenAI don't really have the enterprise market at all. Their APIs are closer in that many companies are using them to power features in other software, primarily Microsoft, but they're not the ones providing end user value to enterprises with APIs. As for ChatGPT, it's a consumer tool, not an enterprise tool. It's not really integrated into an enterprises' existing toolset, it's not integrated int…

Is their valuation proposition self fulfilling: the more people pipe their queries to OpenAI, the more training data they have to get better?

Also, a replacement for search

Re: ChatGPT Pro

#559

Post by dartos » Thu, Dec 05, 2024, 10:57 PM UTC

CharlieDigital wrote: post #472

Atotalnoob wrote: post #425

Earlier quoted context omitted.

AI writing detectors are snake oil

Startup I'm at has generated a LOT of content using LLMs and once you've reviewed enough of the output, you can easily see specific patterns in the output. Some words/phrases that, by default, it overuses: "dive into", "delve into", "the world of", and others. You correct it with instructions, but it will then find synonyms so there is also a structural pattern to the output that it favors by default. For example, if…

All of what you described can change wildly from model to model. Even across different versions of the same model.

Maybe a database could be built with “tells” organized by model.

Re: ChatGPT Pro

#560

Post by [deleted] » Thu, Dec 05, 2024, 10:57 PM UTC

warkanlock wrote: post #366

motoxpro wrote: post #311

If one makes $150 an hour and it saves them 1.25 hours a month, then they break even. To me, it's just a non-deterministic calculator for words. If it getting things wrong, then don't use it for those things. If you can't find things that it gets right, then it's not useful to you. That doesn't mean those cases don't exist.

Serious question: Who earns (other than C-level) $150 an hour in a sane (non-US) world?

[deleted]