Live data from Hacker News

New models and developer products

openai.com

111–120 of 561 posts

Re: New models and developer products

#112
post #96

Earlier quoted context omitted.

If you want to be a start-up using AI, you have to be in another industry with access to data and a market that OpenAI/MS/Google can't or won't touch. Otherwise you end up eaten like above.

We just launched our AI-based API-Testing tool ( https://ai.stepci.com ), despite having competitors like GitHub Co-Pilot. Why? Because they lack specificity. We're domain experts, we know how to prompt it correctly to get the best results for a given domain. The moat is having model do one task extremely well rather than do 100 things "alright"

Time will tell

Re: New models and developer products

#113

Earlier quoted context omitted.

I don't understand the lock-in argument here. Yes, if a competitor comes in there will be switching cost as everything is re-learned. However, from a code perspective, it is a function of the key and a relatively small API. New regulations outstanding, what is stoping someone from moving from OpenAI to Anthropic (for example) other than the cost of learning how to effectively utilize Anthropic for your use case? Open…

[flagged]

I most definitely am not paid by OpenAI and am very confused how my original (critical) comment could be seen as astroturfing.

Re: New models and developer products

#114

A few notes on pricing: - GPT-4 Turbo vision is much cheaper than I expected. A 768*768 px image costs $0.00765 to input. That's practical to replace more specialized computer vision models for many use-cases. - ElevenLabs is $0.24 per 1K characters while OpenAI TTS HD is $0.03 per 1K characters. Elevenlabs still has voice copying but for many use-cases it's no longer competitive. - It appears that there's no additio…

Does this mean OpenAI tts is available via api? I saw whisper but not tts - maybe I’m missing it?

Re: New models and developer products

#115
So with 128K context window, if you actually input 100K it would cost you:

Input: $0.01 per 1K tokens * 100 = $1.00

$1.00 per query?

Given that each query uses the entire context window, the session would start at $1 for the first query and go up from there? Or do I have it wrong?

Re: New models and developer products

#116
This is kind of the wrong place for this, but given the burst of attention from LLM-loving people: is there any open source chat scaffolding that actually provides a good UI for organizing chat streams and doing stuff with them?

A trivial example is how the LHS of the ChatGPT UI only allows you a handful of characters to name your chat, and you can't even drag the pane to the right to make it bigger; so I have all these chats with cryptic names from the last eleven months that I can't figure out wtf they are; and folders are subject to the same problem.

Seriously, just being able to organize all my chats would be a massive help; but there are so many cool things you could do beyond this! But I've found nothing other than literal clones of the ChatGPT UI. Is there really nothing? Nobody has made anything better?

Re: New models and developer products

#117
post #71

Every day this video ages more and more poorly [1]. categories of startups that will be affected by these launches: - vectorDB startups -> don't need embeddings anymore - file processing startups -> don't need to process files anymore - fine tuning startups -> can fine tune directly from the platform now, with GPT4 fine tuning coming - cost reduction startups -> they literally lowered prices and increased rate limits…

Checking hn and product hunt a few times a week gives you most of that awareness and I don’t need to remind you about the person behind hn ‘sama’ handle.

Re: New models and developer products

#118
post #96

Earlier quoted context omitted.

We just launched our AI-based API-Testing tool ( https://ai.stepci.com ), despite having competitors like GitHub Co-Pilot. Why? Because they lack specificity. We're domain experts, we know how to prompt it correctly to get the best results for a given domain. The moat is having model do one task extremely well rather than do 100 things "alright"

Sorry to be blunt but they can be totally right, if you do not succeed and have to shut down your startup.

It certainly will be a fun experience. But our current belief is that LLMs are a commodity and the real value is in (application-specific) products built on top of them.

Re: New models and developer products

#119
post #71

Every day this video ages more and more poorly [1]. categories of startups that will be affected by these launches: - vectorDB startups -> don't need embeddings anymore - file processing startups -> don't need to process files anymore - fine tuning startups -> can fine tune directly from the platform now, with GPT4 fine tuning coming - cost reduction startups -> they literally lowered prices and increased rate limits…

Vector DBs should never have existed in the first place. I feel sorry for the agent startups though.

Re: New models and developer products

#120

Earlier quoted context omitted.

https://www.youtube.com/live/U9mJuUkhUzk?t=2006 (Timestamp 33:26) Edit: updated the timestamp

~~wat? the video is 45:35 long.~~

Oh! When I replied it was a lot longer — it still had the countdown from before the stream went live. I guess they replaced it with the trimmed version.
Post reply on HN