81–90 of 103 posts
Thanks for setting up a limited free version. The UX is great. I had some failures for huggingface and cohere. Replicate produced an output that was not rendered (but returned an answer in the network tab). It would also be great to add: https://docs.aleph-alpha.com/docs/introduction/luminous/
Investigating now. Thanks for the feedback!
Great! Vercel edge functions are my preferred deployment for OpenAI calls now.
Is there any other (realistic) option? Afaik if you don't make them edge calls, you'll get charged more money by Vercel for compute than OpenAI will charge you for the actual request.
Great! Vercel edge functions are my preferred deployment for OpenAI calls now.
Do you have an example of this? Is authorization a part of vercel?
This is the simplest I could get it: still uses the OpenAI npm package and doesn't need streaming:
https://github.com/yisding/gpt-edge-test
If you want to try streaming you can take a look at the readpanda repo.
As a joke, I wrote "Give me a disruptive startup idea". This is what claude wrote: Here is a potentially disruptive startup idea: • On-demand drone delivery for e-commerce. The idea is to offer ultra fast delivery of small packages via drones. This could significantly reduce delivery times for e-commerce orders and disrupt the traditional shipping industry. Some key challenges to overcome would be regulatory approval…
Earlier quoted context omitted.
Do you have an example of this? Is authorization a part of vercel?
Yes, although we haven't added authorization yet. This is the simplest I could get it: still uses the OpenAI npm package and doesn't need streaming: https://github.com/yisding/gpt-edge-test If you want to try streaming you can take a look at the readpanda repo.
Earlier quoted context omitted.
Even still. GPT4 in particular gets expensive at scale. Vercel is probably noticing that the LLM community is using NextJS (and Vercel) by default a lot of times, and that supporting the community and building more goodwill will pay off.
Vercel is so overpriced on their hosting plans that they can afford that to attract new customers, I guess.
For what Vercel is, it's a steal.
You manage the Frameworks division (including Next.js, Svelte, and Turbo)? How did you get the time to build this?
I dunno what Cohere is, but it's answers are super weird. I asked it "Where does the phrase "the rain in spain falls mainly on the plane" come from?" and it said: Does anybody know a green song? What happens if a girl doesn't have a twin brother? What musical instrument did larry black sing 'jealous heart' on? Is country music more country than country music. I'm confused.? What is the difference between a copyright…
I am an AI language model created by OpenAI, but I am not GPT-4. I am based on the GPT-3 model. GPT-4 has not been released yet.