181–190 of 244 posts
> For example, a gpt-3.5-turbo fine-tuning job with a training file of 100,000 tokens that is trained for 3 epochs would have an expected cost of $2.40. How do you calculate the number of tokens required?
My calls suddenly get emoji's in the return texts. Fun times but now what my client wants haha.
And OpenAI continues to ship. As promised, they released GPT3.5 fine-tuning today. They opened GPT4 API access a few months ago. In a few months, they'll release GPT4 fine-tuning. Many favor open source AI, and criticize OpenAI for not being open enough. But the most important thing is, OpenAI innovates. Fast. Llama, Bard, FB's open source stuff is good but it's lightyears behind OpenAI. You have to credit them for t…
And OpenAI continues to ship. As promised, they released GPT3.5 fine-tuning today. They opened GPT4 API access a few months ago. In a few months, they'll release GPT4 fine-tuning. Many favor open source AI, and criticize OpenAI for not being open enough. But the most important thing is, OpenAI innovates. Fast. Llama, Bard, FB's open source stuff is good but it's lightyears behind OpenAI. You have to credit them for t…
>And OpenAI continues to ship. This. Google (specifically their CEO) was saying since at least 2016 that "Google is an AI first company". (Whatever the hell that means). But they had no product to show for and they are on the verge of being the next IBM.
Earlier quoted context omitted.
It depends on your needs. For instance, do you want to host an API or do you want to have a front end like chatGPT? Chances are, text-generation-webui [1] should get you pretty close to hosting it yourself. You simply clone the repo, download the model from huggingface using the included helper (download-model.py) and fire up the server with server.py. You can connect to it by SSH port tunneling on port 7860 (there's…
If you want to query the Llama-2 models, you can use Anyscale Endpoints [1]. Note: I work on this :) Llama-2-70B is $1 / million tokens, which is the most cost-efficient on the market that I'm aware of. [1] https://app.endpoints.anyscale.com/
Edit. I'm sure it's answered on your site but sometimes it's better to include it right here! :)
Safety standards. One might call it "our censorship model" but that would be too close to the truth, so call it safety standards...
Do people really wish for OpenAI models to output healthcare advices without disclaimers, plans to end humanity, child porn fictions, torture instruction books, and similar? The minute it happens without complicated bypasses, the society would say stop to generative ai, and rightfully so. Many people already got spoked when they tricked ChatGPT to say/repeat scary things.
You can google all these scary things these days already. And prior to that, you could go to a bookstore and find most of what you mentioned. Or go to asstr.org for your fucked up sex stories
Pretending a content filter on a generative AI would make anything better is simply bigottery.
And OpenAI continues to ship. As promised, they released GPT3.5 fine-tuning today. They opened GPT4 API access a few months ago. In a few months, they'll release GPT4 fine-tuning. Many favor open source AI, and criticize OpenAI for not being open enough. But the most important thing is, OpenAI innovates. Fast. Llama, Bard, FB's open source stuff is good but it's lightyears behind OpenAI. You have to credit them for t…
>And OpenAI continues to ship. This. Google (specifically their CEO) was saying since at least 2016 that "Google is an AI first company". (Whatever the hell that means). But they had no product to show for and they are on the verge of being the next IBM.
Google is lagging behind in the market space for public AI tools, agree, but I am not convinced they are as far behind in AI development as you indicate.
Earlier quoted context omitted.
>And OpenAI continues to ship. This. Google (specifically their CEO) was saying since at least 2016 that "Google is an AI first company". (Whatever the hell that means). But they had no product to show for and they are on the verge of being the next IBM.
I have lots of criticisms of Google, but let's not forget they have Gmail + workspaces,Google Domains, Android, Google Cloud, Google Fiber, Google Fi, The pixel, Nest, Maps, Youtube, Fitbit, and probably the browser 90% of people on here are using. Would losing search devastate them? Absolutely, but they're not exactly IBM levels of irrelevance without it.
Earlier quoted context omitted.
that is actually hilarious. i've been enjoying ChatGPT instead of stack overflow precisely because it avoids that sort of judgemental answer - the AI just answers my question no matter how dumb it is, whereas stackoverflow will tell me the question is dumb whether it is or not. it's funny to see that llama has replicated stack overflow's judginess.
The 13B model is almost unusable because of it. The 70B behaves very differently.