While this post champions the progress made by OSS, it also mentions that a huge leap came from Meta releasing Llama. Would the rapid gains in OSS AI have came as quickly without that? Did Meta strategically release Llama knowing it would destroy Google & OpenAI's moats?
Google “We have no moat, and neither does OpenAI”
161–170 of 1001 posts
Re: Google “We have no moat, and neither does OpenAI”
#162Some snippets for folks who come just for the comments: > While our models still hold a slight edge in terms of quality, the gap is closing astonishingly quickly. Open-source models are faster, more customizable, more private, and pound-for-pound more capable. They are doing things with $100 and 13B params that we struggle with at $10M and 540B. And they are doing so in weeks, not months. > A tremendous outpouring of…
Openai moat is the upcoming first party integration with ms office.
By that logic Google's moat is the integration with Gmail and Google Docs.
And frankly it's not. People will decide to copy some text from Office or Docs to some other non-integrated tool, get LLMs to work, and then paste back to Office or Docs.
Re: Google “We have no moat, and neither does OpenAI”
#163The part of the post that resonates for me is that working with the open source community may allow a model to improve faster. And, whichever model improves faster, will win - if it can continue that pace of improvement. The author talks about Koala but notes that ChatGPT is better. GPT-4 is then significantly better than GPT-3.5. If you've used all the models and can afford to spend money, you'd be insane to not use…
>Midjourney is more popular (from what I'm seeing) than Stable Diffusion at the moment because it's better at the moment. Midjourney is closed-source. Midjourney is easier, its not better. The low barrier to entry has it popular, but it isnt as realistic, doesnt follow the prompt as well, and has almost no customization. SD is the holy grail of AI art, if you can afford a computer or server to run SD + have the abili…
Are you sure about this? For the couple things I tried, a colleague with Midjourney managed to outperform my attempts with SD by leaps and bounds.
Re: Google “We have no moat, and neither does OpenAI”
#164Some snippets for folks who come just for the comments: > While our models still hold a slight edge in terms of quality, the gap is closing astonishingly quickly. Open-source models are faster, more customizable, more private, and pound-for-pound more capable. They are doing things with $100 and 13B params that we struggle with at $10M and 540B. And they are doing so in weeks, not months. > A tremendous outpouring of…
> the one clear winner in all of this is Meta. Because the leaked model was theirs, they have effectively garnered an entire planet’s worth of free labor. Since most open source innovation is happening on top of their architecture, there is nothing stopping them from directly incorporating it into their products. This
I think this type of comment is generally frowned upon on HN.
Upvote serves the same purpose.
Re: Google “We have no moat, and neither does OpenAI”
#165The part of the post that resonates for me is that working with the open source community may allow a model to improve faster. And, whichever model improves faster, will win - if it can continue that pace of improvement. The author talks about Koala but notes that ChatGPT is better. GPT-4 is then significantly better than GPT-3.5. If you've used all the models and can afford to spend money, you'd be insane to not use…
Midjourney is more popular because it takes zero technical know-how compared to SD (even with A1111 it took me nearly an hour to walk my competent-but-layman brother through installing it) and doesn't require a high-end gaming PC to run it. (DALL-E lost because they let MJ eat their lunch)
Re: Google “We have no moat, and neither does OpenAI”
#166Some snippets for folks who come just for the comments: > While our models still hold a slight edge in terms of quality, the gap is closing astonishingly quickly. Open-source models are faster, more customizable, more private, and pound-for-pound more capable. They are doing things with $100 and 13B params that we struggle with at $10M and 540B. And they are doing so in weeks, not months. > A tremendous outpouring of…
Meta's leaked model isn't open-source. I can found a business using Linux, that's open-source. The LLM piracy community are unpaid FB employees; it is not legal for anyone but Meta to use the results of their labor. I know this might be hard news but it needs to be said... if you want to put your time into working on open source LLMs, you need to get behind something you have a real (and yes, open source) license for…
I'm still not on board with calling it leaked...the weights were open for anyone to get and use as long as they agreed to use them academically.
Basically, completely open source with a non-commercial license. I'm not sure why so many people keep saying it 'leaked'. It's just using open source weights not directly from the provider in a way that violates the software license.
Re: Google “We have no moat, and neither does OpenAI”
#167The part of the post that resonates for me is that working with the open source community may allow a model to improve faster. And, whichever model improves faster, will win - if it can continue that pace of improvement. The author talks about Koala but notes that ChatGPT is better. GPT-4 is then significantly better than GPT-3.5. If you've used all the models and can afford to spend money, you'd be insane to not use…
>Midjourney is more popular (from what I'm seeing) than Stable Diffusion at the moment because it's better at the moment. Midjourney is closed-source. Midjourney is easier, its not better. The low barrier to entry has it popular, but it isnt as realistic, doesnt follow the prompt as well, and has almost no customization. SD is the holy grail of AI art, if you can afford a computer or server to run SD + have the abili…
Midjourney is higher quality by a fair bit, from my personal experience and from being near a few of the top early AI artists for a good little while.
Re: Google “We have no moat, and neither does OpenAI”
#168"I have no moat, and I must scream"
Re: Google “We have no moat, and neither does OpenAI”
#169Earlier quoted context omitted.
>Midjourney is more popular (from what I'm seeing) than Stable Diffusion at the moment because it's better at the moment. Midjourney is closed-source. Midjourney is easier, its not better. The low barrier to entry has it popular, but it isnt as realistic, doesnt follow the prompt as well, and has almost no customization. SD is the holy grail of AI art, if you can afford a computer or server to run SD + have the abili…
> SD is the holy grail of AI art, if you can afford a computer or server to run SD + have the ability to figure out how to install python, clone Automatic1111 from git, and run the installer, its the best. If you can afford Colab (which is free if you don’t want to use it too much), you can just click one of the existing A1111 colabs and run that, you don’t need to figure out python, git, or A1111 installs.
Free Colabs have started blocking any SD web-ui it detects (presumably because it's meant as a community service for ML researchers, not for people who want to play hentai gacha, and they're running out of server time)
Re: Google “We have no moat, and neither does OpenAI”
#170So I use ChatGPT every day. I like it a lot and it is useful but it is overhyped. Also from 3.5 to 4 the jump was nice but seemed relatively marginal to me. I think the head start OpenAi has will vanish. Iteration will be slow and painful giving google or whoever more than enough time to catch up. ChatGPT was a fantastic leap getting us say 80% to Agi but as we have seen time and time again the last 20% are excruciat…
Personally, the difference between GPT4 and 3.5 is, pretty immense for what I am using it for. I can use GPT 3.5 for things like summarization tasks (as long as the text isn't too complex), reformatting, and other transformation type tasks alright. I don't even bother with using it for logical or programming tasks though.
Would you please be more explicit? I'm curious about the relative strength's and weaknesses other's see