Earlier quoted context omitted.
Issue is the data moat OAI is building. They'll have hundreds of millions of high quality user interactions with ChatGPT they can use to finetune their models. What will anyone else including Google have?
As people make chat bots with openAI and tie them into existing chat services, organizations that offer these chat services will get their hands on that kind of data too. Discord comes to mind.
What it feels like to work in AI right now
321–330 of 768 posts
Re: What it feels like to work in AI right now
#322Earlier quoted context omitted.
There is also the other (very high in my opinion) possibility that LLM will hit a wall in regards to performance and a new model is required. It's unfortunate that the current VC landscape encourages this single shot mentality instead of diversification. This will not help in the AI winter since most people will be invested in the same thing.
Wouldn't it stand to reason that LLMs should be obsolete in about a year due to the singularity event and the rapid speed which we're moving towards AGI and then onto exponential technology growth due to ASI? At this point, as an AI researcher, I guess you'd just have to sit back and watch is all unfold, very soon everything you do is obsolete almost immediately.
As it stands, we can't even get the Mark Metaverse right. You are trying to convince me that we have the infra. for AGI? Not convinced.
Re: What it feels like to work in AI right now
#323From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…
Re: What it feels like to work in AI right now
#324From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…
You’re asking “what’s so big about GUIs? Literally nobody has asked to move a pointer around a screen”. It’s the use cases these thing enable that are important. Today, I wrote a draft product announcement. Only after I was done did I realize I had written it in a really impersonal third person (“users will be able to”). No big deal, but maybe 10-20 minutes of work to make it energetic and second person (“now you can…
This is definitely the case with cover letters for jib applications. The ones written by GPT appear to be pretty obvious - my guesses could be wrong, but after seeing most applications not having a cover letter for years to most applications having one over the past few months, I suspect GPT is involved, and there's a distinct 'style' that seems to be showing up.
Using GPT could be the 'bootstrap ui' of product announcements. It looks great on its own, but put it next to a bunch of other companies and they all fail to stand out.
Re: What it feels like to work in AI right now
#325Earlier quoted context omitted.
- Amazing translations (this alone is a game changer) - Language learning... The ability to improvise realistic conversations is huge. I can ask to talk about cooking a specific dish or a sport! - As others have noted, refining documents similar to grammarly - Looking for a product with extremely specific features (though it isn't very good at comparing yet) - Searches that are too vague and complicated to articulate…
For translations, I use Google translate. Should I switch?
With GPT-3 it infers things like gender and formality from earlier context.
Not clear yet how good GPT-4 is as OpenAI won’t say what training data it has, even rough volumes, in each human language.
Needs some thorough research testing it.
Re: What it feels like to work in AI right now
#326Earlier quoted context omitted.
- Amazing translations (this alone is a game changer) - Language learning... The ability to improvise realistic conversations is huge. I can ask to talk about cooking a specific dish or a sport! - As others have noted, refining documents similar to grammarly - Looking for a product with extremely specific features (though it isn't very good at comparing yet) - Searches that are too vague and complicated to articulate…
For translations, I use Google translate. Should I switch?
Re: What it feels like to work in AI right now
#327Earlier quoted context omitted.
You are not missing anything. It's a bubble. This is tech 101 and all over again. You gotta hype some new thing whether it's Web 2.0, Crypto or AI. LLM have proven to be great as a gimmick or making rather okay localized approximations. You can create a good enough image without any designing skills, or have auto-completion on steroids. However, there is no proof that this same tech can extrapolate to the next level.…
You couldn’t be further from the truth. This is the single greatest leap in productivity we’ve had in the last 100 years. Last week, I used GPT-4 to write my code. Later, I used it to analyze 100+ websites and come up with a personalized pitch for a relevant plugin/product idea - something that would have taken me 100+ hours.
Re: What it feels like to work in AI right now
#328Earlier quoted context omitted.
That’s not what’s happening in the US. Too much concentration of wealth (not just tech), leading to almost 3rd world country health outcomes, education levels plummeting and unaffordability to live. Will backfire at one point if it continues.
I would argue that is caused by regulatory capture and government interference (e.g. zoning laws) and not technological progress
Re: What it feels like to work in AI right now
#329From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…
You no longer can mock "Please do the needful" from $1 / hr employees from India. They will be communicating at the same level as an average American and the smart ones can completely take over large fields.
A single person, can wear multiple hats and not get blocked.
This can apply at global scale of at least 4 Billion.
Just because you lack imagination doesn't mean it isn't good
Re: What it feels like to work in AI right now
#330From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…