Live data from Hacker News

What it feels like to work in AI right now

robotic.substack.com

321–330 of 768 posts

Re: What it feels like to work in AI right now

#321
post #217

Earlier quoted context omitted.

Issue is the data moat OAI is building. They'll have hundreds of millions of high quality user interactions with ChatGPT they can use to finetune their models. What will anyone else including Google have?

As people make chat bots with openAI and tie them into existing chat services, organizations that offer these chat services will get their hands on that kind of data too. Discord comes to mind.

That's possible ya. Hope it happens

Re: What it feels like to work in AI right now

#322
post #238

Earlier quoted context omitted.

There is also the other (very high in my opinion) possibility that LLM will hit a wall in regards to performance and a new model is required. It's unfortunate that the current VC landscape encourages this single shot mentality instead of diversification. This will not help in the AI winter since most people will be invested in the same thing.

Wouldn't it stand to reason that LLMs should be obsolete in about a year due to the singularity event and the rapid speed which we're moving towards AGI and then onto exponential technology growth due to ASI? At this point, as an AI researcher, I guess you'd just have to sit back and watch is all unfold, very soon everything you do is obsolete almost immediately.

This suggests that LLM is the path to take us to AGI. There is no proof for that. That seems to be the current bet, but my thinking (and it is strictly mine) that we are still technologically under-powered to achieve such a leap. Maybe in 10 years, or in one year or in a hundred of years. However, for that leap (and strictly my opinion), we need significant infrastructure leaps. Something like processors are x100 faster, or your laptop is powered by a 5Ghz 200 cores CPU...

As it stands, we can't even get the Mark Metaverse right. You are trying to convince me that we have the infra. for AGI? Not convinced.

Re: What it feels like to work in AI right now

#323

From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…

I defined an interface and asked ChatGPT to implement it, in Go, as method receivers on a struct named “repo” against sqlite. The code compiled and I wrapped it in unit tests to ensure it worked. Overall saved me an hour of boilerplate, would recommend.

Re: What it feels like to work in AI right now

#324

From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…

You’re asking “what’s so big about GUIs? Literally nobody has asked to move a pointer around a screen”. It’s the use cases these thing enable that are important. Today, I wrote a draft product announcement. Only after I was done did I realize I had written it in a really impersonal third person (“users will be able to”). No big deal, but maybe 10-20 minutes of work to make it energetic and second person (“now you can…

That's very cool, and right now it's a good idea, but I strongly suspect GPT only looks clever and does a good job in isolation. If everyone starts using it product announcements will start looking very similar, and they'll lose a lot of their impact.

This is definitely the case with cover letters for jib applications. The ones written by GPT appear to be pretty obvious - my guesses could be wrong, but after seeing most applications not having a cover letter for years to most applications having one over the past few months, I suspect GPT is involved, and there's a distinct 'style' that seems to be showing up.

Using GPT could be the 'bootstrap ui' of product announcements. It looks great on its own, but put it next to a bunch of other companies and they all fail to stand out.

Re: What it feels like to work in AI right now

#325

Earlier quoted context omitted.

- Amazing translations (this alone is a game changer) - Language learning... The ability to improvise realistic conversations is huge. I can ask to talk about cooking a specific dish or a sport! - As others have noted, refining documents similar to grammarly - Looking for a product with extremely specific features (though it isn't very good at comparing yet) - Searches that are too vague and complicated to articulate…

For translations, I use Google translate. Should I switch?

LLMs are better at context - as far as I can tell Google Translate only does one sentence at a time.

With GPT-3 it infers things like gender and formality from earlier context.

Not clear yet how good GPT-4 is as OpenAI won’t say what training data it has, even rough volumes, in each human language.

Needs some thorough research testing it.

Re: What it feels like to work in AI right now

#326

Earlier quoted context omitted.

- Amazing translations (this alone is a game changer) - Language learning... The ability to improvise realistic conversations is huge. I can ask to talk about cooking a specific dish or a sport! - As others have noted, refining documents similar to grammarly - Looking for a product with extremely specific features (though it isn't very good at comparing yet) - Searches that are too vague and complicated to articulate…

For translations, I use Google translate. Should I switch?

Yo, check this out! DeepL is like way better than Google Translate, so you should totally use it. But, GPT-4 is like a game-changer, dude! It's obvi way better than DeepL, and it can do all sorts of stuff like rewording, explaining in detail, and changing up the style. This text was translated from Japanese to gamer-style English by ChatGPT-4, no joke!

Re: What it feels like to work in AI right now

#327
post #205

Earlier quoted context omitted.

You are not missing anything. It's a bubble. This is tech 101 and all over again. You gotta hype some new thing whether it's Web 2.0, Crypto or AI. LLM have proven to be great as a gimmick or making rather okay localized approximations. You can create a good enough image without any designing skills, or have auto-completion on steroids. However, there is no proof that this same tech can extrapolate to the next level.…

You couldn’t be further from the truth. This is the single greatest leap in productivity we’ve had in the last 100 years. Last week, I used GPT-4 to write my code. Later, I used it to analyze 100+ websites and come up with a personalized pitch for a relevant plugin/product idea - something that would have taken me 100+ hours.

If it makes you feel better (or worse?). I am using it daily and extensively. It is a productivity boost but not something that will propel me to god-level and the more I use it (Codex in particular) the more I discover its limitations; and that's where my conclusion has came from: It is too limited beyond the local scope it has. It is not clear (and there are no indications) it can make a jump from that local scope.

Re: What it feels like to work in AI right now

#328

Earlier quoted context omitted.

That’s not what’s happening in the US. Too much concentration of wealth (not just tech), leading to almost 3rd world country health outcomes, education levels plummeting and unaffordability to live. Will backfire at one point if it continues.

I would argue that is caused by regulatory capture and government interference (e.g. zoning laws) and not technological progress

Despite all these zoning laws there are tent encampments everywhere...

Re: What it feels like to work in AI right now

#329

From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…

LLMs will make average and below average writers / marketers / PR to become extremely good.

You no longer can mock "Please do the needful" from $1 / hr employees from India. They will be communicating at the same level as an average American and the smart ones can completely take over large fields.

A single person, can wear multiple hats and not get blocked.

This can apply at global scale of at least 4 Billion.

Just because you lack imagination doesn't mean it isn't good

Re: What it feels like to work in AI right now

#330

From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…

One thing I find it really great for is language learning. It can create examples, explain grammar, contrast to languages you already know etc. Also I'm not a sys admin but occasionally have to do sys admin things and I ask for the shell commands I need in English, it is far far faster than using stackoverflow etc. (i.e. pulling logs from multiple servers and extracting bits) Also I don't want if I want to use a library I ask for what how I want to use it and get a small example entirely tailored to me.
Post reply on HN