Live data from Hacker News

What it feels like to work in AI right now

robotic.substack.com

121–130 of 768 posts

Re: What it feels like to work in AI right now

#121

can someone show some actual product features where AI is being used productively? I dont wanna say it but I think this is a hype train headed for failure

I’ve used ChatGPT to give me script templates, write a README in markdown (it even came up with appropriate build commands), write an annual performance report, and answer questions on topics from FAA regulations to Kubernetes. Copilot does a pretty good job as a “junior engineer” to hammer out first drafts for me.

I’m sure there’s a good deal of over-promising, overexuberant salesmen trying to make a quick buck from it too a la crypto, but the technology is absolutely useful and providing real value as-is.

Re: What it feels like to work in AI right now

#122
post #47

Earlier quoted context omitted.

I don't know about GPT4, but GPT3.5 I'd bet is pretty traditional and boring. It's power comes from a really good, properly curated dataset (including the RLHF). GPT3.5 turbo is much more interesting probably, because they seem to have found out how to make it much more efficient (some kind of distillation?). GPT4 if I had to make a very rough guess, probably flash attention, 100% of the (useful) internet/books for i…

Is there a limit on how big the context size can be?

There’s no theoretical limit

Re: What it feels like to work in AI right now

#124
post #117

I feel like the whole ChatGPT bubble has really highlighted what feel like some fundamental shortcomings in the worldview that is represented in tech. That is, there seems to be a winner take all dynamic baked into the tech world. Maybe this arises from the simple fact that tech places a lot of power in the hands of individuals. But there's an emergent downside to this which is that it makes those who were already mu…

At some point, I became disenchanted with tech and working as a software engineer when I realized that tech doesn't ethically fit into our primitive economic organization right now. It's made me feel bad about myself and the career path I've chosen. Basically, with tech, you can build a product with a very limited amount of people and resources with a potentially infinite customer base. And this means that this produ…

I think ultimately tech will result in humans being like the rest of animals - completely unable to participate in the economy. This will only start to happen once AGI is reached though which might only be a decade away or less.

Re: What it feels like to work in AI right now

#127
post #60

Huge crypto vibes Every single person I know working in AI these days ... has been sparked by the ChatGPT moment.

Crypto had the disadvantage of being a natural conduit for MLM-ish pyramid schemes and a lot of nefarious activities. That gave it some wind, but it was bad wind. Notably, it turned out to be not very useful. AI will be useful, and it's just regular tech, so there's good reason to be optimistic this time.

Just wait till crypto merges with language models and you have AI-powered botnets and DAOs with ransomware.

Re: What it feels like to work in AI right now

#128
post #75

Earlier quoted context omitted.

The impression I get is that they purposely limited Bard in certain ways. It does not seem to be willing to code and makes a lot of excuses when you ask it to (at least as of a couple of weeks ago when I last tried it). Did they put this limitation on it because it's not so good at coding or because they don't want it to be abused in some way? In my experience I had to trick it into coding by telling it to pretend th…

I am still wondering if Google is experiencing it Kodak moment. They have the dominant product that makes them billions and billions of dollars at 'relatively' low cost. The new dominant product is on its way, but it costs far more to operate and will net them far less money, so... um no one wants to kill the goose that is still laying golden eggs, even though its days are numbered already.

Oh how the term "Kodak Moment" has jumped the shark.

https://en.wiktionary.org/wiki/Kodak_moment

Etymology

(moment worth photographing): From an Eastman Kodak Company advertising campaign.

(business's failure to foresee): In reference to the Eastman Kodak Company's decline when cameras and film were overtaken by smartphones and digital technologies.

Noun Kodak moment (plural Kodak moments)

(informal) A sentimental or charming moment worthy of capturing in a photograph.

(informal) The situation in which a business fails to foresee changes within its industry and drops from a market-dominant position to being a minor player or declares bankruptcy.

Kodak Film Commercial - These are the Moments - Baby (1993):

https://www.youtube.com/watch?v=vPSCmnoVgEU

Re: What it feels like to work in AI right now

#129

The middle class was already flagging, destroying all knowledge work is like the coup de grace. Not sure how this isn't clear to people.

Surely this technology will be used for the benefit of humanity. By 2030 we will be working 15 hour weeks and all people will have homes!

Re: What it feels like to work in AI right now

#130
post #117

I feel like the whole ChatGPT bubble has really highlighted what feel like some fundamental shortcomings in the worldview that is represented in tech. That is, there seems to be a winner take all dynamic baked into the tech world. Maybe this arises from the simple fact that tech places a lot of power in the hands of individuals. But there's an emergent downside to this which is that it makes those who were already mu…

At some point, I became disenchanted with tech and working as a software engineer when I realized that tech doesn't ethically fit into our primitive economic organization right now. It's made me feel bad about myself and the career path I've chosen. Basically, with tech, you can build a product with a very limited amount of people and resources with a potentially infinite customer base. And this means that this produ…

But if people are paying for the product then they value it more than the money right?

Tech might bring more inequality, but what is the problem with it if it substantially increases everyones standard of living?

Post reply on HN