Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

What it feels like to work in AI right now

robotic.substack.com

Post reply on HN
Print view View original

741–750 of 768 posts

Re: What it feels like to work in AI right now

#741

Post by kolinko »

girvo wrote: post #491
kolinko wrote: post #417

Earlier quoted context omitted.

As for googling, here are some examples of queries you can try and see how it works: - summary of all the carbon neutral concrete methods, especially ones that can be done in a small industrial workshop as a prototype - I have allergies in Thailand, mid-february. What may it be related to? - list all the companies from Japanese stock exchange that have high debt rate Those are top of my head, but really anything that…

How do you deal with it straight up lying? My problem with this whole system is, if I’m asking those questions it’s because I don’t understand the field well enough to answer it myself, which means I can’t pick up on if ChatGPT is lying…

Fact check with google.

With the example questions I provided, it would take many hours to do research on the subject. GPT provided initial answers instantly, and then fact checking was easy.

That’s what we did with gpt-3. With plugins you can have gpt fact-check itself.

Also, if you have a system for dedicated knowledge, you can use embeddings - with embeddings gpt has very little room for hallucinations, and it can provide detailed references.

Re: What it feels like to work in AI right now

#742

Post by kolinko »

girvo wrote: post #737
SanderNL wrote: post #606

Earlier quoted context omitted.

Fair, but not completely true. The Thailand examples gives a detailed reasoning. You can use those building blocks to check. If it says Thailand is a cold country and uses that in its argumentation, it's shaky. You don't have to be an expert climatologist to make this judgement. It's not just one clean answer and we're done. In my experience it is helpful in breaking the problem down into stuff you can Google.

> In my experience it is helpful in breaking the problem down into stuff you can Google. Yeah I can see that being useful. I’ve also seen a lot of non-technical people straight up accept whatever comes out of it, so that’s a little worrying. It’s true of Google searches too, of course, but at least a google search gives N results someone can check rather than 1.

They straight up accept until they discover first mistakes :)

Re: What it feels like to work in AI right now

#743

Post by riffraff »

mxmbrb wrote: post #559
riffraff wrote: post #302

Earlier quoted context omitted.

Didn't we have amazing translations for a long time? I do not notice a significant improvement between new models and last year's deepl/Google translate.

Sounds like you're a native english speaker? Translations to english often worked "well enough" with google. But as soon as you tried the other way arround, or from one non english language to another, the results where often fully incomprehensive. Btw. the same goes for t2s and s2t. It only got slightly usable in the last few years, therefore wasn't really adopted in many non english countries. As you can see, there…

No, I'm an Italian native speaker mostly translating to Hungarian :), it's less good than English but it seems to me it works well enough with both.

First time I tried chatgpt with Hungarian it actually refused to work, so I'm not sure it can be that much better.

Re: What it feels like to work in AI right now

#744

Post by kolinko »

thinkingemote wrote: post #478
kolinko wrote: post #414

Earlier quoted context omitted.

Text redaction - if any part of job is about writing, you can now just brain dump everything, structure it more or less, throw into chatgpt, and make it produce a clear and readable article. In my case, the output is better than anything I would ever write. Ditto all the redacting work in newspapers, intranet etc. The whole field of proofreaders was virtually extinguished overnight. Marketing agencies - and I spoke t…

I hope you discussed data sharing confidential patient health information with third parties, openai etc. Nevertheless offline models should alleviate some of this.

Yes, I did, of course :)

Re: What it feels like to work in AI right now

#745

Post by riffraff »

bottlepalm wrote: post #311
riffraff wrote: post #298

Earlier quoted context omitted.

> Again, no bugs, perfect code How do you know? Either you know enough Go to be able to tell, and thus you'd be able to write this yourself, or you don't and thus you can't really judge. I mean, it probably is right, but this "I don't know something, but I trust what the chatbot told me" is what worries me about the rise of the LLMs.

Reading and validating code is way easier than figuring out how to write it in the first place. A lot of programming is the same - functions, conditionals, loops, libraries, etc.. The hard part is mostly semantics across languages. Way easier for GPT to do the first pass, then go through it and read up on the parts you don't understand.

Validating code you understand, sure. Validating code for a language you don't know, I don't see how you could.

E.g. say you speak python, how would you know how to cleanup memory in C, since you never had to do it? Would you even know that you have to?

Re: What it feels like to work in AI right now

#746

Post by uxcolumbo »

fdgsdfogijq wrote: post #185
qqtt wrote: post #156

Earlier quoted context omitted.

ChatGPT is cool and novel, but FAANG's requirements for ML/AI go far beyond what ChatGPT provides as a product. ChatGPT is good at answering questions based on an older data set. FAANG typically requires up to date real time inference for huge rapidly changing data sets. Working on the practical side of ML/AI at FAANG, you will probably be working with some combination of feature stores, training platforms, inference…

I can tell you that we have applied teams working on open problems, which can be solved out of the box with ChatGPT. Its a huge deal

What kind of problems?

Re: What it feels like to work in AI right now

#747

Post by icelancer »

AussieWog93 wrote: post #436
snowe2010 wrote: post #412

Earlier quoted context omitted.

GPT 4 is quite astounding. It might be wrong on occasion, but it will easily point you in the right direction most of the time. It still messes up, but like a twentieth of what 3.5 did. Honestly it is like an incredible rubber ducky for me. Not only can I just talk like I’m talking to a rubber duck but I can get fast, mostly informed, feedback that unblocks me. If I have a bunch of things competing for my attention I…

Is a 95% reduction in errors an exaggeration or is it really that much better? Might just need to drop the $20/mo if it's really improved that much.

For code 90%+ reduction is easily correct. For text and other content, I can't say, but I would guess it's not that good.

Anything involving reasoning, code, complex logic, GPT-4 is a breakthrough. GPT-3.5 turbo is more than good enough for poetry and the other text generation stuff.

Re: What it feels like to work in AI right now

#748

Post by jiggawatts »

int_19h wrote: post #681
ThalesX wrote: post #518

Earlier quoted context omitted.

> You can program GPT in English. > Let me repeat that: You can program GPT in English. ENGLISH! How? Let me repeat that: How? I had a little script that from time to time parses a list of jobs from a specific board, extracts some categories, inserts them into an SQLite and have a frontend that displays them to me in a way I want. The board has since changed some things which would mean maybe 2 hours of commitment fr…

Let me give you a simple example. I had to deal with a desynced subtitle file recently. I described the exact nature of the desync (in terms like "at point X1 the offset is Y1, and at X2 it is Y2") to GPT-4 and asked it to write me a Python script to fix this. It did require a couple tweaks to run, but when it did, it "just worked".

"Automatic Language-Agnostic Subtitle Synchronization"

Link: https://github.com/kaegi/alass

It's basically magic.

Re: What it feels like to work in AI right now

#749

Post by nullsense »

zarzavat wrote: post #731
nullsense wrote: post #709

Earlier quoted context omitted.

So, it seems the trajectory is one of increasing generality and capability of models and increasing reliance on them. If it's at all possible to improve our technology then we will. If we improve it it increases in utility. If it increases in utility we use it more. What other thesis is there?

The model architecture has stayed roughly the same since the original AIAYN transformer in 2017. That’s 6 years of nothing fundamental happening. Now, obviously the models have got hugely better in capabilities since BERT. Everything else has advanced. Tweaking, tuning and scaling have delivered true intelligence, albeit sub-human. But it seems unlikely that transformers are what take us to human-parity AGI and beyon…

It's certainly going to be very interesting what comes out of the training runs that are going to be done on giant clusters of H100s.

Re: What it feels like to work in AI right now

#750

Post by [deleted] »

r00fus wrote: post #599
alexvoda wrote: post #546

Earlier quoted context omitted.

You can't program GTP in anything if you can't program. If your prompt is garbage then the output will be garbage and if you don't know how to program you won't even realize the output was garbage. It's not the language part of programming language that is hard. It's the programming part because it means you have to have a good understanding of what you want. Just like a human programmer won't read your mind an AI pr…

> You can't program GTP in anything if you can't program. That's why it makes this so interesting - this type of automation impacts our jobs directly. Of course, I'm not sure who would use this in a corporate codebase without legal concerns.

[deleted]
Post reply on HN