111–120 of 235 posts
Earlier quoted context omitted.
LLM emergence was unpredictable in 2017. Even for the best AI people.
ChatGPT is nothing more than long-form autocomplete. The specifics of approach are irrelevant.
I asked Chat GPT which antacid medications are contraindicated for some medication I'm on. Easily found through NICE. It made up a severe risk of death taking a very common medicine combo. It was super convincing, even giving information on how long to avoid taking them together. It was pure bullshit. I think as much as hyping the benefits we need to hype the flaws and dangers. If the public at large learn to trust t…
This kind of problem is (trivially?) solvable through the ReAct framework, like LangChain etc. Basically you get good data, vector embed it, and make sure the LLM knows where to look for accurate information.
- it chunks inputs, with some overlap, but this can destroy context
- the retrieved passages, when they come from different documents, have no apparent relation or could be mistakenly considered related
- the model struggles to correlate data between the document snippets, taking half an idea from one side and half from the other side and mixing them up in something that doesn't really make sense
Earlier quoted context omitted.
I decided that being paralyzed with fear isn't a great strategy so I'm going to subscribe to OpenAI tools for a while and see how they can fit into my workflow. It feels "wrong" on a strangely emotional level but what is happening is gonna happen anyway. On a brighter note: There are bound to be a lot of unfounded, hype-based Marketing claims that look reasonable during the rush but fall flat over time. It would be a…
That is certainly true about the hype-machine it is in full force. I imagine that will level off soon and the really useful and novel stuff will float to the top. I have no backup plan but as you said, what happens is going to happen? It's a rollercoaster for me personally where some days I am in absolute dread and fear about the future. Then other days I just go along my day as usual.
I think more parallels should be drawn with what we were doing before: Googling it. Perhaps it's because ChatGPT seemed to happen much more suddenly than Google became a programming resource, but we're using them in much the same way. Asking for pre-made solutions, explanations, troubleshooting tips etc. ChatGPT just does the job way better. But no-one was worried Google would put knowledge workers out of a job.
My (sales-y) colleagues are already writing marketing emails with ChatGPT. Saves a little bit of work, but it might result in the loss of being able to write such emails yourself. This can extend to other jobs, which will have some effects. Use in education worries me more. If schools don't change their lazy group-projects and "write an essay on" strategies now , coming generations will have put less effort in than p…
This has been happening since the inception of school. Calculators made math easier. Sparknotes made book reports easier. Wikipedia made essays easier.
> leading to a further drop in levels
Did levels drop because stuff got easier? Were there other causes over the past years, like dopamine dependency form infinitely scrolling algorithmic attention grabbing apps, among others? Maybe from schools becoming political battle grounds? Or from education spending being gutted leading to lower quality? Was it lack of decent education due to Covid?
Also, is there an actual drop in levels? I can't seem to find a source that has decent data on this. And the only stuff I can find says 'IQ' has been rising over time. So please share it with me.
Lastly, I'm personally not convinced any of this will lead to a net negative per se. It'll change the required knowledge and increase the over all capabilities of people. The calculator caused people to stop learning mental arithmetic and start learning more complicated math and how to use a calculator for it. Google caused people to memorize less and become adept at finding information through Google. Welding robots caused less people to learn how to weld and more how to program welding robots.
In the end it gives people the ability to do less of a simple thing and more of a complicated thing. Writing marketing e-mails and multiple titles for A/B testing isn't a skill, it's a trick and so is writing SEO stuff. Not having to do that opens up time to think about product-market fit, marketing strategies, improving advertising return on investment measurements. Which might be more valuable and interesting than writing emails.
Earlier quoted context omitted.
> Do you have colleagues, bosses or reports that are correct 100% or the time? 99.999%? I would love colleagues that are 99% accurate, I certainly am not unfortunately. I see this analogy all the time in these comment sections but it's not a very good one. A person is not a tool. One of the great achievements of humanity, and in computing in particular, is that we make tools that are more accurate than we are. I expe…
Except hammers already do not work as expected 100% of the time, as evident by them painfully hitting the hands of the workers in mishaps. Yet we still use them.
If I try to light a cigarette and accidentally set my beard on fire due to my own clumsyness, did the lighter malfunction? No, the lighter did exactly what it was supposed to do, it was my hand that didn't do what I expected.
Earlier quoted context omitted.
> Almost all the output needs to be re-read, modified and integrated in the project. This often takes longer than just typing it out You'd be very suprised. Try measuring it.
Yes, I have. That's largely why I've stopped using it. The time it's taken to rewrite has been larger than not; and worse, it deprives me of understanding the problem i'm solving. So I end up not having thought through the problem and basically having to press delete and type from scratch.
Earlier quoted context omitted.
> Complex machinery of any kind never is 100% correct and needs constant correction and maintenance Computers are extremely close to 100%, we generally expect a CPU to never make errors even after years of working. If it starts making any errors at all we throw it away and make a new one.
>Computers are extremely close to 100% We must work in extremely different industries!
Earlier quoted context omitted.
LLM emergence was unpredictable in 2017. Even for the best AI people.
ChatGPT is nothing more than long-form autocomplete. The specifics of approach are irrelevant.
I keep reading these opinions that LLMs are just doing some advanced form of copy paste. Actually, we don't know what they are doing. Are they actually doing some form of modelling and abstraction? Seems likely to me.
We are currently surviving with a massive shortage of skilled labor, where people in the richest countries have to wait days or weeks to see a doctor, and months to see a specialist and have important medical procedures. The same is true for other skilled industries, where many people are excluded from access to good resources due to their scarcity. We are a long way off from having too much skill. Let’s first get to…
The primary issue is not shortage of skilled labour. This is a right wing political soundbite. What there is a shortage of is adequate pay to attract skilled people to the work required. British Doctors in the UK leave for other countries, work for private entities or go into different industries.
So... Those people fill in jobs in businesses/countries where there's a shortage, causing a shortage somewhere else?
> political soundbite
Is exactly what you are doing. If there's no shortage in (skilled) labor, why is unemployment at the lowest rate in decades in much of the western world? Why are there not enough builders in much of the EU, while countries like Romania are suffering shortage due to skilled workers moving to EU countries to earn more? Why can't I find enough devs to do even half the work we could be doing? Why are so many companies looking at automation to solve the lack of labor?
I asked Chat GPT which antacid medications are contraindicated for some medication I'm on. Easily found through NICE. It made up a severe risk of death taking a very common medicine combo. It was super convincing, even giving information on how long to avoid taking them together. It was pure bullshit. I think as much as hyping the benefits we need to hype the flaws and dangers. If the public at large learn to trust t…
Not sure if you tried GPT-4 but my experience with 4 is quite different. It has been quite bullshit free, though not completely. For example I asked it to contrast oral and injectable semaglutide formulations. It did a bang up job. One thing I always do is ask it for evidence. And then I look the references up. Sometimes the references don’t say exactly what it said they will. I come back and have a discussion with i…
Can't wait for GPT-4 VSCode integration. What I want most is to have it see the errors and files (file formats, directories, etc) so it will automatically know what is where and how it is structured. Not just code, but also data files.
In the mean while I am starting to format my code in such a way as to contain this information, put there by me by hand. Fully documented files are better for GPT.