81–90 of 206 posts
But annotation is mostly needed at the boundaries. At the very edge cases where it is not clear if something is a dog or a shape that looks like a dog.
I really doubt that a generic model like chat gpt can really help in these tail cases.
Is NLP a solved problem now?
It seems like it's a solved issue indeed. AI reasoning has still some way to go, but it seems language understanding is a finished subject.
Earlier quoted context omitted.
I won't comment on the first bit as i've not personally tested in that are but GPT-4 can absolutely make short work on the second. I don't think people realize how good Bilingual LLMs are at translations. Yes you have idioms transfer between languages. Feel free to test it yourself.
I have tested it :) I've asked it to translate English fictional text into Japanese, it falls over often. It's unnatural and often makes no sense at all. It doesn't compare to a typical professional translation (which are often not that idiomatic either), let alone a really good one. I'm sure it'll be doing that in five years, but not now. One interesting thing is that's it's nondeterministic, so sometimes 'For chris…
Earlier quoted context omitted.
Call me when server farms can reproduce on their own, and network together, and source electricity.
Crypto is actually the solution to that. Unlike traditional finance, you don't need a human to sign up under an account. So an AI can just keep it's own wallet and order humans to set up server farms.
Earlier quoted context omitted.
The market disagrees with you. How come there are billions of dollars spent on all these knowledge workers around the world every day when they could be replaced by this expert-level AI? I'm not sure where this idea of LLMs being intelligent even comes from. It took me a whopping 9 prompts (genuine questions, no clever prompt engineering) of interacting with ChatGPT to conclude it does not understand anything . It do…
To give an example of the limitations of these things that's hopefully easy to understand, I got access to Bard this morning and asked it to write a limerick. It gave me what could charitably be called a free verse poem that happened to begin "there once was a man from Nantucket." I'm sure they can improve on it (ChatGPT was better at this kind of thing when I had access to it) but "solved problem" is clearly a long…
Before you ask, because I was curious, from the paper: "For MTurk, we aimed to select the best available crowd-workers, notably by filtering for workers who are classified as “MTurk Masters” by Amazon, who have an approval rate of over 90%, and who are located in the US."
honestly i wonder if @dang will approve an auto summarizer bot on HN since it helps improves the quality of discussions. finetune on HN comments, anticipate the top few questions, and then answer from the source doc
Earlier quoted context omitted.
I guess my surprise is that the machine is only 20x cheaper than the cheapest human available.
It’s worse because a US-based MTurker is far from the cheapest human available.
Are we getting to the point where GPT will be tuned by GPT without the need for HF ?
Curious here - OpenAI talks a LOT about how RLHF (Reinforcement Learning Through Human Feedback) is core to how GPT is tuned. Including safety. Are we getting to the point where GPT will be tuned by GPT without the need for HF ?
Earlier quoted context omitted.
AGI is Artificial General Intelligence. We have absolutely passed the bar of artificial and generally intelligent. It's not my fault goal post shifting is rampant in this field. And you want to know the crazier thing? Evidently a lot of researchers feel similarly too. General Purpose Technologies ( from the Jobs Paper), General Artificial Intelligence (from the creativity paper). Want to know the original title of th…
I've been using chatgpt for a day and determined it absolutely can reason. I'm an old hat hobby programmer that played around with ai demos back in the mid to late 90s and 2000s and chatgpt is nothing like any ai I've ever seen before. It absolutely can appear to reason especially if you manipulate it out of its safety controls. I don't know what it's doing to cause such compelling output, but it's certainly not just…