321–330 of 380 posts
Earlier quoted context omitted.
Holy crap. Even if this is RAG-based, this is insanely good.
Yes, but this is where current LLMs shine - transforming (in this case summarizing) text rather than generating anything factual from scratch or reasoning/planning.
Given that a few people mentioned it having better than average knowledge of obscure things from the internet, I asked it what the llm tools from Simon Willison is. Gpt2-chatbot said "Log Lady's Mug". Gpt-4-turbo said "Log Lady Mysteries". https://imgur.com/LHg4m5V I tried a few versions of the prompt, including asking first about shot-scraper. It knows shot-scraper was made by Simon Willison and mostly knows how to…
Earlier quoted context omitted.
I simply asked it "what are you" and it responded that it was GPT-4 based. > I'm ChatGPT, a virtual assistant powered by artificial intelligence, specifically designed by OpenAI based on the GPT-4 model. I can help answer questions, provide explanations, generate text based on prompts, and assist with a wide range of topics. Whether you need help with information, learning something new, solving problems, or just loo…
Why would the model be self aware? There is no mechanism for the llm to know the answer to “what are you” other than training data it was fed. So it’s going to spit out whatever it was trained with, regardless of the “truth”
The training data and the system prompt but yes.
Earlier quoted context omitted.
100% of the time when I post a critique someone replies with this. I tell them I've used literally every LLM under the sun quite a bit to find any use I can think of and then it's immediately crickets.
Usually when I encounter sentiment like this it is because they only have used 3.5 (evidently not the case here) or that their prompting is terrible/misguided. When I show a lot of people GPT4 or Claude, some percentage of them jump right to "What year did Nixon get elected?" or "How tall is Barack Obama?" and then kind of shrug with a "Yeah, Siri could do that ten years ago" take. Beyond that you have people who pro…
This is the "You're not using it right" defense.
It's an LLM, it's supposed to understand human language queries. I shouldn't have to speak LLM to speak to an LLM.
Earlier quoted context omitted.
I tried this with GPT-4 for NYC, from my address on the upper west side of Manhattan to the Brooklyn botanical gardens. It basically got the whole thing pretty much correct. I wouldn’t use it as directions, since it sometimes got left and right turns mixed up, stuff like that, but overall amazing.
That's wild. I don't understand how that's even possible with a "next token predictor" unless some weird emergence, or maybe i'm over complicating things? How does it know what the next street or neighbourhood it should traverse in each step without a pathfinding algo? Maybe there's some bus routes in the data it leans on?
It isn't. It failed.
> I wouldn’t use it as directions, since it sometimes got left and right turns mixed up, stuff like that, but overall amazing.
I'm surprised by people's impression. I tried it in my own language and much worse than GPT-4. Of the open source LLMs I've tried, all suck in non-English. I imagine it's difficult to make an LLM work in tens of languages on a consumer computer.
Earlier quoted context omitted.
It strikes me as unprecedented that a technology which takes arbitrary language-based commands can actually surface and synthesize useful information, and it gets better at doing it (even according to extensive impartial benchmarking) at a fairly rapid pace. It’s technology we haven’t really seen before recently, improving quite quickly. It’s also being adopted very rapidly. I’m not saying it’s certainly the fastest…
> unprecedented that a technology [...] It’s technology we haven’t really seen before recently This is what frustrates me: First that it's not unprecedented, but second that you follow up with "haven't really" and "recently". > fairly rapid pace ... decent case for it being a contender Any evidence for this? > extensive impartial benchmarking Or this? The last two "benchmarks" I've seen that were heralded both contai…
By “haven’t really seen until recently” I mean that similar technologies have existed, so we’ve seen something like it, but they haven’t actually functioned well enough to be comparable. So we can say there’s a precedent, but arguably there isn’t in terms of LLMs that can reliably do useful things for us. If I’m mistaken, I’m open to being corrected.
In terms of benchmarks, I agree that there are gaps but I also see a clear progression in capability as well.
Then in terms of evidence for there being a decent case here, I don’t need to provide it. I clearly indicated that’s my opinion, not a fact. I also said conditionally it would seem like a clear winner, and that condition is years of a similar growth trajectory. I don’t claim to know which technology has advanced the fastest, I only claim to believe LLMs seem like they have the potential to fit that description. The first ones I used were novel toys. A couple years later, I can use them reliably for a broad array of tasks and evidence suggests this will only improve in the near future.
Earlier quoted context omitted.
You can ask it's knowledge cutoff and it will respond November 2023. It have no idea of the big events of the beginning of 2024, like the earthquake in Japan.
> You can ask it's knowledge cutoff and it will respond November 2023 It probably just repeated something based on what common AI cutoffs there are, LLMs doesn't have a sense or self or thought process, they don't know more about themselves than the text given to them about themselves, and even then it is likely to default to some common text from the internet.
If you really think it is just saying whatever it read on the web, how do you explain that not all LLM chatbots claim to be ChatGPT?
Engineering is happening, it's not just a raw model of text from the web connected directly to the user.
Earlier quoted context omitted.
Are you trying the paid gpt or just free 3.5 chatgpt?
100% of the time when I post a critique someone replies with this. I tell them I've used literally every LLM under the sun quite a bit to find any use I can think of and then it's immediately crickets.
When looking at Chrome task manager (Windows shortcut Shift+Esc) list, sub-frames popped up I didn't recognize such as:
https://adnxs.com/ https://adsrvr.org/ https://btloader.com/ https://doubleclick.net/ https://gumgum.com/ https://openx.net/ https://smartadserver.com/
And many more. Each taking up RAM.
In incognito mode / without extensions.
Can anyone enlighten me, what's happening?