231–240 of 326 posts
Earlier quoted context omitted.
Sorry, did it try to predict the output, or did it only predict the output based on what it has seen people say about similar code online?
Is your objection to the use of the word "try"?
What would it do if the training data was only code? Only code+inputs+outputs? Only function signature+inputs/outputs? Only signature+comments?
Etc.
Earlier quoted context omitted.
[flagged]
> When these LLMs get normalized probably 5 years from now I'm going go back to these old threads and contact these people who are in self denial and throw it in their face. I'll just link this comment and be like I TOLD YOU, I TOLD YOU, YOU WERE WRONG. this isn't a kind thing to do.
Earlier quoted context omitted.
I guess you perception of society is severely limited if you think a fancy autocomplete is capable of changing every aspect of it.
That was what I thought until a few months ago when ChatGPT was released. I never cared much about LLMs because it always felt like a brute force method to solving problems. What I'm seeing now is that some kind of intelligence seem to emerge from these models, even though under the hoods it is just a bunch o matrix multiplications. Who's can say for sure that our own brains doesn't work similarly? Maybe human intell…
Earlier quoted context omitted.
Well I don't understand the nitroglycerin reference and of course "computationally universal" doesn't mean "sentient" but the point is when you add the external memory they (Flan-U-PaLM 540B to be specific) have been demonstrated to be capable of simulating a specific, well defined Turing machine without special training. There are some other papers out there arguing this from a theoretical angle too, but this is the…
5 thermostats in the right comfiguration can be a universal computer. Approximation, in the computational sense, is relative to some well defined function, which gives the approximation an ontology. The feasability of approximation is not disputed, but the content and nature of the ontology is a battlefield of motivated rhetoric. Yes, this is arguing semantics but in this particular case, semantics is the whole point…
I've asked ChatGPT to write an ode to the beer. This was the result: An ode to the frothy brew, The one that's crisp and true, A beer that's cool and light, The perfect drink for a summer's night. With every sip, a burst of hops, A refreshing taste that never stops, The gentle fizz, the golden hue, A symphony of flavors brewed just for you. Whether you're at a party or alone, A refreshing beer is like coming home, It…
Quite interesting if you think about this not as a marketing jingle but as Art. Contrast it to Poe's Beer Poem "Lines". What does it say about humanity and their ability to create wonderful things? Does it change ? The beauty of poetry is finding the meaning hidden in the rhymes and verses. Lines on Ale: Edgar Allen Poe Filled with mingled cream and amber, I will drain that glass again. Such hilarious visions clamber…
[0] Very good for a non-human.
Earlier quoted context omitted.
Your opinion on this probably depends on what your job currently looks like. Everywhere I've worked there's been significantly more stuff we wanted to do than we could actually do. Speeding that up looks awesome to me. But if you work at BigCo and mostly sit on your hands already, then, yeah. I don't know.
> Everywhere I've worked there's been significantly more stuff we wanted to do than we could actually do. Speeding that up looks awesome to me. Does it? Slowing our breakneck anti-human business pace and stopping mindless and environmentally and culturally harmful consumption and production of trinkets is surely better!
Nice write up! I have been using classic back-prop neural networks since the 1980s, and deep learning for the last 8 years. This tech feels like a rocket ship that is accelerating exponentially! I am in my 70s and I don't work much anymore. That said, I find myself spending many hours in a typical day doing what I call "gentleman scientist" activities around Large Language Models. I was walking this morning with a no…
> Emotionally and psychologically I think that some tech and other highly paid knowledge workers just can't accept the sea-change that we are living through. This is a good way to frame it. As a mid-career person, I’m trying to figure out how to respond to these developments in my own career. I think there’s a good chance that software development as a career looks very different in 10 years in terms of the day to da…
Nice write up! I have been using classic back-prop neural networks since the 1980s, and deep learning for the last 8 years. This tech feels like a rocket ship that is accelerating exponentially! I am in my 70s and I don't work much anymore. That said, I find myself spending many hours in a typical day doing what I call "gentleman scientist" activities around Large Language Models. I was walking this morning with a no…
Indeed, it's fascinating to witness a sizable segment of the HN community and distinguished intellectuals like Chomsky displaying absolute denial. I've started bookmarking the comments so I can look back at them in 5 years and have a good laugh. Some from a few months back are already aging badly[0]. [0] https://news.ycombinator.com/item?id=34197033
This caught my attention as I found it implausible: > One DeepMind engineer even reported being able to convince ChatGPT that it was a Linux terminal and getting it to run some simple mathematical code to compute the first 10 prime numbers. Remarkably, it could finish the task faster than the same code running on a real Linux machine. Following the link, there's a screenshot to a screenshot [0] of a code-golf solutio…
So here are a few screenshots that I personally took after telling it that it was a linux terminal: Correctly produces a convincing output for having decoded the base64-encoding of "ping google.com" and then piping it to bash: https://media.infosec.exchange/infosecmedia/media_attachment... Similar command, but with a garbage domain it hasn't seen before, and a less well-known domain. It produced convincing output in…
Edit: the base64 decoding examples are terrifying. I have no idea how that works.
Edit2: actually I can sort of see how that works, b64 encoding doesn’t have any obfuscation to it, I could see how an ML model can build a pretty good approximation over time after seeing all the examples on the internet.