Live data from Hacker News

Grammarly is offering ‘expert’ AI reviews from famous dead and living writers

wired.com

61–70 of 214 posts

Re: Grammarly is offering ‘expert’ AI reviews from famous dead and living writers

#61

Earlier quoted context omitted.

That isn't learning, it can read things in its context, and generate materials to assist answering further prompts but that doesn't change the model weights. It is just updating the context. Unless you are actually fine tuning models, in which case sure, learning is taking place.

i don't know why you think it matters how it works internally. whether it changes its weights or not is not important. does it behave like a person who learns a thing? yes. if i showed a human a codebase and asked them questions with good answers - yes i would say the human learned it. the analogy breaks at a point because of limited context but learning is a good enough word.

Maybe because I work on a legacy programming language with far less material in the training? For me it makes a difference because it partly needs to "learn" the language itself and have that in the context, along with codebase specific stuff. For something with the model already knowing the language and only needing codebase specific stuff it might feel different.

Re: Grammarly is offering ‘expert’ AI reviews from famous dead and living writers

#62

Earlier quoted context omitted.

Is the reason it can show steps for solving an integral because the training set contained webpages or books showing how to do it?

if we have steps for understanding any author's english and creative process (generally not specific to an author) would you agree then it is possible for an llm to do it?

Repeating a process, yes for sure, even (pseudorandom?) variations on a process. Understanding a process is a different question, and I’m not sure how you would measure that.

In school we would have a test with various questions to show you understand the concept of addition, for example. But while my calculator can perfectly add any numbers up to its memory limit, it has no understanding of addition.

Re: Grammarly is offering ‘expert’ AI reviews from famous dead and living writers

#63

Earlier quoted context omitted.

You will produce output that emulates the patters of Shakespeare's works, but you won't arrive at them by the same process Shakespeare did. You are subject to similar limitations as the llm in this case, just to a lesser degree (you share some 'human experience' with the author, and might be able to reason about their though process from biographies and such) As another example, I can write a story about hobbits and…

that's fair and you have highlighted a good limitation. but we do this all the time - we try to understand the author, learn from them and mimic them and we succeed to good extent. that's why we have really good fake van gogh's for which a person can't tell the difference. of course you can't do the same as the original person but you get close enough many times and as humans we do this frequently. in the context of…

You're still confusing "has a result that looks the same" and "uses the same process"; these are different things.

Re: Grammarly is offering ‘expert’ AI reviews from famous dead and living writers

#64
post #11

Earlier quoted context omitted.

Enough with this analgoy. It's flawed on so many levels. First and foremost, stop devaluing humanitiy and hyping up AI companies by parroting their party line. Second, LLMs don't learn. They can hold a very limited amount of context, as you know. And every time you need to start over. So fuck no, "teaching" and LLM is nothing like teaching an actual human.

absolutely they can learn. you are being emotional and the original point is correct. i give the LLM my codebase and it indeed learns about it and can answer questions.

[flagged]

Re: Grammarly is offering ‘expert’ AI reviews from famous dead and living writers

#65
post #3

The most interesting is the realization that if the LLM's input is only the output of a professional (human), then by definition the LLM cannot mimic the process the (human) professional applied to get from whatever input they had to produce the output. In other words an LLM can spit out a plausible "output of X", however it cannot encode the process that lead X to transform their inputs into their output.

You've pinpointed the connection that people fail to make when they seek legal advice (or even information) from LLMs.

Re: Grammarly is offering ‘expert’ AI reviews from famous dead and living writers

#66
post #52

Earlier quoted context omitted.

An LLM can always output steps, but it doesn’t mean they are true , they are great at making up bullshit. When the “how many ‘r’ in ‘strawberry’” question was all the rage, you could definitely get LLMs to explain the steps of counting, too. It was still wrong.

can you provide a single example now with gpt 5.4 thinking that makes up things in steps? lets try to reproduce it.

I’m pretty sure you can think of one yourself, I’m not going to play this game. Now it’s 5.4 Thinking, before that it was 5.3, before that 5.2, 5.1, 5, before that it was 4… At every stage there’s someone saying “oh, the previous model doesn’t matter, the current one is where it’s at”. And when it’s shown the current model can’t do something, there’s always some other excuse. It’s a profoundly bad faith argument, the very definition of moving the goal posts.

I do have a number of examples to give you, but I no longer share those online so they aren’t caught and gamed. Now I share them strictly in person.

Re: Grammarly is offering ‘expert’ AI reviews from famous dead and living writers

#67

Earlier quoted context omitted.

that's fair and you have highlighted a good limitation. but we do this all the time - we try to understand the author, learn from them and mimic them and we succeed to good extent. that's why we have really good fake van gogh's for which a person can't tell the difference. of course you can't do the same as the original person but you get close enough many times and as humans we do this frequently. in the context of…

You're still confusing "has a result that looks the same" and "uses the same process"; these are different things.

Why do you say it has a different process? When I ask it to do integrals it uses the same process as me

Re: Grammarly is offering ‘expert’ AI reviews from famous dead and living writers

#68
post #66

Earlier quoted context omitted.

can you provide a single example now with gpt 5.4 thinking that makes up things in steps? lets try to reproduce it.

I’m pretty sure you can think of one yourself, I’m not going to play this game. Now it’s 5.4 Thinking, before that it was 5.3, before that 5.2, 5.1, 5, before that it was 4… At every stage there’s someone saying “oh, the previous model doesn’t matter, the current one is where it’s at”. And when it’s shown the current model can’t do something, there’s always some other excuse. It’s a profoundly bad faith argument, the…

Ok so no example.

Re: Grammarly is offering ‘expert’ AI reviews from famous dead and living writers

#69

Earlier quoted context omitted.

if we have steps for understanding any author's english and creative process (generally not specific to an author) would you agree then it is possible for an llm to do it?

Repeating a process, yes for sure, even (pseudorandom?) variations on a process. Understanding a process is a different question, and I’m not sure how you would measure that. In school we would have a test with various questions to show you understand the concept of addition, for example. But while my calculator can perfectly add any numbers up to its memory limit, it has no understanding of addition.

It’s the degree of generalisability. And LLMs do have understanding. You can ask it how it came up with the process in natural language and it can help - something a calculator can’t do.

Re: Grammarly is offering ‘expert’ AI reviews from famous dead and living writers

#70

Earlier quoted context omitted.

i don't know why you think it matters how it works internally. whether it changes its weights or not is not important. does it behave like a person who learns a thing? yes. if i showed a human a codebase and asked them questions with good answers - yes i would say the human learned it. the analogy breaks at a point because of limited context but learning is a good enough word.

Maybe because I work on a legacy programming language with far less material in the training? For me it makes a difference because it partly needs to "learn" the language itself and have that in the context, along with codebase specific stuff. For something with the model already knowing the language and only needing codebase specific stuff it might feel different.

But my codebase isn’t there in training set yet it learns and I can ask questions
Post reply on HN