Live data from Hacker News

Canvas is a new way to write and code with ChatGPT

openai.com

561–570 of 701 posts

Re: Canvas is a new way to write and code with ChatGPT

#562

Earlier quoted context omitted.

I know a similar non-coding founder who was using LLMs to create a full fledged TypeScript based SaaS product and regularly comes to me with high level architecture questions, but also doesn't know or care to figure out what HTTP methods are, variable names are a mishmash of whatever case the LLM decided to generate that day, and there are no tests whatsoever. It's held together by sheer force of manual QA. ...but. I…

This my technique- test the output, make sure it works (in the sense of outputs) the way I want. Test the input edge cases, move on. Occasionally when I can't get it to do what I want the llm suggests things like logging of output between functions etc- in which case they get added, but at the end I ask it to take out all the logging and make the code more concise. And sometimes it breaks in ways I can't fix - so rol…

This is how you end up with software full of vulnerabilities.

Re: Canvas is a new way to write and code with ChatGPT

#563

The issue I continue to have with many AI coding tools is they want me to use their own editor ("native", aka VSCode fork, or in the browser like this). I have zero intention of moving away from IDEA and nothing I've seen so far is good enough to make me want to switch. I really with there was more of "bringing AI into your existing tools/workflows" instead of "here is a new tool with AI baked in".

The icky demo of how much worse /r/LinkedinLunatics is going to get aside: is this the front foot of a globe-spanning, cutting edge research lab at the very efficient frontier of human and machine intelligence?

Or is it yet another lame distraction effort around the abject and embarrassing failure to ship GPT-5?

These people are pretty shameless in ways that range from “exceedingly poor taste” to “interstate wire fraud” depending on your affiliation, but people who ship era-defining models after all the stars bounced they are not.

Re: Canvas is a new way to write and code with ChatGPT

#564

Earlier quoted context omitted.

"past performance is not indicative of future results"

Is it not though? It's not a guarantee but definitely an indication.

Not really. Only thing you can guarantee is things change.

Re: Canvas is a new way to write and code with ChatGPT

#565

The issue I continue to have with many AI coding tools is they want me to use their own editor ("native", aka VSCode fork, or in the browser like this). I have zero intention of moving away from IDEA and nothing I've seen so far is good enough to make me want to switch. I really with there was more of "bringing AI into your existing tools/workflows" instead of "here is a new tool with AI baked in".

This is not an issue. Technology moves forward. You don't adapt, you fall behind. There were other editors and IDE's before the one you use. New devs will use it. Anyway, I don't use them either. I prefer to use ChatGPT and Claude directly.

Technology also moves into dead ends. Not every change is progress. You can only tell a posteriori which paths were fruitful and which were not.

Re: Canvas is a new way to write and code with ChatGPT

#566

Small ot, but it's quite interesting that the highest decisive impact generative AI is having right now is on tech workers and software developers in particular. I'm more and more convinced that we're on the edge of a major shake up in the industry with all these tools. Not getting replaced, but at this rate of improvements I can't unsee major changes. A recent junior I have in my team built his first app entirely wi…

The more I think about it, the more I am convinced developers will be the "first to go" when AGI takes over. Before bloggers and youtubers. Because programming is an activity that requires the least amount of "grounding to reality" among all human activities. We made sure of this with layers and layers of convenient abstraction. What about developers that code the AI systems? Well.. I am sure AGI will come from other…

> Because programming is an activity that requires the least amount of "grounding to reality" among all human activities.

Maybe once you're deep into APIs that talk to other APIs, but near the surface where the data is collected there's nothing but "grounding to reality".

As my professor of Software Engineering put it: when building a system for counting the number of people inside a room most people would put a turnstile and count the turns. Does this fulfill the requirement? No - people can turn the wheel multiple times, leave through a window, give birth inside the room, etc. Is it good enough? Only your client can say, and only after considering factors like "available technology" and "budget" that have nothing to do with software.

Re: Canvas is a new way to write and code with ChatGPT

#567

Earlier quoted context omitted.

This is not an issue. Technology moves forward. You don't adapt, you fall behind. There were other editors and IDE's before the one you use. New devs will use it. Anyway, I don't use them either. I prefer to use ChatGPT and Claude directly.

Technology also moves into dead ends. Not every change is progress. You can only tell a posteriori which paths were fruitful and which were not.

Everything ends. Even things you used for a long time.

Re: Canvas is a new way to write and code with ChatGPT

#569
post #318

Earlier quoted context omitted.

> If anything it makes them more important because you can't systematically arrive at good ones Important and easy to make are not the same I never said prompts didn’t matter, just that they’re so easy to make and so similar to others that they aren’t a moat. > I may be wrong - but I'll speculate you work on infra and have never had to build a (real) application that is trying to achieve a business outcome. You’re ve…

There is a lot of nonsense in here, for example: > but we know that synthetic datasets make for poor training data This is a silly generalization. Just google "synthetic data for training LLMs" and you'll find a bunch of papers on it. Here's a decent survey: https://arxiv.org/pdf/2404.07503 It's very likely o1 used synthetic data to train the model and/or the reward model they used for RLHF. Why do you think they don…

Sure, hand wave away my entire comment as “nonsense” and ignore how statistics works.

Training a model on synthetic data (obviously) increases bias present in the initial dataset[1], making for poor training data.

IIRC (this subject is a little fuzzy for me) using synthetic data for RLHF is equivalent to just using dpo, so if they did RLHF it probably wasn’t with synthetic data. They may have gone with dpo, though.

[1] https://arxiv.org/html/2403.07857v1

Post reply on HN