This is cool, but I wish it were integrated into tools already used for coding and writing rather than having it be a separate app. This also demonstrates the type of things Google could do with Gemini integrated into Google Docs if they step up their game a bit. Honestly I’m scratching my head on OpenAI’s desire to double down on building out their consumer B2C use cases rather than truly focussing on being the infr…
Canvas is a new way to write and code with ChatGPT
641–650 of 701 posts
Re: Canvas is a new way to write and code with ChatGPT
#642Earlier quoted context omitted.
That's funny, I do the exact same thing. If I'm out and about or otherwise not at a computer, and I have an idea or solution to a bug I wanted to solve, I'll fire up an LLM on my phone (usually Claude these days) and basically brainstorm together the pros and cons, with code sometimes as well.
Curious -- does this happen to you often? Do you do that for your work (what pays your salary) or personal projects? Do you find it stressful to think about coding all the time?
Re: Canvas is a new way to write and code with ChatGPT
#643Earlier quoted context omitted.
google's approach to shipping products is puzzling. It's like they don't care if anyone uses them at all
Google isn't a startup, they aren't desperate to impress anyone. I don't even think they consider "AI" to be a product, which is probably correct. These AI enabled features are background processes that ideally integrate into products over time in ways that don't require you to explicitly know they're even there. Given how widely used Google Docs is, for serious work, disrupting people's workflows is not a good thing…
Re: Canvas is a new way to write and code with ChatGPT
#644Earlier quoted context omitted.
> demonstrates the type of things Google could do with Gemini integrated into Google Docs Or Microsoft! > think OpenAI will end up being either an infrastructure provider OR a SaaS, but not both Microsoft cut off OpenAI's ability to execute on the former by making Azure their exclusive cloud partner. Being an infrastructure provider with zero metal is doable, but it leaves obvious room for a competitor to optimise.
Microsoft is integrating Copilot into many of their products, including Visual Studio and Office/365.
Re: Canvas is a new way to write and code with ChatGPT
#645Earlier quoted context omitted.
There is a lot of nonsense in here, for example: > but we know that synthetic datasets make for poor training data This is a silly generalization. Just google "synthetic data for training LLMs" and you'll find a bunch of papers on it. Here's a decent survey: https://arxiv.org/pdf/2404.07503 It's very likely o1 used synthetic data to train the model and/or the reward model they used for RLHF. Why do you think they don…
Sure, hand wave away my entire comment as “nonsense” and ignore how statistics works. Training a model on synthetic data (obviously) increases bias present in the initial dataset[1], making for poor training data. IIRC (this subject is a little fuzzy for me) using synthetic data for RLHF is equivalent to just using dpo, so if they did RLHF it probably wasn’t with synthetic data. They may have gone with dpo, though. […
Researchers are using synthetic data to train LLMs, especially for fine tuning, and especially instruct fine tuning. You are not up to date with recent work on LLMs.
Re: Canvas is a new way to write and code with ChatGPT
#646Earlier quoted context omitted.
How big is this codebase? gpto-preview and claude sonnet are both fairly capable. Claude has longer context windows and is a little less lazy. aider.chat is working on an architect / coder model right now that's verrrry effective. Essentially - paste your whole codebase into 4o-preview, ask it to rearchitect to spec, and output a design document and list of tasks suitable for a senior dev. Dump that plus your tarball…
Would love a more specific example of this. How to use this architect mode. BTW surprised that tarballs work - aren’t these compressed?
Check out the aider GitHub repository for details but 4o is responsive to text requests too.
Re: Canvas is a new way to write and code with ChatGPT
#647Earlier quoted context omitted.
Andrej is a great communicator. I've never seen evidence that he is an especially exceptional programmer.
Between his roles at companies he's worked for, his research and his open source stuff, what else would you be looking for lol ? Remove all the educator stuff and karpathy would still be one of the most accomplished of his generation in his field. Idk just seems like a weird comment.
Re: Canvas is a new way to write and code with ChatGPT
#648Re: Canvas is a new way to write and code with ChatGPT
#649Re: Canvas is a new way to write and code with ChatGPT
#650Earlier quoted context omitted.
Let’s just throw away all past experience then? It’s a mistake to assume that there will be 100% correlation between the past and future, but it’s probably as bad of a mistake to assume 0% correlation. (Obviously dependant on exactly what you are looking at).
So the choices are 100% or 0%?
Each circumstance is different. Sometimes the past is a good guide to the future – even for the notoriously unpredictable British weather apparently you can get a seventy percent success rate (by some measure) by predicting that tomorrows weather will be the same as todays. Sometimes it is not - the history of an ideal roulette wheel should offer no insights into future numbers.
The key is of course to act in accordance with the probability, risk and reward.