Glad I managed to get some work done with it while it was working for a few hours. Holy smokes the code interpreter functionality has been a complete game changer for my workflow.
[deleted]
Major outages across ChatGPT and API
431–440 of 617 posts
Re: Major outages across ChatGPT and API
#432Earlier quoted context omitted.
GPT-4 is quite capable of writing function-length sections of code based only on descriptions. Either in a context where you're not sure what the a good approach is (for myself, when writing Javascript for example), or when you know what needs to be done but it's just somewhat tedious. Here's a session from me working on a side project yesterday: https://chat.openai.com/share/a6928c16-1c18-4c08-ae02-82538d... The mos…
Wow, so, you're not a DBE or DBA but are applying indexes across a database without concern because...a computer model spat out that you should?
This is a local SQLite database into which I had slurped a load of information about git commits to do data analysis. If I'd somehow destroyed the database, I would have just created it again.
Re: Major outages across ChatGPT and API
#433Can't they ask chatgpt to fix it?
[deleted]
Re: Major outages across ChatGPT and API
#434I'd be curious to hear about the workflows people have come up with using ChatGPT. I'm still in the realm of "I don't know how to do this" or "I forgot the exact incantation to that" or "is the an X that does Y in framework Z?"
I can share one set that we have. Basically, we use AI to do a lot of formatting for our manuals. It's most useful with the backend XML markups, not WYSIWYG editors. So, we take the inputs from engineers and other stakeholders, essentially in email formats. Then we pass it through prompts that we've been working on for a while. Then it'll output working XML that we can use with a tad bit of clean-up (though that's be…
Did you have any scripts or other explicit “rules-based” systems to do this before? Is it a young company?
It sounds like a pretty old and common use case in technical writing and one that many organizations already optimized plenty well: you coach contributors to aim towards a normal format in their email and you maintain some simple tooling to massage common mistakes towards that normal.
What prompted you to use an LLM for this instead of something more traditional? Hype? Unfamiliarity with other techniques? Being a new company and seeing this as a more compelling place to start? Something else?
Re: Major outages across ChatGPT and API
#435Welcome to the new world where AI compute is a scarce resource. Sorry guys, 3nm chip factories don't fall out of the skies when you click a few buttons on the AWS console. This is so different from what people were used to when compute was trivial and not in short supply for CRUD apps.
I was listening to a podcast, I forget which, and some AI consultancy guy said they don't have the chips to do all the things everyone wants to do with AI, so they aren't even selling it except to the most lucrative customers.
Re: Major outages across ChatGPT and API
#436Welcome to the new world where AI compute is a scarce resource. Sorry guys, 3nm chip factories don't fall out of the skies when you click a few buttons on the AWS console. This is so different from what people were used to when compute was trivial and not in short supply for CRUD apps. I was listening to a podcast, I forget which, and some AI consultancy guy said they don't have the chips to do all the things everyon…
[deleted]
Re: Major outages across ChatGPT and API
#437Earlier quoted context omitted.
I am curious how people are using Phind. I actually had a discussion with Phind itself recently, in which I said that in order to help me, it seems like it would need to ingest my codebase so that it understands what I am talking about. Without knowing my various models, etc, I don't see how it could write anything but the most trivial functions. It responded that, yes, it would need to ingest my codebase, but it cou…
Founder here. We have a VS Code extension that automatically fetches context from your codebase.
[dead]
Re: Major outages across ChatGPT and API
#438Earlier quoted context omitted.
And then you will have to endure not using a model by OpenAI that is 10x better than a local one
What is so special about OpenAI's cloud hardware that one can't build themselves a similar server to run AI models of similar size?
The hardware is primarily standard Nvidia GPUs (A100s, H100s), but the scale of the infrastructure is on another level entirely. These models currently need clusters of GPU-powered servers to make predictions fast enough. Which explains why OpenAI partnered with Microsoft and got billions in funding to spend on compute.
You can run (much) smaller LLM models on consumer-grade GPUs though. A single Nvidia GPU with 8 GB RAM is enough to get started with models like Zephyr, Mistral or Llama2 in their smallest versions (7B parameters). But it will be both slower and lower quality than anything OpenAI currently offers.
Re: Major outages across ChatGPT and API
#439Made me realize how much I depend on the service already, spooky stuff.
Yeah, I only started using it in August, and I had this realization when it was down a couple weeks ago. I found myself saying, "I guess I'll take the afternoon off and come back to figuring out this task tomorrow." Like I could have poured over documentation and figured out for myself how to implement the thing that I had in mind, like in the old days, but it would probably take me longer than just waiting for ChatGPT to come back up and do it for me. At least that's how I'm rationalizing it; maybe I've just become very lazy.
I mostly use it for writing and debugging small Bash and Python scripts, and creating tables and figures in LaTeX.
Re: Major outages across ChatGPT and API
#440Earlier quoted context omitted.
GPT-4 is quite capable of writing function-length sections of code based only on descriptions. Either in a context where you're not sure what the a good approach is (for myself, when writing Javascript for example), or when you know what needs to be done but it's just somewhat tedious. Here's a session from me working on a side project yesterday: https://chat.openai.com/share/a6928c16-1c18-4c08-ae02-82538d... The mos…
This lines up with my general experience with it. It’s quite proficient at turning a decently detailed description into code if I give it the guard rails. I’ve compared it to having a junior developer at your disposal. They could do a lot of damage if they were given prod access but can come back with some surprisingly good results.
Are you at all worried about what happens if we have a generation of human junior developers who just delegate to this artificial junior developer?
I do. If too many of our apprentices don’t actually learn how to work the forge, how ready will they be to take over as masters someday themselves?
I can see how ChatGPT was useful to the grandparent today, but got very disturbed by what it might portend for tomorrow. Not because of job loss and automation, like many people worry, but because of spoiled training and practice opportunities.
I liked your take, so I’d be curious to hear what you think.