Live data from Hacker News

Workers with less experience gain the most from generative AI

mitsloan.mit.edu

71–80 of 120 posts

Re: Workers with less experience gain the most from generative AI

#71

It can't even get regular expressions correct in my experience

I've had it fail to get a basic regex right, but simultaneously, found it able to model my custom problem using the z3 constraint solcing framework, which I'd have struggled to do myself. Regular expressions are probably harder for it to get right easily, at least not without prompting it to first think through step by step ehat each piece of a regex should be or something.

Re: Workers with less experience gain the most from generative AI

#72
post #55

Earlier quoted context omitted.

Yep, it's been great for me for knocking together scripts in Python where I know there will be a way to do something like open a csv file and read it into a list of dicts, but am not familiar enough with the ecosystem yet to know exactly what packages might be useful or how to invoke them. I could work the same thing out from stack overflow, but it would take a lot longer.

But did it do you any favours? The increadably well written official python csv doc manages to suggest using iterators rather then loading what may eventually be too much data into a list, Points out that the are dialects of CSV and some common ones you might use. https://docs.python.org/3/library/csv.html

If it works, and it's a one-off script, why do I care?

Re: Workers with less experience gain the most from generative AI

#73
post #6

My experience with Bard/ChatGPT has been that you'll easily shoot your foot off if you don't know what you're doing. Dangerous for workers with less experience. I see claims that it makes you 7-8x more effective. That hasn't been my experience. Maybe 5-10% improvement at best. Instead of Googling myself, LLMs can sometimes give me the answer more quickly than I could find it. Once you ask it anything not easily scrap…

The thing I find them best for is fuzzy searching. When you'd have a hard time googling something, you ask the LLM. The answer you get back might also be fuzzy, but often that can be defuzzed and then correctly googled or resourced. In this way it is highly effective. But that is reducing the amount of time searching for information. People that are 5-10x more effective at hard skills like programming, well I'm just…

Similar experience, agents or tools as part of LLM framework can help 'defuzzing'.

Re: Workers with less experience gain the most from generative AI

#74
post #42

Earlier quoted context omitted.

For legacy code: - generate comments (hit or miss, but at least it can rewrite my random notes into consistent notes) - generate type annotations - refactor "broadly" (say, "rename all variables to match the following style" or "turn this class into a dataclass like XXX" or "transform the SQL queries into builder queries using XYZ"). Often requires some manual work but it gets a lot of tedious stuff out of the way -…

> - generate SQL queries at the speed of mouth Because of the points this is the nearest to the work that some colleagues do, I anakyze this point (but you could ask similar questions about many of the other points): In my experience, writing correct SQL queries (which often tend to be quite non-trivial because of the internal complexity of the projects) typically involves a lot of knowledge about the whole system th…

Have you tried this at all?

I find that many of the generative AI models (GPT-4, 3.5, even MPT-30B running on my laptop) are really shockingly good at SQL.

Paste in a query and ask it for a detailed explanation. I've genuinely not seen it NOT provide a good result for that yet.

Generating new SQL queries is a bit harder, because of the context you need to provide - but I've had very strong results from that as well.

I've had the best results from providing both the schema and a couple of example rows from each table - which helps it identify things like "the country column contains abbreviations like US and GB".

If you've found differently I'd love to hear about it.

Re: Workers with less experience gain the most from generative AI

#76
post #6

My experience with Bard/ChatGPT has been that you'll easily shoot your foot off if you don't know what you're doing. Dangerous for workers with less experience. I see claims that it makes you 7-8x more effective. That hasn't been my experience. Maybe 5-10% improvement at best. Instead of Googling myself, LLMs can sometimes give me the answer more quickly than I could find it. Once you ask it anything not easily scrap…

It is not intelligent. Let's just accept it. Ask what happens if you go due east exactly from NYC in a boat. Eventually you'll hit land where does it hit? Totally collapses with false information. Of course you can ask what parallel NYC is at and ask the western most point of Europe at the same parallel and it'll maybe get it right. Give it basic directions. I'm in my car turning right on spring garden onto Broad str…

[deleted]

Re: Workers with less experience gain the most from generative AI

#77

This is exactly the opposite of my experience with it. Getting it to code, it can save me, a fairly experienced coder, quite a lot of time because it can do some boring things - boilerplate stuff, or things I can’t be bothered to look up. And I can tell if it’s done it right or not. I’ve seen people with less coding experience use it and just take its suggestions at face value with painful results and definite detrim…

I like to use it as a jumping off point for a big project. We’re migrating from server round trip navigation to client side navigation and there’s a lot of steps to think through. It helps me get past the “blank paper” phase much faster.

Re: Workers with less experience gain the most from generative AI

#78
post #42

Earlier quoted context omitted.

For legacy code: - generate comments (hit or miss, but at least it can rewrite my random notes into consistent notes) - generate type annotations - refactor "broadly" (say, "rename all variables to match the following style" or "turn this class into a dataclass like XXX" or "transform the SQL queries into builder queries using XYZ"). Often requires some manual work but it gets a lot of tedious stuff out of the way -…

Are you testing chatgpts output in any way? I’ve considered using it for tasks but after hearing all the talk of how it can write good looking code that ends up not working as you might expect, I started wondering if the time savings from generating that block are wasted from interpreting and testing.

I have access to ChatGPT Code Interpreter mode, where it can both write Python and then execute it.

I use that to write code all the time, because ChatGPT can write the code, run it, get an error, then re-write the code to address the error.

Here are two recent transcripts whereI used it in this way:

- https://chat.openai.com/share/b062955d-3601-4051-b6d9-80cef9...

- https://chat.openai.com/share/b9873d04-5978-489f-8c6b-4b948d...

Re: Workers with less experience gain the most from generative AI

#80
post #6

My experience with Bard/ChatGPT has been that you'll easily shoot your foot off if you don't know what you're doing. Dangerous for workers with less experience. I see claims that it makes you 7-8x more effective. That hasn't been my experience. Maybe 5-10% improvement at best. Instead of Googling myself, LLMs can sometimes give me the answer more quickly than I could find it. Once you ask it anything not easily scrap…

It is not intelligent. Let's just accept it. Ask what happens if you go due east exactly from NYC in a boat. Eventually you'll hit land where does it hit? Totally collapses with false information. Of course you can ask what parallel NYC is at and ask the western most point of Europe at the same parallel and it'll maybe get it right. Give it basic directions. I'm in my car turning right on spring garden onto Broad str…

https://imgur.com/qAX6w9S

> My prompt:

What happens if you go due east exactly from NYC in a boat. Eventually you'll hit land where does it hit?

Start your response with "Let's work this out in a step by step way to be sure we have the right answer:" and work this out in a step by step way to be sure you have the right answer

> GPT-4 answer:

Let's work this out in a step by step way to be sure we have the right answer:

1. Firstly, the direction "due east" means you would be following a line of latitude, rather than a straight line on a globe. This is because the Earth is a sphere (more accurately, an oblate spheroid) rather than a flat surface.

2. New York City is located approximately at 40.71 degrees North latitude. If you were to go due east from NYC, you would be following this line of latitude across the Atlantic Ocean.

3. The first landmass you would likely encounter on this journey would be the westernmost points of mainland Europe, specifically the Iberian Peninsula which comprises Spain and Portugal. However, due to the curvature of the Earth and the specific latitude of New York, it is more likely that you'd hit the northern coast of Spain, around the region of Galicia.

4. So, based on this understanding, if you started in New York City and traveled due east, you would likely end up hitting the northern coast of Spain.

However, it's important to note that this answer assumes idealized conditions and that you're strictly adhering to the 40.71-degree North line of latitude. In reality, ocean currents, winds, and other factors might cause a vessel to drift from this line. Plus, the exact landfall can vary depending on the precise starting point in New York City, which is spread out over a fairly large geographical area.

---

https://imgur.com/ExRr1YN

> My prompt:

I'm in my car turning right on spring garden onto Broad street. I Travel north 10 miles on the same road. Where am I?

Start your response with "Let's work this out in a step by step way to be sure we have the right answer:" and work this out in a step by step way to be sure you have the right answer

> GPT-4 answer:

Let's work this out in a step by step way to be sure we have the right answer:

1. First, we need to identify where Spring Garden Street and Broad Street intersect. These are streets located in Philadelphia, Pennsylvania.

2. From the intersection, you said you would be turning right onto Broad Street, indicating that you are now heading north on Broad Street.

3. You then proceed to travel 10 miles north on Broad Street.

Determining the exact location after these steps is a bit more challenging because street maps generally don't provide mileage measurements. The scale can vary, and the actual distance can depend on the specific path taken.

However, to give a rough idea, Broad Street in Philadelphia is approximately 13 miles long from its southern end to its northern end. Given that Spring Garden Street is relatively central, traveling 10 miles north could possibly place you near or past the city limits of Philadelphia, but without more detailed map information, it's difficult to be more precise.

You'd likely end up in the vicinity of Cheltenham or Elkins Park, which are northern suburbs of Philadelphia, if the distance traveled is relatively straight, but again this could vary based on the specific path taken and the precise start location. This is a rough estimate and the exact location may vary. For precise navigation, it's recommended to use GPS or a reliable map application.

Post reply on HN