Live data from Hacker News

BYU study: Why some people choose not to use artificial intelligence

news.byu.edu

21–30 of 48 posts

Re: BYU study: Why some people choose not to use artificial intelligence

#21
post #11

I’m a dev working with AI to build tools for others, but I don’t use them personally. Why? Because they make your writing sound like everyone else, they produce shoddy and broken code (unless you’re doing something really commonplace), and they dull your own creativity. If you’re relying on someone else to do your work, you’re going to lose the ability to think for yourself. AI is built essentially on averages. It’s…

> they produce shoddy and broken code

We must have dramatically different approaches to writing code with LLMs. I would never implement AI-written code that I can't understand or prove works immediately. Are people letting LLMs write entire controllers or modules and then just crossing their fingers?

Re: BYU study: Why some people choose not to use artificial intelligence

#22
post #14

The weirdest thing about AI is how shocked people that like AI are that some people don't use it. While i'm sure its a useful tool in some situations, and i don't begrudge anyone who finds value in it, it simply doesn't fit into my life as something that would be useful on a regular basis.

I just had that conversation with a coworker last week, they started with 'I wonder if there is anyone left who isn't using AI daily?', and I had to reply with.. 'um well me actually'.

I only occasionally try it out for specific tasks and have never felt the inclination to try making it a part of any daily process, but his mindset was such that he couldn't perceive of anyone not wanting to fully dive in everyday and that those who didn't were missing out on significant value to their lives.

Re: BYU study: Why some people choose not to use artificial intelligence

#23
The other day, I came across a blog post by someone I really value and it sounded very much like written by AI. So I decided to be very explicit and transparent about my own ways of using (and not using) AI for my blog: https://www.morling.dev/ai/.

TL,DR: I don't use it for writing (I want to say something original in my own voice), but I do use it for copy editing (improving wording, helping with title ideas, etc.).

Re: BYU study: Why some people choose not to use artificial intelligence

#24
post #11

I’m a dev working with AI to build tools for others, but I don’t use them personally. Why? Because they make your writing sound like everyone else, they produce shoddy and broken code (unless you’re doing something really commonplace), and they dull your own creativity. If you’re relying on someone else to do your work, you’re going to lose the ability to think for yourself. AI is built essentially on averages. It’s…

> they produce shoddy and broken code We must have dramatically different approaches to writing code with LLMs. I would never implement AI-written code that I can't understand or prove works immediately. Are people letting LLMs write entire controllers or modules and then just crossing their fingers?

In my experience: Yes.

Doing security reviews for this content can be a real nightmare.

To be fair though I have no issue with using LLM created code with the caveat being YOU MUST BE UNDERSTAND IT. If you don’t understand it enough to be able to review it you’re effectively copying and pasting Stack Overflow

Re: BYU study: Why some people choose not to use artificial intelligence

#25
post #13

I wish OP had linked to the actual study, because that blurb is a press release Resistance to Generative AI: Investigating the Drivers of Non-Use - https://scholarspace.manoa.hawaii.edu/server/api/core/bitstr...

Either I'm an outlier or this is a bad article/study.

All the reasons given are fears:

    Output Quality - Fears that...
    Ethical - Fears about..
    Risk - Fears that...
    Human Connection - Fears that...
    Impairment - Fears that...
    Creativity - Fears that...
My disuse is all about flow and value, not fear. The ways I use it is in refining ideas at a higher level, not outputting code/content/etc (except for rote work).

Re: BYU study: Why some people choose not to use artificial intelligence

#26
When ChatGPT appeared I have been working at a small startup for couple of months that was planning to hire another programmer.

CTO became extremely enthusiastic about ChatGPT and said that the programming would be a dying job and tried to show during presentation how good ChatGPT was and asked it to write a basic code related to our tasks. It produced total garbage that could not be used even as a starting point. CTO tried to prompt it to the needed directions, but it made things worse.

After the presentation I tried to search for the task from the presentation. It turned out there were very few StackOverflow or GitHub entries about it as the topic was rather specialized and ChatGPT tried to average those into the task.

In a month I and another recent hire departed from the company. And a year later the company was hiring programmers again.

Out of curiosity I repeated the task few times with different models all the time resulting in the same garbage.

So my rule of the thumb is that if a task generates a lot of search hit, then perhaps a LLM can average the knowledge into something reasonable. If not, averaging is not possible.

Re: BYU study: Why some people choose not to use artificial intelligence

#27
Of the four top concerns (Output Quality, Ethical Implications, Risk and Human Connection), I agree with the first three and am ambivalent about the fourth. I think the first three are also inseparably interlinked. The Human Connection issue is a bit different - that's more about the individual than the technology, to my mind. As long as no one is forced to use an AI and as long as final decisions are made by responsible humans, we might be OK.

Re: BYU study: Why some people choose not to use artificial intelligence

#28

Earlier quoted context omitted.

> they produce shoddy and broken code We must have dramatically different approaches to writing code with LLMs. I would never implement AI-written code that I can't understand or prove works immediately. Are people letting LLMs write entire controllers or modules and then just crossing their fingers?

In my experience: Yes. Doing security reviews for this content can be a real nightmare. To be fair though I have no issue with using LLM created code with the caveat being YOU MUST BE UNDERSTAND IT. If you don’t understand it enough to be able to review it you’re effectively copying and pasting Stack Overflow

At least with Stack Overflow there's upvotes and comments to give me some confidence (sometimes too much confidence). With LLMs I start hyper-skeptical and remain hyper-skeptical - there's really no way to develop confidence in it because the mistakes can be so random and dissimilar to the errors we're used to parsing in human-generated content.

Having said that, LLMs have saved me a ton of time, caught my dumb errors and typos, helped me improve code performance (especially database queries) and even clued me into to some better code-writing conventions/updated syntax that I hadn't been using.

Re: BYU study: Why some people choose not to use artificial intelligence

#29
Re the ethics part, something I haven't quite understand myself yet:

On one hand, training it isn't "copying" per se, but "learning", so maybe it isn't straight up copyright infringement, unless it can reproduce large parts identically. It could also allow small team/individuals to have much large impact in the world and could lower the barrier to entry for research and experimentation, maybe even other endeavors. It certainly could help with knowledge sharing and accessibility, where downstream creativity and usefulness can outweigh diffuse individual harm. Maybe it expands the creative field rather than shrinks it, that'd be a good thing.

But then on the other hand, many models (datasets) are built with copyrighted works without permission or royalties, with the effect that LLM availability could reduce demand for human livelihoods, leading to eroding fields instead of expanding them. Most releases today are kind of opaque with their training datasets, most are undisclosed and it's hard if not impossible for authors to have agency over if their work is included or not. Maybe if LLMs remain it'll be hard to sustain cultural production instead, that'd be good for no one.

So then what is the best approach for someone who doesn't want the forfeit the usefulness they themselves experience, but also not go directly against what the ethical considerations bring up? In the end I don't know if there is an easy or right side to take, I guess usually the optimum sits somewhere around the middle, not at the extremes at least.

Re: BYU study: Why some people choose not to use artificial intelligence

#30

Earlier quoted context omitted.

> AI is built essentially on averages. It is, but that also means if you prompt it correctly it will give you the answer of the average graduate student working on theoretical physics, or the average expert on the historical inter-cultural conflict of the country you are researching. Averages can be very powerful as well.

I see this argument all the time. That the user must not be prompting correctly. In my experience the way you prompt is less important than the “averageness” of the answer you’re looking for.

Talking about averages is really misleading. Talk about capabilities instead, framed in tool language if you must.

Quoting https://buttondown.com/hillelwayne/archive/ai-is-a-gamechang... about https://zfhuang99.github.io/github%20copilot/formal%20verifi... "In the post, Cheng Huang claims that Azure successfully used LLMs to examine an existing codebase, derive a TLA+ spec, and find a production bug in that spec." This is not the behavior of the "average" anything.

Post reply on HN