Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Zero-Copy GPU Inference from WebAssembly on Apple Silicon

abacusnoir.com

Post reply on HN
Print view View original

11–20 of 59 posts

Re: Zero-Copy GPU Inference from WebAssembly on Apple Silicon

#11

Post by JSR_FDED »

bensyverson wrote: post #6
rvz wrote: post #4

Earlier quoted context omitted.

This sort of obvious pattern is an instant AI dead give-away that I keep on seeing in hundreds of blogs and code posted on this site: "Here is X - it makes Y" "That's not X, it's Y." "...no this, no that, no X, no Y." Another way of telling via code is by deducing the experience of the author if they became an expert of a different language since...yesterday. There will be a time where it will be problematic for thos…

I think the days of on-site interviews with whiteboard tests may be drawing to a close faster than you suspect

Huh, I’m 100% going to interview this way the next time I have to hire an engineer. I can’t think of a better way to get a sense of how a candidate reasons about things, and of their values - do they have a sense of responsibility, conscientiousness, team fit.

All other things that could be LLM-mediated have no more signal.

Re: Zero-Copy GPU Inference from WebAssembly on Apple Silicon

#12

Post by Aurornis »

trueno wrote: post #3

> on Apple Silicon, a WebAssembly module's linear memory can be shared directly with the GPU: no copies, no serialization, no intermediate buffers enhance > no copies, no serialization, no intermediate buffers would it kill people to write their own stuff why are we doing this. out of all the things people immediately cede to AI they cede their human ability to communicate and convey/share ideas. this timeline is bon…

I’ve become overly sensitive to it as well because it’s such a reliable indicator that there are other problems in the work.

I’ve wasted so much time looking at interesting repos this year before discovering that one of the main claims was a hallucination, or that when I got to the specific part of the codebase it just had a big note from the LLM that’s it’s a placeholder until it can figure out how to do the requested thing.

The people who have AI write their articles don’t care if it works or if it’s correct. They’re trying to get jobs and want something quick and interesting that will appeal to a lazy hiring manager. We’re just taking the bait too.

Re: Zero-Copy GPU Inference from WebAssembly on Apple Silicon

#13

Post by z0r »

bensyverson wrote: post #6
rvz wrote: post #4

Earlier quoted context omitted.

This sort of obvious pattern is an instant AI dead give-away that I keep on seeing in hundreds of blogs and code posted on this site: "Here is X - it makes Y" "That's not X, it's Y." "...no this, no that, no X, no Y." Another way of telling via code is by deducing the experience of the author if they became an expert of a different language since...yesterday. There will be a time where it will be problematic for thos…

I think the days of on-site interviews with whiteboard tests may be drawing to a close faster than you suspect

Is this implying that you don't believe people will hire programmers anymore?

Re: Zero-Copy GPU Inference from WebAssembly on Apple Silicon

#14

Post by notepad0x90 »

trueno wrote: post #3

> on Apple Silicon, a WebAssembly module's linear memory can be shared directly with the GPU: no copies, no serialization, no intermediate buffers enhance > no copies, no serialization, no intermediate buffers would it kill people to write their own stuff why are we doing this. out of all the things people immediately cede to AI they cede their human ability to communicate and convey/share ideas. this timeline is bon…

I don't know, to me your sentiment sounds a lot like how back in the day they used to say "you can't just use a calculator all the time, use your brain and show the work on pen and paper".

humans have been using tools to communicate since pre-history. language itself is one tool of communication invented to supersede body-language and grunting and noises. the thought and idea is theirs, it was communicated. Would it be that much different if they used a spellchecker extensively to edit their work?

I get why you're annoyed but is it really such a big deal? random people aren't to blame for whatever other annoyances "AI slop" has created.

Re: Zero-Copy GPU Inference from WebAssembly on Apple Silicon

#15

Post by andsoitis »

JSR_FDED wrote: post #11
bensyverson wrote: post #6

Earlier quoted context omitted.

I think the days of on-site interviews with whiteboard tests may be drawing to a close faster than you suspect

Huh, I’m 100% going to interview this way the next time I have to hire an engineer. I can’t think of a better way to get a sense of how a candidate reasons about things, and of their values - do they have a sense of responsibility, conscientiousness, team fit. All other things that could be LLM-mediated have no more signal.

> I can’t think of a better way to get a sense of how a candidate reasons about things

Some ideas to help you: ask the candidate something underspecified and watch what they do first. Do they ask clarifying questions, make their assumptions explicit? After they answer ask what would change their mind, where does that break down? Pick a topic they know and ask them to explain it to a smart non-engineer. Make them estimate something they can’t look up (forces them to decompose, bound, and calibrate). Once they’ve proposed a solution to a question, change the constraints to see if they can adapt or whether they’re stuck.

What you want to evaluate is dynamic reasoning, adaptability.

Re: Zero-Copy GPU Inference from WebAssembly on Apple Silicon

#17

Post by rdedev »

notepad0x90 wrote: post #14
trueno wrote: post #3

> on Apple Silicon, a WebAssembly module's linear memory can be shared directly with the GPU: no copies, no serialization, no intermediate buffers enhance > no copies, no serialization, no intermediate buffers would it kill people to write their own stuff why are we doing this. out of all the things people immediately cede to AI they cede their human ability to communicate and convey/share ideas. this timeline is bon…

I don't know, to me your sentiment sounds a lot like how back in the day they used to say "you can't just use a calculator all the time, use your brain and show the work on pen and paper". humans have been using tools to communicate since pre-history. language itself is one tool of communication invented to supersede body-language and grunting and noises. the thought and idea is theirs, it was communicated. Would it…

> language itself is one tool of communication invented to supersede body-language and grunting and noises

That's a pretty utilitarian view of language. How would it feel if everyone spoke and wrote like a PR representative? This is what an article written by an LLM is starting to sound like.

I'm even willing to argue that the way in which you convey your ideas is as important as the idea itself. Like we could all be eating soylent for our daily nutritional requirements but we don't. The taste of the food we eat is important. It's the same with writing for me

Re: Zero-Copy GPU Inference from WebAssembly on Apple Silicon

#18

Post by [deleted] »

notepad0x90 wrote: post #14
trueno wrote: post #3

> on Apple Silicon, a WebAssembly module's linear memory can be shared directly with the GPU: no copies, no serialization, no intermediate buffers enhance > no copies, no serialization, no intermediate buffers would it kill people to write their own stuff why are we doing this. out of all the things people immediately cede to AI they cede their human ability to communicate and convey/share ideas. this timeline is bon…

I don't know, to me your sentiment sounds a lot like how back in the day they used to say "you can't just use a calculator all the time, use your brain and show the work on pen and paper". humans have been using tools to communicate since pre-history. language itself is one tool of communication invented to supersede body-language and grunting and noises. the thought and idea is theirs, it was communicated. Would it…

[deleted]

Re: Zero-Copy GPU Inference from WebAssembly on Apple Silicon

#19

Post by ben-schaaf »

notepad0x90 wrote: post #14
trueno wrote: post #3

> on Apple Silicon, a WebAssembly module's linear memory can be shared directly with the GPU: no copies, no serialization, no intermediate buffers enhance > no copies, no serialization, no intermediate buffers would it kill people to write their own stuff why are we doing this. out of all the things people immediately cede to AI they cede their human ability to communicate and convey/share ideas. this timeline is bon…

I don't know, to me your sentiment sounds a lot like how back in the day they used to say "you can't just use a calculator all the time, use your brain and show the work on pen and paper". humans have been using tools to communicate since pre-history. language itself is one tool of communication invented to supersede body-language and grunting and noises. the thought and idea is theirs, it was communicated. Would it…

> the thought and idea is theirs, it was communicated

Are they? I don't know how much they used AI, the entire article could be written from a one sentence prompt and so I'd argue that the thoughts and ideas are not their own.

This isn't like using a spell checker, it's like using a ghost writer.

Post reply on HN