Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Revert for jart’s llama.cpp MMAP miracles

github.com

Post reply on HN
Print view View original

91–96 of 96 posts

Re: Revert for jart’s llama.cpp MMAP miracles

#91

Post by patroom »

lhnz wrote: post #83
ddren wrote: post #81

Earlier quoted context omitted.

I was trying to distance myself from this situation, but this is just too painful to read. I am sincerely sorry that people have harassed you on my behalf, but I have no control over what some people say or do on an anonymous board based on publicly available information. That doesn't mean that I am happy with the way our collaboration was handled. Why did you create a new converter when you knew there was already an…

> I was trying to distance myself from this situation [...] You were trying to distance yourself from the situation? Looking at https://rentry.co/Jarted [0], there was somebody claiming to be you saying things like: 1. "Slaren here. Pretty much all that has been said here is correct, what jart did was to take my code, remove backwards compatibility, add a new converter and then proceed to take all the credit." 2. "To…

[flagged]

Re: Revert for jart’s llama.cpp MMAP miracles

#92

Post by IAmNotACellist »

lhnz wrote: post #90
IAmNotACellist wrote: post #89

Earlier quoted context omitted.

"my changes" "Here's how folks in the community have been reacting to my work." "I just wrote a change that's going to let your LLaMA models load instantly..." https://archive.ph/PyPFZ "I'm the author" https://archive.ph/qFrcY "Author here..." "Tragedy of the commons...We're talking to a group of people who live inside scientific papers and jupyer notebooks." "My change helps inference go faster." "The point of my ch…

From what I can see, @jart had spent a considerable amount of time on this problem and had posted an interesting-but-not-production hack to it ( https://github.com/ggerganov/llama.cpp/commit/5b8023d9354010... ) on March 17th, which they had also excitedly posted about on Twitter. This was 2 weeks prior to @slaren's contribution ( https://github.com/slaren/llama.cpp/commit/fc685122f95f212d1... ) on March 29th, so in a…

If you read the rentry you'll see that both of them were working on an issue that l29ah raised, along with other users. jart's work was on something that didn't end up making it in, the malloc() approach. slaren is the one who wrote the code in the commits I linked to, and that's the code that was adopted. You can (and should) do a comparison of the mmap code and see. What I wrote about the version change, magic number, WIN32, etc., is all true too. As is the haste with which the new PR was made, leading to the recent pushes to revert due to swap thrashing and anger over false and rushed claims about "miracle RAM reduction" etc.

In fact, if you read the thread you linked to, you'll see this for yourself too, no reentry required. There's nothing actually objectionable or "repulsive," as jart put it, in that renetry, with an exception of the "r word" being applied to a proposed technical solution.

Your interpretation is incompatible with what we see and the clear timeline. The social media bragging, the second PR, etc., are further evidence. I hope whatever anger you had going into this has abated to the point where you can now actually judge the evidence.

Re: Revert for jart’s llama.cpp MMAP miracles

#93

Post by dontupvoteme »

lhnz wrote: post #83
ddren wrote: post #81

Earlier quoted context omitted.

I was trying to distance myself from this situation, but this is just too painful to read. I am sincerely sorry that people have harassed you on my behalf, but I have no control over what some people say or do on an anonymous board based on publicly available information. That doesn't mean that I am happy with the way our collaboration was handled. Why did you create a new converter when you knew there was already an…

> I was trying to distance myself from this situation [...] You were trying to distance yourself from the situation? Looking at https://rentry.co/Jarted [0], there was somebody claiming to be you saying things like: 1. "Slaren here. Pretty much all that has been said here is correct, what jart did was to take my code, remove backwards compatibility, add a new converter and then proceed to take all the credit." 2. "To…

Pretending to be someone else to stir up drama is pretty much par for the course for 4chan, especially because they really, REALLY hate transexuals. I'd have been more surprised if someone WASN'T claiming to be slaren.

Trust absolutely nothing from that site or any other imageboard unless people provide documented evidence, e.g. timestamped picture or signed message, etc

>The stories and information posted here are artistic works of fiction and falsehood.

>Only a fool would take anything posted here as fact.

I don't actually have any idea where this quote appears these days, I've just been hearing it in reference to chans for well over a decade now. I think it might have been on the bottom of every page in the past.

Re: Revert for jart’s llama.cpp MMAP miracles

#94

Post by up2isomorphism »

jart wrote: post #62
azeirah wrote: post #60

Earlier quoted context omitted.

huh? Of all things what does 4chan have to do with anything here?

See https://rentry.org/Jarted I'm not sure if it's 4chan but it appears to be some chan. When I was working on solving the mmap() problem in https://github.com/ggerganov/llama.cpp/issues/91 (that issue tracks the full history) I originally wrote a malloc() hack to prove zero latency load times could work. But I thought we should hold off and wait until we could fix the file format before merging anything into master.…

The moment you involve a topic that is hot with bunch of bystanders you are endangering yourself by fighting/invoking with stupid people with abundant time.

Re: Revert for jart’s llama.cpp MMAP miracles

#95

Post by xcdzvyn »

dontupvoteme wrote: post #93
lhnz wrote: post #83

Earlier quoted context omitted.

> I was trying to distance myself from this situation [...] You were trying to distance yourself from the situation? Looking at https://rentry.co/Jarted [0], there was somebody claiming to be you saying things like: 1. "Slaren here. Pretty much all that has been said here is correct, what jart did was to take my code, remove backwards compatibility, add a new converter and then proceed to take all the credit." 2. "To…

Pretending to be someone else to stir up drama is pretty much par for the course for 4chan, especially because they really, REALLY hate transexuals. I'd have been more surprised if someone WASN'T claiming to be slaren. Trust absolutely nothing from that site or any other imageboard unless people provide documented evidence, e.g. timestamped picture or signed message, etc >The stories and information posted here are a…

It's /b/'s banner.

Re: Revert for jart’s llama.cpp MMAP miracles

#96

Post by eecc »

xiphias2 wrote: post #64
fastball wrote: post #57

Earlier quoted context omitted.

Not super surprising. These projects have (understandably given the current environment) blown up in the last few weeks. The level of exposure / pace / etc is something very few people in general are probably equipped to deal with.

I agree. Also as a person who tried to contribute to open source projects, I understand the pressure Jart had to put all his changes into 1 big change instead of splitting it up to pieces: there's always a power asymmetry that favors the project maintainer by default as he's getting more famous (which happened to Greg). If Jart would have tried to do everything the ,,proper way'', this change wouldn't have had this v…

looks like a she/her, and she _might_ have mis-appropriated attribution. Not sure, but we live in a world that doesn't assume good-will. https://rentry.org/Jarted
Post reply on HN