Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

LoRA Learns Less and Forgets Less

arxiv.org

Post reply on HN
Print view View original

41–50 of 65 posts

Re: LoRA Learns Less and Forgets Less

#41

Post by [deleted] »

squarefoot wrote: post #12
sva_ wrote: post #11

Earlier quoted context omitted.

Yes, but this is LoRA, clearly not LoRa.

PP has a point though. I entered "LoRA" on Google, DuckDuckGo, Startpage and Bing, and all returned results in all first pages were about the communication protocol (1). They could have inferred my interests from previous searches, but I never used Bing in the last year or so, so it seems to me someone didn't care about name clashes. (1) well, except Google which -surprise- returned about mid page an ad of a local qu…

[deleted]

Re: LoRA Learns Less and Forgets Less

#43

Post by mbirth »

atherton33 wrote: post #23
sva_ wrote: post #11

Earlier quoted context omitted.

Yes, but this is LoRA, clearly not LoRa.

I think you mean LoRa®, a registered trademark of Semtech® Corporation, for use only with permission and within specific guidelines. https://www.semtech.com/uploads/company/FAQ-for-Use-of-LoRa-...

Not to be confused with Semtex who sell a completely different kind of problem solver.

Re: LoRA Learns Less and Forgets Less

#44

Post by refulgentis »

squarefoot wrote: post #12
sva_ wrote: post #11

Earlier quoted context omitted.

Yes, but this is LoRA, clearly not LoRa.

PP has a point though. I entered "LoRA" on Google, DuckDuckGo, Startpage and Bing, and all returned results in all first pages were about the communication protocol (1). They could have inferred my interests from previous searches, but I never used Bing in the last year or so, so it seems to me someone didn't care about name clashes. (1) well, except Google which -surprise- returned about mid page an ad of a local qu…

Wait until you find out its a name too

Re: LoRA Learns Less and Forgets Less

#45

Post by noisy_boy »

mbirth wrote: post #43
atherton33 wrote: post #23

Earlier quoted context omitted.

I think you mean LoRa®, a registered trademark of Semtech® Corporation, for use only with permission and within specific guidelines. https://www.semtech.com/uploads/company/FAQ-for-Use-of-LoRa-...

Not to be confused with Semtex who sell a completely different kind of problem solver.

Isn't Semtex an explosive aka RDX?

Re: LoRA Learns Less and Forgets Less

#47

Post by yau8edq12i »

rzzzt wrote: post #33

This paper has 12 authors, which fascinates me to no end for some unexplainable reason. How does it work? Is it a common occurrence to have this many people working on a submission? Did each of them get at least a paragraph in edgewise?

Wait until you learn that the paper on the LHC has more than 5000 authors: https://www.nature.com/articles/nature.2015.17567

Re: LoRA Learns Less and Forgets Less

#48

Post by bryanrasmussen »

goodpoint wrote: post #36
dheera wrote: post #27

Earlier quoted context omitted.

Not sure about "popular" 99% of ML engineers wouldn't know what it is.

...but they should know how to use search engines...

at some point we are going to run out of easily pronounceable abbreviations that are unique. Perhaps that point is actually in the past and we should just acknowledge it and move on. Although I guess it could have been Lorall - oops, that's a character in World of Warcraft.

Re: LoRA Learns Less and Forgets Less

#49

Post by bmitc »

dheera wrote: post #27
thepasswordis wrote: post #10

I really wish people would be more careful about choosing names for these things. LoRa has been a popular wireless protocol for like 10 years.

Not sure about "popular" 99% of ML engineers wouldn't know what it is.

Not much of a surprise there. The ML culture is to reinvent names for everything.

Re: LoRA Learns Less and Forgets Less

#50

Post by HeatrayEnjoyer »

martinky24 wrote: post #8
hybridtupel wrote: post #2

This is about Low-rank adaptation. Not to be confused with LoRa the long range proprietary radio communication technique, which hopefully doesn't learn at all.

"Why the hell is LoRa learning" was indeed my first thought...

This is how the subs were knocked offline in Terminator III
Post reply on HN