Viewing profile — sdrg822

“Model Control Plane” - quite early to already re-use a popular acronym

Congrats on the launch!

+1 it wouldn’t be terribly useful if it were only caching the tokenizer output.

Where is the lie in this repo?

I think if you actually meet the people you'd realize they're pretty earnest and candid of these things' limitations, though it may not show in tweets and hackernews posts. This re…

But indexing *is* training. It's just not using end-to-end gradient descent.

Dang they use Transformer-XL from 2019 haha - didn't realize people still used that / XLNet-like architectures

It is not.

Congrats on the launch!

Cool. Important note: """ One may ask whether the conditionality introduced by the use of CMM does not make FFFs incompatible with the processes and hardware already in place for d…

It’s only a matter of time

Given that GPTZero was an undergrad’s side project it’s not that surprising?

Attention is Turing complete

For things like BERT where you just want to extract an embedding, the naive way you reach full utilization at inference time is that you : - run tokenization of inputs on CPU - sor…

Yeah this is purely a risk decision for a prototype not an actual technical limitation.

Really well done

Which humans?

Good points!

Just a slight comment - "&" was indeed called "and" (not "per se"), but in reading the alphabet, it was confusing to say "and and." To clear up confusion, one could say "and per se…

Seasoning isn't the problem... Turmeric and cumin added to your pulses aren't going to give you metabolic diseases...

Agreed, the "but" in the bolded text[1] further confuses, but the article highlights some great progress. >> STAR, has responded to 748 incidents." >> about 3 percent of calls for …

> "While it remains to be seen whether transplantation from very young donors can restore cognitive function in aged recipients, the findings demonstrate that age-related shifts in…

Automated summarization, content moderation/censorship, and advertising. It could make publishing more profitable, but will it make enable higher quality content? It feels more lik…

Abbreviation for a popular blogger in the financial independence / retire early domain. See: https://www.mrmoneymustache.com