Live data from Hacker News

2nd Batch of the A16Z Open Source AI Grant

a16z.com

1–10 of 10 posts

Re: 2nd Batch of the A16Z Open Source AI Grant

#4
Huge props to A16Z for supporting lucidrains' work! His prolific output was instrumental to my self-teaching process when learning about Transformers, as he probably has the largest collection of publicly available implementations of Transformer-related papers in PyTorch.

I think a large amount of people who get interested in implementing deep learning papers end up referencing lucidrains' work.

Re: 2nd Batch of the A16Z Open Source AI Grant

#6

I immediately thought of the Axolotl Tanks in Dune when I saw this list. Great name.

Axolotl != axlotl https://en.wikipedia.org/wiki/Axolotl https://dune.fandom.com/wiki/Axlotl_Tank

As your second source notes, the Dune thing uses both spellings.

Re: 2nd Batch of the A16Z Open Source AI Grant

#7
Very nice to see LLaVA there, IMO it's one of the last puzzle pieces for a proper open source infrastructure in AI (e.g. filtering/classification after something like artspew).

A bit surprised about common crawl, is the financial cost there due to the massively bloated scale of the modern web they're (presumably) still trying to crawl?

Re: 2nd Batch of the A16Z Open Source AI Grant

#9

When my GPU is under strain, my monitor makes weird noises - and so it does on this page! And then I checked my GPU util, are they mining bitcoin or training models using my GPU? :) Volatile GPU-Util 43%

> When my GPU is under strain, my monitor makes weird noises

I love technology