Viewing profile — Smerity

Ton Roosendaal is brilliant both strategically (taking a closed source codebase and growing it into the open source success story that is Blender today) but also as a person. When …

You can download Common Crawl data for free using HTTPS with no credentials. If you don't store it (streamed processing or equivalent) and you have no cost for incoming data (which…

Excited to see more people working on RNNs but wish their citations were better. In 2016 my team from Salesforce Research published our work on the Quasi-Recurrent Neural Network[1…

I think you've done a great explanation expansion except I believe it's ALiBi ("Attention with Linear Biases Enables Input Length Extrapolation"), a method of positional encoding (…

As mentioned it's trivial across the spread of compression algorithms supporting this type of behaviour (`gzip`, `zstandard`, `zip`, ...), the header in `zip` making it even more c…

In the distant past I was the lone engineer of Common Crawl almost a decade ago. Common Crawl heavily leverages the WARC format. My favorite capability of the WARC format borrows f…

That section of the text is ambiguous but it's $250k for 8 x H100s (PCI-e) and $350k for 8 x H100 (SXM). The prices above are plus or minus from Lambda Labs[1]. [1]: https://lambda…

To note, Figma use something inspired by but not quite CRDTs: > Figma isn't using true CRDTs though. CRDTs are designed for decentralized systems where there is no single central a…

I have had my XPS 13 laptop die four times in the past two years, needing a replacement logic board each time. The laptop is amazing when it's working, default Linux support too, b…

The author is focused on GPU texture compression for games[1] so they're not too concerned with fast compression speed. Given a game will be played on (at a minimum) tens of thousa…

I saw a version of this myself at Geary and Mason around midnight on June 20th[1]. That it happened again but at a larger scale ten days later is deeply concerning. Given I had no …

I just want to note the replies to this thread are excessively dismissive and toxic. You may not agree with the wording of their advertising ("world's most powerful NLP toolkit" is…

What I find most interesting in this is the pseudo detective story of hunting down disappearing post-mortem and "lessons learned" documentation. Optimistically we'd hope that perha…

From the pricing page I linked to[1]: > There are no charges for outbound data transfer when using a dedicated network connection to the RSTOR network and direct peering is establi…

You're right, I misread it and now can't edit my comment. This puts it all in quite a similar position to Wasabi[1] who have a 1:1 storage:transfer ratio per month and a 90 day min…

Thanks! I'd never seen them. The only minor catches that I've seen are that they want you to start the account with $50 or more added, it's $6 per TB per month (rounded up to the n…

The state of Australia's national science initiatives and the projects they support have always been of concern to me. There are bright spots but they seem overwhelmingly destined …

I loved Mia.bet's pet hamster marble race concept but their website notes: > The continuously high Ethereum gas fees cause betting fees and operation costs to skyrocket. Hence, we …