Viewing profile — ylow

Just for you I will switch my FTP server to run on Port 23.

Most tech startups will be Delaware. And a lot comes down to the definition of "own" which is ambiguous especially as a C-Corp. One may not be CEO, but can be a H1B Co-founder with…

There is no obligation to provide the public with his life story. Even if provided, few really understand the US immigration process to really comprehend what it means. And finally…

Whether he did really have valid work permits, or not, I have no idea. You seem knowledgeable. But I am just generally mildly frustrated by people online jumping to conclusions ass…

This is not true. You do not need to be a US resident to register a company, and anyone own shares in a company. There are a variety of visa options, and ways to navigate the proce…

Its not so complicated. Not everyone wants a green card. It triggers international taxation, exit taxes if you give it up, etc. If you can maintain a work permit for 20 years, why …

The application, method and algorithm needs to be separated. The application is movie recommendation. One of the methods which works pretty well for this is low rank matrix complet…

The actual problem that is being solved here is well defined mathematically and is matrix completion via low rank matrix factorization. And using a sampling approach for it. (I hav…

This is using statistics to tell a preconceived story. Underlying this a notion that foreign workers are simply “imported” like they are dug out of the ground or something. How do …

Even just audio transcription can hallucinate in bizarre ways. https://arstechnica.com/ai/2024/10/hospitals-adopt-error-pro...

I think both are necessary. The cdc technique is file format independent. The row group method makes Parquet robust to it.

We are here to help lower that :-) . As we can push dedupe to the edge we can save on bandwidth as well. And hopefully make everyone upload and download faster.

Great question! Rsync also uses a rolling hash/content defined chunking approach to deduplicate and reduce communication. So it will behave very similarly.

I believe Parquet predates Arrow. That's probably why.

Can you elaborate? As I understand Delta Lake provides transactions on top of existing data and effectively stores "diffs" because it knows what the transaction did. But when you h…

Hi all! Yucheng (CEO XetHub) here, happy to answer any technical questions anyone might have. Our current tech is a significant enhancement over the original Git Is For Data paper …

The dedupe is optimistic and is designed to scale to 1-10 PB range. There is a more complicated architecture blog post we are working on. We can dedupe across repositories but we d…

(Yes 71 + 27 != 100, but that LLMs can't count is a whole other issue)

Indeed this is unsurprising given how LLMs work. I mean if you ask a human to generate a random number, and then reset the universe and all state of the human and ask again, you wi…

I think this is because a graph is not a data-structure nor a data-type. It is really an abstraction. Fundamentally, all I need to define a graph is a set of vertices v \in V and f…

The issue comes when cells take many minutes or even hours to run (intentionally or not). The ideal is indeed sequential, and this helps me a lot with maintaining the sequential or…

Author here. Mandala looks really cool. Thanks for the recommendation!

Author here. The goal in a way is better reproducibility. The memo hashes the contents of the inputs, so if your cell is deterministic (and you cover all the inputs), the memo shou…