Viewing profile — MasterIdiot

"add tests to"

Off the top of my head: - Vortex https://github.com/vortex-data/vortex - Lance https://github.com/lancedb/lance - Nimble https://github.com/facebookincubator/nimble There are also …

I think the distribution he uses is pretty close to the paper he links "Exploiting Cloud Object Storage for High-Performance Analytics" https://www.durner.dev/app/media/papers/anyb…

anecdotally Meta has pretty lax moderation against anti-palestinian in Hebrew, allowing tons of extremely racist/violent speech.

Having worked for a SIEM vendor, I can say that all security software is extremely invasive, and most security people can probably track every action you make on company-issued dev…

Prometheus push gateway maybe? I guess it depends on limitations like battery life, bandwidth and network access (maybe it's behind a NAT or something)

hnswlib is in cpp and has python bindings (you should be able to make your own for other languages). Faiss, Annoy (by Spotify) should also provide similar functionality. https://gi…

There's one, but with some limitations (For example - only vectors of up to 1024 dimensions) https://github.com/pgvector/pgvector

If you really think that's enough to build a real product, go for it. Even open-source companies (Elastic, Mongo, Scylla) have to build tons of infra around their core codebase in …

Among other things - larger caches, more instructions, more cores and more busses in between them.

I've seen similar solutions being built internally in multiple companies, none with a syntax as well thought out as this. Amazing work!

While there's probably some value in posting the resources "everyone knows", Papers with Code was submitted multiple times in the past few years, which is a pretty common HN thing …

It seems to be happening for a pretty long time (at least the 1970s) https://en.wikipedia.org/wiki/Operation_Ivy_Bells

I remember a talk where someone who did both software and hardware development for Intel talked about "Hardware development cycle fro software developers" or something like that at…

Ubuntu LTS on my laptop, because it's the closest I've found to "Just Works" status. I run RHEL servers at work, but that's not my decision, though they are serious workhorses (alb…

While there are some good recommendations here, I would defintely hire an expert (either in-house or some external contractor) to design and test the final solution.

NiFi is intended as a serious workhorse, we run it on a cluster with 256GM of RAM and over 20 cores for each server (on-prem), the 2GB of disk storage is negligible in any sort of …

From what I see in the B2B space, acquisitions are a major avenue for quick innovation. Large corporations buy smaller startup, do some integration into existing solutions and come…

Quibi - they raised a billion (according to the media) before launching anything,and a video I can rotate doesn't sound like a revolutionary new form of media or art.

This is not version control using ML, but version control for ML development and research.

also flask, pretty simple and very lean.

It allows you to define a schema, and then compile it to various languages and have multiple applications in multiple languages "speak" the same class, down to the binary level (fo…

A different network connection (With physical infrastructure you might actually use a completely different network) that you can use to move private keys or any other sensetive inf…