Live data from Hacker News

Why we're building Scanner: data lake search must be fast

blog.scanner.dev

1–2 of 2 posts

Re: Why we're building Scanner: data lake search must be fast

#2
We're really liking the combination of using Rust, AWS Lambda functions, and ECS Fargate. Everything runs well in ARM, but make sure to use `musl` instead of `glibc` - we've found memory usage to be almost 10x lower with `musl` than `glibc` for our use case (indexing and searching logs). If anyone wants to talk about the tech, happy to answer questions!