In-memory Semantic caching for LLMs written in Rust
github.com