Viewing profile — zh217

OpenAI's embedding API has an undocumented flag 'encoding_format': 'base64' which will give you base64-encoded raw bytes of little-endian float32. As it is used by the official pyt…

Some observations: 1. their usage page is currently broken, showing only the usage of the new models and the embedding models. usage for the deprecated models are not included now.…

This sounds pretty bad, right? Since their model is way smaller than SOTA transformers (and small size is one of their selling points).

Maybe "Impedance Mismatch"?

> Tell me more about Trump As a language model, I'm not able to assist you with that. > Tell me more about Biden Joseph Robinette Biden Jr. (born November 20, 1942) is an American …

Summary: Dromedary is an AI assistant developed using the SELF-ALIGN approach, which combines principle-driven reasoning and the generative power of large language models for self-…

For me personally the most important motivations are to have recursive queries using vector search, and to integrate graphs and vectors. Obviously I need to implement my own, as no…

If anyone wants to try a FOSS vector-relational-graph hybrid database for more complicated workloads than simple vector search, here it is: https://github.com/cozodb/cozo/ About th…

Another alternative JSON parser is the YAML parser. YAML is a superset of JSON and deals with a lot more weird cases, notably capital True and False.

Thanks. Out of all the suggestions in the comments for this post, this one works the best. And in fact it is only one line, not 40: "Please respond ONLY with valid json that confor…

Hey HN! I've built a Python library called OpenAI Multi-Client to streamline concurrent requests to OpenAI's API. The library simplifies handling multiple API requests while automa…

Thanks! I'm really glad that you find CozoDB useful!

Sorry about that ... I will revise it to be more consistent. Cozo is a bit ambiguous, so now it is usually called CozoDB.

The linked article explains these in details.

Yes, actually I already do that. Sbert is better than openai ada embeddings for many use cases.

They need to be put into distinct indices and unfortunately you cannot “jump” between them in this case (if someone knows a way to achieve this, I would love to hear!)

I have been thinking about adding FTS to CozoDB for a long time but resisted the temptation so far. The reason is that text search is language-specific: what works for one language…

Great questions! - As can be seen https://docs.cozodb.org/en/latest/releases/v0.3.html , for concurrent writes about 200K QPS can be achieved with 24 threads on a pretty old server…

Wow, cellular sheaves, that's a connection I haven't thought of before!

Thank you!

Thanks for the suggestion--will surely do that!

For the parquet question: currently CozoDB is developed by a single developer (me), but I am starting to explore ways of expanding the development team. Certainly a lot more featur…