Viewing profile — jtarchie

sqlite extension that uses database tables for indexing HNSW values. This is something I wanted to build after trying to build my own in pure Go. Warning: Was vibe coded with my in…

ncruces helped me with some code I made for VFS. It uses [zstd seekable]( https://github.com/jtarchie/sqlitezstd ) for reading a file. I thought it would be really well-suited for …

There are two sections that describe the same thing. - Try: turning off synchronous mode - Try: synchronous “OFF” Was this AI generated?

I'm doing a little detective work here. 1. A posting like this appeared on [Reddit]( https://www.reddit.com/r/programming/comments/1e79xoz/creati... ) two months ago. This repo sta…

Note: We've crossed paths on another thread (Reddit?). I have an experiment going (as part of a talk) of how compressed of a sqlite database I can get all of English Wikipedia with…

I'm glad it was helpful. It was a list of things I had known before I used it. So it was meant to be a quick getting started like doc.

Someone on Reddit mentioned in Norwegian, it means "nothing."

I've used Pocketbase for some other projects. A quick small web app, but it was so easy.

I did see that. I'm going to let the fork simmer for awhile. I didn't require module support for my runtime. Since its meant to be very basic ETL runtime.

Not doing it all, Go allows my API endpoint to accept sandboxed javascript code to enable users to run more complex queries against my data. It is also faster because they don't ha…

I just wanted to share the details of my experience with Goja. It was not relevant to compare Otto.

Currently 55GB, for read-only work at the moment. Using full text search, rtree, JSON, and indexes.

This is almost the same. We both do compression. The compression layer it transparent to the application via VFS. I have tried this trick with Wikipedia too. It don’t have the numb…

I can help answer this a bit. Processing the data with code and SQLite takes about 4 hours for the United States and Canada. If I can figure out how to parallelize some of the work…

Oh, you!

That's great. I was impressed with DuckDB's speed with the OSM data. I'm doing it with all the data, but I intended to have: - a single file that can be queried - a single file tha…

I do some sharding, mainly by grid-based bounding boxes. This allows for searching with an area or overlapping areas FTS index. It means there is some data duplication, but it is m…

The FTS table also has the extra benefit of different tokenizers -- porter, unicode, trigram, etc. It allows less precise searches to happen but still returns some results. I liked…

That's an interesting take. I also found [flatgeobuf]( https://github.com/flatgeobuf/flatgeobuf ), which promises something similar-ish. Perhaps not the same interface for querying…

I understand this is how they would work for a JSON/JSONB payload in sqlite. In Postgres, there are [indexes]( https://www.postgresql.org/docs/current/datatype-json.html#J... ), bu…

Grammarly, but point taken. Will fix.

I have not tried that. Will PGO work with CGO external libraries? I'm using https://github.com/mattn/go-sqlite3