Viewing profile — bartdegoede

It’s gets much larger (there’s the potion-multilingual-128M model, distilled from bge-m3 which has like 100 languages), so it gets to ~120m range for the lookup table (4x smaller i…

Chrome ships with one ( https://news.ycombinator.com/item?id=43973502 ) but AFAICT it’s only used for history, there’s no api for it. There’s also an included LLM? https://www.that…

A few years ago I wrote a post about implementing tf-idf in 150 lines of python. The data source it relied on was removed (turns out Yahoo! isn't as relevant anymore).

Adventures with writing a novel with LLMs

Added an MIT license. Have fun :-)

The idea was to illustrate the concepts of an inverted index and tf-idf :-) I've built some stuff like this for a smaller project written in Python because it was Easier™ than spin…

Author here: you may want to check out something like Whoosh https://whoosh.readthedocs.io/en/latest/intro.html (it's like a clone of Lucene but in pure Python). I've used this to …