Ask HN: What are some tools / libraries you built yourself?

I wrote pandas2numpy [0] it helps you turn a pandas dataframe into one (or two if you have categorical variables) numpy tensors ready to be pushed into a deep learning framework.

It can deal with continuous data, categorical data, normalisation of the data, log scale and NA.

I found it really useful to work on tabular data and, since it uses numpy, it is agnostic to the deep-learning framework used.

[0]: https://github.com/nestordemeure/pandas2numpy

At last count I have 36 repos on GitHub - some private - but by far the one that has been the most useful is my Diminuto (com-diag-diminuto) LGPLv2 repo that is a library of C/GNU/Linux-based functions and tools that provide simpler (for me anyway) APIs for tasks that routinely crop up in the kind of embedded programming I typically do: logging, time keeping, sockets, linked lists, red-black trees, GPIO, threads, etc. It's saved me a lot of time in other C development, both my own side work (e.g. com-diag-hazer), and in several commercial products I've worked on for clients, to have a library that is already unit tested and with which I have years of experience using.

I've made a few things:

- Zola (https://github.com/getzola/zola) a SSG that works like I wanted and had a template engine close to Jinja2. I was using Hugo at the time but can't stand Golang template engine (imagine my sadness recently when I realised what Helm Charts are using...)

- Tera (https://github.com/keats/tera): a template engine pretty close to Jinja2/Django templates - at the time it was made only Handlebars existed in Rust and it was not enough for what I needed in Zola

- kickstart (https://github.com/Keats/kickstart): an equivalent of cookiecutter from Python but trying to be more interactive/powerful as a simple binary, see the GIF in the repo for an example

- validator (https://github.com/Keats/validator): my take on Python marshmallow validations, nothing existed at the time.

So yeah, most of my open-source is re-creating libraries I use with Python in Rust.

That’s funny - I just started building something _exactly_ like this for my own website - I wanted mine to be more like a vintagy/iBooks-like proper wooden bookshelf that displayed the book covers of the books I was currently reading on the front page of my personal website.

I spent a much of 2020 developing a project that auto provisions REST, GraphQL & gRPC services that support CRUD operations (with full validation) to tables, views and materialized views of several popular databases (postgres, postgis, mysql, sqlite).

Features include: Full CRUD, geoquery support (bbox, radius, custom wkt polygon) complex_resources (aggregate & sub queries), middleware (access the query before db execution), permissions (table/view level CRUD configs), field redaction (enable query support -- without publication), schema migrations, auto generated openapi3/swagger docs, auto generated proto file, full validation.

GitHub https://github.com/sudowing/service-engine

YouTube Overview https://www.youtube.com/playlist?list=PLxiODQNSQfKOVmNZ1ZPXb...