Live data from Hacker News

Ask HN: What are some tools / libraries you built yourself?

news.ycombinator.com

431–440 of 617 posts

Re: Ask HN: What are some tools / libraries you built yourself?

#431
I built (or at least "designed most of, built parts of") Hyperscan: https://github.com/intel/hyperscan - a fast multiple regular expression matcher.

It was not originally open sourced; it was a commercial product for some time.

I wasn't satisfied with what already existed at the time (and neither were our customers) because most regular expression libraries are not focused on performance (using backtracking), streaming (again, backtracking) across multiple inputs - e.g. packets - without holding on to old data - and handling lots of regular expressions at scale.

re2 came along while we were still doing a commercial project but had zero impact on our sales, as it didn't handle streaming (weirdly, imo, as it could have) but it also didn't scale very well to large numbers of patterns.

I also designed simdjson (https://github.com/simdjson/simdjson), although others (chiefly Daniel Lemire and John Keiser) now do all the real work. It's still my design under the hood (although the "On Demand" stuff is significantly new and different). I built the first prototypes of simdjson because Daniel trolled me with a paper from Microsoft and I was bored.

Re: Ask HN: What are some tools / libraries you built yourself?

#432
1. React Leaflet canvas overlay: Leaflet is a popular mapping library and React Leaflet brings the declarative nature of React to the Leaflet api. I needed to display some 3D rendered shadows on a map and needed to overlay a canvas at specific lat/lng bounds so I made a React component to plug into React Leaflet.

2. Puppeteer Camera: I needed a solution for recording Twilio live video and hosting it myself in S3. I made a docker container that launches Chrome headless, points it at any website (including a Twilio video conference) and uses a Chrome extension to record the browser screen and stream the video to S3. In theory it could be used to record any website on the internet.

[1] https://github.com/ted-piotrowski/react-leaflet-canvas-overl...

[2] https://github.com/ted-piotrowski/puppeteer-camera

Re: Ask HN: What are some tools / libraries you built yourself?

#433
I built Dud[1] because I wanted a simpler, faster DVC[2]. If DVC is Django, I set out to build Flask. In using Dud myself, I think I've succeeded thus far. But the only way to know for sure is to publicize the project and get it in other people's hands. Here's to that. I'm planning on polishing the documentation and cutting a 0.1 release soon.

[1]: https://github.com/kevin-hanselman/dud

[2]: https://dvc.org/

Re: Ask HN: What are some tools / libraries you built yourself?

#434
I made up a new Internet-only writing medium called "Iceberg Articles":

https://john.kozubik.com/pub/IcebergArticle/tip.html

"The purpose of the Iceberg format is to convey an idea in the medium of the web, but without the distractions of that medium. The author wishes to leverage the richness of a hypertext web of multimedia while avoiding the diffusion of a flat, non-heirarchical resource."

(with apologies in advance - this is a work in progress and even basic navigation might have issues ...)

Re: Ask HN: What are some tools / libraries you built yourself?

#435
make-portable.sh.

Makes any macOS .dylib or executable portable.

It (recursively) makes local copies of all the dynamic libraries on which you depend, and rewrites all load commands to prefer the local copy.

This lets you safely distribute your software to another computer (rather than discovering it only works on your computer because of your brew installs).

https://gist.github.com/Birch-san/e84cfa3b93ffa104af2bd9a047...

Explanation, diagrams: https://birchlabs.co.uk/blog/alex/juicysfplugin/synth/cpp/20...

Re: Ask HN: What are some tools / libraries you built yourself?

#436
I've built a few over the years:

- https://volt.fm - See, share and compare your Spotify stats

- https://postsheet.com - Send emails to contacts in a Google Sheets or Airtable document

- https://pikaso.me - Screenshots Twitter for sharing on Instagram

- https://github.com/soheilpro/zsh-vi-search - Adds support for searching the current line (in normal vi mode) to zsh

- https://github.com/soheilpro/catj - A better way to display JSON files

- https://github.com/soheilpro/mann - Never forget command line options again

- https://github.com/soheilpro/pgcmd - Non-interactive PostgreSQL query tool

- https://github.com/soheilpro/sqlmon - Collect events from SQL Server and save them to Elasticsearch

- https://github.com/soheilpro/sqltop - Find the most resource consuming SQL Server queries

- https://github.com/soheilpro/mon - Painless performance monitoring for Windows

- https://github.com/soheilpro/Ledger - Interactive CLI double-entry accounting

Re: Ask HN: What are some tools / libraries you built yourself?

#437
https://github.com/armstnp/validryad

> Other validation tools are either focused on:

> - binding to user input forms,

> - recreating or supplementing ActiveRecord validations, or

> - supplying user-friendly error messages instead of programmatic error codes

>

> This is a design gap I'm interested in filling, as it fits my mental model for many validation cases, and is especially suitable for APIs in a way other Ruby validation libraries are not.

>

>The aim, then, is for Validryad to be a validation library that supplies programmatically useful validation errors, while performing some minimal coercion and alteration of the data as useful.

>

> The library draws on the existing dry-validation library for design inspiration, while making some concretely different decisions:

>

> - Error messages are programmatic, not user-based

> - Validation is not tailored towards hashes alone, but suited for any combination of values, including hashes and arrays

It's extremely basic, but I'm using it for current work and it does the job I need it to do. It was a simple enough tool that I figured it might be useful to push as its own library. Looking at recent discussion, it probably better fits the 'parse, don't validate' mentality, under which case it's something of a misnomer.

Re: Ask HN: What are some tools / libraries you built yourself?

#438
https://github.com/imwally/battstat - CLI battery status indicator. https://github.com/imwally/untweet - destroy tweets and likes. https://github.com/imwally/linkview - like urlview but shows anchor text. Works great with mutt. https://github.com/imwally/pin - CLI pinboard client to add and manage bookmarks.

Re: Ask HN: What are some tools / libraries you built yourself?

#439
post #137
post #43

I built a little PWA just for me that I can use to scan ISBN codes of physical books I read. It then looks up the book and adds it to my spreadsheet of "Books I've read". I wrote a bit about it here https://nikhilism.com/post/2021/tracking-books-i-read-using-... It was partly just a way to try out Svelte and XState.

That’s funny - I just started building something _exactly_ like this for my own website - I wanted mine to be more like a vintagy/iBooks-like proper wooden bookshelf that displayed the book covers of the books I was currently reading on the front page of my personal website.

Share the link please if available, would love to see it.

Re: Ask HN: What are some tools / libraries you built yourself?

#440
post #109

I made a crappy little web tool[1] that lets me paste a timestamp into it, and will show me that time in my current timezone by default (I think that's just hardcoded haha), or in another one that I select. I mostly use it when reasoning about logs -- for some reason my mind has never gotten used to mapping UTC time to my time. It also has a selector for the source timezone, but that doesn't work, for reasons I've fo…

Cool simple tool! :)

I think the reason the source zone might not work (and I'm not an expert, and date times in code are hard), is that all "timestamps" are in Zulu / GMT0 time, so it won't make sense if you try to source a Zulu time from like Hawaii time or whatever.

Post reply on HN