Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: What are you working on? (July 2025)

news.ycombinator.com

Post reply on HN
Print view View original

801–810 of 900 posts

Re: Ask HN: What are you working on? (July 2025)

#801

Post by marginalia_nu »

n_u wrote: post #798
marginalia_nu wrote: post #793

Earlier quoted context omitted.

I'm primarily looking at document lists and possibly the keyword-documents mapping. Caching will likely be fairly tuned toward the operation itself, since it's not a general-purpose DBMS and I can fairly accurately predict which pages will likely be useful to cache or when read-ahead is likely to be fruitful based on the operation being performed. For keyword-document mappings some LRU cache scheme is likely a good f…

Ah interesting. Is your keyword-document map (aka term dict) too big to keep in memory permanently? My understanding is that at Google they just keep it in memory on every replica. Edit: I should specify they shard the corpus by document so there isn't a replica with the entire term dict on it.

Could plausibly fit in RAM, is only like ~100 GB in total. We'll see, will probably keep it mmap:ed at first to see what happens. It isn't the target of very many queries (relatively speaking) at any rate so either way is probably fine.

Re: Ask HN: What are you working on? (July 2025)

#803

Post by [deleted] »

tech234a wrote: post #796
dataviz1000 wrote: post #629

Earlier quoted context omitted.

Absolutely. However, it is easier to start with just Chromium flavor of browsers. The two important concepts from Puppeteer/Playwright are managing the lifecycle of pages (tabs) and frames and the other is using handles / locators. There are a lot of limitations using the extension API in any browser instead of CDP / Webdriver BiDi. I'm curious, how would you use this idea?

Could be cool for automated website UI testing/verification (check if certain text appears), perhaps also with network API events as well.

[deleted]

Re: Ask HN: What are you working on? (July 2025)

#804

Post by n_u »

marginalia_nu wrote: post #801
n_u wrote: post #798

Earlier quoted context omitted.

Ah interesting. Is your keyword-document map (aka term dict) too big to keep in memory permanently? My understanding is that at Google they just keep it in memory on every replica. Edit: I should specify they shard the corpus by document so there isn't a replica with the entire term dict on it.

Could plausibly fit in RAM, is only like ~100 GB in total. We'll see, will probably keep it mmap:ed at first to see what happens. It isn't the target of very many queries (relatively speaking) at any rate so either way is probably fine.

>It isn't the target of very many queries (relatively speaking)

Wow why is that? Do you use a vector index primarily?

Re: Ask HN: What are you working on? (July 2025)

#805

Post by kridsdale1 »

kylestanfield wrote: post #277
Vermeulen wrote: post #169

A multiplayer survival game based around voxel physics. Can be described as Astroneer-like setting, Teardown voxel physics, in a Valheim-like online multiplayer survival game. Game isn't really announced yet but I've shown some videos of the tech: https://x.com/Alientrap/status/1909316208563732866 (On Youtube: https://www.youtube.com/watch?v=ZWISaUmvit4 ) https://x.com/Alientrap/status/1918024969939808654

Looks pretty great so far. Reminds me of playing Red Faction as a kid

If you liked Red Faction, check out Donkey Kong Bananza (2025) on Switch 2.

It’s like Super Mario Sunshine X Deep Rock Galactic / RedFaction / Minecraft.

Re: Ask HN: What are you working on? (July 2025)

#806

Post by jatora »

password4321 wrote: post #767
jatora wrote: post #231

I'm working on a rating/reviewing website for YouTube videos, with strong search and filter functions that YouTube sorely lacks, along with good curated list building functionality. https://www.ytdb.io/ With a strong rating weight system that can avoid (some) of the pitfalls of community ratings. Right now videos must be added to be searchable, to comply with YouTube API rules. I'd hope that over time, with enough us…

Maybe you hit some type of Heroku limit, currently an HTTP 404 "no such app" error.

Interesting, I think it must've unluckily been during a daily restart as that coincides with the timing of your reply lol... I hope.

edit: scratch that. wrong url. forgot i dont have www mapped: https://ytdb.io

Re: Ask HN: What are you working on? (July 2025)

#807

Post by marginalia_nu »

n_u wrote: post #804
marginalia_nu wrote: post #801

Earlier quoted context omitted.

Could plausibly fit in RAM, is only like ~100 GB in total. We'll see, will probably keep it mmap:ed at first to see what happens. It isn't the target of very many queries (relatively speaking) at any rate so either way is probably fine.

>It isn't the target of very many queries (relatively speaking) Wow why is that? Do you use a vector index primarily?

No I mean for every query there is mapping up keywords to trees of documents, there is dozens if not hundreds of queries in the latter in order to intersect document lists.

Re: Ask HN: What are you working on? (July 2025)

#808

Post by n_u »

marginalia_nu wrote: post #807
n_u wrote: post #804

Earlier quoted context omitted.

>It isn't the target of very many queries (relatively speaking) Wow why is that? Do you use a vector index primarily?

No I mean for every query there is mapping up keywords to trees of documents, there is dozens if not hundreds of queries in the latter in order to intersect document lists.

Ah I see. I thought by query you meant "user search query". I'm guessing by query here you mean "read".

Re: Ask HN: What are you working on? (July 2025)

#809

Post by motohagiography »

kidnoodle wrote: post #498

I’m still slowly working on a location intelligence data union ( https://wherelabs.info ) - the idea is people install an app and agree in a very upfront way to have their location tracked over time. The union monetises this by selling privacy preserving aggregates (think ‘where is everyone in London right now’, or ‘where did people commute from?’), and acts on behalf of union members to stop data brokers selling the…

this is a really fascinating idea. I'm reading it as, instead of seeing my individual identity in a location dataset, it will see -DataUnionMember- with no unique identifier? When two members are in the same place at the same time, you don't know which one went in which direction?

The question of who can de-identify or unmask the data is there, but I could see the capability being required for gov, military, and police, and then as a premium service to customers.

Re: Ask HN: What are you working on? (July 2025)

#810

Post by Seb-C »

Still working on my game, Astral Divide.

I finished writing most of the story and am now working on implementing the main enemy's AI.

I'm having quite some fun with studying and making a schooling algorithm that fits my needs.

https://store.steampowered.com/app/2597060/Astral_Divide/

Post reply on HN