Viewing profile — stfurkan

1. bitgpu: Fast WebGPU runtime for 1-bit (binary-weight) LLMs in the browser. Repo: https://github.com/stfurkan/bitgpu Demo: https://stfurkan.github.io/bitgpu/examples/chat.html 2.…

I'm currently working on an open-source LLM inference engine [1] for browsers via webGPU. If anyone wants to try or has any suggestions, I'm happy to listen :) 1. https://github.co…

Hi again :) I updated the engine and 27B model should work in the demo[1]. We can still consider it as experimental but I am trying to make it better and efficient. 1. https://stfu…

Thank you :) I wanted to create it from zero myself so I can control it better. e.g. I started with ONNX support but now it support gguf models too. It might be a good idea to add …

Hello, I sent you a LinkedIn connection request. We can chat first and schedule a meeting. Thanks

Hi, the engine itself already has tool calling capabilities but if you're asking for the aidekin I didn't add tool calling there on purpose. It needs webgpu support but I haven't h…

Hi :) There are some smaller embedding and re-ranking models (I am currently using some of them on my aidekin project) but having it like bonsai models will be great to have.

Thank you for trying it :) I just added the 27B support 1 hour ago. Let me check and try to fix it. All other models should work as expected but if you have issues with them too, I…

I'm currently working on an open-source engine [1] exactly for this purpose. If anyone wants to try or has any suggestions, I'm happy to listen :) 1. https://github.com/stfurkan/bi…

It looks great, thank you! I'll see if I can use it for my in browser AI assistant project's ( https://aidekin.com ) voice part. It's currently using Nemotron-3.5-ASR and supertoni…

aidekin: an open-source, client-side AI assistant you drop onto any website. Your visitors get a private voice and text assistant that runs entirely on their own device via WebGPU …

Thank you :) Currently I am not planning to have hosted fallback Q&A but it's a nice idea. It should only download the ~300mb initially once and then use the cached model.

[flagged]

I see, thanks for the feedback :) It'll be a nice addition to the game.

Thank you for the feedback :) Letting players play before signing up might not be ideal for this case but I probably need to make the landing page better.

https://duckville.town You play a duck in a small shared town. You pick a job, pay rent, post on a Twitter-style feed, vote in local elections. The simulation keeps running when yo…