Viewing profile — yvbbrjdr

We actually profiled one of the models, and saw that the last GeMM, which is completely memory bound, is taking a lot of time, which reduces the token speed by a lot.

I see! Do you know what's causing the slowdown for ollama? They should be using the same backend..

Hi, author here. I crowd-sourced the devices for benchmarking from my friends. It just happened that none of my friend has this device.

Hi, author here. I crowd-sourced the devices for benchmarking from my friends. It just happened that one of my friend has this device.

We use DeepSeek v3 in prod. Works even better than GPT-4o.

Join the Discord server to see Athena in action! https://discord.gg/X38GnhdTH8

For ethics behind MemoFlow and how AI is used, see https://blog.memoflow.com/2023/07/hello-world-its-memoflow/

Hi HN, over the years of using the social media (Instagram, Pinterest, etc..), I’m quite weary of the trend that people tend to polish their content so well and post the perfect as…

As I'm developing a social media app, I need to verify my users by sending them a verification code via email. After researching various options, I chose to use AWS SES due to thei…

Yes. What I'm targeting is the mass population, and I really need to figure out a way to solve this dilemma.

Under the hood, we used Argon2i algorithm to derive the secret key from an arbitrary-long password string. We used the term "password" because that's what ordinary people will unde…

Wow! This project seems to do exactly what ours does right now.. with an even better UI/UX.. but they don't seem to support any kind of nonce'ed and key'ed encryption? For some rea…

Interesting project! But yeah it requires little effort to detect