Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: An unmetered LLM API–$6/month, no token tracking, no limits

yolo-auto.com

Post reply on HN
Print view View original

11–19 of 19 posts

Re: Show HN: An unmetered LLM API–$6/month, no token tracking, no limits

#11

Post by atmanactive »

yolo-auto wrote: post #7
atmanactive wrote: post #6

I wanted to start using this but I can't since I can't use any email/password combination I want. By requiring an existing account from Google/GitHub/Discord you are just contributing to corporate-owned dystopia.

i know, but im scared to own our own auth, when there's money involved... too cheap to pay for a service. So we lean on the back of the giants for now. If it helps, there's really no reason to ever log into our site after you get an API Key. I guess until you want to make another api key

So I said, OK, let me open a Discord account, just to be able to access your service. How hard can it be, right? Wrong. Got stuck in a "Wait, are you a robot?" loop, doing dozens of captchas, and in the end had to close the browser tab. Broken piece of crap.

Re: Show HN: An unmetered LLM API–$6/month, no token tracking, no limits

#12

Post by yolo-auto »

atmanactive wrote: post #11
yolo-auto wrote: post #7

Earlier quoted context omitted.

i know, but im scared to own our own auth, when there's money involved... too cheap to pay for a service. So we lean on the back of the giants for now. If it helps, there's really no reason to ever log into our site after you get an API Key. I guess until you want to make another api key

So I said, OK, let me open a Discord account, just to be able to access your service. How hard can it be, right? Wrong. Got stuck in a "Wait, are you a robot?" loop, doing dozens of captchas, and in the end had to close the browser tab. Broken piece of crap.

Well, are you a robot?

Ok well I need a way to securely give you an API key for you to try it out but I don't really want to post it on HN so I'm open to ideas lol

Re: Show HN: An unmetered LLM API–$6/month, no token tracking, no limits

#14

Post by atmanactive »

yolo-auto wrote: post #12
atmanactive wrote: post #11

Earlier quoted context omitted.

So I said, OK, let me open a Discord account, just to be able to access your service. How hard can it be, right? Wrong. Got stuck in a "Wait, are you a robot?" loop, doing dozens of captchas, and in the end had to close the browser tab. Broken piece of crap.

Well, are you a robot? Ok well I need a way to securely give you an API key for you to try it out but I don't really want to post it on HN so I'm open to ideas lol

I am definitely not a robot. I have aches in several parts of my body which are giving me painful reminders it's all flesh and blood.

I'll try opening a dedicated Github account next. Fingers crossed.

Re: Show HN: An unmetered LLM API–$6/month, no token tracking, no limits

#16

Post by yolo-auto »

atmanactive wrote: post #14
yolo-auto wrote: post #12

Earlier quoted context omitted.

Well, are you a robot? Ok well I need a way to securely give you an API key for you to try it out but I don't really want to post it on HN so I'm open to ideas lol

I am definitely not a robot. I have aches in several parts of my body which are giving me painful reminders it's all flesh and blood. I'll try opening a dedicated Github account next. Fingers crossed.

lmao dont hurt yourself

Re: Show HN: An unmetered LLM API–$6/month, no token tracking, no limits

#18

Post by shaism »

yolo-auto wrote: post #8
anoop_kumar wrote: post #3

Got me down a rabbit hole of trying to find the ROI of doing something like this. This is what every GM at AWS thinks about. So, a back of the napkin calculation of running at FP8 and approx 35GB. You can fit that on a g6e.xlarge @ 48GB for about $900/year at reserved capacity. Assuming you are netting at $5.5 (post stripe fees), and maybe $100/month for API/auth box for egress, you probably need about 170 paying cus…

actually the math is more like $1500 a month on a MI300x on a highly optimized rocm/sglang image and everyone's getting 100+ tok/sec and we have 100 active people and plenty of room for others. but were losing money right now obviously. we did come from 4x 3090s could actually make money, but we thought a couple hundred bucks a month isnt worth a 100 degree office. People are dumping 128k cold documents in like its t…

Which provider do you use to access the MI300x?

Re: Show HN: An unmetered LLM API–$6/month, no token tracking, no limits

#19

Post by anoop_kumar »

yolo-auto wrote: post #8
anoop_kumar wrote: post #3

Got me down a rabbit hole of trying to find the ROI of doing something like this. This is what every GM at AWS thinks about. So, a back of the napkin calculation of running at FP8 and approx 35GB. You can fit that on a g6e.xlarge @ 48GB for about $900/year at reserved capacity. Assuming you are netting at $5.5 (post stripe fees), and maybe $100/month for API/auth box for egress, you probably need about 170 paying cus…

actually the math is more like $1500 a month on a MI300x on a highly optimized rocm/sglang image and everyone's getting 100+ tok/sec and we have 100 active people and plenty of room for others. but were losing money right now obviously. we did come from 4x 3090s could actually make money, but we thought a couple hundred bucks a month isnt worth a 100 degree office. People are dumping 128k cold documents in like its t…

[dead]
Post reply on HN