Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

A site to share LLMs APIs via Tor

neuroengine.ai

Post reply on HN
Print view View original

11–20 of 22 posts

Re: A site to share LLMs APIs via Tor

#11

Post by LoganDark »

aortega wrote: post #7
ReactiveJelly wrote: post #5

Interesting. Since I'm behind Tor I will probably pick my own https client for sending json requests, instead of trusting this python client. How will you ban bad actors if there's no keys and no registration?

Sure, the API is a very simple json request. Currently, registration is needed for the sharing of AIs, as you rightly mentioned, to prevent malicious individuals from distributing malware links. However, accessing the AIs does not necessitate registration. This is because, depending on your definition of "bad actors," users have limitations in terms of what they can presently accomplish with an AI, even in an uncenso…

But they can stress your servers with tons of requests. The point of requiring registration is usually to prevent DoS, not to prevent the models from being used for certain purposes.

Re: A site to share LLMs APIs via Tor

#14

Post by th0ma5 »

aortega wrote: post #8
th0ma5 wrote: post #6

No only are there ethical and privacy concerns about how we use your data, we're also now completely untraceable!

There will always be a delicate equilibrium between freedom and security. This site provides a greater degree of freedom compared to other services; however, it still necessitates registration for the purpose of sharing AIs. If you employ it to disseminate malware links, you will promptly face a ban. Nevertheless, apart from potential throttling in the event of excessive usage, there are no other restrictions imposed…

Yeah but what do you do with the data people send you

Re: A site to share LLMs APIs via Tor

#15

Post by charcircuit »

aortega wrote: post #4
codetrotter wrote: post #3

Earlier quoted context omitted.

Thank you for making this :) I wish more services were made with Tor access in mind, and that such services would feature on HN more often!

Generative AIs are perfect for TOR, as the are low-bandwidth, high-latency services. I should say that I cannot accept all the credits for doing the site, as it was made 90% by the AI itself (under my direction, I hope).

I disagree. There is no way to do rate limiting and generative AI is slow. This means the API is trivially denial of service attacked.

Re: A site to share LLMs APIs via Tor

#16

Post by aortega »

LoganDark wrote: post #11
aortega wrote: post #7

Earlier quoted context omitted.

Sure, the API is a very simple json request. Currently, registration is needed for the sharing of AIs, as you rightly mentioned, to prevent malicious individuals from distributing malware links. However, accessing the AIs does not necessitate registration. This is because, depending on your definition of "bad actors," users have limitations in terms of what they can presently accomplish with an AI, even in an uncenso…

But they can stress your servers with tons of requests. The point of requiring registration is usually to prevent DoS, not to prevent the models from being used for certain purposes.

I can handle that with automatic throttling, unless you want to spend a lot of resources doing a malicious attack.

Re: A site to share LLMs APIs via Tor

#17

Post by aortega »

th0ma5 wrote: post #14
aortega wrote: post #8

Earlier quoted context omitted.

There will always be a delicate equilibrium between freedom and security. This site provides a greater degree of freedom compared to other services; however, it still necessitates registration for the purpose of sharing AIs. If you employ it to disseminate malware links, you will promptly face a ban. Nevertheless, apart from potential throttling in the event of excessive usage, there are no other restrictions imposed…

Yeah but what do you do with the data people send you

Currently I do not store any logs, nor I have any use for them. But you should not have to trust my word.

I can guarantee that if you use TOR, I do not have your IP or any other info that can be used to identify any client.

Re: A site to share LLMs APIs via Tor

#18

Post by LoganDark »

aortega wrote: post #16
LoganDark wrote: post #11

Earlier quoted context omitted.

But they can stress your servers with tons of requests. The point of requiring registration is usually to prevent DoS, not to prevent the models from being used for certain purposes.

I can handle that with automatic throttling, unless you want to spend a lot of resources doing a malicious attack.

> unless you want to spend a lot of resources doing a malicious attack

I don't want to perform an attack at all. I just think you probably underestimate the resources that any random darknet hacker possesses.

Re: A site to share LLMs APIs via Tor

#19

Post by aortega »

LoganDark wrote: post #18
aortega wrote: post #16

Earlier quoted context omitted.

I can handle that with automatic throttling, unless you want to spend a lot of resources doing a malicious attack.

> unless you want to spend a lot of resources doing a malicious attack I don't want to perform an attack at all. I just think you probably underestimate the resources that any random darknet hacker possesses.

You can easily limit the damage with a Captcha or similar. Anyway, it survived being in the from page of Hacker News for a couple hours, so I think it's fine.
Post reply on HN