Viewing profile — Manouchehri

Hear me out: use JWTs as the cookie session value. - Use ES256 - Always set the JTI to be completely random - Set iat (issued at time) and exp (expiration time) - Set iss (issuer) …

It's so odd, because Claude models on Amazon Bedrock do support all those features. For awhile now, I've had a api.anthropic.com emulator that "secretly" forwards requests to Amazo…

It’s included for Claude models on Bedrock. Initially that wasn’t the case, until April 2024. https://aws.amazon.com/blogs/startups/aws-activate-credits-n...

Correct.

I would guess that Copilot uses Azure OpenAI. In my small sample size of a bit over a 100 accidentally leaked messages, many/most of them are programming related questions. It's ea…

Azure sent them to me like that. I only saw two companies mentioned in the messages I got back. I reached out to both to try to confirm, but never heard back.

Yeah, I saw over 100 leaked messages. Fun ones include people trying to get GPT to write malware. I can’t help create software that secretly runs in the background, captures user a…

I've seen Azure OpenAI leak other customer's prompt responses to us under heavy load. https://x.com/DaveManouchehri/status/2037001748489949388 Nobody seems to care.

There's only very niche fields where closed-source code quality is often better than open-source code. Exploits and HFT are the two examples I can think of. Both are usually closed…

> BrighData offer H3/QUIC but only in beta and you have to contact their sales team as far as I'm aware. That's what I thought too, but it's working for me. (I've sent a lot of tic…

Would you be open to offering MASQUE proxying? I started to as support to GOST, been testing with Bright Data (only for UDP sadly, not TCP), but would love to see others add suppor…

Interesting! So far I've only seen Bright Data (among the large players) offer UDP proxying over QUIC/HTTP3, but that's pretty limiting since less than half of sites have HTTP/3 en…

Would a similar technique work for tunnels through QUIC?

I believe I was using us-east-2. In the early days of cross-region inference, less people were using it, and there was basically no monitoring (and/or alerting) on Amazon's side. T…

Yeah, I was often the single source of reporting Claude outages (or even missing support completely) on less commonly used Amazon Bedrock regions.

I wrote a Telegram translate bot that uses Opus 4.5 for outgoing messages. Super simple, yet it’s already good enough that I’ve had detailed conversations and debates in languages …

LiteLLM was good in the early days. I ran into more features than bugs. Sadly in the past year or so, I run into more bugs than features.

I documented the process of using AWS SES from a Cloudflare Worker about a year ago. https://www.ai.moda/en/blog/ses-emails-from-workers Hopefully it’s helpful next time for you!

I used to own spyware.tk until I forgot to renew it and the registrar disappeared. Sad I had to let that one go.

I don’t think Cloudflare is using B2; Backblaze isn’t listed as a sub-processor. https://www.cloudflare.com/gdpr/subprocessors/cloudflare-ser...

I found the pricing for Sora and thought it might be useful to share with others (as Microsoft nor OpenAI has updated their websites with it yet).

It's really poor wording. Bright Data does indeed consider 100 results in a single request to be a single billed "result" event, billed at $1.5/1000 requests. I always set 100 resu…