Live data from Hacker News

Getting a Gemini API key is an exercise in frustration

ankursethi.com

231–240 of 361 posts

Re: Getting a Gemini API key is an exercise in frustration

#231

I was recently (vibe)-coding some games with my kid, and we wanted some basic text-to-speech functionality. We tested Google's Gemini models in-browser, and they worked great, so we figured we'd add them to the app. Some fun learnings: 1. You can access those models via three APIs: the Gemini API (which it turns out is only for prototyping and returned errors 30% of the time), the Vertex API (much more stable but lac…

Some other fun things you'll find: - The models perform differently when called via the API vs in the Gemini UI. - The Gemini API will randomly fail about 1% of the time, retry logic is basically mandatory. - API performance is heavily influenced by the whims of the Google we've observed spreads between 30 seconds and 4 minutes for the same query depending on how Google is feeling that day.

The way the models behave in Vertex AI Studio vs the API is unforgivable. Totally different.

Re: Getting a Gemini API key is an exercise in frustration

#232

I was recently (vibe)-coding some games with my kid, and we wanted some basic text-to-speech functionality. We tested Google's Gemini models in-browser, and they worked great, so we figured we'd add them to the app. Some fun learnings: 1. You can access those models via three APIs: the Gemini API (which it turns out is only for prototyping and returned errors 30% of the time), the Vertex API (much more stable but lac…

Trying to implement their gRPC api from their specs and protobufs for Live is an exercise in immense frustration and futility. I wanted to call it from Elixir, even with our strong AI I wasted days then gave up.

Re: Getting a Gemini API key is an exercise in frustration

#233
post #177

I wasted several hours this week going around in the exact same circles. We have a billing account, but kept hitting a gemini quota. Fine. But then on the quota page, every quota said 0% usage. And our bill was like $5. Some docs said check AI studio, but then the "import project from google cloud to AI studio" button kept silently failing. This was a requests per minute quota, which was set at 15 (not a whole lot...…

Exactly the same for me. Quote usage is something like 2%, but constantly experience the quota limit error.

Re: Getting a Gemini API key is an exercise in frustration

#234
I went through the same nightmare a couple of months ago; in frustration I sent a not very nice email to support. They did respond a week later, saying everything was "fixed". But by that time I had moved on, and will probably never come back.

But I wonder how it can happen that a bunch of obviously extremely smart people can create such absurd Rube Goldberg machines -- without the fun part.

Re: Getting a Gemini API key is an exercise in frustration

#236

Earlier quoted context omitted.

Also, usage and billing takes a DAY to update. On top of that, there are no billing caps or credit-based billing. They put the entire burden on users not to ensure that they don't have a mega bill.

> there are no billing caps or credit-based billing. Was really curious about that when I saw this in the posted article: > I had some spare cash to burn on this experiment, Hopefully the article's author is fully aware of the real risk of giving Alphabet his CC details on a project which has no billing caps.

there's prob a couple ppl out there with an Amex Black parked on a cloud acct, lol

Re: Getting a Gemini API key is an exercise in frustration

#237
Google is the most political, extractive and dysfunctional cloud from a customer point of view.

1. Startup credits require multiple follow-ups, meetings, etc. And these reps have weird incentive structures (so they are trying to bypass each other to meet their quotas or whatever).

2. Billing is opaque, you get charged for things you haven't used

3. Support is outsourced - and it takes 4-5 exchanges with this external vendor come to the central issue (by then usually people just give up I guess)

4. Overall behavior from various Google staff has been high-handed - to say the least

Every other cloud provider has done better than Google in our experience - AWS, Azure, Digital Ocean, OVH - all of them are better to deal with.

I like to tell my team there are two G's in our life: (1) Google and (2) Government, and these days the second G often does better than first :)

Re: Getting a Gemini API key is an exercise in frustration

#238

I was recently (vibe)-coding some games with my kid, and we wanted some basic text-to-speech functionality. We tested Google's Gemini models in-browser, and they worked great, so we figured we'd add them to the app. Some fun learnings: 1. You can access those models via three APIs: the Gemini API (which it turns out is only for prototyping and returned errors 30% of the time), the Vertex API (much more stable but lac…

Oh man let me add onto that!

4. If you read about a new Gemini model, you might want to use it - but are you using @google/genai, @google/generative-ai (wow finally deprecated) or @google-ai/generativelanguage? Silly mistake, but when nano banana dropped it was highly confusing image gen was available only through one of these.

5. Gemini supports video! But that video first has to be uploaded to "Google GenAI Drive" which will then splices it into 1 FPS images and feeds it to the LLM. No option to improve the FPS, so if you want anything properly done, you'll have to splice it yourself and upload it to generativelanguage.googleapis.com which is only accessible using their GenAI SDK. Don't ask which one, I'm still not sure.

6. Nice, it works. Let's try using live video. Open the docs, you get it mentioned a bunch of times but 0 documentation on how to actually do it. Only suggestions for using 3rd party services. When you actually find it in the docs, it says "To see an example of how to use the Live API in a streaming audio and video format, run the "Live API - Get Started" file in the cookbooks repository". Oh well, time to read badly written python.

7. How about we try generating a video - open up AI studio, see only Veo 2 available from the video models. But, open up "Build" section, and I can have Gemini 3 build me a video generation tool that will use Veo 3 via API by clicking on the example. But wait why cant we use Veo 3 in the AI studio with the same API key?

8. Every Veo 3 extended video has absolutely garbled sound and there is nothing you can do about it, or maybe there is, but by this point I'm out of willpower to chase down edgy edge cases in their docs.

9. Let's just mention one semi-related thing - some things in the Cloud come with default policies that are just absurdly limiting, which means you have to create a resource/account, update policies related to whatever you want to do, which then tells you these are _old policies_ and you want to edit new ones, but those are impossible to properly find.

10. Now that we've setup our accounts, our AI tooling, our permissions, we write the code which takes less than all of the previous actions in the list. Now, you want to test it on Android? Well, you can:

- A. Test it with your account by signing in into emulators, be it local or cloud, manually, which means passing 2FA every time if you want to automate this and constantly risking your account security/ban.

- B. Create a google account for testing which you will use, add it to Licensed Testers on the play store, invite it to internal testers, wait for 24-48 hours to be able to use it, then if you try to automate testing, struggle with having to mock a whole Google Account login process which every time uses some non-deterministic logic to show a random pop-up. Then, do the same thing for the purchase process, ending up with a giant script of clicking through the options

11. Congratulations, you made it this far and are able to deploy your app to Beta. Now, find 12 testers to actively use your app for free, continuously for 14 days to prove its not a bad app.

At this point, Google is actively preventing you from shipping at every step, causing more and more issues the deeper down the stack you go.

Re: Getting a Gemini API key is an exercise in frustration

#239
post #234

I went through the same nightmare a couple of months ago; in frustration I sent a not very nice email to support. They did respond a week later, saying everything was "fixed". But by that time I had moved on, and will probably never come back. But I wonder how it can happen that a bunch of obviously extremely smart people can create such absurd Rube Goldberg machines -- without the fun part.

Leadership roles, especially in large corporations, often favor people who are opportunistic. They don’t care about the product, they want that promo.

And to win that promo you have to ship big and ship fast. So often times what you see is people delivering vaporware that has the appearance of high quality (lots of promises, looks amazing in the slides deck, carefully selected data shows great numbers, etc). It’s a gamble, and sometimes it pays off.

By the time people accept that it’s hot garbage, the leaders have already moved on to the next opportunity. And it’s not that they were able to fool their managers, because their managers are playing the same game on an even larger scale, so they care even less.

Of course, this is not always the case. But there is a bias, and it tends to show up more in large organizations (government, large corporations, etc.)

Re: Getting a Gemini API key is an exercise in frustration

#240

Google is the most political, extractive and dysfunctional cloud from a customer point of view. 1. Startup credits require multiple follow-ups, meetings, etc. And these reps have weird incentive structures (so they are trying to bypass each other to meet their quotas or whatever). 2. Billing is opaque, you get charged for things you haven't used 3. Support is outsourced - and it takes 4-5 exchanges with this external…

>Startup credits require multiple follow-ups, meetings, etc. And these reps have weird incentive structures (so they are trying to bypass each other to meet their quotas or whatever).

Man, I tried going for the credits. I've organised meetups and conferences for Google, gave talks, been a part of Google Startup campus for years now, have been invited to participate in GDE program, and as I'm making a GenAI startup I decided "well, maybe time to try getting those 300k cloud credits, I've given them so much I'll surely get it".

Well, the first person I talked to, said I'm denied, because they didn't even check the websites I added in the description. They said oh I need to add it to another field for their team to see, told me to update it, but there is no way to update it. Then we had a second call, they said it's okay I can ignore that and pointed me to another person who will be my "account manager".

That person was absolutely uninterested into what we're doing, what we want and what we plan to do. They did not even care about helping us much until we reached 15k monthly spend or so, giving a holier-than-thou attitude and sounding like they're making lunch during the call. I'd rather have the call with an LLM at this point.

Then even though our website says our product relies on AI, it is impossible without AI and I explained to him how and why we train custom models and use their GenAI products - the person decided we are not an AI company and can only get 2k in Cloud credits.

The interaction left such a sour taste in my mouth that I will _never_ use Google Cloud in our product, as I do not want to have to deal with the Account Manager.

Post reply on HN