Live data from Hacker News

Google Gemini Pro API Available Through AI Studio

ai.google.dev

31–40 of 118 posts

Re: Google Gemini Pro API Available Through AI Studio

#31
post #12

I can only access https://makersuite.google.com/ when using a VPN to the US. Also, it spams popups that get blocked by Firefox. Some basic prompts, which are answered correctly most of the time by ChatGPT4: There are 31 books in my house. I read 2 books over the weekend. How many books are still in my house? > 29 books Julia has three brothers, each of them has two sisters. How many sisters does Julia have? > Three I…

Great questions. Gpt4 got the second wrong in my test, but corrected itself when I told it to review for errors. It got the other two right at first try.

Re: Google Gemini Pro API Available Through AI Studio

#32
post #12

I can only access https://makersuite.google.com/ when using a VPN to the US. Also, it spams popups that get blocked by Firefox. Some basic prompts, which are answered correctly most of the time by ChatGPT4: There are 31 books in my house. I read 2 books over the weekend. How many books are still in my house? > 29 books Julia has three brothers, each of them has two sisters. How many sisters does Julia have? > Three I…

Mistral 7b gets the first two wrong, but gets the third one right: "The orange is still in the living room. When you moved the plate, you didn't move the orange. It remains in its original location until you pick it up and move it to a different place"

Re: Google Gemini Pro API Available Through AI Studio

#34
post #16

Typical Google UX. Get API key, takes me to makersuite, where I get a create API key button that errors. Then when I reload the page, I get a straight forbidden page. HP said it best, you have to isolate the team from the bigger company to allow them to work as an effective startup. How can solo-preneurs provide better UX & onboarding while doing 16 other jobs than Google can with multi-billion dollar budgets?

It’s not about budgets, it’s about incentives and the Dunbar limit. A solo-preneur, or a small organisation has all the incentives to have great onboarding experiences. And they’re small enough for everyone to know each other and have a coherent vision.

At a huge organisation like Google there’s a plethora of people all working according to their incentives. These organisations pay lip service to customer experience and excellence, but when push comes to shove it’s the flashy projects that get rewarded.

So nobody has a great overview of everything going on to the necessary level of detail, and nobody actually cares about onboarding UX.

Microsoft has the same problem, I want to shoot myself every time I need to get something done for a kid’s account on Xbox.

Re: Google Gemini Pro API Available Through AI Studio

#35
post #12

I can only access https://makersuite.google.com/ when using a VPN to the US. Also, it spams popups that get blocked by Firefox. Some basic prompts, which are answered correctly most of the time by ChatGPT4: There are 31 books in my house. I read 2 books over the weekend. How many books are still in my house? > 29 books Julia has three brothers, each of them has two sisters. How many sisters does Julia have? > Three I…

Since the Maker Suite doesn't have the same prompting as something like Bard or ChatGPT, I gave Gemini Pro a bit more context:

> Consider the following user chat. Reason out loud as needed to provide a reasonable response. User message: "Julia has three brothers, each of them has two sisters. How many sisters does Julia have?"

Gemini Pro:

> Julia's brothers have nothing to do with how many sisters she has. Julia's sisters are also her brothers' sisters, so the number of sisters Julia has is the same as the number of sisters her brothers have. Julia's brothers have two sisters each, so if we add up the number of sisters for each brother, we get: 2 + 2 + 2 = 6. Therefore, Julia has 6 sisters. The answer is 6.

Re: Google Gemini Pro API Available Through AI Studio

#38
post #31
post #12

I can only access https://makersuite.google.com/ when using a VPN to the US. Also, it spams popups that get blocked by Firefox. Some basic prompts, which are answered correctly most of the time by ChatGPT4: There are 31 books in my house. I read 2 books over the weekend. How many books are still in my house? > 29 books Julia has three brothers, each of them has two sisters. How many sisters does Julia have? > Three I…

Great questions. Gpt4 got the second wrong in my test, but corrected itself when I told it to review for errors. It got the other two right at first try.

GPT4 insisted on wrong answer in the second test: https://chat.openai.com/share/301cc597-929b-43d6-9685-2aad3e...

Re: Google Gemini Pro API Available Through AI Studio

#39
post #12

I can only access https://makersuite.google.com/ when using a VPN to the US. Also, it spams popups that get blocked by Firefox. Some basic prompts, which are answered correctly most of the time by ChatGPT4: There are 31 books in my house. I read 2 books over the weekend. How many books are still in my house? > 29 books Julia has three brothers, each of them has two sisters. How many sisters does Julia have? > Three I…

Gemini Pro compares to GPT 3.5.. their biggest model that competes with GPT-4 is called Gemini Ultra and they say that's coming early next year.

Re: Google Gemini Pro API Available Through AI Studio

#40
post #35
post #12

I can only access https://makersuite.google.com/ when using a VPN to the US. Also, it spams popups that get blocked by Firefox. Some basic prompts, which are answered correctly most of the time by ChatGPT4: There are 31 books in my house. I read 2 books over the weekend. How many books are still in my house? > 29 books Julia has three brothers, each of them has two sisters. How many sisters does Julia have? > Three I…

Since the Maker Suite doesn't have the same prompting as something like Bard or ChatGPT, I gave Gemini Pro a bit more context: > Consider the following user chat. Reason out loud as needed to provide a reasonable response. User message: "Julia has three brothers, each of them has two sisters. How many sisters does Julia have?" Gemini Pro: > Julia's brothers have nothing to do with how many sisters she has. Julia's si…

Isn't 6 still incorrect? Or am I dumb?
Post reply on HN