Live data from Hacker News

Google Gemini Pro API Available Through AI Studio

ai.google.dev

61–70 of 118 posts

Re: Google Gemini Pro API Available Through AI Studio

#61
post #54
post #12

I can only access https://makersuite.google.com/ when using a VPN to the US. Also, it spams popups that get blocked by Firefox. Some basic prompts, which are answered correctly most of the time by ChatGPT4: There are 31 books in my house. I read 2 books over the weekend. How many books are still in my house? > 29 books Julia has three brothers, each of them has two sisters. How many sisters does Julia have? > Three I…

To the second question chatGPT answered : The orange is in the kitchen, as that is where the plate, along with the orange, was moved. Now a human can reason because a human can visualize in their mind that a plate is being moved without moving the orange. How is that kind of reasoning possible in LLMs which in my very basic understanding is predicting the next token.

Make sure you're including the GPT version, there's a wide gulf between GPT4 and prior models. GPT-4 answers:

Q. If you place an orange below a plate in the living room, and then move the plate to the kitchen, where is the orange now?

A. The orange remains in the living room. Moving the plate to the kitchen does not affect the position of the orange.

----

Q. There are 31 books in my house. I read 2 books over the weekend. How many books are still in my house?

A. There are still 31 books in your house. Reading books does not change their quantity

----

Q. Julia has three brothers, each of them has two sisters. How many sisters does Julia have?

A. Julia has one sister. Each of her three brothers has two sisters, and Julia is one of them. The other one is her sister, making it a total of one sister for Julia.

Re: Google Gemini Pro API Available Through AI Studio

#62
post #54
post #12

I can only access https://makersuite.google.com/ when using a VPN to the US. Also, it spams popups that get blocked by Firefox. Some basic prompts, which are answered correctly most of the time by ChatGPT4: There are 31 books in my house. I read 2 books over the weekend. How many books are still in my house? > 29 books Julia has three brothers, each of them has two sisters. How many sisters does Julia have? > Three I…

To the second question chatGPT answered : The orange is in the kitchen, as that is where the plate, along with the orange, was moved. Now a human can reason because a human can visualize in their mind that a plate is being moved without moving the orange. How is that kind of reasoning possible in LLMs which in my very basic understanding is predicting the next token.

In order to predict next tokens in text with greater and greater accuracy, some parameters of the language model must represent a model of the world.

Re: Google Gemini Pro API Available Through AI Studio

#63
post #12

I can only access https://makersuite.google.com/ when using a VPN to the US. Also, it spams popups that get blocked by Firefox. Some basic prompts, which are answered correctly most of the time by ChatGPT4: There are 31 books in my house. I read 2 books over the weekend. How many books are still in my house? > 29 books Julia has three brothers, each of them has two sisters. How many sisters does Julia have? > Three I…

GPT4 gets the second question wrong for me, but in a weird way.

> Julia has three brothers, each of them has two sisters. How many sisters does Julia have?

Julia has two sisters. Each brother having two sisters refers to the same two sisters, Julia and another sister.

Then if I ask to verify its answer, it realizes the issue.

> Apologies for any confusion. If Julia has three brothers and each of them has two sisters, then Julia is one of the sisters. The other sister is common among all three brothers. Therefore, Julia has only one sister.

Re: Google Gemini Pro API Available Through AI Studio

#64
post #16

Typical Google UX. Get API key, takes me to makersuite, where I get a create API key button that errors. Then when I reload the page, I get a straight forbidden page. HP said it best, you have to isolate the team from the bigger company to allow them to work as an effective startup. How can solo-preneurs provide better UX & onboarding while doing 16 other jobs than Google can with multi-billion dollar budgets?

You reminded me of how much hatred I had for Google binding all their products language (including Workspaces) to my account language, with no chance to be changed (even if I updated the account settings). How can they be so unaware of the fact that people will often prefer english because that's the language with most tutorials/guides/resources and makes interoperability in cross-country remote companies simpler? Do…

Ugh Google Flights.

Hey maybe try using, I dunno, the currency of my logged in account / country? Or the currency I used last time? Or the currency of my VPN country?

Just because I’m traveling in Uzbekistan for a few days doesn’t mean I want to buy tickets denominated in Uzbek Som.

Re: Google Gemini Pro API Available Through AI Studio

#65
post #54
post #12

I can only access https://makersuite.google.com/ when using a VPN to the US. Also, it spams popups that get blocked by Firefox. Some basic prompts, which are answered correctly most of the time by ChatGPT4: There are 31 books in my house. I read 2 books over the weekend. How many books are still in my house? > 29 books Julia has three brothers, each of them has two sisters. How many sisters does Julia have? > Three I…

To the second question chatGPT answered : The orange is in the kitchen, as that is where the plate, along with the orange, was moved. Now a human can reason because a human can visualize in their mind that a plate is being moved without moving the orange. How is that kind of reasoning possible in LLMs which in my very basic understanding is predicting the next token.

Here's the response chatGPT 4 gave for me:

> The orange remains in the living room. Moving the plate to the kitchen does not affect the location of the orange, since it was placed below the plate but not attached to it. Therefore, the orange stays where it was originally placed, which is in the living room.

You don't need to visualize it in your mind to understand the relationship between being _below_ and being _moved with_. Keep in mind that many people cannot visualize anything in their mind!

Re: Google Gemini Pro API Available Through AI Studio

#66
post #42

Earlier quoted context omitted.

Isn't 6 still incorrect? Or am I dumb?

This made me laugh. It's very wrong. Unless I'm dumb, the answer we're looking for should be 1. Sounds like the confidence of Gemini worked on you, though.

.

Re: Google Gemini Pro API Available Through AI Studio

#67

Earlier quoted context omitted.

Isn't 6 still incorrect? Or am I dumb?

You're not dumb. But it's an ambiguous question as written. Presumably, we are to assume that all siblings involved are still alive, that all all full siblings (ie no half- or step-siblings), that everyone is cisgender, and that Julia is female. In which case, Julia would have one sister. Each of her three brothers would have two sisters, one of whom was Julia herself.

My 6yo can answer this correctly, making all of your stated assumptions above. Edit: Clarification - I am in no way implying that someone who was confused by the math is dumb, everyone makes silly mistakes sometimes.

I think It’s only ambiguous to a machine. To a human, even in 2023, these are likely default assumptions for a question phrased as above, unless being overly pedantic or attempting to “get around” the puzzle.

If you ask a model - or a person - “what does 1+1 equal to?”, it is also ambiguous, since we haven’t defined what “+” means, did not specify that we are dealing with natural numbers rather than eg elements in Z//2Z which could be similarly denoted.

Re: Google Gemini Pro API Available Through AI Studio

#68
post #42

Earlier quoted context omitted.

Isn't 6 still incorrect? Or am I dumb?

This made me laugh. It's very wrong. Unless I'm dumb, the answer we're looking for should be 1. Sounds like the confidence of Gemini worked on you, though.

It’s way more complicated. As an example, my kid has one half sister and had one step sister. My kid referred to both of them as their sisters, but the step person didn’t acknowledge my kid as such.

Even if we err on the side of the step, take the half sister entirely out of the equation and only focus on the step relationship, one would have claimed 0 sisters and the other would have claimed 1. They were talking about each other and they were both telling their truth. But the answer is simultaneously 0 and 1.

It gets even more interesting because neither my kid nor their step sibling are cisgender. I don’t know what to call their step so just use their name and pronouns now. The step still won’t acknowledge they’re siblings and I respect that a lot.

When these smart young folks take over, the world will get really cool.

Edit - This was way more complicated to explain than I anticipated.

Re: Google Gemini Pro API Available Through AI Studio

#69
post #15

Earlier quoted context omitted.

Gemini is not available in the EU is it?

> Just as for Bard, Europe will need to wait for Gemini https://thenextweb.com/news/google-gemini-ai-unavailable-eur...

When they finally release this train wreck to the EU we will have had another round of OpenAI, Antrophic and finally Mistral releases. Why even pretend to compete Google? Just admit already that you guys are only interested in shoving ads in our faces and call it a day?

Re: Google Gemini Pro API Available Through AI Studio

#70
post #16

Typical Google UX. Get API key, takes me to makersuite, where I get a create API key button that errors. Then when I reload the page, I get a straight forbidden page. HP said it best, you have to isolate the team from the bigger company to allow them to work as an effective startup. How can solo-preneurs provide better UX & onboarding while doing 16 other jobs than Google can with multi-billion dollar budgets?

I know and agree about the UX problem.

But I wanted to note API key generation works when you pick an existing Google Cloud project.

Post reply on HN