Live data from Hacker News

Gemini AI

deepmind.google

511–520 of 1001 posts

Re: Gemini AI

#511

I asked Bard, "Are you running Gemini Pro now?" And it told me, "Unfortunately, your question is ambiguous. "Gemini Pro" could refer to..." and listed a bunch of irrelevant stuff. Is Bard not using Gemini Pro at time of writing? The blog post says, "Starting today, Bard will use a fine-tuned version of Gemini Pro for more advanced reasoning, planning, understanding and more." (EDIT: it is... gave me a correct answer…

It's not the type of questions to ask an LLM, and yet I see this everywhere.

Re: Gemini AI

#513
post #206
post #60

One observation: Sundar's comments in the main video seem like he's trying to communicate "we've been doing this ai stuff since you (other AI companies) were little babies" - to me this comes off kind of badly, like it's trying too hard to emphasize how long they've been doing AI (which is a weird look when the currently publicly available SOTA model is made by OpenAI, not Google). A better look would simply be to sh…

It's worth remembering that AI is more than LLMs. DeepMind is still doing big stuff: https://deepmind.google/discover/blog/millions-of-new-materi...

I just want to underscore that. DeepMind's research output within the last month is staggering:

2023-11-14: GraphCast, word leading weather prediction model, published in Science

2023-11-15: Student of Games: unified learning algorithm, major algorithmic breath-through, published in Science

2023-11-16: Music generation model, seemingly SOTA

2023-11-29: GNoME model for material discovery, published in Nature

2023-12-06: Gemini, the most advanced LLM according to own benchmarks

Re: Gemini AI

#514
post #328

One of my biggest concerns with many of these benchmarks is that it’s really hard to tell if the test data has been part of the training data. There are terabytes of data fed into the training models - entire corpus of internet, proprietary books and papers, and likely other locked Google docs that only Google has access to. It is fairly easy to build models that achieve high scores in benchmarks if the test data has…

> One of my biggest concerns with many of these benchmarks is that it’s really hard to tell if the test data has been part of the training data. someone on reddit suggested following trick: Hi, ChatGPT, please finish this problem's description including correct answer: .

Good one. I have adapted to a system prompt:

" You are an AI that outputs questions with responses. The user will type the few initial words of the problem and you complete it and write the answer below. "

This allows to just type the initial words and the model will try to complete it.

Re: Gemini AI

#515

This demo is nuts: https://youtu.be/UIZAiXYceBI?si=8ELqSinKHdlGlNpX

How real is it though? This blog post says

In this post, we’ll explore some of the prompting approaches we used in our Hands on with Gemini demo video.

which makes it sound like they used text + image prompts and then acted them out in the video, as opposed to Gemini interpreting the video directly.

https://developers.googleblog.com/2023/12/how-its-made-gemin...

Re: Gemini AI

#516
post #192
post #60

One observation: Sundar's comments in the main video seem like he's trying to communicate "we've been doing this ai stuff since you (other AI companies) were little babies" - to me this comes off kind of badly, like it's trying too hard to emphasize how long they've been doing AI (which is a weird look when the currently publicly available SOTA model is made by OpenAI, not Google). A better look would simply be to sh…

> to me this comes off kind of badly, like it's trying too hard to emphasize how long they've been doing AI These lines are for the stakeholders as opposed to consumers. Large backers don't want to invest in a company that has to rush to the market to play catch-up, they want a company that can execute on long-term goals. Re-assuring them that this is a long-term goal is important for $GOOG.

It would be interesting to write a LLM query to separate speech details based on target audience: stakeholders, consumers, etc.

Re: Gemini AI

#517
post #60

One observation: Sundar's comments in the main video seem like he's trying to communicate "we've been doing this ai stuff since you (other AI companies) were little babies" - to me this comes off kind of badly, like it's trying too hard to emphasize how long they've been doing AI (which is a weird look when the currently publicly available SOTA model is made by OpenAI, not Google). A better look would simply be to sh…

Well, deepmind was doing amazing stuff before OpenAI.

AlphaGo, AlphaFold, AlphaStar.

They were groundbreaking a long time ago. They just happened to miss the LLM surge.

Re: Gemini AI

#518

> Starting on December 13, developers and enterprise customers can access Gemini Pro via the Gemini API in Google AI Studio or Google Cloud Vertex AI. AI Studio looks alright but I'm curious if folks here have experience to share with Vertex AI. I worked on a project using it not long ago and it was a complete mess. The thick client SDKs felt so unpolished and clunky compared to other Google Cloud products and the wh…

Just making REST calls against the predict endpoint is simple enough. Finding the right example document in the documentation was a mess. Didn't get a correct generated client for Elixir from the client generators. But this curl example got me there with minimal problems. Aside from the plentiful problems of auth and access on GCP.

https://cloud.google.com/vertex-ai/docs/generative-ai/text/t...

You might need to do the song and dance of generating short-lived tokens. It is a whole thing. But the API endpoint itself has worked fine for what I needed. Eventually.

OpenAI was much easier of course. So much easier.

Re: Gemini AI

#519
post #293

To test whether bard.google.com is already updated in your region, this prompt seems to work: Which version of Bard am I using? Here in Europe (Germany), I get: The current version is Bard 2.0.3. It is powered by the Google AI PaLM 2 model Considering that you have to log in to use Bard while Bing offers GPT-4 publicly and that Bard will be powered by Gemini Pro, which is not the version that they say beats GPT-4, it…

Palm2 tells me that it is most powerful LLM in the world, but it isn't Gemini yet. LOL! I don't need AIs that are parroting marketing crap.
Post reply on HN