There are posts going around X that Gemini image generation is very biased toward minority preferences even when factual data and real-life statistics don't support the outputs. For example, can somebody ask Gemini to generate a picture of a typical Swedish women?
Ask HN: How are you finding Gemini Ultra?
11–20 of 58 posts
Re: Ask HN: How are you finding Gemini Ultra?
#12Earlier quoted context omitted.
How do you get Gemini Ultra to generate images? It just tells me that it can't do that yet.
"Can you draw a photo of an avocado-shaped chair with a pineapple-man sitting in it?" Came up with 4 images. You raise a good point, though... I've also asked it to use its "web search" capability for tasks and it says it doesn't have that capability, but when I ask it by implying it should do a web search, it goes ahead and does it. Weird!
Yes, Gemini and previously Bard has a lot of confusion about its own capabilities. I use it to translate Chinese text in aliexpress product listings by taking screenshots. It’s perfectly capable and quite helpful in translating the text from those screenshots, but I think depending on how you phrase the question while uploading the photo, it will sometimes say “I’m only a language model I can’t help with that” or even “I can’t help with images”. Once it says that, I think it poisons the chat history and I start a new session to try to get it to work. I’ve not translated many images but so far this error happens maybe 20% of the time. It’s very strange.
I have another issue which is that when I paste a C++ code file in to the web interface, I get an error from the web interface and Gemini never even sees the code. The web interface is refusing to accept my code file. I opened up AI studio instead of the normal Gemini window and that seems to work, but I’d rather just use the normal chat window.
Re: Ask HN: How are you finding Gemini Ultra?
#13For things I would formerly use a web browser to look up, Gemini is often a lot better than gpt-4. The more obscure the query, the better Gemini does compared to gpt-4.
But gpt-4 is still best for ML Python coding. Gemini hallucinates non-existent libraries and often adds unnecessary junk to its code. For example, Gemini often defines spurious variables and then never uses them.
Re: Ask HN: How are you finding Gemini Ultra?
#14There are posts going around X that Gemini image generation is very biased toward minority preferences even when factual data and real-life statistics don't support the outputs. For example, can somebody ask Gemini to generate a picture of a typical Swedish women?
[flagged]
Re: Ask HN: How are you finding Gemini Ultra?
#15I've been using GPT-4 (mostly for coding and general knowledge, use it a lot more for personal projects than actual work) for the past year, and just switched to Gemini Advanced (since there's a 2 month trial, that includes Google One, which I'm already paying for), and so far it's pretty comparable. The "check sources" google button is sort of handy but it only works maybe 25% of the time to get a confirmation of a statement.
It sort of adds a "confidence level" check that saves me from doing it myself afterward like I would for GPT-4.
Edit to add: Gemini Advanced seems to be a lot faster as well at responding, in terms of tokens/second, compared to GPT-4.
Re: Ask HN: How are you finding Gemini Ultra?
#16This is about early testing (on code) of Gemini 1.5, but presumably that will come to the Gemini consumer product in not too long so …
I've put a complex codebase into a single 120K-token prompt, and asked 7 questions GPT-4 and Gemini 1.5. Here are the results! https://www.reddit.com/r/singularity/comments/1atjz9v/ive_pu...
Re: Ask HN: How are you finding Gemini Ultra?
#17There are posts going around X that Gemini image generation is very biased toward minority preferences even when factual data and real-life statistics don't support the outputs. For example, can somebody ask Gemini to generate a picture of a typical Swedish women?
Sure I asked it to generate a picture of a Swedish woman and it generated four white women that look Swedish to me (not that I would really know).
I then asked it to generate a portrait of a woman and it generated a white woman, a woman that to my eye looks East Asian, and a black woman. If you consider a random sample of all skin tones and regions on earth, this distribution seems pretty normal.
I’ve seen some people get very annoyed when people who don’t look like them get represented somewhere. Maybe those people were being extra loud about the representation. Or maybe I’ve not been able to generate the purported weird distributions you have heard of.
Re: Ask HN: How are you finding Gemini Ultra?
#18There are posts going around X that Gemini image generation is very biased toward minority preferences even when factual data and real-life statistics don't support the outputs. For example, can somebody ask Gemini to generate a picture of a typical Swedish women?
Sure I asked it to generate a picture of a Swedish woman and it generated four white women that look Swedish to me (not that I would really know). I then asked it to generate a portrait of a woman and it generated a white woman, a woman that to my eye looks East Asian, and a black woman. If you consider a random sample of all skin tones and regions on earth, this distribution seems pretty normal. I’ve seen some peopl…
Interesting, probably "fake news" then on X. Is there a way to publicly share Gemini interactions like with chatGPT?
Re: Ask HN: How are you finding Gemini Ultra?
#19This is about early testing (on code) of Gemini 1.5, but presumably that will come to the Gemini consumer product in not too long so … I've put a complex codebase into a single 120K-token prompt, and asked 7 questions GPT-4 and Gemini 1.5. Here are the results! https://www.reddit.com/r/singularity/comments/1atjz9v/ive_pu...
Interesting thanks! On your point #4, I might suggest that hallucination is worse than failing to answer, so maybe it wasn’t a tie.
Also how do you get the code into Gemini? I’ve pasted a C++ file in to the chat window and I get errors. Seems to work on AI studio though, is that how you interface with it?
Re: Ask HN: How are you finding Gemini Ultra?
#20Earlier quoted context omitted.
Sure I asked it to generate a picture of a Swedish woman and it generated four white women that look Swedish to me (not that I would really know). I then asked it to generate a portrait of a woman and it generated a white woman, a woman that to my eye looks East Asian, and a black woman. If you consider a random sample of all skin tones and regions on earth, this distribution seems pretty normal. I’ve seen some peopl…
Interesting, probably "fake news" then on X. Is there a way to publicly share Gemini interactions like with chatGPT?
Apparently yes, even from the Google mobile app where I did this.