Live data from Hacker News

The killer app of Gemini Pro 1.5 is using video as an input

simonwillison.net

391–400 of 507 posts

Re: The killer app of Gemini Pro 1.5 is using video as an input

#391

> It looks like the safety filter may have taken offense to the word “Cocktail”! I opened up the safety settings, dialled them down to “low” for every category and tried again. It appeared to refuse a second time. Google really is its own worst enemy. Their risk management people have completely taken over the organization to a point where somehow the smartest computers ever created are afraid of using dangerous word…

It could be worse. I once triggered temporary block (session refused to return anything) when using GitHub copilot because of variable names.

Was the project particularly frustrating or did it freeze like that on fairly standard names?

Re: The killer app of Gemini Pro 1.5 is using video as an input

#393

> It looks like the safety filter may have taken offense to the word “Cocktail”! I'm definitely not a fan of these severely hamstrung by default models. Especially as it seems to be based on an extremely puritan ethical system.

Deeply agree with the sentiment. AIs are so throttled and crippled that it makes me sad every time gemini or chatgpt refuses to answer my questions.

Also agree that it’s mostly policed by American companies who follow the American culture of “swearing is bad, nudity is horrible, some words shouldn’t even be said”

Re: The killer app of Gemini Pro 1.5 is using video as an input

#394
post #125
post #117

Earlier quoted context omitted.

Remember, if it's using a similar tokeniser to GPT-4 (cl100k_base iirc), each token has a dimension of ~100,000. So 258x100,000 is a space of 25,800,000 floats, using f16 (a total guess) that's 51.6kB, probably enough to represent the image at ok quality with JPG.

I don't think that's right. A token in GPT-4 is a single integer, not a vector of floats. Input to a model gets embedded into vectors later, but the actual tokens are pretty tiny.

But they are not a "single integer" either as in, like a byte... I don't have any good examples but I'm pretty sure the tokens are in the range of thousands of dimensions. It has to encode the properties of the patch of the image it derives from, and even a small 40x40 RGB pixel patch has plenty of information you have to retain.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#397

Earlier quoted context omitted.

I employ a different strategy: I own 25 pairs of the same gray socks (gray was chosen so that it matches most outfits) and I just wear those all the time. Obviously I do own other socks (for suits etc.) but it has cumulatively saved me hours of sock searching.

Yes, I tried to employ this same strategy, but maybe it's because of my ADD or something, but I never manage to buy the same bulk socks, and eventually I run out and try to buy another bulk of socks which starts to get mixed with the last ones. I need a robot that can physically sort and organize absolutely everything in my living space. I have ideas for different strategies, but I am never able to actually implement…

If you build a solution out, you could stand to make millions

Re: The killer app of Gemini Pro 1.5 is using video as an input

#398

Earlier quoted context omitted.

If you want a great example of how this plays out long-term, look no further than algospeak[0] - the new lingo created by censorship algorithms like those on youtube and tiktok. [0] https://www.nytimes.com/2022/11/19/style/tiktok-avoid-modera...

Paywall

https://archive.is/tBYVK

Re: The killer app of Gemini Pro 1.5 is using video as an input

#399
post #363

Earlier quoted context omitted.

Isn't monetization so low on youtube that it is more worthy as an advertising platform for your sponsors, patreon subscriptions and merchandising than anything?

That probably really depends on your audience what kind of monetization scheme makes sense for you, but all of them depend on traffic, getting discovered and having subscribers. I doubt there's many sponsors for videos hosted on a Peertube instance. Nothing against the technology or the idea of federating (which I like), but telling people to just get off YouTube and switch to Peertube is a very unrealistic and naive…

I was just referring to the direct monetization which looks to me relatively marginal unless you reach viewers in the 7 or 8 digit numbers at which point most youtubers already have started having other source of revenues anyway which are probably higher than what youtube provides: consulting, physical shows/appearances, sponsorship, merch, own brands, etc.

I understand that network effect is probably more important than anything else but to me content platforms are more a way to get and stay known than a direct source of revenue. Hence the success of instagram and tiktok with the newer gen whose shorter forms of content and lower searchability involve smaller investment and production cost and more immediate followship[1].

[1] people more immediately subscribe for fear to not have to wait to get access to feed again while on youtube it is still relatively easy to find back videos or consult channels without subscribing.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#400

Earlier quoted context omitted.

Paywall

If you are averse to seeing links to paywalled articles you probably shouldn't use HN

Why are we spamming the landing page of paywalled sources? We should completely avoid posting them here, to preserve their bandwidth and our sanity.
Post reply on HN