Apple has a video understanding model too. I can't wait to find out what accessibility stuff they'll do with the models. As a blind person, AI has changed my life.
I wonder if there's anything that can help blind people to navigate the world more easily - I guess in the future AR Glasses won't just be for the sighted but allow people without vision to be helped considerably. It really is both amazing and terrifying the future we're heading towards.
Apple Releases Open Weights Video Model
131–140 of 178 posts
Re: Apple Releases Open Weights Video Model
#132Apple has a video understanding model too. I can't wait to find out what accessibility stuff they'll do with the models. As a blind person, AI has changed my life.
Hi Devin and other folks, I'm looking for software developers who are blind or hard of sight as there is a tool I'm building that I think might be of interest to them (it's free and open source). If you or anyone you know is interested in trying it please get in touch through my email.
Re: Apple Releases Open Weights Video Model
#133Earlier quoted context omitted.
My two cents, this seems like a comment it should be up to the OP to make instead of virtue signaling.
...you know, people can have opinions about the best way to behave outside of self-aggrandizement, even if your brain can't grasp this concept.
exactly
Re: Apple Releases Open Weights Video Model
#134Apple has a video understanding model too. I can't wait to find out what accessibility stuff they'll do with the models. As a blind person, AI has changed my life.
> As a blind person, AI has changed my life. Something one doesn't see in news headlines. Happy to see this comment.
I have to believe you used the word see twice ironically.
Re: Apple Releases Open Weights Video Model
#135Apple's got to stop running their AI group like a university lab. Get some actual products going that we can all use--you know, with a proper fucking web UI and a backend.
Personally, I'm happy that Apple is spending the time and money on research. We have products that already do what this model does, the next step is to make it either more efficient or better (closer to the prompt, more realistic, higher quality output). That requires research, not more products.
Re: Apple Releases Open Weights Video Model
#136Earlier quoted context omitted.
From the paper: > Datasets. We construct a diverse and high-quality collection of video datasets to train STARFlow-V. Specifically, we leverage the high-quality subset of Panda (Chen et al., 2024b) mixed with an in-house stock video dataset, with a total number of 70M text-video pairs.
> in-house stock video dataset Wonder if "iCloud backups" would be counted as "stock video" there? ;)
More likely AppleTV shows
Re: Apple Releases Open Weights Video Model
#137Earlier quoted context omitted.
Not the gp, but currently reading a web novel with a card game where the author didn't include alt text in the card images. I contacted them about it and they started, but in the meantime ai was a big help. all kinds of other images on the internet as well when they are significant to understanding the surrounding text. better search experience when Google, DDG, and the like make finding answers difficult. I might us…
As a (web app) developer I never quite sure what to put in alt. Figured you might have some advice here?
> As a (web app) developer I never quite sure what to put in alt.
Are you making these five mistakes when writing alt text? [1] Images tutorial [2] Alternative Text [3]
[1]: https://www.a11yproject.com/posts/are-you-making-these-five-...
Re: Apple Releases Open Weights Video Model
#138The license[0] seems quite restrictive, limiting it's use to non commercial research. It doesn't meet the open source definition so it's more appropriate to call it weights available. [0] https://github.com/apple/ml-starflow/blob/main/LICENSE_MODEL
[deleted]
Re: Apple Releases Open Weights Video Model
#139Earlier quoted context omitted.
As a (web app) developer I never quite sure what to put in alt. Figured you might have some advice here?
I'm gonna flip this around... have you tried pasting the image (and the relevant paragraph of text) and asking ChatGPT (or another LLM) to generate the alt text for the image and see what it produces? For example... https://chatgpt.com/share/692f1578-2bcc-8011-ac8f-a57f2ab6a7...
> I'm gonna flip this around... have you tried pasting the image (and the relevant paragraph of text) and asking ChatGPT (or another LLM) to generate the alt text for the image and see what it produces?
There's a great app by an indie developer that uses ML to identify objects in images. Totally scriptable via JavaScript, shell script and AppleScript. macOS only.
Could be 10, 100 or 1,000 images [1].
Re: Apple Releases Open Weights Video Model
#140Earlier quoted context omitted.
What would you put for this? "Graph of All-Transactions House Price Index for the United States 1975-2025"? https://fred.stlouisfed.org/series/USSTHPI
Charts are one I've wondered about, do I need to try to describe the trend of the data, or provide several conclusions that a person seeing the chart might draw? Just saying "It's a chart" doesn't feel like it'd be useful to someone who can't see the chart. But if the other text on the page talks about the chart, then maybe identifying it as the chart is enough?
https://www.w3.org/WAI/tutorials/images/ including how write alt text for charts.