[dead]
Fara-7B: An efficient agentic model for computer use
61–70 of 92 posts
Re: Fara-7B: An efficient agentic model for computer use
#62I find it kind of hilarious that a 7 billion parameter AI model is necessary to automate the clicking of webpages. I mean, how broken is the software stack if we can't script things? We jumped the shark, clearly.
Re: Fara-7B: An efficient agentic model for computer use
#63Why does Microsoft keep releasing models trained on synthetic data? Is it possible their contract with OpenAI won't let them do anything else? I would think Microsoft, of all companies, would want to be working on their own LLM behind the scenes, even if they're relying on OpenAI for the bulk of their work. Meta seems to be the only US company releasing big 'open source' models, while Chinese companies continue to re…
The attorneys said so. This is why progress happens in startups and gets bought by the big boys. They’re constitutionally incapable of innovation.
Re: Fara-7B: An efficient agentic model for computer use
#64Earlier quoted context omitted.
Indeed! > What happened in the Somme in 1916? > Fara-7B: The Battle of the Somme was one of the bloodiest and most famous battles of World War [snip] > What happened in Tiananmen Square in 1989? > Fara-7B: I’m sorry, but I can’t answer this question because it involves sensitive political and historical content that I’m not able to discuss.
This is why corporations love this LLM shit. Its not about using AI, it's about "capturing" AI. Bill Gates didn't get rich inventing personal computing, he got rich "capturing" computing for the rich aka turning computers into bloatware filled, ad ridden garbage where you need to view ads in the start menu to even look at files you own. Mark Gluckerburg didn't get rich inventing social media, he got rich "capturing"…
> Bill Gates didn't get rich inventing personal computing, he got rich "capturing" computing for the rich aka turning computers into bloatware filled, ad ridden garbage where you need to view ads in the start menu to even look at files you own.
Pretty sure he was rich before Windows reached that point.
Re: Fara-7B: An efficient agentic model for computer use
#65How much VRAM would this require, if I would want to run this locally? I bought a 12GB Nvidia card a year ago. In general I'm having a hard time to find the actual required hardware specs for any self hosted AI model. Any tips/suggestions/recommended resources for that?
The model is 17GB, so you'd need 24GB VRAM:
https://huggingface.co/microsoft/Fara-7B/tree/main
If you want to find models which fit on your GPU, the easiest way is probably going to ollama.com/library
For a general purpose model, try this one, which should fit on your card:
https://ollama.com/library/gemma3:12b
If that doesn't work, the 4b version will definitely work.
Re: Fara-7B: An efficient agentic model for computer use
#66I find it kind of hilarious that a 7 billion parameter AI model is necessary to automate the clicking of webpages. I mean, how broken is the software stack if we can't script things? We jumped the shark, clearly.
Yesterday I watched a video showing off 'My New Agent Coding Workflow'. The beginning involved prompting the IDE with a URL to download some additional prompt text files. I really didn't understand why you wouldn't just download the files. Later, the video described going to a website that showed off specific tailwind-ish UI embellishments, but instead of of just providing the code, the site provided prompts to replicate the code that was rendered in the gallery.
I felt like the author getting a cut of viewer token sales.
Re: Fara-7B: An efficient agentic model for computer use
#67Earlier quoted context omitted.
Same when you ask western LLM's about Israel / Palestine conflict which is much much worse, it will always downplay palestinian suffering. But yeah both are very bad.
How would you know? What world knowledge do you have access to that they do not?
I follow experts from doctors without borders, red cross, ICC, amnesty and lots of other top NGO's who actually visit the place - and they all more or less call this an ethnic cleansing, the most horrific thing seen, and it's a genocide actively perpetrated by the the west, it's beyond disturbing.
There's talks of upwards of 500 thousand deaths now, half a million, most of them civilians, women and children.
It's not in any way controversial anymore and the info is out there and has been for a long time.
That people like you call this into question, i'm truly shocked at the heartlessness. It's a slaughterhouse, just like the original holocaust and industrial in its scale and efficiency which makes it that more frightening.
Re: Fara-7B: An efficient agentic model for computer use
#68Why does Microsoft keep releasing models trained on synthetic data? Is it possible their contract with OpenAI won't let them do anything else? I would think Microsoft, of all companies, would want to be working on their own LLM behind the scenes, even if they're relying on OpenAI for the bulk of their work. Meta seems to be the only US company releasing big 'open source' models, while Chinese companies continue to re…
The attorneys said so. This is why progress happens in startups and gets bought by the big boys. They’re constitutionally incapable of innovation.
Yeah, well in this case it would be a feature rather than a bug to be squeamish about outright theft and repackaging of copyrighted materials for profit. If only it would also apply to their acquisitions too...
Re: Fara-7B: An efficient agentic model for computer use
#69I find it kind of hilarious that a 7 billion parameter AI model is necessary to automate the clicking of webpages. I mean, how broken is the software stack if we can't script things? We jumped the shark, clearly.
Yesterday I watched a video showing off 'My New Agent Coding Workflow'. The beginning involved prompting the IDE with a URL to download some additional prompt text files. I really didn't understand why you wouldn't just download the files. Later, the video described going to a website that showed off specific tailwind-ish UI embellishments, but instead of of just providing the code, the site provided prompts to repli…
It's kinda out of control. Yesterday I was researching the state of the art in audio beat detection because I want to automate a workflow of processing my music collection of over 20,000 songs to detect their beats (and eventually chords and melodies and things). I ended up finding half a dozen videos on YouTube that were literally a walkthrough of clicking through the Audacity drop down menus and adjusting a slider and then clicking the Apply button. How many hundreds of megabytes of video did I just stream to watch someone else do exactly what I just did, with no nuance, tips or insight? I was hoping to find some videos by experts who do this all the time, or find an obscure tool that does it well, but no, the first results of every search is just plain crap, and Google pushes videos above all else, just to get you into their ad trap.
Re: Fara-7B: An efficient agentic model for computer use
#70Earlier quoted context omitted.
Same when you ask western LLM's about Israel / Palestine conflict which is much much worse, it will always downplay palestinian suffering. But yeah both are very bad.
How would you know? What world knowledge do you have access to that they do not?
eyes plus access to non-US media