Fuyu-8B: A multimodal architecture for AI agents
1–10 of 60 posts
Re: Fuyu-8B: A multimodal architecture for AI agents
#2Hey I work at Adept and helped make this!
Happy to answer questions.
The thing I think is especially neat/notable is how simple you can make the model architecture while still getting good performance.
I expect we'll continue to see bits of these models get deleted in the next few years
Note that you can get the model weights on HuggingFace here: https://huggingface.co/adept/fuyu-8b
Re: Fuyu-8B: A multimodal architecture for AI agents
#3Hey I work at Adept and helped make this! Happy to answer questions. The thing I think is especially neat/notable is how simple you can make the model architecture while still getting good performance. I expect we'll continue to see bits of these models get deleted in the next few years Note that you can get the model weights on HuggingFace here: https://huggingface.co/adept/fuyu-8b
Hi,
Will it work for html/APP UI screenshots, Have been trained using UI screenshots ?
Thank you
Re: Fuyu-8B: A multimodal architecture for AI agents
#4Really cool that the image patches are converted to tokens with just a linear projection instead of a big embedding model! I wonder if that trick will prove viable for other multimodel media like audio.
Re: Fuyu-8B: A multimodal architecture for AI agents
#5Hey I work at Adept and helped make this! Happy to answer questions. The thing I think is especially neat/notable is how simple you can make the model architecture while still getting good performance. I expect we'll continue to see bits of these models get deleted in the next few years Note that you can get the model weights on HuggingFace here: https://huggingface.co/adept/fuyu-8b
can you guys launch a web gradio demo until the transformers PR gets approved? i'd like to play around with the model
Re: Fuyu-8B: A multimodal architecture for AI agents
#6Oh wow. This seems to be the best released vlm model. The chart/UI understanding displayed in particular is superb.
Re: Fuyu-8B: A multimodal architecture for AI agents
#7Before someone else does, I'm going to point out that CC-BY-NC is technically not an open source license.
Re: Fuyu-8B: A multimodal architecture for AI agents
#8Oh wow. This seems to be the best released vlm model. The chart/UI understanding displayed in particular is superb.
>This is by far the best open source vlm model
LLaVA 1.5 is very good, at least at describing images. http://llava.hliu.cc/
Re: Fuyu-8B: A multimodal architecture for AI agents
#9Hey I work at Adept and helped make this! Happy to answer questions. The thing I think is especially neat/notable is how simple you can make the model architecture while still getting good performance. I expect we'll continue to see bits of these models get deleted in the next few years Note that you can get the model weights on HuggingFace here: https://huggingface.co/adept/fuyu-8b
What’s the situation with the license? Your blog post says you are open sourcing it, but it’s currently only available under a non-commercial license instead. Is an open source release forthcoming?
Re: Fuyu-8B: A multimodal architecture for AI agents
#10Before someone else does, I'm going to point out that CC-BY-NC is technically not an open source license.
[deleted]