Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Fuyu-8B: A multimodal architecture for AI agents

adept.ai

Post reply on HN
Print view View original

21–30 of 60 posts

Re: Fuyu-8B: A multimodal architecture for AI agents

#21

Post by ansk »

mandelken wrote: post #16
JimDabell wrote: post #9

Earlier quoted context omitted.

What’s the situation with the license? Your blog post says you are open sourcing it, but it’s currently only available under a non-commercial license instead. Is an open source release forthcoming?

You can download the weights on Hugginface. I believe the copyright on AI model weights in the US is not fully established, but so far it has been held that a list of numbers can not be copyrighted, so likely the same applies to model weights. Note that you don't have to enter into an agreement with Adept to use the model. Alternatively, use and download the weights in Japan that has explicitly no copyright on AI mod…

> a list of numbers can not be copyrighted

Any digital object can be represented as a list of numbers (this is precisely the origin of the term digital). Since there is clearly precedent for copyrighted digital objects (media, software, etc), reducing something to "a list of numbers" is not a useful distinction in regard to copyright law.

Re: Fuyu-8B: A multimodal architecture for AI agents

#23

Post by MattPalmer1086 »

ansk wrote: post #21
mandelken wrote: post #16

Earlier quoted context omitted.

You can download the weights on Hugginface. I believe the copyright on AI model weights in the US is not fully established, but so far it has been held that a list of numbers can not be copyrighted, so likely the same applies to model weights. Note that you don't have to enter into an agreement with Adept to use the model. Alternatively, use and download the weights in Japan that has explicitly no copyright on AI mod…

> a list of numbers can not be copyrighted Any digital object can be represented as a list of numbers (this is precisely the origin of the term digit al). Since there is clearly precedent for copyrighted digital objects (media, software, etc), reducing something to "a list of numbers" is not a useful distinction in regard to copyright law.

IANAL but as far as I remember, you can't copyright a list of objective facts, for example a phone book containing a list of phone numbers.

Model weights are clearly not in that category. Happy to be corrected if I misremember.

Re: Fuyu-8B: A multimodal architecture for AI agents

#24

Post by ekelsen »

Q6T46nT668w6i3m wrote: post #11
tasdfqwer0897 wrote: post #2

Hey I work at Adept and helped make this! Happy to answer questions. The thing I think is especially neat/notable is how simple you can make the model architecture while still getting good performance. I expect we'll continue to see bits of these models get deleted in the next few years Note that you can get the model weights on HuggingFace here: https://huggingface.co/adept/fuyu-8b

Neat idea! Are the batches encoded as tokens into the input sequence? This is something I really like about the multi-modal PALM papers since it enables the multi-modal tokens to be referenced.

Image patches are projected directly into an embedding that goes into the decoder Transformer. The same thing could be done for audio.

Re: Fuyu-8B: A multimodal architecture for AI agents

#27

Post by snats »

thefcpk wrote: post #25

One thing that puzzles me is the lack of multilingual models... it is a bit sad to see everything through the English language.

Yes, but currently there is a project called Aya[1] from Cohere4AI that I think it is trying to create multilingual models.

[1] aya.for.ai

Re: Fuyu-8B: A multimodal architecture for AI agents

#28

Post by zan2434 »

tasdfqwer0897 wrote: post #2

Hey I work at Adept and helped make this! Happy to answer questions. The thing I think is especially neat/notable is how simple you can make the model architecture while still getting good performance. I expect we'll continue to see bits of these models get deleted in the next few years Note that you can get the model weights on HuggingFace here: https://huggingface.co/adept/fuyu-8b

Hey! Awesome work. It seems like in theory this encoding scheme should enable the a model like this to generate images as well, by outputting image tokens, is that right?
Post reply on HN