Magika: AI powered fast and efficient file type identification

Post by beeboobaa » Fri, Feb 16, 2024, 8:45 PM UTC

timschmidt wrote: post #200

beeboobaa wrote: post #192

Earlier quoted context omitted.

> You are asking what if this guy has "web crawl data" that google does not have? No, I'm asking if he has permission to redistribute these files.

Are you attempting to assert that use of these files solely for the purpose of improving a software system meant to classify file types does not fall under fair use? https://en.wikipedia.org/wiki/Fair_use

Post by beeboobaa » Fri, Feb 16, 2024, 8:54 PM UTC

timschmidt wrote: post #202

beeboobaa wrote: post #201

Earlier quoted context omitted.

I'm asking a question. Here's another one for you: Do you believe that all pictures you have ever taken, all emails you have ever written, all code you have ever written could be posted here on this forum to improve someone else's software system? If so, could you go ahead and post that zip? I'd like to ingest it in my model.

Your question seems orthogonal to the situation. The three files posted seem to be the minimum amount of information required to reproduce the bug. Fair use encompasses a LOT of uses of otherwise copyrighted work, and this seems clearly to be one.

Post by michaelmior » Fri, Feb 16, 2024, 8:57 PM UTC

jdiff wrote: post #140

michaelmior wrote: post #134

Earlier quoted context omitted.

> the current implementation can't be relied on IMO What's your reasoning for not relying on this? (It seems to me that this would be application-dependent at the very least.)

I'm not the person you asked, but I'm not sure I understand your question and I'd like to. It whiffed multiple common softballs, to the point it brings into question the claims made about its performance. What reasoning is there to trust it?

Post by Gormo » Fri, Feb 16, 2024, 9:13 PM UTC

jsnell wrote: post #169

jdiff wrote: post #162

Earlier quoted context omitted.

Nobody's asking for perfection. But the AI is offering inexplicable and obvious nondeterministic mistakes that the traditional algorithms don't suffer from. Magika goes wrong and your fonts become audio files and nobody knows why. Magic goes wrong and your ZIP-based documents get mistaken for generic ZIP files. If you work with that edge case a lot, you can anticipate it with traditional algorithms. You can't anticip…

Where are you getting the non-determinism part from? It would seem surprising for there to be anything non-deterministic about an ML model like this, and nothing in the original reports seems to suggest that either.

Post by timschmidt » Fri, Feb 16, 2024, 9:20 PM UTC

beeboobaa wrote: post #208

timschmidt wrote: post #204

Earlier quoted context omitted.

So you don't think that software development which happens in public web forums deserve fair use protection?

That's an interesting way to frame "publicly posted someone else's data without their consent for anyone to see and download"