Magika: AI powered fast and efficient file type identification
opensource.googleblog.com
Magika: AI powered fast and efficient file type identification
1–10 of 262 posts
Re: Magika: AI powered fast and efficient file type identification
#2A somewhat surprising and genuinely useful application of the family of techniques.
I wonder how susceptible it is to adversarial binaries or, hah, prompt-injected binaries.
Re: Magika: AI powered fast and efficient file type identification
#3A somewhat surprising and genuinely useful application of the family of techniques. I wonder how susceptible it is to adversarial binaries or, hah, prompt-injected binaries.
“These aren’t the binaries you are looking for…”
Re: Magika: AI powered fast and efficient file type identification
#4this couldnt have been released at a better time for me! really needed a library like this.
Re: Magika: AI powered fast and efficient file type identification
#5Supported file types: https://github.com/google/magika/blob/main/docs/supported-co...
Re: Magika: AI powered fast and efficient file type identification
#6As somebody who's dealt with the ambiguity of attempting to use file signatures in order to identify file type, this seems like a pretty useful library. Especially since it seems to be able to distinguish between different types of text files based on their format/content e.g. CSV, markdown, etc.
Re: Magika: AI powered fast and efficient file type identification
#7Is it really common enough for files not to be annotated with a useful/correct file type extension (e.g. .mp3, .txt) that a library like this is needed?
Re: Magika: AI powered fast and efficient file type identification
#8Today web browsers, code editors, and countless other software rely on file-type detection to decide how to properly render a file.
"web browsers"? Odd to see this coming from Google itself. https://en.wikipedia.org/wiki/Content_sniffing was widely criticised for being problematic for security.
Re: Magika: AI powered fast and efficient file type identification
#9Is it really common enough for files not to be annotated with a useful/correct file type extension (e.g. .mp3, .txt) that a library like this is needed?
malware can intentionally obfuscate itself
Re: Magika: AI powered fast and efficient file type identification
#10Oh man, this brings me back! Almost 10 years ago I was working on a rails app trying to detect the file type of uploaded spreadsheets (xlsx files were being detected as application/zip, which is technically true but useless).
I found "magic" that could detect these and submitted a patch at https://bugs.freedesktop.org/show_bug.cgi?id=78797. My patch got rejected for needing to look at the first 3KB bytes of the file to figure out the type. They had a hard limit that they wouldn't see past the first 256 bytes. Now in 2024 we're doing this with deep learning! It'd be cool if google released some speed performance benchmarks here against the old-fashioned implementations. Obviously it'd be slower, but is it 1000x or 10^6x?