After getting burned by Watson. I am not touching any AI from IBM.
Tell us more about how you were burned, please!
'Western Qwen': IBM Wows with Granite 4 LLM Launch and Hybrid Mamba/Transformer
21–26 of 26 posts
Re: 'Western Qwen': IBM Wows with Granite 4 LLM Launch and Hybrid Mamba/Transformer
#22IBM announcement post is more informative than venturebeat IBM Granite 4.0: hyper-efficient, high performance hybrid models for enterprise https://www.ibm.com/new/announcements/ibm-granite-4-0-hyper-...
ISO 42001 certified. > ISO/IEC 42001 is an international standard that specifies requirements for establishing, implementing, maintaining, and continually improving an Artificial Intelligence Management System (AIMS) within organizations. It is designed for entities providing or utilizing AI-based products or services, ensuring responsible development and use of AI systems. https://www.iso.org/standard/42001 If anyon…
Depends. In my experience, some countries, e.g. Spain, are very into certs while others just ignore it.
Re: 'Western Qwen': IBM Wows with Granite 4 LLM Launch and Hybrid Mamba/Transformer
#23I really just want to know how it compares to ChatGPT and Claude at various tasks, but there aren’t any graphs for that.
It will probably take a few days/week for some in depth benchmarks to start popping up. The IBM article has this image showing that it's supposed to be a bit ahead of GPT OSS 120B for at least some tasks (horrible URL but oh well): https://www.ibm.com/content/dam/worldwide-content/creative-a... So in general it's going to be worse than GPT-5 and also Sonnet 4.5, but closer to GPT-5 mini. At least you can run this on…
Edit: or perhaps not, seems like 3rd party benchmarks aren't as positive.
Re: 'Western Qwen': IBM Wows with Granite 4 LLM Launch and Hybrid Mamba/Transformer
#24After getting burned by Watson. I am not touching any AI from IBM.
It's a file you can run on your computer
Re: 'Western Qwen': IBM Wows with Granite 4 LLM Launch and Hybrid Mamba/Transformer
#25I made some dynamic GGUFs for the 32B MoE model! Try: ./llama.cpp/llama-cli -hf unsloth/granite-4.0-h-small-GGUF:UD-Q4_K_XL Also a support agent finetuning notebook with granite 4: https://colab.research.google.com/github/unslothai/notebooks...
You guys are lightning fast. Did you folks have access to the model weights before hand or something, if you don't mind me asking?
Oh thanks! Yes sometimes we get early access to some models!
Re: 'Western Qwen': IBM Wows with Granite 4 LLM Launch and Hybrid Mamba/Transformer
#26I made some dynamic GGUFs for the 32B MoE model! Try: ./llama.cpp/llama-cli -hf unsloth/granite-4.0-h-small-GGUF:UD-Q4_K_XL Also a support agent finetuning notebook with granite 4: https://colab.research.google.com/github/unslothai/notebooks...
As always, you're awesome. keep up the great work!
Thanks!