Viewing profile — galeos

Is there scope to implement ternary models using this approach to minimise die area of the model parameters?

How did you find ModernBERT performance Vs prior BERT models?

You can try out the model in a demo they have setup: https://bitnet-demo.azurewebsites.net/

My understanding is that BERT can still outperform LLMs for sentiment classification?

These are MLPerf training results. I think current ternary quantization research is focused more on speeding up inference?