Viewing profile — rish-b

A common reason is to reduce cost and latency. Larger models typically require GPUs with more memory (and hence higher costs), plus the time to serve requests is also higher (more …

This is such an interesting direction for LLM research (especially because it's easy to imagine applicability in industry as well). If all it takes is ~1k high-quality examples (of…