Viewing profile — JegernOUTT
JegernOUTT
HN member- Joined
- Fri, Mar 31, 2023, 2:21 PM UTC
- HN karma
- 2
- Public activity
- 3 items
- HN profile
- View on Hacker News ↗
About JegernOUTT
No profile information was provided.
Recent public activity
-
comment
Comment #37390314
It can be checked if the model predicts canonical solutions from humaneval. I understand it is not ideal, but at least you can check it yourself There are a bunch of other benchmar…
-
comment
Comment #37389983
Hi, thank you for your attention! > They compare the performance of this model to the worst 7B code llama model. The base code llama 7B python model scores 38.4% on humaneval, vers…
- comment