NFL Pick-Em's LLM Bot
github.com
NFL Pick-Em's LLM Bot
1–10 of 10 posts
Re: NFL Pick-Em's LLM Bot
#2This is very cool. I’d be interested to see how it does against the market
Re: NFL Pick-Em's LLM Bot
#3I feel like it would be a lot more useful if it wasn't tied directly to the ESPN game. Like, the screen scraping part seems ancillary.
The performance is very impressive though, NFL games aren't easy to pick.
Re: NFL Pick-Em's LLM Bot
#4I can't find the actual picks that this LLM made, are they listed anywhere? As squirrelmaster commented [1], would be very worthwhile to see how this picked in regards to the (betting) markets: against-the-spread (ATS) and the money-line.
Re: NFL Pick-Em's LLM Bot
#5[deleted]
Re: NFL Pick-Em's LLM Bot
#6In my experience, you can get extremely good performance in this style of sports prediction with extremely basic methods. E.g. doing some sort of basic Elo rating system + choosing the higher rated competitor to win every game. This is simply because almost all human competitors will frequently try to predict upsets (as its more fun), but it will harm their performance overall.
I would be cool to see if something like this can do can outperform a benchmark Elo system but even that is an extremely high bar that most sophisticated models can't beat.
Re: NFL Pick-Em's LLM Bot
#7I can't find the actual picks that this LLM made, are they listed anywhere? As squirrelmaster commented [1], would be very worthwhile to see how this picked in regards to the (betting) markets: against-the-spread (ATS) and the money-line. [1] - https://news.ycombinator.com/reply?id=39019606
Pickem is straight up normally so would be money line bets essentially.
The spread is designed to make the bet a 50/50 so it would need to take into other factors or compute it’s spread to determine if there is an edge on Vegas.
Re: NFL Pick-Em's LLM Bot
#8In my experience, you can get extremely good performance in this style of sports prediction with extremely basic methods. E.g. doing some sort of basic Elo rating system + choosing the higher rated competitor to win every game. This is simply because almost all human competitors will frequently try to predict upsets (as its more fun), but it will harm their performance overall. I would be cool to see if something lik…
dolphins
cowboys 2 seed
eagles
how would that have worked this season? those high elo teams lost badly multiple unexpected times no?
Re: NFL Pick-Em's LLM Bot
#9In my experience, you can get extremely good performance in this style of sports prediction with extremely basic methods. E.g. doing some sort of basic Elo rating system + choosing the higher rated competitor to win every game. This is simply because almost all human competitors will frequently try to predict upsets (as its more fun), but it will harm their performance overall. I would be cool to see if something lik…
dolphins cowboys 2 seed eagles how would that have worked this season? those high elo teams lost badly multiple unexpected times no?
Also in sports (especially a sport like American football), you have circumstances that change from week to week: i.e., a quarterback gets injured, and will sit out for a game. This won't show up in the Elo rating, but normal football fans would be aware of it and take it into account in making predictions.
Re: NFL Pick-Em's LLM Bot
#10Earlier quoted context omitted.
dolphins cowboys 2 seed eagles how would that have worked this season? those high elo teams lost badly multiple unexpected times no?
Also in sports (especially a sport like American football), you have circumstances that change from week to week: i.e., a quarterback gets injured, and will sit out for a game. This won't show up in the Elo rating, but normal football fans would be aware of it and take it into account in making predictions.
also in sports, you have a league (multi-billion dollar advertising business) and league-controlled referees who are inconsistent and may or may not have a narrative they are trying to push (aka, so-and-so team will do better advertising/TV ratings if they make it deeper into the playoffs)
how do you account for inconsistent/bad calls/missed calls when there is zero accountability? you can only review some things sometimes, and supposedly "new york" is watching in a booth to tell the refs "bad call/good call", yet announcers + players + coaches all disagree with refs on calls all the time that 100% affect the outcome of the game
i personally don't think the NFL + NBA is to be trusted. i don't want to sound like some crackpot conspiracy theorist but i feel like there's enough evidence that... it's not a serious product. it's entertainment first and foremost.
i don't know what corporate boardroom focus group research was done to identify the fact that viewers respond well to something they hate (bad calls), but... boy, they sure are not trying to use technology to remove them from the game