Live data from Hacker News

BloombergGPT

bloomberg.com

11–17 of 17 posts

Re: BloombergGPT

#13
post #7

Earlier quoted context omitted.

Nope, 30 march.

Sometimes, they release them the day before but you're right here. They actually link the published paper in the article and I missed it: https://arxiv.org/abs/2303.17564

This paper was actually discussed here on HN too:

https://news.ycombinator.com/item?id=35381036

Re: BloombergGPT

#15
post #6

For all the hype, the benchmarks they report don't seem super compelling. Financial questions need to have 100% accurate responses (not 60% or so they report) otherwise they are worse than useless and can cost billions of dollars in losses

Isn't it enough to win 51% times?

Re: BloombergGPT

#16
post #6

For all the hype, the benchmarks they report don't seem super compelling. Financial questions need to have 100% accurate responses (not 60% or so they report) otherwise they are worse than useless and can cost billions of dollars in losses

Isn't it enough to win 51% times?

It’s not trading anything, in which case the above still wouldn’t be true. It’s just answering financial questions, so if it hallucinates and tells you Tesla isn’t a public company 40% of the time then what’s the point? I’m using a very simple example here, I’m sure the model makes more intricate mistakes.
Post reply on HN