Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Does generative AI facilitate investor trading? Evidence from ChatGPT outages

papers.ssrn.com

Post reply on HN
Print view View original

11–20 of 107 posts

Re: Does generative AI facilitate investor trading? Evidence from ChatGPT outages

#11

Post by sitkack »

jazzyjackson wrote: post #9
joering2 wrote: post #8

I think lately results of chat went downhill. I got used to asking "are you sure about that" after each chat answer to my question, and to most of the time the answer is "you are right, here is how I was wrong".

chatgpt has never stood up for itself, if you express doubt it will defer and say it must by mistaken even when it's correct

That is because they turned the sycophancy up to 11. You have to turn it down, if you are a serious LLM user and you don't have your own system prompt, you are using it wrong.

Re: Does generative AI facilitate investor trading? Evidence from ChatGPT outages

#12

Post by ben_w »

candiddevmike wrote: post #7
mebutnotme wrote: post #5

Earlier quoted context omitted.

It could be news parsing, where it can turn news article text into data points that an investment model could imply market signals from. Something similar could happen with transcripts of company investor calls, or any other text/audio companies put out. With the right prompt you can turn text into signals, the trick would be getting that prompt right (and prompt engineering to limit hallucinations as much as possibl…

Sentiment analysis is AI now?

Always was

Re: Does generative AI facilitate investor trading? Evidence from ChatGPT outages

#13

Post by babypuncher »

sitkack wrote: post #11
jazzyjackson wrote: post #9

Earlier quoted context omitted.

chatgpt has never stood up for itself, if you express doubt it will defer and say it must by mistaken even when it's correct

That is because they turned the sycophancy up to 11. You have to turn it down, if you are a serious LLM user and you don't have your own system prompt, you are using it wrong.

This doesn't change how frequently the LLM provides a wrong answer, just how confident it is when you question it.

Re: Does generative AI facilitate investor trading? Evidence from ChatGPT outages

#14

Post by [deleted] »

sitkack wrote: post #11
jazzyjackson wrote: post #9

Earlier quoted context omitted.

chatgpt has never stood up for itself, if you express doubt it will defer and say it must by mistaken even when it's correct

That is because they turned the sycophancy up to 11. You have to turn it down, if you are a serious LLM user and you don't have your own system prompt, you are using it wrong.

[deleted]

Re: Does generative AI facilitate investor trading? Evidence from ChatGPT outages

#17

Post by potatoman22 »

candiddevmike wrote: post #7
mebutnotme wrote: post #5

Earlier quoted context omitted.

It could be news parsing, where it can turn news article text into data points that an investment model could imply market signals from. Something similar could happen with transcripts of company investor calls, or any other text/audio companies put out. With the right prompt you can turn text into signals, the trick would be getting that prompt right (and prompt engineering to limit hallucinations as much as possibl…

Sentiment analysis is AI now?

This is a classic example of "AI is whatever hasn't been done yet." https://en.wikipedia.org/wiki/AI_effect

Re: Does generative AI facilitate investor trading? Evidence from ChatGPT outages

#18

Post by sfink »

mebutnotme wrote: post #5
2Gkashmiri wrote: post #4

How would this work in the market, I am Curious to try it

It could be news parsing, where it can turn news article text into data points that an investment model could imply market signals from. Something similar could happen with transcripts of company investor calls, or any other text/audio companies put out. With the right prompt you can turn text into signals, the trick would be getting that prompt right (and prompt engineering to limit hallucinations as much as possibl…

> the trick would be getting that prompt right (and prompt engineering to limit hallucinations as much as possible).

Why do you have to get it right? Don't you just have to get it the same as everyone else, slightly faster?

Re: Does generative AI facilitate investor trading? Evidence from ChatGPT outages

#19

Post by kelseyfrog »

jazzyjackson wrote: post #9
joering2 wrote: post #8

I think lately results of chat went downhill. I got used to asking "are you sure about that" after each chat answer to my question, and to most of the time the answer is "you are right, here is how I was wrong".

chatgpt has never stood up for itself, if you express doubt it will defer and say it must by mistaken even when it's correct

It makes it difficult to get less-biased responses. I find myself asking an affirmative-worded question and its affirmative-worded inverse to subtract out the sycophancy. It's a poor workaround.

Re: Does generative AI facilitate investor trading? Evidence from ChatGPT outages

#20

Post by Zambyte »

babypuncher wrote: post #13
sitkack wrote: post #11

Earlier quoted context omitted.

That is because they turned the sycophancy up to 11. You have to turn it down, if you are a serious LLM user and you don't have your own system prompt, you are using it wrong.

This doesn't change how frequently the LLM provides a wrong answer, just how confident it is when you question it.

For what it's worth, certain system prompts can improve output quality.
Post reply on HN