> if you ask the right questions
Yes that's the problem with LLMs, they tend to work well only if you ask questions like an expert. Which is how they were trained.
AI financial advice is surprisingly good, especially if you ask right questions
81–90 of 443 posts
Re: AI financial advice is surprisingly good, especially if you ask right questions
#82> if you ask the right questions Yes that's the problem with LLMs, they tend to work well only if you ask questions like an expert. Which is how they were trained.
It’s true across the board. How to get good results with coding using AI? Be a good coder. How to get good financial advice? Be financially literate. How to get good medical advice? Be a doctor…
Makes ya wonder: where is the intelligence coming from?
Re: AI financial advice is surprisingly good, especially if you ask right questions
#83> if you ask the right questions Yes that's the problem with LLMs, they tend to work well only if you ask questions like an expert. Which is how they were trained.
It’s true across the board. How to get good results with coding using AI? Be a good coder. How to get good financial advice? Be financially literate. How to get good medical advice? Be a doctor… Makes ya wonder: where is the intelligence coming from?
I would argue coding is different from those other categories. I think you can ask AI expert level questions without being an expert in many fields if you are smart and well educated in general.
Re: AI financial advice is surprisingly good, especially if you ask right questions
#84> if you ask the right questions Yes that's the problem with LLMs, they tend to work well only if you ask questions like an expert. Which is how they were trained.
To me its felt like the LLM sort mirrors what you say to it and how you say it, to the point where I now include additional instructions to steer the model "Never mirror the user’s present diction, mood, or affect". It feels like I get a better experience but to be honest i haven't really done any benchmarking especially on newer models
Re: AI financial advice is surprisingly good, especially if you ask right questions
#85Earlier quoted context omitted.
It’s true across the board. How to get good results with coding using AI? Be a good coder. How to get good financial advice? Be financially literate. How to get good medical advice? Be a doctor… Makes ya wonder: where is the intelligence coming from?
I would argue coding is different from those other categories. I think you can ask AI expert level questions without being an expert in many fields if you are smart and well educated in general.
I think AI is better at coding than most other disciplines.
Re: AI financial advice is surprisingly good, especially if you ask right questions
#86> if you ask the right questions Yes that's the problem with LLMs, they tend to work well only if you ask questions like an expert. Which is how they were trained.
[deleted]
Re: AI financial advice is surprisingly good, especially if you ask right questions
#87[flagged]
Re: AI financial advice is surprisingly good, especially if you ask right questions
#88> if you ask the right questions Yes that's the problem with LLMs, they tend to work well only if you ask questions like an expert. Which is how they were trained.
Literally from TFA:
> “We were somewhat surprised by how good the advice was,” Choukhmane said. “Especially when you read the kind of questions people asked, it was not a given that the advice would line up with what academics think are good financial principles.”
TFA goes on to point out that more academic prompts did better still -- but a major point was that, even with naive and simple questions, the advice was still surprisingly good.
And similarly, quoting from the article which TFA cites:
> First, following LLM advice would move most survey respondents closer to the prescriptions of life cycle theory relative to their current behavior, including broader participation in diversified equity funds, equity shares that decline with age, and sizeable saving buffers. Second, replacing individual-written prompts with academic prompts moves LLM advice even closer to life cycle theory, with better consumption smoothingand less reliance on simple heuristics.
Re: AI financial advice is surprisingly good, especially if you ask right questions
#89I wonder if telling (or somehow architecturally coaxing) the LLM it has 'skin in the game' will make it more risk-averse? I imagine it does. This makes me wonder too about the entire premise and worthiness of these evals. They orient themselves around normal one-shot interactions with a likely non-sys-prompted model with no built up context or memory of the person. I doubt the mentioned 'job loss' scenario is even co…
The problem I see with this approach is threefold.
First, from a technical standpoint the required context window would be massive if you're looking at a person's career/life holistically. Probably solvable, but definitely something to be aware of.
Second, privacy goes completely out the window since you're sharing everything. You don't know what's relevant and what's not up front so you need to provide everything.
Third, you would need a training dataset of all those input variables and their outcomes to be able to provide any sort of useful output. The first set of people to share everything wouldn't be able to derive any value from the tool, and I think you'd be hard pressed to convince enough people to do it to get a useful dataset.
Re: AI financial advice is surprisingly good, especially if you ask right questions
#90Better than human at least the one you can pay 200 dollars/hour to get advice from, IMO