[deleted]
TinyTroupe, a new LLM-powered multiagent persona simulation Python library
21–30 of 55 posts
Re: TinyTroupe, a new LLM-powered multiagent persona simulation Python library
#22Here's the punchline from the Product Brainstorming example, imagining new AI-driven features to add to Microsoft Word:
> AI-driven context-aware assistant. Suggests writing styles or tones based on the document's purpose and user's past preferences, adapting to industry-specific jargon.
> Smart template system. Learns from user's editing patterns to offer real-time suggestions for document structure and content.
> Automatic formatting and structuring for documents. Learns from previous documents to suggest efficient layouts and ensure compliance with standards like architectural specifications.
> Medical checker AI. Ensures compliance with healthcare regulations and checks for medical accuracy, such as verifying drug dosages and interactions.
> AI for building codes and compliance checks. Flags potential issues and ensures document accuracy and confidentiality, particularly useful for architects.
> Design checker AI for sustainable architecture. Includes a database of materials for sustainable and cost-effective architecture choices.
Right, so what's missing in Word is an AI generated medical compliance check that tracks drug interactions for you and an AI architectural compliance and confidentiality... thing. Of course these are all followed by a note that says "drawbacks: None." Also, the penultimate line generated 7 examples but cut the output off at 6.
The intermediate output isn't much better, generally restating the same thing over and over and appending "in medicine" or "in architecture." They quickly drop any context this discussion relates to word processors in favor of discussing how a generic industrial AI could help them. (Drug interactions in Word, my word.)
Worth noting this is a Microsoft product generating ideas for a different Microsoft product. I hope they vetted this within their org.
As a proof of concept, this looks interesting! As a potentially useful business insight tool this seems far out. I suppose this might explain some of Microsoft's recent product decisions...
https://github.com/microsoft/TinyTroupe/blob/main/examples/p...
Re: TinyTroupe, a new LLM-powered multiagent persona simulation Python library
#23Here's the punchline from the Product Brainstorming example, imagining new AI-driven features to add to Microsoft Word: > AI-driven context-aware assistant. Suggests writing styles or tones based on the document's purpose and user's past preferences, adapting to industry-specific jargon. > Smart template system. Learns from user's editing patterns to offer real-time suggestions for document structure and content. > A…
That example is funny because 99% of doctors would not use Word to write their notes (and not because it doesn't have this hot new AI feature).
Re: TinyTroupe, a new LLM-powered multiagent persona simulation Python library
#24This seems fundamentally unsuitable for its stated purpose, which is “understanding human behavior”. While it may, as it says, produce “convincing interactions”, there is no basis at all peesented for believing it produces an accurate model of human behavior, so using it to “understand human behavior” is at best willful self-deception, and probably, with a little effort at tweaking inputs to produce the desired resul…
I would tend to agree. Although for something like testing ads it seems like it would be relatively straightforward to produce an A/B test that compares the performance of two ads relative t TinyTroupe's predictions.
Re: TinyTroupe, a new LLM-powered multiagent persona simulation Python library
#25This seems fundamentally unsuitable for its stated purpose, which is “understanding human behavior”. While it may, as it says, produce “convincing interactions”, there is no basis at all peesented for believing it produces an accurate model of human behavior, so using it to “understand human behavior” is at best willful self-deception, and probably, with a little effort at tweaking inputs to produce the desired resul…
I did not test this library so I can't argue from that perspective ( I think I will though ; it does seem interesting ).
In a sense, this is what training employees is all about. You want to get them ready for various possible scenarios. For recurring tasks that do require some human input, it does not seem that far fetched.
This is the interesting part. Is convincing a bad thing if it does what user would be expected to see?
Re: TinyTroupe, a new LLM-powered multiagent persona simulation Python library
#26Hmm, now lets see if there is an effort anywhere to link it to a local llm.
Re: TinyTroupe, a new LLM-powered multiagent persona simulation Python library
#27I envision a future where ads are llms targetized.
Is this worst or better than what we have now?
Re: TinyTroupe, a new LLM-powered multiagent persona simulation Python library
#28Could this be applied to mass propaganda and disinformation campaigns on social networks?
Like not only generating and testing narratives but then even use it for agents to generate engagement.
We've seen massive bot networks unchecked on X to help tilt election results, so probably this could be deployed there too.
Re: TinyTroupe, a new LLM-powered multiagent persona simulation Python library
#29This seems fundamentally unsuitable for its stated purpose, which is “understanding human behavior”. While it may, as it says, produce “convincing interactions”, there is no basis at all peesented for believing it produces an accurate model of human behavior, so using it to “understand human behavior” is at best willful self-deception, and probably, with a little effort at tweaking inputs to produce the desired resul…
My first thought while reading was this would be a great academic framework in the hands of PhD students with extremely high attention to all the details and those detail interactions. But in the hands of any group or any individual with a less scientifically rigorous mindset, it's a construction set for justifications to do practically anything. It's becomes in the hands of biased laypersons a toolset for using statistics to lie exponentially changed into a nuclear weapon.
Re: TinyTroupe, a new LLM-powered multiagent persona simulation Python library
#30This seems fundamentally unsuitable for its stated purpose, which is “understanding human behavior”. While it may, as it says, produce “convincing interactions”, there is no basis at all peesented for believing it produces an accurate model of human behavior, so using it to “understand human behavior” is at best willful self-deception, and probably, with a little effort at tweaking inputs to produce the desired resul…
I did not test this library so I can't argue from that perspective ( I think I will though ; it does seem interesting ). In a sense, this is what training employees is all about. You want to get them ready for various possible scenarios. For recurring tasks that do require some human input, it does not seem that far fetched. This is the interesting part. Is convincing a bad thing if it does what user would be expecte…
> it will be an engine for simply manufacturing support for a pre-selected option.
There's nothing unique about this tool in that regard though. Pretty much anything can be mis-used in that way - spreadsheets, graphics/visualizations, statistical models, etc. etc. Whether tools are actually used to support better decision making, or simply to support pre-selected decisions, is more about the culture of the organization and the mind-set of its leaders.