I had lot of fun chatting with Pi. After some poking around to give it’s “system prompt”(long when it came back and prompt injection was a cool thing)., it said it was using some conversational frameworks like Grice’s principle etc. I tried to recreate one in GPT store. I call it Tara. Try it here- https://chat.openai.com/g/g-mI1QatRrc-tara.
Inflection-2: the next step up
21–30 of 39 posts
Re: Inflection-2: the next step up
#22Their byline is "the second most capable LLM in the world today." Ok thanks for the heads up, I'll go use the first most capable LLM while Inflection catches up... Their press release shows this model well behind gpt-4. There's currently no non-beta API. I'm just not sure who this is for.
this is for investors. while some companies actually build useful models, some like inflection are still catching up with palm-2, an old, forgotten, measly model.
GPT 4 is older than Palm 2. It's weird that big companies are basically only competing for fourth best(after GPT-4, GPT-3.5 and Claude full) and GPT-4 is just a gold standard even now that there are many unicorns and big companies putting all of their resources into it.
Re: Inflection-2: the next step up
#23From the press release: "Before Inflection-2 is released on Pi, it will undergo a series of alignment steps to become a helpful and safe personal AI."
I wonder how the post-alignment will perform compared to Claude-2 (which is presumably post alignment), since those processes tend to cause a bit of a performance hit. We'll have to see if it retains that coveted 2nd place spot.
If they didn't account for this, it seems like an unfair comparison.
Re: Inflection-2: the next step up
#24"Our mission at Inflection is to create a personal AI for everyone." "By messaging Pi, you are agreeing to our Terms of Service and Privacy Policy." Yeah, no. Any AI that operates in your cloud where I have to agree to your Terms of Service and Privacy Policy is not "personal AI," no matter how much you want me to believe otherwise. Modern LLMs can do inferencing on my own personal computer. Some of them can even do…
What's the gold standard these days for local LLMs?
Re: Inflection-2: the next step up
#25I realize part of why Sam Altman feels so important in OpenAI is because he invited everyone to come along. You can build something pretty close to chat.openai.com on the APIs, and their APIs continue to grow as their product grows. I think that's closely related to his leadership. This Inflection announcement feels kind of like your neighbor showing you his cool new Jaguar. Can I even take it for a test drive? Well,…
Despite all the complaining about OpenAI not being open, I've been able to do amazing things with their broad API access.
I feel fortunate to have access to it at all, knowing how much it has cost to build out and what it's capable of (whether we're talking about GPT 3.5, Dalle3, GPT 4, Whisper, GPTs etc).
I've been waiting for GPT 4 to catch up in time so I can talk to it about Godot 4's latest capabilities. Thanks to GPTs I've just gone ahead and started building my own GPT for that purpose. It's pretty wonderful what OpenAI has made accessible and possible thus far.
Re: Inflection-2: the next step up
#26"Our mission at Inflection is to create a personal AI for everyone." "By messaging Pi, you are agreeing to our Terms of Service and Privacy Policy." Yeah, no. Any AI that operates in your cloud where I have to agree to your Terms of Service and Privacy Policy is not "personal AI," no matter how much you want me to believe otherwise. Modern LLMs can do inferencing on my own personal computer. Some of them can even do…
What's the gold standard these days for local LLMs?
It's still Llama 2.
Re: Inflection-2: the next step up
#27Their byline is "the second most capable LLM in the world today." Ok thanks for the heads up, I'll go use the first most capable LLM while Inflection catches up... Their press release shows this model well behind gpt-4. There's currently no non-beta API. I'm just not sure who this is for.
[deleted]
Re: Inflection-2: the next step up
#28Is it me or do they not mention the size of the model at all? Pretty hard to compare it with other models when we don't know what weight class it's in...
Why? You’re not going to be running it on your own hardware. As an end user all that matters are the results.
Re: Inflection-2: the next step up
#29Is it me or do they not mention the size of the model at all? Pretty hard to compare it with other models when we don't know what weight class it's in...
I disagree, IMO for any model that isn't open source model size is just an implementation detail. If someone released a 10 trillion parameter model that's better than GPT4 it isn't somehow inferior because it has more parameters.
Re: Inflection-2: the next step up
#30This is just typical of so much work in the field. They pick and choose which models to compare against and on which benchmarks. If this model was truly great, they would be comparing against Claude 2 and GPT4 across a bunch of different benchmarks. Instead they compare against Palm 2, which in a lot of tests is a weak model (https://venturebeat.com/ai/google-bard-fails-to-deliver-on-i....) and prone to hallucination (https://github.com/vectara/hallucination-leaderboard).