What I really want from Anthropic, Gemini, and ChatGPT is for users to be able to log in with them, using their tokens. Then you can have open/free apps that don’t require the developer to track usage or burn through tons of tokens to demonstrate value. Most users aren’t going to manage API keys, know that that even means, or accept the friction.
Foundation Models on iOS/macOS was seen to have dormant code for doing this via OpenAI. So they are experimenting with it and may make it available next year.
What I really want from Anthropic, Gemini, and ChatGPT is for users to be able to log in with them, using their tokens. Then you can have open/free apps that don’t require the developer to track usage or burn through tons of tokens to demonstrate value. Most users aren’t going to manage API keys, know that that even means, or accept the friction.
won't they just eventually have a 'log in with OpenAI' button similar to a 'login with Google' button?
Maybe a 'connect with OpenAI' button so the service can charge a fee, while allowing a bring your own token type hybrid.
Tried the GitHub app, made sure everything was properly connected, and asked a question about one of my repositories. It repeatedly claimed (5 times) that it wasn't connected and couldn't do anything, telling me to check the checkboxes that were already checked. Only after I showed it a screenshot of the settings did it suddenly comply and answer the question. I guess it still needs more polish.
Screenshots use a different router, so if you get stuck in one modality then pasting a screenshot can sometimes divert whatever "expert" you were stuck on that was refusing to comply. I don't work at OpenAI but I know enough about how these systems are architected to know that once you are stuck in a refusal basin the only way is to start a new session or figure out how to get routed to another node in their MoE configuration. Ironically, they promised their fancy MoE routing would fix issues like these but it seems like they are getting worse.
Tried the GitHub app, made sure everything was properly connected, and asked a question about one of my repositories. It repeatedly claimed (5 times) that it wasn't connected and couldn't do anything, telling me to check the checkboxes that were already checked. Only after I showed it a screenshot of the settings did it suddenly comply and answer the question. I guess it still needs more polish.
hi kgeist - i work on the team that manages the github app. are you able to share a conversation where the github connector did not work? feel to message me at https://x.com/kevins8 (dm's open)
They are unfocused. Need to stop with the mba playbook moves like this and just make the model worth paying for.
They don't have any more juice left to squeeze at that front. The lack of new ideas in LMs is pretty palpable by now. There is a bunch of companies with billions invested in them that are all just looking at each other, trying to figure out what to do.
Both Anthropic and Google have clear directions. Anthropic is trying to corner the software developer market and succeeding, Google is doing deep integration with their existing products. There’s also Deepseek who seem hell bent on making the cheapest SotA models and supplying the models people can use for research on applications. Even Grok is fairly mission focused on with X integration.
Is this an attempt to engender developer goodwill that they've lost over 5.2s overfitting issues? I've canceled my subscription, I don't plan on releasing an app to their platform.
What I really want from Anthropic, Gemini, and ChatGPT is for users to be able to log in with them, using their tokens. Then you can have open/free apps that don’t require the developer to track usage or burn through tons of tokens to demonstrate value. Most users aren’t going to manage API keys, know that that even means, or accept the friction.
It’s unclear to me wether that would give some access to a token quota or if it would just be like any other « Sign in with … ». In all cases I am currently developing an app that would greatly benefit from letting my users connect to their ChatGPT account and use some token quota.