What’s the competing Azure/OpenAI service?
Is it Azure OpenAI service (that seems too simple!)?
Generative AI support on Vertex AI is now generally available
21–30 of 34 posts
Re: Generative AI support on Vertex AI is now generally available
#22I've been demoing it and have found it struggles to reliably output structured JSON at the moment. I'm curious if folks have had different experiences and if so what their prompts were.
Re: Generative AI support on Vertex AI is now generally available
#23I've been demoing it and have found it struggles to reliably output structured JSON at the moment. I'm curious if folks have had different experiences and if so what their prompts were.
We fine-tuned bison with input set to doc content, and output as JSON, but the generation keeps getting prefixed with some of the input. Waiting to hear back from Google about what we might be doing wrongly. The JSON itself looks great, though.
Edit: sorry, that was a different experiment. The one that worked well was an address splitter, trained off Google Address Validator output, funnily enough. Still, the output JSON got prefixed with some of the address input.
Re: Generative AI support on Vertex AI is now generally available
#24We are waiting to launch a new iOS app that has text generation using vertex AI for GA. So we will go live next live. We started with GPT API but switched to Vertex AI due to speed. We will still use GPT API as backup still though.
how does Vertex compare to GPT in terms of quality of output? Also do you use it as it is, or do any fine tuning?
Re: Generative AI support on Vertex AI is now generally available
#25How does the pricing compare with OpenAI's GPT-3 Turbo? Seems double the price?
Re: Generative AI support on Vertex AI is now generally available
#26Re: Generative AI support on Vertex AI is now generally available
#27How does the pricing compare with OpenAI's GPT-3 Turbo? Seems double the price?
They seem like discounting it heavily right now. I haven't seen much charge yet on my bill even though I have used is quite a lot. But things might change so not really sure how the bill will be at the end of the month.
Re: Generative AI support on Vertex AI is now generally available
#28Extremely curious that PaLM-E, PaLI, and GPT-4 were trained to be multimodal (accept non-text inputs, such as images) but the released API's are text-only. In GCP's case, here, they've released PaLM-2 which is not multimodal like PaLM-E and PaLI. This prevents using it for visual reasoning[0]. I'm just wondering why multiple parties seem reluctant to allow the public to use this. 0: https://visualqa.org
[dead]
Re: Generative AI support on Vertex AI is now generally available
#29Earlier quoted context omitted.
Where can you find gecko? Has it finally been published?
textembedding-gecko reached GA on June 7th, together with text-bison. You can view all the models available to you on Model Garden.
It doesn't seem to be available to me. How do I get access? If I remember correctly gecko is small enough to run on device.
Re: Generative AI support on Vertex AI is now generally available
#30We are waiting to launch a new iOS app that has text generation using vertex AI for GA. So we will go live next live. We started with GPT API but switched to Vertex AI due to speed. We will still use GPT API as backup still though.
how does Vertex compare to GPT in terms of quality of output? Also do you use it as it is, or do any fine tuning?
Quality of output is at same level as GPT.
The biggest issues for us:
1. text-bison limited to 1024 output tokens.
2. Output format we ask for JSON. But it is not valid json many times (, after last element, missing } after element etc). We have to write our own parsing code in the end to work around these JSON format issues.