61–70 of 617 posts
Might as well have a quick discussion here. How's everyone finding the new models? 4-Turbo is a bit worse than 4 for my NLP work. But it's so much cheaper that I'll probably move every pipeline to using that. Depending on the exact problem it can even be comparable in quality/price to 3.5-turbo. However the fact that output tokens are limited to 4096 is a big asterisk on the 128k context.
URGENT - Does anyone have an alternative to OpenAI's embeddings API? I do have alternative to GPT's API (e.g. Anthropic Claude) but I'm not able to use them without embeddings API (used to generate semantic representation of my knowledge base and also to create embeddings from user's queries). We need to have an alternative to OpenAI's embeddings as a fallback in case of outages.
The plan is to add Llama 2 completions to the processors, which would include dictionary completion (keyterm/sentiment/etc), chat completion, code completion, for reasons exactly like what we're discussing.
Here's the code for the Instructor embeddings: https://github.com/FeatureBaseDB/Laminoid/blob/main/sloth/sl...
To do Instructor embeddings, do the imports then reference the embed() function. It goes without saying that these vectors can't be mixed with other types of vectors, so you would have to reindex your data to make them compatible.
Lots of jokes to be made, but we are setting ourselves up for some big rippling negative effects by so quickly building a reliance on providers like OpenAI. It took years before most companies who now use cloud providers to trust and be willing to bet their operations on them. That gave the cloud providers time to make their systems more robust, and to learn how to resolve issues quickly.
Earlier quoted context omitted.
This came up the other day. I decided to tease everyone with an 'I told you so' about using some third party hosting service instead of the offline one I had developed years prior. The offline service was still working, and people were doing their job. The online service was not working, and it was causing other people to be unable to do their job. We had 0 control over the third party. The other thing, I make softwa…
Do you write your refrigerators firmware?
Earlier quoted context omitted.
This came up the other day. I decided to tease everyone with an 'I told you so' about using some third party hosting service instead of the offline one I had developed years prior. The offline service was still working, and people were doing their job. The online service was not working, and it was causing other people to be unable to do their job. We had 0 control over the third party. The other thing, I make softwa…
Do you write your refrigerators firmware?
Lots of jokes to be made, but we are setting ourselves up for some big rippling negative effects by so quickly building a reliance on providers like OpenAI. It took years before most companies who now use cloud providers to trust and be willing to bet their operations on them. That gave the cloud providers time to make their systems more robust, and to learn how to resolve issues quickly.