Representation Engineering: Mistral-7B on Acid
1–10 of 69 posts
Re: Representation Engineering: Mistral-7B on Acid
#2Interesting, seems like control vectors could reduce the need to fine-tune a model.
Re: Representation Engineering: Mistral-7B on Acid
#3Very interesting! Can you see those helping for RAG scenarios? Specifically:
- decreasing models tendency to answer with ungrounded answers
- increase models ability to respond with the correct syntax for citations- the open models like llama2 dont seem to obey my prompt’s syntax instructions.
Re: Representation Engineering: Mistral-7B on Acid
#4Interesting, seems like control vectors could reduce the need to fine-tune a model.
Not only that, you can change the behavior of the model as needed.
With 5 finetunes you need to host 5 copies or load and unload them.
With control vectors you can modify the model as needed
Re: Representation Engineering: Mistral-7B on Acid
#5Nice! The anti-jailbreaking angle is extremely interesting for those of us working on commercial applications.
Re: Representation Engineering: Mistral-7B on Acid
#6[deleted]
Re: Representation Engineering: Mistral-7B on Acid
#7Interesting, seems like control vectors could reduce the need to fine-tune a model.
Not only that, you can change the behavior of the model as needed. With 5 finetunes you need to host 5 copies or load and unload them. With control vectors you can modify the model as needed
I think you could layer them too
Re: Representation Engineering: Mistral-7B on Acid
#8Very interesting! Can you see those helping for RAG scenarios? Specifically: - decreasing models tendency to answer with ungrounded answers - increase models ability to respond with the correct syntax for citations- the open models like llama2 dont seem to obey my prompt’s syntax instructions.
For the second item, I've had luck using grammar to overcome this issue. The easiest one to implement I've seen so far is Microsoft's guidance-ai.
Re: Representation Engineering: Mistral-7B on Acid
#9Nice, so, can I get a visual way to browse for potentially powerful control vectors :)
Re: Representation Engineering: Mistral-7B on Acid
#10Very interesting! Can you see those helping for RAG scenarios? Specifically: - decreasing models tendency to answer with ungrounded answers - increase models ability to respond with the correct syntax for citations- the open models like llama2 dont seem to obey my prompt’s syntax instructions.
You can use outlines https://github.com/outlines-dev/outlines to let models generate with correct syntax.