Most ML applications are just request routers
onecontext.ai
Most ML applications are just request routers
1–6 of 6 posts
Re: Most ML applications are just request routers
#2Moving an internal ML project from "a quick demo on localhost", to "deployed in production", is hard. We think latency is one of the biggest problems. We built OneContext to solve that problem. We launched today. Would love your feedback + feature requests!
Re: Most ML applications are just request routers
#3Moving an internal ML project from "a quick demo on localhost", to "deployed in production", is hard. We think latency is one of the biggest problems. We built OneContext to solve that problem. We launched today. Would love your feedback + feature requests!
Looks super interesting! This could be super helpful for us. Will drop your team a note :)
Re: Most ML applications are just request routers
#4“simply by cutting out the network latency between the steps, OneContext reduces the pipeline execution time by 57%)”
how does this fit in with barebones langchain/bedrock setup?
Re: Most ML applications are just request routers
#5Seems like a great product !
Re: Most ML applications are just request routers
#6Amazing! Congrats on launching. Company motto: "dumb enough to actually have attempted this already".