Viewing profile — calum-bird

Do you have any resources you can share on managing the enclave’s public key? We found documentation to be sparse.

So typically these providers only offer ZDR to "managed" customers, after a lengthy application process. For example, on Azure, "managed" means companies with >$1m, possibly more n…

We (disclosure: founder) do something similar at Trelent[1] but with an emphasis on security. Paid accounts can use OpenAI & Anthropic models, free ones just OpenAI. We have 3.5 so…

For efficiency, 132B. That way, at inference-time you get the speed of 36B params because you are only "using" 36B params at a time, but the next token might (and frequently does) …

Wish you could use ChatGPT at work? You know that AI would boost your team, but your boss is (rightly) worried about data leaks. Meet Trelent, your team's fully-encrypted AI assist…

Trelent | Founding Engineer | REMOTE (US/Canada preferable) | $100k+ I am the founder of Trelent. We’re building a useful agent for RPA, with a distinctly structured & hierarchical…

Copilot does inline completion right now - they implemented it into copilot as a pilot program[0] before OAI went live with that new model IIRC. [0]: https://openai.com/blog/gpt-3-…

Haha indeed, NLP is fun!

Our website has a little more @ www.trelent.net. Working on a better way to showcase more examples. Will be inherently bias as we're selecting them (even if we try to take a fair s…

Totally get that. Working on locally-hosted version for enterprise use-case with this in mind. We are either paid in dollars or data, and I'd rather be transparent about that then …

Haha I wish! That's just loading the weights for inference :)

Please note: this does make use of a remote server, so use with caution. Working on locally-hosted version for anyone with ~48GB of VRAM (and change) to spare.