Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Launch HN: Credal.ai (YC W23) – Data Safety for Enterprise AI

news.ycombinator.com

Post reply on HN
Print view View original

11–20 of 25 posts

Re: Launch HN: Credal.ai (YC W23) – Data Safety for Enterprise AI

#11

Post by r_thambapillai »

rishsriv wrote: post #10

This is so sorely needed. I used the app after the PH launch and loved how easy the self-serve was! Do you have plans to let users define "types" of data that can be redacted (like monetary terms in a contract, code embedded in documents etc)? Also, any plans on making this an API that other developers could build on top of?

Great questions and thanks for trying the product!!

Yup so a few thoughts here - we're exploring using embeddings to allow a description of what you want to hide, that will actually immediately show you what of the data you have synced already would be caught by that (or which previous requests).

On the API side: yes ABSOLUTELY! the API is already live and used intensely by some of our startup customers like Sourceful. The API docs for using the OpenAI models here: https://credalai.notion.site/OpenAI-Drop-in-API-0ef7cfd18a7c...

and the Anthropic models here: https://credalai.notion.site/Anthropic-Drop-In-API-ad298f6f7...

Re: Launch HN: Credal.ai (YC W23) – Data Safety for Enterprise AI

#12

Post by kriro »

Congrats, I think this will be really successfull and you got a very early food in the door.

Do you consider self hosted LLMs a competitor of sorts? I suppose your premise is if a company uses Google Docs they will also likely never host internal LLMs, right?

Re: Launch HN: Credal.ai (YC W23) – Data Safety for Enterprise AI

#13

Post by r_thambapillai »

kriro wrote: post #12

Congrats, I think this will be really successfull and you got a very early food in the door. Do you consider self hosted LLMs a competitor of sorts? I suppose your premise is if a company uses Google Docs they will also likely never host internal LLMs, right?

Thanks so much! So about half of our enterprise customers use Credal in conjunction with either a self hosted LLM or Azure OpenAI (which you can debate, but most companies we've spoken to seem to treat their Azure OpenAI instance as equivalent to self hosted). In practice, you still need to:

1. Manage the permissions of making sure the self hosted LLM is only reading from the documents, slack channels, e.t.c. that the end user should actually have access to

2. Generate an audit log of exactly who did what when

So we actually see self hosted LLMs being a big part of how Credal is used! In the long term, we think Credal will actually become a tool for AI app developers to safely request access to data & embeddings from the enterprise on the fly, and make sure the data they get is appropriately controlled and the audit logs exist in a single place for the enterprise to see what data went to whom/when/why etc

Re: Launch HN: Credal.ai (YC W23) – Data Safety for Enterprise AI

#14

Post by javidlakha »

Congratulations on the launch! (I'm a beta user.) Audit trails, access controls and security certifications are big headaches when developing in regulated industries. Having these already set up has made it easier for us to experiment with and build on LLM APIs.

Re: Launch HN: Credal.ai (YC W23) – Data Safety for Enterprise AI

#16

Post by jackfischer »

javidlakha wrote: post #14

Congratulations on the launch! (I'm a beta user.) Audit trails, access controls and security certifications are big headaches when developing in regulated industries. Having these already set up has made it easier for us to experiment with and build on LLM APIs.

Many thanks! There is a lot of opportunity for LLMs lurking in regulated industries right now - glad to have given you a boost!

Re: Launch HN: Credal.ai (YC W23) – Data Safety for Enterprise AI

#17

Post by deet »

Looks awesome and will make many enterprises feel more comfortable using AI.

I suspect your intuition about moving emphasis from redaction to unified access control and audit logging over time is right.

The "AI Chief of Staff" sounds interesting though -- can you share a bit more about what you showed to companies and received lukewarm response to?

Re: Launch HN: Credal.ai (YC W23) – Data Safety for Enterprise AI

#18

Post by r_thambapillai »

pseudonymouspat wrote: post #15

Go Ravin and Jack! We're not at sufficient scale to really get use of this product, but would love to try it down the road. Are you using Foundry for data integration and ACLs?

Stay tuned!! Right now no, but Foundry is definitely under consideration

Re: Launch HN: Credal.ai (YC W23) – Data Safety for Enterprise AI

#19

Post by jackfischer »

pseudonymouspat wrote: post #15

Go Ravin and Jack! We're not at sufficient scale to really get use of this product, but would love to try it down the road. Are you using Foundry for data integration and ACLs?

Thank you! We haven't gone down the Foundry route yet. We do have some smaller scale apps and companies using Credal either as their AI API or chat platform respectively - would be interested to hear a bit about your use case and see if it's a match?

Re: Launch HN: Credal.ai (YC W23) – Data Safety for Enterprise AI

#20

Post by jackfischer »

deet wrote: post #17

Looks awesome and will make many enterprises feel more comfortable using AI. I suspect your intuition about moving emphasis from redaction to unified access control and audit logging over time is right. The "AI Chief of Staff" sounds interesting though -- can you share a bit more about what you showed to companies and received lukewarm response to?

The AI Chief of Staff had a few layers. The first was data integration of both productivity data (slack, notion etc) and "big data" lakes/warehouses. The former tells you what is getting done at a human level and the latter has the potential to tell you whether and how it is working. The second layer was modeling of your business strategy and including dependencies between concepts like projects and teams, which allows us to back out things like stakeholders and early warning recipients for any given progress or problems. The third was a presentation layer allowing humans to get a birds' eye view of what's happening including generating artifacts like meetings decks.

Ultimately this 1) wasn't successfully solving an urgent enough problem for most businesses and 2) was too difficult to adopt.

LLMs do break open opportunities in this space so I expect to see some more versions of this, perhaps on top of the Credal API!

Post reply on HN