Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Launch HN: Credal.ai (YC W23) – Data Safety for Enterprise AI

news.ycombinator.com

Post reply on HN
Print view View original

21–25 of 25 posts

Re: Launch HN: Credal.ai (YC W23) – Data Safety for Enterprise AI

#21

Post by pseudonymouspat »

jackfischer wrote: post #19
pseudonymouspat wrote: post #15

Go Ravin and Jack! We're not at sufficient scale to really get use of this product, but would love to try it down the road. Are you using Foundry for data integration and ACLs?

Thank you! We haven't gone down the Foundry route yet. We do have some smaller scale apps and companies using Credal either as their AI API or chat platform respectively - would be interested to hear a bit about your use case and see if it's a match?

Word- we're in the thick of it but I'll reach out once we're ready to start thinking through bringing in chat.

Re: Launch HN: Credal.ai (YC W23) – Data Safety for Enterprise AI

#22

Post by aiappreciator »

This seems like a very promising product, a ChatGPT interface, enterprise version, is a large gap in the market.

However, this part in your advertising, sounds very dubious:"Credal can be deployed fully on-premise for Large Enterprises, including the large language models themselves"

What do you mean the LLMs themselves? Open source I can understand, how are you going to move GPT-4 to on prem? OpenAI is not giving you the weights.

Re: Launch HN: Credal.ai (YC W23) – Data Safety for Enterprise AI

#23

Post by r_thambapillai »

aiappreciator wrote: post #22

This seems like a very promising product, a ChatGPT interface, enterprise version, is a large gap in the market. However, this part in your advertising, sounds very dubious:"Credal can be deployed fully on-premise for Large Enterprises, including the large language models themselves" What do you mean the LLMs themselves? Open source I can understand, how are you going to move GPT-4 to on prem? OpenAI is not giving yo…

Thanks for your encouragement and that is a totally fair criticism - when we say that, we mean two things:

1. We support using Credal with your own, open source LLM, which can of course be fully on prem in every sense

2. We also support using Credal with your own Azure OpenAI instance. As you say, OpenAI aren't giving us the weights, but many of our customers have procured Azure OpenAI from Microsoft and then we point GPT 4 usage at their Azure instance, meaning that the data never goes to Open AI at all.

One of the things that's going to be really interesting to see moving forward is whether the open source models are going to be able to compete with the blistering pace and funding that the closed source ones - Bard, Claude, and GPT-X are going to be able to attract (and maybe Mistral?). For the sake of the industry, I really hope that the OS models catch up but given the amount of funding (and now in OpenAI's case, revenue) the closed source models are generating, its hard to see how that happens

Re: Launch HN: Credal.ai (YC W23) – Data Safety for Enterprise AI

#24

Post by debarshri »

mritchie712 wrote: post #2

Going thru the SOC2 process myself[0]. As I expected, we're hearing from customers they won't use a product that passes the contents of their database tables into an AI model (although some AI products are doing this). So the problem Credal is solving makes sense. Have you considered building an open source Python package for solving just this bit of the problem? Any tips on the SOC2? Did you use something like Drata…

Apologies for the shameless plugin. I generally don't do this, but I just thought our product might be relevant for the use case you mentioned. We do not compete with Credal, but at Adaptive [1], we have been building a platform that helps with infrastructure access management and allows users to automatically generate and collect evidence, especially for CC5 and CC6 (logical access). Vendor security questionnaires become easy to answer when we, as an organisation, use our product.

We have seen reproducibility and access auditability in organisations that adopt products that access schema and metadata from databases, compute infrastructures, etc. comforts customers. Your customers care about security incidents like unauthorised access, privilege abuse, accidental operations, insider threats, etc. on the vendor's side which in my opinion are real threats.

[1] http://adaptive.live

Post reply on HN