Live data from Hacker News

Viewing profile — yuhongsun

yuhongsun

HN member
Joined
Mon, May 08, 2023, 8:02 PM UTC
HN karma
189
Public activity
74 items

About yuhongsun

Building open source Enterprise Search meets Generative AI.

https://github.com/danswer-ai/danswer

Recent public activity

  1. story
  2. story
  3. job
  4. job
  5. job
  6. comment
    Comment #43260780

    RAG is a tool for the deep research agent to use in finding all of the context it needs. Deep research can call the search many times and reflect on the results of the previous sea…

  7. comment
    Comment #43260740

    Yup, hopefully with Onyx, the folks who have these questions can just fire off a query with agent mode turned on and the LLM will research the relevant tree of knowledge and come b…

  8. comment
    Comment #43260724

    We have a dataset that we use internally to evaluate our search quality. It's more representative of our use case since it contains Slack messages, call transcripts, very technical…

  9. comment
    Comment #43260686

    Assuming self-hosting, data is processed within the deployment with local deep learning models for embedding, identifying low information documents, etc. A hybrid keyword/vector in…

  10. comment
    Comment #43260623

    This is a large challenge in itself actually. Every external tool has it's own framework for permissions (necessarily so). For example, Google Drive docs have permissions like "glo…

  11. comment
    Comment #43260600

    It's like how OpenAI's deep research works by searching the internet, ours works by searching over our "RAG" system that indexes company documents.

  12. comment
    Comment #43260594

    Quite a lot to cover here! So in addition to the typical RAG pipeline, we have many other signals like learning from user feedback, time based weighting, metadata handling, weighti…

  13. comment
    Comment #43260525

    On privacy and security, we are the only option (as far as I know) that you can connect up to all your company internal docs and have it be all processed locally to the deployment …

  14. comment
    Comment #43260518

    Amazing to hear from a happy user! Thanks for the kind words!

  15. comment
    Comment #43242555

    Before sharing how it works, I want to highlight some of the challenges of a system like this. Unlike deep research over the internet, LLMs aren’t able to easily leverage the built…

  16. story
    Show HN: Open-source Deep Research across workplace applications

    I’ve been using deep research on OpenAI and Perplexity and it’s been just amazing at gathering data across a lot of related and chained searches. Just earlier today, I asked “What …

  17. story
    Show HN: Danswer APIs – Open-source APIs for building RAG apps over company docs

    Hi HN! I’m one of the creators of Danswer, the open-source enterprise search project that you may have seen on HN a bit under a year ago ( https://news.ycombinator.com/item?id=3946…

  18. story
    Ask HN: How to run a startup sponsored competition?

    We plan to run a competition with a prize pool as an experimental way of finding amazing candidates. Has anyone seen this work out? For the top submissions we will extend an offer …

  19. comment
    Comment #41291969

    Hey everyone, I’m one of the authors of the post. As an engineer at small companies, I’ve only ever heard about ERPs but never fully understood them. They seemed like clunky, expen…

  20. story
  21. job
  22. comment
    Comment #41132286

    Danswer AI | https://www.danswer.ai/ | Full Stack Engineer, Customer Engineer | On-site | $150,000 - $240,000 Danswer is an open-source GenAI assistant with organization specific k…

  23. comment
    Comment #39576608

    We have a connector interface and build guide for contributors: https://github.com/danswer-ai/danswer/blob/main/backend/dans... Should be not too bad to build one out! Fun fact, mo…

  24. comment
    Comment #39576572

    Ya, I haven't dug too deep into their project, to be honest. But we do think it's great more teams are going for open source. I tried to look up their RAG pipeline to see if they'v…

  25. comment
    Comment #39576477

    There's a question by cpach further up on this page which is essentially asking this but also with some additional questions. Hopefully you find that thread useful! TLDR: There's t…