Live data from Hacker News

Viewing profile — matanyal

matanyal

HN member
Joined
Mon, Apr 11, 2022, 1:22 AM UTC
HN karma
59
Public activity
17 items

About matanyal

Engineer @ Groq, building high-performance, low-latency AI Inference systems. discord: discord.gg/2AAqvtFAUw email: matanya@groq.com

Recent public activity

  1. comment
    Comment #39436654

    Hey y'all, we have a discord now for more discussion and announcements: https://discord.com/invite/TQcy5EBdCP

  2. comment
    Comment #39436064

    When you have a pile of hardware and silicon Intellectual Property, patents, etc, IMO it's pretty clever. However, I'm a Groq Engineer, and I'm mega-biased.

  3. comment
    Comment #39436026

    We intend to be very competitive on cost, power, hardware, TCO, whatever it is. Custom-built silicon+hardware has the advantage in this space.

  4. comment
    Comment #39436008

    Thanks! Feel free to join our discord for more announcements and demos! https://discord.com/invite/TQcy5EBdCP

  5. comment
    Comment #39435960

    We are great for image embedding (and audio, with more to come!) There is no reason you should be forced to use graphics cards intended for gaming for any AI workload.

  6. comment
  7. comment
    Comment #39435896

    Groq Engineer here as well; we actually built our compiler to compile pytorch, TensorFlow, and Onnx natively, so a lot of the amazing work being done by y'all isn't building much o…

  8. comment
    Comment #39432163

    Groq Engineer here, I'm not seeing why being able to scale compute outside of a single card/node is somehow a problem. My preferred analogy is to a car factory: Yes, you could buil…

  9. story
    Ask HN: What are folks using for dealing with K8s manifests these days?

    A few years back, my options for dealing with manifest where either templated yaml (helm) or overlayed yaml (kustomize). I've been playing around with Jsonnet, tanka, and cdk8s, an…

  10. comment
    Comment #38740009

    https://groq.com/groq-sets-new-large-language-model-performa...

  11. comment
    Comment #38740003

    More info about Groq: https://groq.com/lpu-inference-engine/

  12. comment
    Comment #38739883

    [flagged]

  13. comment
    Comment #38739851

    Reading is one thing, but think about stuff like website generation, searching for information in massive datasets, real-time audio chats that don't sound like the AI misheard ever…

  14. comment
    Comment #38739826

    It told me "Yeehaw Ridem Cowboy" was potentially problematic, which is news to me living out west.

  15. comment
    Comment #37453806

    [flagged]

  16. comment
    Comment #37156819

    Interesting, no mention of Groq for number 6.

  17. comment
    Comment #36384025

    Hey Jeff, Good to see that y'all are still pushing in the right direction! I left between the layoffs to pursue some innovation in the semiconductor space, but I look back fondly o…