What do you use for tracing llm calls etc ?
Ask HN: What is your LLM monitoring stack?
1–2 of 2 posts
Re: Ask HN: What is your LLM monitoring stack?
#2Consider using resources like TensorFlow Profiler, PyTorch Profiler, and Spark MLlib's profiler. you can also take advantage from the capabilities of tracing libraries like TensorBoard or Prometheus.