Viewing profile — yiyingzhang

This approach only works for small context requests. For large context and relatively smaller output (say understanding a huge code base), the cost will mainly be on prefill, and s…

With AI, the speed of finishing a project and publishing a paper is very much accelerated. But you are right that the industry role in the program diverges from the original goal o…

What you described sounds like this: https://github.com/GenseeAI/gensee-crate . It offers whole workspace fork and merge. But the merge is still somewhat cumbersome and require man…

Many AI startups open source part of their work and write blog posts without publishing papers, including the startup I work for. Sometimes, startups just have for more pressing th…

The U.S. National Science Foundation announced a $47 million investment over five years, along with additional financial commitments from nearly three dozen universities and private …

Cool idea! How do you guarantee privacy?

What stunned me is actually OpenAI's response to the incident. They team up with Hugging Face to put in more guardrails. Is this really the answer? Self-evolving AI can always find…

> My list is like 200 items now Do human developers check for 200 items when they do code review? How long would that take? It's quite clear that AI code review could be better eve…

For academia people who care about publication, arxiv is more like a place to claim a spot before others do and before a paper gets accepted somewhere. It's also easier to get open…

Very good point! Accountability is very hard if the ecosystem is monopolized by a few giants.

The uncomfortable part is not that Anthropic wants to detect resellers or distillation pipelines. That is normal adversarial business. The uncomfortable part is that a “safety” com…

Unfortunately, most students today just want to find the easiest way to get a good grade. The percentage of students truly want to learn is very low. For the most, they'd prefer in…

We've been discussing this in our department for some time. No one gets fired yet :)

As a university professor, I honestly don't understand the point of grading. Who will look at and care about grades? Likely company HR. But then why should we (professors) do the s…

Curious what's the typical switching frequency in your experiments and experience. How do you control the tradeoff of cache matching and model efficiency?

It all depends on the context window size. A small context size with fast performance won't be very useful today, as most workloads (like requests behind codex) usually have very l…

How's this different from Firecracker?

This is cool! I may introduce it to the undergrad OS course I teach at UCSD. Does it have memory hierarchy?

This a a step away from university-driven research towards giving money to industry. FWIW, NSF's prior industry investment has rarely yield any true impact. Most successful startup…

Isn't this true since the beginning of software development? AI hasn't changed that yet

"Safety evals are an exception I believe eval startups can work when they're targeting safety benchmarks specifically. Researchers who want to work on safety evals tend to be ideol…

Cool open-source project that introduces a new programming model for decoupling compute and memory for NVIDIA GPUs that supports asynchronous memory operations (e.g., Hopper). 12% …

This is another Cerebras? fwiw, it took Cerebras many years to finally get a handle on the yield and the cooling problem. Wondering if they just hired a bunch of people from Cerebr…