Viewing profile — scott_s

[dead]

I find that an odd take. The paper claims to establish what causes the problem: dimensionality. They are clear in that they don't understand why. But this sort of work is what need…

We dynamically load the shared object files. See: https://github.com/meta-pytorch/torchcodec/blob/8bbce656797c... Solutions that shell out to the `ffmpeg` binary are not going to p…

I was copying URLs fast-and-furious. The PyTorch Stable ABI reference is: https://docs.pytorch.org/docs/2.12/notes/libtorch_stable_abi...

1. A higher-level API that better integrates into the PyTorch ecosystem. 2. Ease of going back-and-forth between CPU and GPU; in our experience, there's still a lot of scenarios wh…

You can get older version of TorchCodec that work with older version of PyTorch, but it unfortunately will not have the new features (HDR video decoding; fast Wav decoding) in the …

The one you have installed. :) We don't distribute FFmpeg and instead find your installed version at runtime. We support versions 4 through 8.

For disclosure, I've worked on TorchCodec. I'm happy to answer any questions!

You are correct, but this is not a new role. AI effectively makes all of us tech leads.

That's not what the author means. Multiple times a day, I have conversations with LLMs about specific code or general technologies. It is very similar to having the same conversati…

I think of, and look up, this drunken rant at least once a year.

Yes, and that peer review happens through the ACM. It serves an organizing function. The conferences themselves are also in-person events, and most of the important research papers…

It doesn't. arXiv is exclusively a pre-print service. The ACM digital library is for peer-reviewed, published papers. All of the peer-review happens through the ACM, as well as the…

IEEE may do it, as it's a professional organization. That is, they're a non-profit dedicated to the furtherance of the field. Being open access fits their mission, and the costs ca…

Great news. They temporarily opened it in 2020 during the pandemic. I argued it should remain so in a post: https://www.scott-a-s.com/acm-digital-library-should-remain-... . I'm gl…

Gather metrics and regularly report them.

Agreed. In grad school, I used Perl to script running my benchmarks, post-process my data and generate pretty graphs for papers. It was all Perl 5 and gnuplot. Once I saw someone d…

That's true of all renewable energy sources. So we should take advantage of all of them, as much as is feasible.

You train on data. Context is also data. If you want a model to have certain data, you can bake it into the model during training, or provide it as context during inference. But if…

Because training one family of models with very large context windows can be offered to the entire world as an online service. That is a very different business model from training…

> Of course, because I am not new to the problem, whereas an LLM is new to it every new prompt. That is true for the LLMs you have access to now. Now imagine if the LLM had been tr…

The tools are at the point now that ignoring them is akin to ignoring Stack Overflow posts. Basically any time you'd google for the answer to something, you might as well ask an AI…

It's not as obvious a win as you may think. Keep in mind that for every binary that gets deployed and executed, it will be compiled many more times before and after for testing. Fo…