Live data from Hacker News

Initial mainline video capture and camera support for Rockchip RK3588

collabora.com

11–20 of 30 posts

Re: Initial mainline video capture and camera support for Rockchip RK3588

#11

Earlier quoted context omitted.

I really feel like that should be table stakes if your entire business is making chips to run Linux, though after working professionally with their stuff I'm really not a fan of Rockchip

Why is that? IME pretty much all of their software is a mess and the hardware has some bugs/issues iirc but is otherwise ok?

> all of their software is a mess and the hardware has some bugs/issues

Is that not enough of a reason?

Re: Initial mainline video capture and camera support for Rockchip RK3588

#12
Worth noting that, well, alas, camera support is incredibly incredibly incredibly cursed, period. It feels like, broadly, with all the image blocks, everyone makes really neat really good hardware thats chock-a-block full of capabilities that are un- or poorly documented or really hard to support for reasons, etc. Its a pretty bespoke high throughput pipeline with a lot of special domain knowledge very unlike anything else on computing.

Intel's IPU6 has been a ~4 year travail to get going (thankfully IPU7 landed fairly quickly however!) https://www.phoronix.com/news/Intel-IPU6-Camera-Challenge-25 https://www.phoronix.com/news/Intel-IPU7-Linux-6.17

AMD similarly has only just gotten the Strix Halo ISP near working: https://www.phoronix.com/news/AMD-ISP4-For-Linux-7.2

The whole video world seems like a nightmare. Difficult world of hardware. Just the worst Intellectual Property hostage taking banditry from awful awful valent legally predatory people everywhere, a dark forest ready to leap out of the dark and attack you if you dare use a computing to deal in bits that represent moving images.

Re: Initial mainline video capture and camera support for Rockchip RK3588

#13

I guess I don't understand... why would the SOC manufacturer spend the money on integrating this stuff if they don't intend on also spending the money to enable it on the software side?

They did, jut not mainline. People forget these are embedded chips - they are intended to go inside of something and do one thing. These chips lack auto hardware discovery because the manufacturer assumes the customer will only turn on the hardware peripherals they need for their specific use case and build a static kernel image to meet that requirement. They ship a product that will likely see few, if any software updates and end up in a landfill.

It's because of the Raspberry Pi foundation we have this perception that embedded Arm chips are like general purpose desktop computers that run Linux desktops. The original Pi SoC was designed for TV set top boxes, STB's hence the loopy booting from GPU which was likely part of some obfuscated secure boot chain to thwart STB hackers. The Pi was a throw away hobby toy based on a chip Broadcom was going to scrap so they got a dumpster deal. It took a lot of effort for the community to fully reverse the Broadcom SoC and bring all the Pi hardware to mainline.

Re: Initial mainline video capture and camera support for Rockchip RK3588

#14
Good. Video capture on second grade Linux SoCs is hell - lots of blobs and weird custom vendor SDKs that work with the vendor's own happy path use case demos and nothing else.

I hope that the more SoCs get mainline V4L2, the more likely the future SoCs are going to be to use it instead of doing something non-standard and awful.

Re: Initial mainline video capture and camera support for Rockchip RK3588

#15

I guess I don't understand... why would the SOC manufacturer spend the money on integrating this stuff if they don't intend on also spending the money to enable it on the software side?

So that they can sell licenses to proprietary software implementations on top of selling the hardware.

Re: Initial mainline video capture and camera support for Rockchip RK3588

#16

Worth noting that, well, alas, camera support is incredibly incredibly incredibly cursed, period. It feels like, broadly, with all the image blocks, everyone makes really neat really good hardware thats chock-a-block full of capabilities that are un- or poorly documented or really hard to support for reasons, etc. Its a pretty bespoke high throughput pipeline with a lot of special domain knowledge very unlike anythin…

I work in this field and this is 100 percent true. It's really hard to learn about too. A lot of textbooks go over the algorithms in the chips in an idealized form. The actual versions are so messy and different that the textbooks aren't even useful sometimes, especially if you work on custom ISPs. It's cursed, but it's fun.

Re: Initial mainline video capture and camera support for Rockchip RK3588

#17

Worth noting that, well, alas, camera support is incredibly incredibly incredibly cursed, period. It feels like, broadly, with all the image blocks, everyone makes really neat really good hardware thats chock-a-block full of capabilities that are un- or poorly documented or really hard to support for reasons, etc. Its a pretty bespoke high throughput pipeline with a lot of special domain knowledge very unlike anythin…

I work in this field and this is 100 percent true. It's really hard to learn about too. A lot of textbooks go over the algorithms in the chips in an idealized form. The actual versions are so messy and different that the textbooks aren't even useful sometimes, especially if you work on custom ISPs. It's cursed, but it's fun.

Are there any resources you would recommend for learning about real implementations?

Re: Initial mainline video capture and camera support for Rockchip RK3588

#18
post #2

Great to see progress on mainlining more support for common and powerful chips. The work required to get this one piece into mainline over 5-6 years reveals why most chip vendors aren’t aiming for mainline by default: > A few iterations of the rkcif driver later, the basic driver providing support for the PX30 VIP and the RK3568 VICAP was accepted (October 2025). After more than five years of development, including 2…

The product has a typical lifespan of 3–5 years, they just don't need LTS. RKISP(ImageSignalProcessor) is piece of code glued to the kernel, fast and cheap. The mainstream version provides proper integration with Linux multimedia subsystems.

Re: Initial mainline video capture and camera support for Rockchip RK3588

#19
post #2

Great to see progress on mainlining more support for common and powerful chips. The work required to get this one piece into mainline over 5-6 years reveals why most chip vendors aren’t aiming for mainline by default: > A few iterations of the rkcif driver later, the basic driver providing support for the PX30 VIP and the RK3568 VICAP was accepted (October 2025). After more than five years of development, including 2…

> why most chip vendors aren’t aiming for mainline by default: > It’s never as simple as submitting existing work upstream and making a few changes. If they had started by working with upstream, then they wouldn't have to go through unnecessary revisions trying to adapt the thing they already wrote.

The part I quoted was from a team that was working with upstream, not the RockChip team.

They were experienced with working with upstream and it still took them that long to do it.

Re: Initial mainline video capture and camera support for Rockchip RK3588

#20

Worth noting that, well, alas, camera support is incredibly incredibly incredibly cursed, period. It feels like, broadly, with all the image blocks, everyone makes really neat really good hardware thats chock-a-block full of capabilities that are un- or poorly documented or really hard to support for reasons, etc. Its a pretty bespoke high throughput pipeline with a lot of special domain knowledge very unlike anythin…

Wait is IPU6 working now? My work laptop has it and the only thing I know is it might work provided I use some user space relay driver and a bunch of other things.

Has this situation improved?

Post reply on HN