Conversation

The SoftISP is making progress, allowing libcamera to operate on platforms where the ISP (Image Signal Processor) is either unusable, or not available.

Here we have Hans comparing the Intel IPU6 running the out-of-kernel stack against the libcamera SoftISP. The colours are off, as the white balance isn't handled yet - and there is no denoise.

But clear progress to functioning cameras!

4
5
1

@libcamera Congrats! And congrats to Hans for the majestic stare :D

Too bad I can't make it to FOSDEM this year, would have been nice to hang out once again, it's been a while!

0
0
0

@libcamera needs a few more iterations for Hans' face to brighten up sufficiently
❤️

0
0
1
@libcamera I have patches to get that working on PinePhone. And yes, it is step forwards, but there's still huge ammount of work ahead. This is AE (auto-exposure), and AE is quite easy. AF is harder (and missing from this). Plus, one day we'll want video recording. That's hard. And we'll want to take photos. That's also quite hard. Millipixels has some parts, but more should go in libcamera, and we really need drivers for jpeg/mpeg encoding.
1
0
4

@pavel @libcamera accelerated encoding is somewhat independent of this, no? I.e. if the a device supports encoding via V4L2 or VA-API, that can be handled by applications / frameworks like Gstreamer - and doesn't need to live in , right?

1
0
1
@rmader @libcamera It does not need to live in libcamera, but what you ultimately want is good quality video, and there a lot of integration will be required. You want different AE/AF while recording video. Plus you need (for example) to tune debayer well to work nicely with the video encoding, yet leave enough resources for the encoding pipeline.
0
0
0

@libcamera Do you know if the denoising could be performed with a neural network?

1
0
0

@tomeu well that's something I'd be asking you about :-) looking forward to trying out your work sometime.

0
0
0