I have published the snippet of code that implements a GPU-based ISP with bunch of corrections and encodes video in real time on the Librem 5. Feel free to take parts of it and use in your apps and frameworks... or record your cats 😼

https://source.puri.sm/-/snippets/1223

#linuxmobile #mobilelinux #linuxphones #camera #librem5 #shotonlibrem5

@dos Thank you! Viewfinder is upside down for me, and it has tendency to crash the camera (or system) as described in the README. I do not see crashes with my code (https://gitlab.com/tui/tui/-/tree/master/icam?ref_type=heads), but I'm doing _way_ simpler processing; I did see memory corruption with my version at one point, through. I'm using YUY2, and 1024x... 30fps recording is feasible with simple shaders.

@pavel It shows the right way and runs reliably for hours here on crimson. There should be no crashes whatsoever. Could be some regression on GStreamer side, but on newer distros you should rather use GTK4 and GtkGraphicsOffload instead anyway.

Of course simpler shaders allow for higher performance, the challenge is in simplifying the shader without making the output shitty ;)

@pavel ...and remember that it won't work on byzantium/bullseye.

@dos For the record, I'm on Mobian 13 aka Trixie. I did single-bit change to get the viewfinder right side up. I'll play some more.

- "! gtkwaylandsink name=gtkwaylandsink rotate-method=1 sync=false "
+ "! gtkwaylandsink name=gtkwaylandsink rotate-method=3 sync=false "

@pavel rotate-method sets what gets passed to wl_surface::set_buffer_transform verbatim, and the camera is rotated 90° counter clock-wise in relation to the screen, so it should be 1. Unless I'm getting something wrong, it smells like a bug in newer phoc.

By the way, with just a one-line change (commenting out mp4mux/filesink, uncommenting flvmux/rtmpsink and adjusting the URL) you can stream online rather than to a local file 😎

(fwiw this screenshot is from before autofocus, white balance and most of image processing stuff was there)

#linuxmobile #mobilelinux #linuxphones #camera #librem5 #shotonlibrem5

@dos

Ladies, gentlemen and enbies of the Fedi... the circle is now complete. We have mobile Linux cat videos on The Fediverse.

#LinuxMobile #Cats #Fediverse #Librem5

@dos I tried to add gtk buttons to trigger taking photo and to refocus... I failed so far. gstreamer + gtk behaves strangely.

Some time ago you mentioned you had phase-detection AF. Is that code somewhere? I understand it needs kernel changes.

@pavel As long as it doesn't overlay the GStreamer's subsurface, you simply add a button to the box. I had that at one point, so I know it works. For more complex UI, use GtkGraphicsOffload which will handle overlaying widgets. I won't hand-hold you with that, it's simple stuff with many examples out there.

PDAF is more complex to setup and I don't have anything to share at this moment.

@pavel Also, you can already refocus manually with the code I posted.

@dos Yeah, after adjusting BORDER_SIZE I figured out what was going on. I could not find reasonable way to stop/start recording and saving to different files... so I am restarting whole app. Current version is at https://gitlab.com/tui/tui/-/tree/master/ccam?ref_type=heads .

@dos @pavel ^

@okias @dos Yep, I added start/stop recording to that, and already have some horse videos :-). Now I'm working on taking photos. Plus I'd really like 0.8MPix recording, and this is 0.2MPix.

@pavel Indeed: https://gitlab.gnome.org/World/Phosh/phoc/-/merge_requests/706