Pavel Machek
Posts
1789Following
90Followers
167
Pavel Machek
pavel
Hi!
I asked for help with ISP...
Can you program GPUs and do you want to become a HERO? #linuxphone
community needs your help.
[...]
and I got help. Both from humans and from language models. Quickly it
turned out Librem 5's GPU is fast enough for debayering at 24fps,
0.8MP and data can be transfered enough fast enough. Soon, it turned
GPU can use full 13MP image as a source, scaling it down to 0.2MP for
gstreamer mp4 recording.
This opens possibility to do phase-detection AF and digital
zoom. Librem 5 is not fast machine, its CPU/GPU/RAM is slower than
Thinkpad X220, for example.
Then I set out to investigate "how much of an ISP can I do" and it
turned out I did not yet find a limit.
So far I did black level, some attempt at denoise, three matrix
multiplies and gamma correction. (CPU could do black level + gamma +
one matrix multiply, almost, if I did vector instructions and a lot of
care). I don't know how much my GPU is loaded, but at the moment I
believe ISP on the GPU is the way to go.
Yes, I'm doing simpler debayer than usual, through not as simple as
explained below. I believe that's right choice when 13MP image is
available.
Code is at
https://gitlab.com/tui/tui/-/tree/master/icam?ref_type=heads . It has
some pretty rough edges. But get Librem 5, it is worth it :-).
Special thanks to @dos Sebastian Krzyszkowiak and @datenwolf.
Best regards,
Pavel
I asked for help with ISP...
Can you program GPUs and do you want to become a HERO? #linuxphone
community needs your help.
[...]
and I got help. Both from humans and from language models. Quickly it
turned out Librem 5's GPU is fast enough for debayering at 24fps,
0.8MP and data can be transfered enough fast enough. Soon, it turned
GPU can use full 13MP image as a source, scaling it down to 0.2MP for
gstreamer mp4 recording.
This opens possibility to do phase-detection AF and digital
zoom. Librem 5 is not fast machine, its CPU/GPU/RAM is slower than
Thinkpad X220, for example.
Then I set out to investigate "how much of an ISP can I do" and it
turned out I did not yet find a limit.
So far I did black level, some attempt at denoise, three matrix
multiplies and gamma correction. (CPU could do black level + gamma +
one matrix multiply, almost, if I did vector instructions and a lot of
care). I don't know how much my GPU is loaded, but at the moment I
believe ISP on the GPU is the way to go.
Yes, I'm doing simpler debayer than usual, through not as simple as
explained below. I believe that's right choice when 13MP image is
available.
Code is at
https://gitlab.com/tui/tui/-/tree/master/icam?ref_type=heads . It has
some pretty rough edges. But get Librem 5, it is worth it :-).
Special thanks to @dos Sebastian Krzyszkowiak and @datenwolf.
Best regards,
Pavel
0
0
2
Pavel Machek
pavel
Mam tu lahvicku s napisem "sampon", dvema jednorozci a dvema srdicky. A otazka je -- je ten sampon pro me nebo pro zlutaka? 🙂.
0
0
0
Pavel Machek
pavel
Ty kupy mrtvych civlistu v Gaze zacinaji byt tak velke, ze "smrt IDF" se pomalu presouva z kategorie "hnusny extremismus" smerem ke kategorii "vlastne docela rozumny pozadavek na zastaveni genocidy" :-(.
Billy Bragg (snip)
Anyone unable to understand why thousands of people joined Bob Vylan in chanting ‘Death, Death to the IDF’ at Glastonbury should read the article below. (snip)
theguardian.com
Israeli military used 500lb bomb in strike on Gaza cafe, fragments reveal
Billy Bragg (snip)
Anyone unable to understand why thousands of people joined Bob Vylan in chanting ‘Death, Death to the IDF’ at Glastonbury should read the article below. (snip)
theguardian.com
Israeli military used 500lb bomb in strike on Gaza cafe, fragments reveal
0
0
1
Pavel Machek
pavel
OnePlus 6 ma tri fotaky, 2 vzadu a jeden selfie. #oneplus6 #linuxphone #oneplus6t Ty dva vzadu maji dost podobny parametry, jeden z nich na mainlinu funguje, druhy bohuzel ne, selfie funguje taky; tak proc neni podpora v Megapixels a internet plny fotek? No, protoze ten co funguje je makro kamerka ktera neumi fotit na dalku. Aha. Zahada vyresena.
OnePlus 6 has three cameras – two on the back and one selfie camera.
#oneplus6 #linuxphone #oneplus6t
The two rear cameras have quite similar specs. One of them works on mainline, the other unfortunately doesn't. The selfie camera works too.
So why isn't there support in Megapixels and why isn't the internet full of photos?
Well, because the one that works is the macro camera, which can't focus at a distance.
Ah. Mystery solved.
OnePlus 6 has three cameras – two on the back and one selfie camera.
#oneplus6 #linuxphone #oneplus6t
The two rear cameras have quite similar specs. One of them works on mainline, the other unfortunately doesn't. The selfie camera works too.
So why isn't there support in Megapixels and why isn't the internet full of photos?
Well, because the one that works is the macro camera, which can't focus at a distance.
Ah. Mystery solved.
0
0
1
Pavel Machek
pavel
Opravuju ADSL modem... ten, co to schytal pri bource. Zatim jsem na opravu pouzil kondenzator z GME.cz (jeste jednou diky za trpelivost!), a papirovou karticku. Nechtelo se mi pajet, takze kondenzator je nasazen na nozicky toho vybuchleho. A ja bych mel brat sazky: Bude to fungovat?
0
0
2
Pavel Machek
pavel
I, once again, believe that GPU on Librem 5 can be useful for debayering. #librem5 #linuxphone https://gitlab.com/tui/debayer-gpu/-/tree/master/bwtest?ref_type=heads
0
0
1
Pavel Machek
pavel
Edited 1 month ago
edit: Thanks for all the heroes that chimed in. In meantime, I got help from entity that shall not be named, and currently have something fast enough. And I have great human experts on line, with patches to test. Thanks again! :-)
Can you program GPUs and do you want to become a HERO? #linuxphone
community needs your help.
We are trying record video, and have most pieces working, but one is
missing: fast enough debayering. That means about 23MB/sec on #librem5.
Debayering is not hard; camera images have subpixels split on two
lines, which need to be corrected. They also use different color
representation, but that's fixable by some table lookup and two matrix
multiplies.
Librem 5 has Vivante GPU, 4 in-order CPU cores and 3GB RAM. My feeling
is that it should be fast enough for that. If task is for some reason
impossible, that would be good to know, too.
Image data looks like this
RGRGRG...
xBxBxB...
.........
.........
Task is to turn that into usual rgbrgb.... format. rgb = RGB * color
matrix, with table lookups for better quality. I can fix that once I
get an example.
I'm looking for example code (#pinephone would work, too), reasons it
can not be done... and boosts if you have friends that can program
GPUs. #gpu #opensource
Can you program GPUs and do you want to become a HERO? #linuxphone
community needs your help.
We are trying record video, and have most pieces working, but one is
missing: fast enough debayering. That means about 23MB/sec on #librem5.
Debayering is not hard; camera images have subpixels split on two
lines, which need to be corrected. They also use different color
representation, but that's fixable by some table lookup and two matrix
multiplies.
Librem 5 has Vivante GPU, 4 in-order CPU cores and 3GB RAM. My feeling
is that it should be fast enough for that. If task is for some reason
impossible, that would be good to know, too.
Image data looks like this
RGRGRG...
xBxBxB...
.........
.........
Task is to turn that into usual rgbrgb.... format. rgb = RGB * color
matrix, with table lookups for better quality. I can fix that once I
get an example.
I'm looking for example code (#pinephone would work, too), reasons it
can not be done... and boosts if you have friends that can program
GPUs. #gpu #opensource
4
38
17
Pavel Machek
pavel
Ok, I thought that "Librem 5 GPU is faster than X220 GPU" was a bit too good to be true. Turns out code was broken and simply produced black frames on Wayland... but did that fast. #linuxphone #librem5
0
0
2
Pavel Machek
pavel
Did camera support on Librem 5 break with recent PureOS updates? That's bad timing for me :-(. #linuxphone #librem5
1
0
2
Pavel Machek
pavel
Jasne ze srst izoluje. Ale vnitrni prostredi ma ~36C a je v nem tepelny zdroj; vnejsi s trochou stesti min. A zvirata na leto linaji, to se asi evoluce spletla... https://www.seznamzpravy.cz/clanek/domaci-zivot-v-cesku-ve-vedru-nebrat-zvire-do-rozpaleneho-auta-a-rozhodne-nezkracovat-srst-280494
0
0
1
Pavel Machek
pavel
Quite scary: yt ChatGPT\ Is\ Becoming\ A\ Religion\ \[zKCynxiV_8I\]. Please do _not_ turn language models into priests, don't make it emulate Jesus or Gods. Its too easy to do, and ... it would be highway to hell if hell actually existed.
0
0
1
Pavel Machek
pavel
GPU on Librem 5 is actually faster than on X220? Good. I proved to myself that 1Mpix/30fps is possible. Now for the boring task of actually getting it to work... #linuxphone #librem5
2
4
8
Pavel Machek
pavel
ISP on GPU is probably doable. If I'm lucky, it will do ~1Mpix / 30fps on Librem 5. #linuxphone Standby.
0
0
3
Pavel Machek
pavel
debayer-gpu (git@gitlab.com:tui/debayer-gpu.git) tries to do debayering on GPU. But it seems OpenGL 2.1 is ... really not meant to do the computation. glReadPixels() can be used to get data off the GPU, but that does not have great performance. On PinePhone, you can only get RGBA out, but we really need RGB. Doing RGBA->RGB on CPU is easy, but it degrades performance further. I believe problem is that ISP produces a lot of data.
On Thinkpad X220, converting 400 images is like 12 seconds. If I do no processing in the fragment shader, it is still 10 seconds. X220 is able to process ~20Mpix/second on GPU. I don't believe Librem 5 will be significantly better.
If you believe GPU can be useful for task like debayering (mostly rearranging data with some additions and 2 matrix multiplies per pixel), let me know. 30Mpix/second on Librem 5 would be useful performance. #linuxphone
On Thinkpad X220, converting 400 images is like 12 seconds. If I do no processing in the fragment shader, it is still 10 seconds. X220 is able to process ~20Mpix/second on GPU. I don't believe Librem 5 will be significantly better.
If you believe GPU can be useful for task like debayering (mostly rearranging data with some additions and 2 matrix multiplies per pixel), let me know. 30Mpix/second on Librem 5 would be useful performance. #linuxphone
1
2
5
Pavel Machek
pavel
Zlocinci vladnou svetu
Putin je velmi pravdepodobne zlocinec. Krome jineho valecny, rozpoutani preventivni valky na Ukrajine je zlocin. To co se v ni deje je take daleko za carou, chteji ho videt v Haagu. Unosy deti naznacuji genocidu.
Trump je zlocinec. Pokusil se o puc, mimo jine, ale odsouzeny byl za neco mensiho.
Netanjahu je velmi pravdepodobne zlocinec. Krome jineho valecny, stavby na okupovanych uzemich nejsou v souladu s mezinarodnim pravem, a na tom je celkem shoda. Pak je taky obvinen za korupci/podvod a tak... a Trump naleha na jejich justici (!). Jo, a preventivni utok na Iran nebyl legalni.
Jenze to uz se stalo. Co se dal deje je genocida v Gaze. Tam situace az tak jasna neni, protoze Izrael veci taji. Jsou jen hromady mrtvol, a pry mame Izraeli verit, ze maximalne dba na bezpecnost civilistu. Coz je dost tezky, kdyz jejich politici rikaji veci jako "Palestinci by meli zmizet z povrchu zeme".
To posledni je neco, s cim bysme meli byt schopny neco delat. Ano, Izrael je nas spojenec. Ne, to neznamena, ze mame zavirat oci.
[Sas, Rabin Jusef, "palestinci jsou ciste zlo, zmije, meli by zmizet z povrchu zeme".]
https://www.seznamzpravy.cz/clanek/zahranicni-izraelska-palba-v-gaze-u-distribucnich-center-zabila-desitky-lidi-uvadi-urady-279287
https://www.seznamzpravy.cz/clanek/zahranicni-trump-naleha-na-izraelskou-justici-aby-zrusila-proces-s-netanjahuem-280301
Putin je velmi pravdepodobne zlocinec. Krome jineho valecny, rozpoutani preventivni valky na Ukrajine je zlocin. To co se v ni deje je take daleko za carou, chteji ho videt v Haagu. Unosy deti naznacuji genocidu.
Trump je zlocinec. Pokusil se o puc, mimo jine, ale odsouzeny byl za neco mensiho.
Netanjahu je velmi pravdepodobne zlocinec. Krome jineho valecny, stavby na okupovanych uzemich nejsou v souladu s mezinarodnim pravem, a na tom je celkem shoda. Pak je taky obvinen za korupci/podvod a tak... a Trump naleha na jejich justici (!). Jo, a preventivni utok na Iran nebyl legalni.
Jenze to uz se stalo. Co se dal deje je genocida v Gaze. Tam situace az tak jasna neni, protoze Izrael veci taji. Jsou jen hromady mrtvol, a pry mame Izraeli verit, ze maximalne dba na bezpecnost civilistu. Coz je dost tezky, kdyz jejich politici rikaji veci jako "Palestinci by meli zmizet z povrchu zeme".
To posledni je neco, s cim bysme meli byt schopny neco delat. Ano, Izrael je nas spojenec. Ne, to neznamena, ze mame zavirat oci.
[Sas, Rabin Jusef, "palestinci jsou ciste zlo, zmije, meli by zmizet z povrchu zeme".]
https://www.seznamzpravy.cz/clanek/zahranicni-izraelska-palba-v-gaze-u-distribucnich-center-zabila-desitky-lidi-uvadi-urady-279287
https://www.seznamzpravy.cz/clanek/zahranicni-trump-naleha-na-izraelskou-justici-aby-zrusila-proces-s-netanjahuem-280301
1
1
2
Pavel Machek
pavel
Pan je vtipnej. Chtel by obohacovat uran na 0.5%. No, to asi uplne nepujde :-). https://www.seznamzpravy.cz/clanek/audio-podcast-5-59-iran-hleda-po-uderu-americkym-pulnocnim-kladivem-radu-v-moskve-279874 https://en.wikipedia.org/wiki/Uranium
0
0
1
Pavel Machek
pavel
Doporucim na yt game101/The Dominoes Falling Toward World War III [DBe4yHPbUiw] -- a jo, padaji nejen domina. https://www.seznamzpravy.cz/clanek/zahranicni-rekonstrukce-bombardery-letely-37-hodin-trump-se-rozhodl-v-utery-279830
0
0
0