Conversation
Jarkko Sakkinen
jarkko
Edited 15 days ago
Building GNOME was already hard but creating installer is exceptionally hard :-) And to make sure vanilla state with the build, each trial requires 2h of wait.
I use Python and https://textual.textualize.io/, which I found and seems to do its job.
Installation works like that the live version copies its live bootc image to the target system i.e., it literally duplicates. Based on composefs and ostree.
For hardware capabilities I have detection and capabilty tags consumed by k3s, which uses them to configure Helm threads correctly. It gives quite robust and easy way to run local vLLM payloads without extra configuration.
I have both discrete and unified memory hardware available to make sure things are not overall wrong. I have enabled e.g., also NVLink and ConnectX but all of this is untested given lack of gear basically.
Relevant repositories for this Buildroot fork (technically not, it's in-fact br2-external) will eventually be:
1. https://codeberg.org/puu/puu
2. https://quay.io/puu/puu
Really don't know yet when as this last 1% takes its time :-) Puu literally can turn a gaming PC a dedicated local LLM appliance with gotcha that it uses "dedicated/appliance" approach. I think it is important to make things better and less harmful. This is from my side more like harm reduction than promoting the technology itself.
I use Python and https://textual.textualize.io/, which I found and seems to do its job.
Installation works like that the live version copies its live bootc image to the target system i.e., it literally duplicates. Based on composefs and ostree.
For hardware capabilities I have detection and capabilty tags consumed by k3s, which uses them to configure Helm threads correctly. It gives quite robust and easy way to run local vLLM payloads without extra configuration.
I have both discrete and unified memory hardware available to make sure things are not overall wrong. I have enabled e.g., also NVLink and ConnectX but all of this is untested given lack of gear basically.
Relevant repositories for this Buildroot fork (technically not, it's in-fact br2-external) will eventually be:
1. https://codeberg.org/puu/puu
2. https://quay.io/puu/puu
Really don't know yet when as this last 1% takes its time :-) Puu literally can turn a gaming PC a dedicated local LLM appliance with gotcha that it uses "dedicated/appliance" approach. I think it is important to make things better and less harmful. This is from my side more like harm reduction than promoting the technology itself.
1
0
0
@jarkko It's been a while since I last heard about Buildroot. I got used to https://buildstream.build/ now with GNOME OS. @jorge seems to be liking it too :P
1
0
0
Jarkko Sakkinen
jarkko
1
0
0
0
0
0