Posts
6528
Following
355
Followers
573
My in-progress (but not yet fully finished) operating system project:

1. https://github.com/puu-os/bootc
2. https://github.com/puu-os/installer

Jarkko Sakkinen

Edited 4 days ago
Other than AI slop appearing in the Asustor's ADM, their security is broken too.

Or at least the password dictionary attack block is not exactly working :-)

#infosec #asustor
1
0
0

Jarkko Sakkinen

Asustor Control Center is suddenly mixing Swedish to Finnish UI and using triple vowels.

I've never seen any typos in it ever before.

It could not be slop, could it?

#ai #slop #asustor #nas
1
0
1

Jarkko Sakkinen

I just got web access working in preconfigured Open WebUI of PUU OS :-) It's amazing how much the vividity of the user experience degrades with an offline LLM ;-) Bonsai-2-27B is running on RTX 4090 24 GiB as vLLM workload hosted by K3s.
0
0
1

Jarkko Sakkinen

Edited 12 days ago
OKSA is the model manager and hardware calibration engine of PUU OS. Taking baby steps on the web/management side. Not very flashy but at this point what is shown here is more for "power on testing" and debugging than anything else.

Likely stuff to land soon here is mainly QSFP networking configuration for parallel inference.

Given that every build has an integer number that identifies that build *uniquely* as builds are *reproducible* I also likely find a lean way to use this information to notify the user if the nodes co-operating in parallel inference have a version mismatch (i.e., non-enforcing warning).

This is because for optimal results in parallel inference it would be feasible if all nodes run exact same version of the same operating system, and with PUU OS it is possible to achieve in bit-by-bit level.

In Puu OS bootc containers and reproducible builds are not used because they are cool but instead what they bring on the table is one of the key features for implementing stable inference across a mesh of nodes.

This is fun area to innovate because not much of it is that well documented when it comes to inference hosting. And likely lot of it is also a trade secret for AI companies. So for things like hardware calibration there was no tutorial or AI assistance. I simply have to figure out how it could be done, fail, learn and retry. And still doing it :-)

It's amazing how far Buildroot can be streched.

#buildroot
0
0
0

Jarkko Sakkinen

Someone did AI recomp of RB-338. The screenshot is from related FB post. No interest but you can now have it as a plugin (also for Apple silicon).
0
0
0

Jarkko Sakkinen

Edited 22 days ago
Landstrip seems to be now somewhat operational in OpenCode 2.

I.e. now is a good time provide bug reports as it is "assumed to work" ;-)

#opencode
0
0
2

Jarkko Sakkinen

still active order, not shipped ;-)
0
0
0

Jarkko Sakkinen

Interesting:

1. With USB stick pressing enter did nothing on USB stick's boot entry.
2. With PiKVM virtual stick just connected I got the error message in the screenshot, which is visible second or two.
3. Boots after that work exactly same way as with USB stick.

The error message helped to locate the bug but not entirely sure why it works like that.

While at it I'll upgrade to SystemD 262, which hopefully has fscryptv2 pataches (have not checked, would upgrade anyway).
1
0
0

Jarkko Sakkinen

sorry, could not help myself, as i just got finally got my hair cut and hats fit ;-) my ex-girlfriend used to be a hairdresser and it took me 1.5 years to realize that hair does not cut itself.

https://www.youtube.com/watch?v=E86gWQs-ios
0
2
4

Jarkko Sakkinen

Edited 1 month ago
Test prompted with machine having RTX 4090 24 GiB and Puu OS hosting Bonsai 2 27B. Seems to work :-)
0
0
2

Jarkko Sakkinen

Edited 1 month ago
Bonsai 2 27B with 256k context running on RTX 4090 24 GiB, and hosted by Puu OS.

Puu OS also has preconfigured Qwen 3.8 27B, which fits easily to DGX Spark.

LLM models, when you actually host them, require their own (manual) shoehorning in order to fly nicely in the environment, and there is no exact template for this. Thus, I focus on one all-arounder model with two different quantizations in the base installation of Puu OS. For those that don't know this Bonsai 2 27B is a ternary quantization of Qwen 3.8 27B.

This is a personal achievement for me despite not being a huge achievement overall as I could never imagine I could have a something with a decent context size with the hardware that I have at hand.

I purposely want to do a small AI assisted contribution with this to kernel when I have a chance :-)
2
0
1

Jarkko Sakkinen

It's a shame that Caustic is dead other than running it under Wine. It's still the best mobile DAW workflow.
0
0
0

Jarkko Sakkinen

I did not know how much there would be work in writing a rock solid installer for an operating system before I did one for Puu OS.

Here's in high-level what it does :-)
0
0
0

Jarkko Sakkinen

Edited 1 month ago
Session #3 with Dirtywave M8 iOS aka "how to add italo":

How to italo:
1. Play random keys in scale.
2. Repeat sequentially.
0
0
0

Jarkko Sakkinen

super hard cable type to find apparently

USB-B male to USB-B female Y splitter cable it is.
0
0
0

Jarkko Sakkinen

learning M8 for iOS part 2: still don't know most of the time what i'm doing but let's continue shoveling :-) i should probably check out what tables are some day. have not read or watched anything because this way it is more fun.
1
0
0

Jarkko Sakkinen

Those two Roland synths (term in the broad scope of the word) run on AA batteries. And I just realized that do five out of seven hardware synths that I own. It's clearly an attribute that I appreciate... And I like to reboot working environments constantly meaning that physical objects do change their place all the time at my house :-)
1
0
1

Jarkko Sakkinen

Learning Dirtywave M8 (iOS version). Took a while to learn how to do things like "select". Sounds quite horrible but I got something out :-)

#tracker #chiptune
1
1
1

Jarkko Sakkinen

I ordered audio gear first time since over three years: both of Elektron's "Models" grooveboxes and this limited metallic red edition of TT-303 Bass Bot V2 by Cyclone Analogic ;-)
0
0
0

Jarkko Sakkinen

Edited 2 months ago
I could try to fix the USB issue with Oxygen 8:

https://github.com/leighsmith/midisport-macos

... or get a random cable from China and call it a day :-) They have a cable for every possible trouble over there.
0
0
1
Show older