Posts
186
Following
31
Followers
85
Maintaining DAMON (https://damonitor.github.io). All opinions are my own.
repeated

Very happy to announce my book The Linux Memory Manager is now available to pre-order at

https://nostarch.com/linux-memory-manager

It's a comprehensive 1,300 page exploration of how memory functions in Linux that goes into great depth on the subject, and is the first book of its kind for 20 years :)

13
37
4
repeated

Well well, look what the cat dragged in
https://nostarch.com/linux-memory-manager

4
14
2
repeated

I just published a hands-on tutorial walking through a real kernel bug investigation using drgn, both as a video: https://youtu.be/s5TvkvMiV_M and a writeup: https://drgn.readthedocs.io/en/latest/tutorials/blk_rq_qos_crash.html. It includes a core dump that you can download to follow along. It covers stack traces, local variables, and a few drgn helpers for identifying unknown addresses and structures. Check it out!

0
7
1
I just posted an RFC patch series[1] for automatically tuning DAMON monitoring intervals, like auto-exposing cameras. Hopefully this will mitigate one of big blockers for making DAMON just works and runs on all Linux machines by default.

[1] https://lore.kernel.org/20250213014438.145611-1-sj@kernel.org

#linux #kernel #damon
0
3
5
I presented DAMON and hkml last Sunday FOSDEM. I finished reviewing of the record, and the videos are under transcoding now. Seems it woudl take some time. The slides are already available, though.

DAMON: https://fosdem.org/2025/schedule/event/fosdem-2025-4396-damon-kernel-subsystem-for-data-access-monitoring-and-access-aware-system-operations/

hkml: https://fosdem.org/2025/schedule/event/fosdem-2025-4572-hkml-a-tool-for-working-on-mailing-lists-driven-projects-without-subscribing/

#linux #kernel #damon #hkml #fosdem #fosdem2025
0
2
3
Received the LSFMMBPF[1] invitation this morning, and just registered. Looking forward to meet people and discuss about DAMON and Linux kernel!

[1] https://cvent.me/4ldr5l?sms=7&cn=EKkfkKZzQzqP2fCBdr2aRg

RE: https://social.kernel.org/objects/19008587-0a35-45d0-80e3-01d5f4d76875
0
0
3
repeated
For 2025, here is a updated and hopefully-useful notice about Linux kernel security issues, as it seems like this knowledge isn't distributed very widely based on the number of emails I still get on a weekly basis:

- The Linux kernel security team does not have any "early notice" announcement list for security fixes for anyone, as that would only make things more insecure for everyone. The number of organizations that fail to understand this is way too high.

- The kernel community DOES assign CVEs, as we are a CNA, please see https://www.kernel.org/doc/html/latest/process/cve.html for how they are handled and assigned. Side note, we were #2 in quantity for CVE assignments in 2024 despite only doing so for 10 1/2 months, averaging about 10 CVEs per day. Any process you might have where you feel you need to research each CVE on an individual basis manually is going to be a major time suck, automate it! All CVE entries are provided with proper git commit ids for the vulnerable release ranges for you to check yourself, AND we have tools and other formats that you can use to check this yourself. See https://git.kernel.org/pub/scm/linux/security/vulns.git/ for the tools and raw data for you to pull from directly if you don't want to deal with the cve.org json feed.

- Kernel CVE entries are constantly updated over time, you can not just look a them only when created, and then ignore all updates. Too many groups are missing revoked CVE entries and tightening of vulnerable kernel ranges that we are updating on a weekly basis. By ignoring the updates, you are causing yourself more work, not less. cve.org provides an "updated" feed in their git tree, use it!

- Along the lines of the huge number of recorded CVEs, you HAVE to take all of the stable/LTS releases in order to have a
secure and stable system. If you attempt to cherry-pick random patches you will NOT fix all of the known, and unknown, problems,
but rather you will end up with a potentially more insecure system, and one that contains known bugs. Reliance on an "enterprise"
distribution to provide this for your systems is up to you, discuss it with them as to how they achieve this result as this is what you are paying for. If you aren't paying for it, just use Debian, they know what they are doing and track the stable kernels and have a larger installed base than any other Linux distro. For embedded, use Yocto, they track the stable releases, or keep your own buildroot-based system up to date with the new releases.

- Test all stable/LTS releases on your workload and hardware before putting the kernel into "production" as everyone runs a different %
of the kernel source code from everyone else (servers run about 1.5mil lines of code, embedded runs about 3.5mil lines of code, your mileage will vary). If you can't test releases before moving them into production, you might want to solve that problem first.

- A fix for a known bug is better than the potential of a fix causing a future problem as future problems, when found, will be fixed then.
0
61
75
repeated

Join the sched-ext crew at @fosdem for the Scheduler Contest. Submit your own Linux scheduler (written with eBPF and sched-ext) or scheduling policy idea, and with a bit of luck, win a sched-ext T-Shirt and a cup: https://mostlynerdless.de/blog/2025/01/28/sched-ext-scheduler-contest-fosdem25/

0
3
1
MM pull request[1] for Linux 6.14-rc1 is out. This includes many interesting changes including below six DAMON patchsets.

- "mm/damon: add sample modules"
- "mm/damon: replace most damon_callback usages in sysfs with new core functions"
- "mm/damon: enable page level properties based monitoring"
- "mm/damon: remove DAMON debugfs interface"
- "mm/damon: extend DAMOS filters for inclusion"
- "Docs/mm/damon: add tuning guide and misc updates"

I highly recommend to read the summaries on the pull request[1] to find exciting MM changes for Linux 6.14!

[1] https://lore.kernel.org/20250124162248.60104eec848619a187242392@linux-foundation.org/

#linux #kernel #mm #damon
0
1
2
I posted two LSF/MM/BPF topic proposals for DAMON. One[1] for the usual annual DAMON development updates and plans discussions, and the other one[2] for discussing what DAMON need to provide help future access-aware MM features.

[1] https://lore.kernel.org/all/20250102222317.48760-1-sj@kernel.org/
[2] https://lore.kernel.org/20250101222039.74565-1-sj@kernel.org

#linux #kernel #damon
0
1
1
Edited 1 month ago
I just posted the last DAMON quaterly news letter for 2024: https://lore.kernel.org/20250102211811.48322-1-sj@kernel.org In short, we got more users, features, and presentation/documents.

#linux #kernel #damon #damo #quaterly_newsletter #2024-q4
0
1
2
I just looked back at my open source commits that made in 2024.

I made 7th and 2nd biggest changes to Linux kernel memory management subsystem among the 340 people, in terms of lines of changes (2,347) and commits (102).

For the Linux kernel whole tree, the numbers become 235-th (3,754 lines) and 74th (150 commits) among 5,278 people.

I also made around 45,000 lines of changes with around 2,500 commits for non-Linux open source projects.

For more details, disclaimers, and the source code for the numbers: https://sjp38.github.io/post/my_opensource_commits_stat_2024/

#linux #kernel #mm #damon #damo #hkml #perfook_ko-kr #lazybox #2024 #commits #statistic
0
3
1
Just released damo v2.6.1. Using this version and kernels that built with an RFC patch series, you can try page level properties based access monitoring. For example, you can know how much of anonymous and non-Young pages are in regions of different access pattern, like attaching image. Please refer to a blog post[1] for more details.

[1] https://damonitor.github.io/posts/damon_sz_filter_passed/

#linux #kernel #damon #damo #sz_ops_filter_passed
0
1
2
My hkml lightning talk proposal[1] for FOSDEM'25 is accepted. Looking forward to be connected with more people!

[1] https://pretalx.fosdem.org/fosdem-2025/talk/review/WK7MY7MR9HVELCGWS3QKBY8GXQR3JPDG

#hkml #fosdem #fosdem25
0
1
3
I just received an acceptance notification of my DAMON presentation proposal[1] for FOSDEM'25[2]. Looking forward to meet you at Brussels!

[1] https://pretalx.fosdem.org/fosdem-2025/talk/review/3UT9TYYRE3UXJMRRCRLMQLJKUHLRKVYE
[2] https://fosdem.org/2025/

#linux #kernel #damon #fosdem25
0
2
4
repeated

Thorsten Leemhuis (acct. 1/4)

Greg now officially deemed 6.12 as a longterm by adding it to https://www.kernel.org/category/releases.html right after marking 4.19 as EOL; ohh, and he marked the 6.11 series as EOL today, too!

For details see the latest commits here: https://git.kernel.org/pub/scm/docs/kernel/website.git/log/

2
12
2
On Middlewar'24, a paper describing DAMON as a common cloud workload and evaluate their system for DAMON usage has presented: https://dl.acm.org/doi/10.1145/3652892.3700755

This is yet another creative usage of DAMON that I never expected.

#linux #kernel #damon #middleware24
0
1
1
Show older