Just found OSSummit NA has unconference session chance. I booked one slot to use it as a place for yet another in-person veresion of the DAMON community meetup, a.k.a Beer/Coffee/Tea Chat. The time is just after my talk at LinuxCon. Looking forward to meet you and chat interesting things!

More formal announcement: https://lore.kernel.org/r/20240416184044.98993-1-sj@kernel.org

#linux #kernel #damon #ossummit

DAMO v2.3.0[1] is out. An important change on this version is the support of memory footprint visualization[2]. All DAMO features including this, which are added since last OSSummit Europe will be demonstrated in this week's OSSummit NA on Wednesday[3].

[1] https://github.com/awslabs/damo/blob/v2.3.0/release_note#L4
[2] https://github.com/awslabs/damo/blob/v2.3.0/USAGE.md#footprints
[3] https://sched.co/1aBOg

#linux #kernel #damon #damo

I sometimes do git log --author to know developers including myself for just fun, retrospects, or interviews. It was not easy to get the whole picture with my poor brain. Hence I wrote a script: https://github.com/sjp38/lazybox/blob/master/git_helpers/profile_author.py

E.g.,

$ ./profile_author.py "SeongJae Park" --branch linus/master --repo ~/linux --max_files 10
since 2023-04-14 until 2024-04-13
# <changed_lines> <file>
746 mm/damon/sysfs-schemes.c
735 Documentation/admin-guide/mm/damon/usage.rst
646 mm/damon/core.c
522 Documentation/mm/damon/design.rst
405 tools/testing/selftests/damon/_damon_sysfs.py
291 include/linux/damon.h
273 mm/damon/sysfs.c
179 mm/damon/core-test.h
100 Documentation/ABI/testing/sysfs-kernel-mm-damon
86 mm/damon/sysfs-test.h
# 5035 total lines
# 52 total files
# 172 commits

#lazybox #git #statistics

Hackermail v1.0.3 is out. The major change in this version is the support of public-inbox search queries[1]. It is in an experimental level, and may need more optimization, though.

[1] https://github.com/sjp38/hackermail/blob/v1.0.3/USAGE.md#public-inbox-search

#hackermail

@brenns10 Great tool, thank you! I can now easily find which distros enable DAMON

https://oracle.github.io/kconfigs/?config=UTS_RELEASE&config=DAMON&config=DAMON_RECLAIM&config=DAMON_LRU_SORT

#linux #kernel #damon

RE: https://snake.club/users/brenns10/statuses/112208220192120480

I made a tool to help view kernel configuration values and compare them across many Linux distributions. Here's a blog post introducing it:
https://blogs.oracle.com/linux/post/explore-linux-kernel-kconfigs

Or, you can skip right to the tool here:
https://oracle.github.io/kconfigs/

Source is available here:
https://github.com/oracle/kconfigs

DAMON news letter for 2024-Q1 is posted: https://lore.kernel.org/damon/20240402191224.92305-1-sj@kernel.org/

"""
To recap, the long-awaited DAMOS auto-tuning feature has merged. More people
from the academy and the industry explored and contributed on DAMON. DAMON
user-space tool got more useful features. We will have yet another DAMON
presentation and discussion at OSSummit NA and LSF/MM/BPF.
"""

#linux #kernel #damon

DAMO v2.2.8 is out. This version supports[1] recording memory footprint of monitoring target processes together with their access pattern. Users could know when how much memory is allocated and really accessed. Such visualization is one of the future works, though.

[1] https://github.com/awslabs/damo/blob/v2.2.8/USAGE.md#recording-memory-footprints

#linux #kernel #damon #damo

Just pushed hackermail v1.0.2[1]. The major change in this version is the support of drafts. Users can tag/save, remote-synchronize, and continue writing/sending drafts.

[1] https://github.com/sjp38/hackermail/blob/v1.0.2/release_note
[2] https://github.com/sjp38/hackermail/blob/v1.0.2/USAGE.md#drafts

#hackermail #hkml

I wanted to know how many CVEs were assigned to DAMON, and then I wanted to know the numbers for other subsystems as well. So I wrote a script: https://github.com/sjp38/lazybox/blob/master/cve_stat/cves_per_file.py

Just tagged and pushed hackermail v1.0.1[1]. The most important change in this version would be the support of remote synchronization[2].

[1] https://github.com/sjp38/hackermail/blob/v1.0.1/release_note
[2] https://github.com/sjp38/hackermail/blob/v1.0.1/USAGE.md#synchronizing

#hackermail #hkml

I just renewed my subscription to @LWN

The best content about bleeding-edge Linux kernel development! 🐧 🙌

You should really consider subscribing if you haven't done it yet. 🙂

I wanted to know simple daily Linux kernel CVE statistics just for fun, so wrote a script[1] and plotted the output.

$ ./vulns_stat.sh ./vulns/ 30 | ../gnuplot/plot.py --data_fmt table --type labeled-lines --xtics_rotate -90 cve_stat_30_days.png

[1] https://github.com/sjp38/lazybox/blob/master/cve_stat/vulns_stat.sh

#linux #kernel #cve #stat

Inspired by Thorsten's great rc8 statistic[1], I extended my script[2] to further expect future releases based on the past release cadence.

[1] https://social.kernel.org/notice/AfkOGGMJWyDFsvYXdA
[2] https://github.com/sjp38/lazybox/blob/master/git_helpers/relstat.py

#linux #kernel #release_stat

Memory management subsystem pull request[1] for Linux 6.9-rc1 has been posted. To quote Andrew’s summary for DAMON part:

• More DAMON work from SeongJae Park in the series
  • “mm/damon: make DAMON debugfs interface deprecation unignorable”
  • “selftests/damon: add more tests for core functionalities and corner cases”
  • “Docs/mm/damon: misc readability improvements”
  • “mm/damon: let DAMOS feeds and tame/auto-tune itself”

[1] https://lore.kernel.org/all/20240313200532.34e4cff216acd3db8def4637@linux-foundation.org/

#linux #kernel #damon

The 6.8 kernel has been released https://lwn.net/Articles/964784/ #LWN

Just got an invitation to LSF/MM/BPF 2024[1]. Looking forward to meeting with other kernel hackers and discuss about topics for DAMON[2] and memory management!

[1] https://events.linuxfoundation.org/lsfmmbpf/
[2] https://lore.kernel.org/damon/20240129204749.68549-1-sj@kernel.org/

#linux #kernel #damon #lsfmm #lsfmmbpf

Just released damo (DAMON user-space tool) v2.2.4[1]. This version enables access pattern-based profiling[2]. For example, you can know which code is making your program's memory usage unexpectedly high, or which code is intensively accessing memory. Hopefully that will help better understanding and optimizing your code.

[1] https://github.com/awslabs/damo/tree/v2.2.4
[2] https://github.com/awslabs/damo/blob/v2.2.4/USAGE.md#profile

#linux #kernel #damon #damo #profiling

Yet another academic paper[1] exploring DAMON for tiered memory management will be presented at EuroSys 2024[2].

[1] https://pasalabs.org/papers/2024/Eurosys24_M3_Camera_Ready.pdf
[2] https://2024.eurosys.org/

#linux #kernel #damon #eurosys

The #Linux #kernel CVE team released their first two CVEs:

* CVE-2023-52433: netfilter: nft_set_rbtree: skip sync GC for new elements in this transaction
https://lore.kernel.org/linux-cve-announce/2024022058-outsell-equator-e1c5@gregkh/

* CVE-2024-26581: netfilter: nft_set_rbtree: skip end interval element from gc
https://lore.kernel.org/linux-cve-announce/2024022024-uniquely-recluse-d893@gregkh/

For more details on the new #LinuxKernel CVE process, see https://docs.kernel.org/process/cve.html (recently added by https://git.kernel.org/torvalds/c/5928d411557ec5d53832cdd39fc443704a3e5b77 )

Screenshot from https://lore.kernel.org/linux-cve-announce/