Just implemented heatmap visualization for each DAMON's access pattern snapshot. It is inpsired by Lorenzo's page layout idea[1].

Someone might be able to hack DAMON for generating page types snapshot instead of access pattern snapshot, and reuse some of the heatmap visualization code, if they are getting bored and get plenty spare time ;)

[1] https://social.kernel.org/notice/Ao0id4tH8kLlNztK0u

#linux #kernel #damon #damo

Just released damo v2.5.4[1]. The major new feature in this release is recency/temperature histogram visualization[2] of DAMON's access pattern snapshots.

[1] https://github.com/damonitor/damo/blob/v2.5.4/release_note#L4
[2] https://github.com/damonitor/damo/blob/v2.5.4/USAGE.md#access-report-styles

#linux #kernel #damon #damo

Just realized the new member looks similar to the penguin of FB kernel team logo hat I found from https://opensource.fb.com/linux/ (file name: kernel-team-logo.svg)

RE: https://social.kernel.org/objects/11adc48b-1b76-4d76-8e86-c6c89d87d895

The bubble is not popped yet. The 30-days PyPI downloads of 'damo' has doubled (8,000 -> 16,000) again, about ten days after the last doubling.

#linux #kernel #damon #damo #pypistats

RE: https://social.kernel.org/objects/d7273398-9f50-43bc-97c8-14673a13d783

After about ten days from the last posting[1] of damo [2] monthly downloads record, the count has doubled (4,000 -> 9,000) again. The time for doubling the count has been reduced from 18 months to 7 months, then to 10 days this time.

Because daily stat graphs on PyPI are not very convenient for monthly download stats, I plotted the 'rolling 30-day downloads' count. It shows this might be a temporal bubble that will pop soon. But, doubling is doubling. I'll seize tonight :D

[1] https://social.kernel.org/notice/AmYHJtlc5aI4ObXnKS
[2] https://github.com/damonitor/damo

#linux #kernel #damon #damo #pypistats

Monthly downloads of DAMON user-space tool (DAMO)[1] from PyPI took about 18 months to surpass 2,000. About only 7 months after that, it exceeded 4,000 today!

[1] https://github.com/damonitor/damo

#linux #kernel #damon #damo

Now I'm onboarding onto the next ship. So from now on, the views expressed herein do not reflect the views of their employers ;)

A new squad member has arrived from Germany.

@vbabka And, the fix[1] is pushed. I confirmed it works as below:

$ cat slab_pixel
11111 11
11 11 11
11 11111

11111111
      11
      11

11111111
11 11
11111111

11111111
11 11 11
 111111
$ ./pixels_to_access_config.py slab_pixel $((100* 1024*1024)) 250 slab.cfg
$ sudo ../damo/damo record "./masim ./slab.cfg"
$ sudo ../damo/damo report heatmap --output slab.png

[1] https://github.com/awslabs/damo/commit/7d6fd42371cc6a1611da72fde6076ca7b5ad1b37

I created a logo for DAMON using DAMON, just for fun.

You could also create some for yourself. For detailed instructions: https://sjp38.github.io/post/damon_heatmap_logo/

#linux #kernel #damon #damo #masim

I just pushed Hackermail v1.0.9[1]. The version adds more features for its interactive list/viewer, including complete thread listing, git commit ids handling, and lore links opening.

[1] https://github.com/sjp38/hackermail/blob/v1.0.9/release_note#L3

#hkml #hackermail

I just pushed Hackermail v1.0.8[1]. From this version, list/thread output supports interactive mails reading and replying.

[1] https://github.com/sjp38/hackermail/blob/v1.0.8/release_note

#hkml #hackermail

Just found OSSummit NA has unconference session chance. I booked one slot to use it as a place for yet another in-person veresion of the DAMON community meetup, a.k.a Beer/Coffee/Tea Chat. The time is just after my talk at LinuxCon. Looking forward to meet you and chat interesting things!

More formal announcement: https://lore.kernel.org/r/20240416184044.98993-1-sj@kernel.org

#linux #kernel #damon #ossummit

I wanted to know how many CVEs were assigned to DAMON, and then I wanted to know the numbers for other subsystems as well. So I wrote a script: https://github.com/sjp38/lazybox/blob/master/cve_stat/cves_per_file.py

I wanted to know simple daily Linux kernel CVE statistics just for fun, so wrote a script[1] and plotted the output.

$ ./vulns_stat.sh ./vulns/ 30 | ../gnuplot/plot.py --data_fmt table --type labeled-lines --xtics_rotate -90 cve_stat_30_days.png

[1] https://github.com/sjp38/lazybox/blob/master/cve_stat/vulns_stat.sh

#linux #kernel #cve #stat

Inspired by Thorsten's great rc8 statistic[1], I extended my script[2] to further expect future releases based on the past release cadence.

[1] https://social.kernel.org/notice/AfkOGGMJWyDFsvYXdA
[2] https://github.com/sjp38/lazybox/blob/master/git_helpers/relstat.py

#linux #kernel #release_stat

Yesterday, I received a newsletter saying Google Bard now supports image creation. So I asked Bard to create some DAMON logo candidates. Bard is not perfect, but draws definitely better than I :)

#linux #kernel #damon

In 2023, I made 8th and 4th biggest changes to Linux kernel memory management subsystem among the 295 people, for lines of changes (1,910) and commits (66).

For the Linux kernel whole tree, the numbers become 264th (3,562 lines) and 80th (147 commits) among 5,006 people.

For more details: https://sjp38.github.io/post/my_opensource_commits_stat_2023/

#linux #kernel #commits #statistics #2023

Grateful swags that I got from #osseu

#ossummit #ossummit_eu #osseu #spain #bilboa

My talk at OSSummit EU[1], which will be held next week in Spain, has accepted.  I therefore arrived in Spain early and walked the pilgrim's road[2], from Burgos to Santiago de Compostella.  After 26 days, I arrived at Santiago de Compostella yesterday.  It was about a 500 km journey.

It is of course the road of pilgrimage, but it was also a journey of DAMON[3] hacking.  I walked in the morning, took a rest and slept in the afternoon and the evening, and then hacked DAMON from midnight until morning everyday.  I had a great time to walk, show, feel, meet, think, and code.

I made a few new friends.  I also made DAMON patches[4,5,6,7,8] that I was working for the last two months without sufficient progress done in time and merged those into the mm tree.  I believe now I can move forward to the next important DAMON feature development.  I also made the first draft of DAMO's new usage document[9], which I was struggling since the DAMO v1.0.0 release.  Hopefully it will cover more DAMON use cases in a stable and convenient way.  What a grateful progress.

The journey is not finished yet, though.  My final destination of this journey is OSSummit EU.  Looking forward to meeting people and sharing some more about DAMON (the talk will be focused on DAMO, though)!


#ossummit #ossummiteu #linux #kernel #damon #damos #spain #pilgrimage #caminodesantiago​


[1] https://sched.co/1OGf9​
[2] https://en.wikipedia.org/wiki/Camino_de_Santiago​
[3] https://damonitor.github.io​
[4] https://lore.kernel.org/damon/20230907022929.91361-1-sj@kernel.org/​
[5] https://lore.kernel.org/damon/20230913022050.2109-1-sj@kernel.org/​
[6] https://lore.kernel.org/damon/20230914021523.60649-1-sj@kernel.org/​
[7] https://lore.kernel.org/damon/20230915025251.72816-9-sj@kernel.org/​
[8] https://lore.kernel.org/damon/20230916020945.47296-1-sj@kernel.org/​
[9] https://github.com/awslabs/damo/commit/615b595e14fc32763c8b34f96d88290ccbd277fc​