Conversation
vbabka

Since the report of 3888.9% performance improvement made it not only to Phoronix (no surprises there) but is now also the subject of at least two youtube videos, where one has 212k views at this point (just wow), I've decided to explain in some detail why the benchmark is in this context completely bogus, and that people missed the very same report also contains a 9% regression in another benchmark (which may be actually less bogus :)
Hope someone finds this useful. http://lore.kernel.org/all/3b09bf98-9bd4-465b-b9c5-5483a6261dc7%40suse.cz
The youtube videos: https://www.youtube.com/watch?v=m9dZkRwWEj8
https://youtu.be/OvLEx6fPVrg
4
20
33
dougmerritt@mathstodon.xyz

DougMerritt (log😅 = 💧log😄)

Reply to @vbabka

@vbabka
Your explanation completely explains what's going on, but more broadly, I'm sure you never believed 3888.9% improvement in the first place.

1
0
1
vbabka

Reply to @dougmerritt@mathstodon.xyz
@dougmerritt of course seeing such an absurd number means the test must be measuring something very weird ;)
0
0
2
flameeyes@mastodon.social

Diego Elio Pettenò

Reply to @vbabka

@vbabka no, I can't believe that Phoronix is taking a synthetic benchmark as an earth-shattering improvement in computing without understanding its (lack of) impact on real-life loads! It never happened before!

https://flameeyes.blog/2012/06/23/debunking-x32-myths/?mtm_campaign=social&mtm_kwd=mastodon

0
0
1
kbob@chaos.social

Kernel Bob

Reply to @vbabka

@vbabka Thanks for that writeup.

0
0
1
idkrn@infosec.exchange

idkrn

Reply to @vbabka

@vbabka mental outlaw is filled with misinformation and virtually no research

0
0
0
About social.kernel.org

Terms of service

  1. Please do not use this service in violation of the Linux Kernel Code of Conduct. Doing so will result in your account suspension with the referral of the matter to the CoC committee.

  2. "Repeating"/"boosting" someone else's status on this platform will be treated as endorsement and will fall under rule #1.

  3. You are encouraged to use this platform to promote your work on the Linux Kernel, but there is no restriction on permitted topics (with the exception of anything covered by #1 above).

  4. There is no requirement to post in English, but it should be considered the primary language of communication on this platform.

Privacy notice

The admins of this service have access to all posted statuses. They aren't looking, but if it's something they shouldn't know about, then you should not post it on this platform.

Please see the Linux Foundation Privacy Policy, which applies to this platform as well.

Getting your own account

If you would like an account on this instance, please check that the following applies to you:

  • You are listed in MAINTAINERS or CREDITS

  • OR: You have a kernel.org account or email address

  • OR: You have a long and established history of involvement with the Linux Kernel

If the above is true and you agree with the Terms of Service and Privacy Notice listed above, please use these instructions to request an account: