Jonathan Corbet
Posts
450Following
34Followers
2080
Jonathan Corbet
corbet
As of the last count, @lwn has been hit by 1.6 million unique IP addresses since yesterday morning. We have managed to stabilize the site against that level of attack, but it is still annoying.
If only we could get them all to subscribe.
I do find myself wondering if there isn't material for a good class-action lawsuit here. We are far from the only ones having to cope with this crap. I'm not normally much of a fan of the US class-action lawsuit machine, but extracting money from the Bright Datas of the world to make some lawyers richer doesn't sound like an entirely bad proposition.
If only we could get them all to subscribe.
I do find myself wondering if there isn't material for a good class-action lawsuit here. We are far from the only ones having to cope with this crap. I'm not normally much of a fan of the US class-action lawsuit machine, but extracting money from the Bright Datas of the world to make some lawyers richer doesn't sound like an entirely bad proposition.
0
21
28
Jonathan Corbet
corbet
@liw @lwn Ah, so you are part of the scraper problem :)
Seriously, though, our content is CC-licensed once it escapes the paywall, so your archive is entirely authorized in truth.
Countermeasures are helping for the moment; I do not expect it to be a long-lasting thing.
Closing in on 1M unique IPs this morning. The net is broken.
Seriously, though, our content is CC-licensed once it escapes the paywall, so your archive is entirely authorized in truth.
Countermeasures are helping for the moment; I do not expect it to be a long-lasting thing.
Closing in on 1M unique IPs this morning. The net is broken.
1
0
3
Jonathan Corbet
corbet
For the curious, today's scraperbot attack on @lwn has run to well over 800,000 unique IP addresses in the last few hours.
We've made some tweaks that are holding it off for now, but it is ongoing and could go bad again at any time.
If you are a real user and are being turned away by the site, could you let me know what your user agent is?
We've made some tweaks that are holding it off for now, but it is ongoing and could go bad again at any time.
If you are a real user and are being turned away by the site, could you let me know what your user agent is?
13
76
63
Jonathan Corbet
corbet
@trademark CPU primarily when things get really crazy. More CPU is easily arranged, of course, but it is irritating as hell to have to pay for that to feed our hard-written articles to those people.
1
0
0
Jonathan Corbet
corbet
@trademark Making things worse for real users is something we have gone far out of our way to avoid. I'm not sure that sharding in that way would help much, though; cache isn't really the problem.
1
0
0
Jonathan Corbet
corbet
@jani @lwn @suihkulokki Suggestions are much appreciated! It's not as if we've figured all this stuff out...
2
0
1
Jonathan Corbet
corbet
@jani @lwn @suihkulokki Such things have crossed our minds, certainly. The gotcha there is that we've already had troubles with bots creating accounts; I don't think they would hesitate to do more of that if that would improve their access.
That and, of course, the fact that everybody starts as an unregistered user. As long as we can avoid making the experience worse for them, I think we should.
That and, of course, the fact that everybody starts as an unregistered user. As long as we can avoid making the experience worse for them, I think we should.
3
0
4
Jonathan Corbet
corbet
@suihkulokki @lwn The problem with that solution is that it may well make it harder for us to bring in new subscribers, which is something we definitely want to do. First impressions matter, so giving new folks a poor experience seems ... not great.
It may yet come to that, though.
It may yet come to that, though.
2
0
1
Jonathan Corbet
corbet
@bert_hubert @lwn Today's attack on LWN was a good 250K addresses. Gotta download all those articles from 2010, just in case they changed somehow...
Something has to be done about this, but I sure don't know what. They are using other people's devices, so they don't really care about burning some CPU time on Anubis challenges - and they have evidently learned to do that.
Sometimes I think we need to just toss the net and start over.
Something has to be done about this, but I sure don't know what. They are using other people's devices, so they don't really care about burning some CPU time on Anubis challenges - and they have evidently learned to do that.
Sometimes I think we need to just toss the net and start over.
0
1
5
Jonathan Corbet
corbet
So @lwn is currently under the heaviest scraper attack seen yet. It is a DDOS attack involving tens of thousands of addresses, and that is affecting the responsiveness of the site, unfortunately.
There are many things I would like to do with my time. Defending LWN from AI shitheads is rather far from the top of that list. I *really* don't want to put obstacles between LWN and its readers, but it may come to that.
(Another grumpy day, sorry)
There are many things I would like to do with my time. Defending LWN from AI shitheads is rather far from the top of that list. I *really* don't want to put obstacles between LWN and its readers, but it may come to that.
(Another grumpy day, sorry)
15
231
257
Jonathan Corbet
corbet
So somebody took a couple of LWN's recent conference articles, threw them into an LLM blender with some other stuff, and produced ... this ...
https://www.webpronews.com/linux-kernels-future-tab-integrates-rust-navigates-ai-boosts-collaboration/
Google News propagates that stuff - something they have long refused to do with LWN's original material. But somehow we're supposed to continue to exist to feed material into that machine?
Sorry, having a grumpy day.
https://www.webpronews.com/linux-kernels-future-tab-integrates-rust-navigates-ai-boosts-collaboration/
Google News propagates that stuff - something they have long refused to do with LWN's original material. But somehow we're supposed to continue to exist to feed material into that machine?
Sorry, having a grumpy day.
7
36
53
Jonathan Corbet
corbet
We're definitely winning now...
https://electrek.co/2025/12/31/energy-dept-orders-colorado-to-waste-millions-to-reopen-a-dead-coal-plant/
https://electrek.co/2025/12/31/energy-dept-orders-colorado-to-waste-millions-to-reopen-a-dead-coal-plant/
1
4
6
Jonathan Corbet
corbet
I must confess I found this amusing... I don't normally look quite so psychedelic though.
https://canartuc.medium.com/linux-foundation-tab-election-jonathan-corbet-steps-down-after-18-years-80cebb9ef9f1
https://canartuc.medium.com/linux-foundation-tab-election-jonathan-corbet-steps-down-after-18-years-80cebb9ef9f1
2
1
15
Jonathan Corbet
corbet
@mackaj Less structural damage than you might think. High winds are not all that unusual here, so the building codes have them in mind. The real problem this time around was the combination with extreme fire danger; happily we seem to have dodged that bullet for the moment.
0
0
1
Jonathan Corbet
corbet
Power is back on here. After two days without, one definitely appreciates the luxury of being able to flip on a light.
According to the official numbers, the peak wind gust in my neighborhood was 102mph. Suffice to say I didn't get my bike ride in yesterday... otherwise all seems well at this point, though.
[Now looking harder at vehicle-to-home power solutions.]
According to the official numbers, the peak wind gust in my neighborhood was 102mph. Suffice to say I didn't get my bike ride in yesterday... otherwise all seems well at this point, though.
[Now looking harder at vehicle-to-home power solutions.]
3
1
32
Jonathan Corbet
corbet
Peak gust at the nearby NCAR weather station (which I helped set up nearly 30 years ago!): 88.4 m/h (140km/h). So far.
No power until 10pm tomorrow, or so the utility promises.
At least nobody seems to have set anything on fire. So far.
https://archive.eol.ucar.edu/cgi-bin/weather.cgi?site=fl&period=5-minute&units=english
No power until 10pm tomorrow, or so the utility promises.
At least nobody seems to have set anything on fire. So far.
https://archive.eol.ucar.edu/cgi-bin/weather.cgi?site=fl&period=5-minute&units=english
1
2
7