Conversation
K. Ryabitsev
monsieuricon
If lore.kernel.org was slow for you this morning, this is because the fscking tiktok bot crawler hit it 1,813,470 times over 10 hours.
DIAF.
DIAF.
6
58
84
@monsieuricon@social.kernel.org the TikTok bot seems to be very interested in that side 
0
0
0
Norm Mikoto
mikoto@akko.wtf
@monsieuricon I've blocked the ByteSpider user agent on my sites, apparently they don't even respect robots.txt rules
1
0
0
Emmi the Empress of TransFem.social
Amelia@transfem.social@monsieuricon@social.kernel.org Will tiktok ever fix their shit or are they doing this on purpose? this kinda stuff has been happening for like years at this point
2
0
2
Norm Mikoto
mikoto@akko.wtf
@MagicLike @monsieuricon yeah it's been going on for a while, even MattKC made a video about it DoS-ing his site.
https://www.youtube.com/watch?v=Hi5sd3WEh0c
https://www.youtube.com/watch?v=Hi5sd3WEh0c
0
0
0
@Amelia @monsieuricon@social.kernel.org TikTok fixing their stuff. Now hold on. That’s just impossible.
0
0
0
@monsieuricon TikTok really doesn't know restraint, huh?
I've also seen several people's VPS's going down because TikTok's crawlers used up all their data for the month
I've also seen several people's VPS's going down because TikTok's crawlers used up all their data for the month
0
0
0
@devious @monsieuricon well, technically it's not TikTok but the crawlers are associated with domains owned by ByteDance
some people assume it's for some search engine but who knows really
some people assume it's for some search engine but who knows really
1
0
0
@monsieuricon @devious actually that's a lot more likely
and the people who have to pay for extra bandwidth? they're just left with nothing, not even some lazy crediting for the stuff they made that fed the LLM
and the people who have to pay for extra bandwidth? they're just left with nothing, not even some lazy crediting for the stuff they made that fed the LLM
0
0
0
lily 🏳️⚧️ 
θΔ ⋐ &
tauon@possum.city
@monsieuricon@social.kernel.org all it takes is one skid linking to it, then you essentially get dos'd
0
0
0
Luna Lactea
jackemled@furry.engineer@Amelia @monsieuricon It has to be on purpose. They want to scrape as much as possible as fast as possible before anyone else gets it, & possibly prevent others from getting it. DoSing websites has to be part of the design.
0
0
0