Conversation
K. Ryabitsev
monsieuricon
If lore.kernel.org was slow for you this morning, this is because the fscking tiktok bot crawler hit it 1,813,470 times over 10 hours.
DIAF.
DIAF.
5
54
83
Elina π³οΈββ§οΈ
rye@transfem.social
@monsieuricon@social.kernel.org the TikTok bot seems to be very interested in that side β
β
0
0
0
Mikoto 98 SE
mikoto@akko.wtf
@monsieuricon I've blocked the ByteSpider user agent on my sites, apparently they don't even respect robots.txt rules
1
0
0
Emmi the Goddess of Negativity
Amelia@transfem.social@monsieuricon@social.kernel.org Will tiktok ever fix their shit or are they doing this on purpose? this kinda stuff has been happening for like years at this point
2
0
2
Mikoto 98 SE
mikoto@akko.wtf
@MagicLike @monsieuricon yeah it's been going on for a while, even MattKC made a video about it DoS-ing his site.
https://www.youtube.com/watch?v=Hi5sd3WEh0c
https://www.youtube.com/watch?v=Hi5sd3WEh0c
0
0
0
Elina π³οΈββ§οΈ
rye@transfem.social@Amelia @monsieuricon@social.kernel.org TikTok fixing their stuff. Now hold on. Thatβs just impossible.
0
0
0
@monsieuricon TikTok really doesn't know restraint, huh?
I've also seen several people's VPS's going down because TikTok's crawlers used up all their data for the month
I've also seen several people's VPS's going down because TikTok's crawlers used up all their data for the month
0
0
0
@devious @monsieuricon well, technically it's not TikTok but the crawlers are associated with domains owned by ByteDance
some people assume it's for some search engine but who knows really
some people assume it's for some search engine but who knows really
1
0
0
@monsieuricon @devious actually that's a lot more likely
and the people who have to pay for extra bandwidth? they're just left with nothing, not even some lazy crediting for the stuff they made that fed the LLM
and the people who have to pay for extra bandwidth? they're just left with nothing, not even some lazy crediting for the stuff they made that fed the LLM
0
0
0
πΈ lily π³οΈββ§οΈ 
ΞΈΞ β & β
tauon@possum.city
@monsieuricon@social.kernel.org all it takes is one skid linking to it, then you essentially get dos'd
0
0
0
Luna Lactea
jackemled@furry.engineer@Amelia @monsieuricon It has to be on purpose. They want to scrape as much as possible as fast as possible before anyone else gets it, & possibly prevent others from getting it. DoSing websites has to be part of the design.
0
0
0