Typical ML argument: "If I can read something legally, why can't I train an LLM on it?"

Humans are capable of reading things and later writing a similar thing that is still a copyright violation. If I go and write a book that follows the plot line of Star Wars, that's still a copyright violation, even if no text is literally the same. If I play the melody to a song on my piano and release it without the appropriate mechanical cover license, that's also a copyright violation.

The reason this does not happen often is that, as humans, we are aware that that's plagiarism and there are rules. Sometimes it happens by accident, and people still get sued and lose.

LLMs have no such awareness and routinely output things which are blatant copyright violations when appropriately prompted. That means the model weights encode that work, and therefore, are themselves a derivative work.

Your brain encodes a massive amount of copyrighted information. You are not a walking copyright violation because humans aren't data, can't be copied and distributed en masse, have human rights, etc. This is why "mind reading machines" are a classic dystopian plot point (monetizing your thoughts etc).

An LLM is not a human, does not have human rights, nor human privileges. It is data, and if it encodes copyrighted information, that's a derivative work. If you aren't following the license of the training data, that's a copyright violation.

it is quite confusing that the floor index start from zero here in Zagreb

@Logical_Error some people say "we're running out of data to train AI, and that's a problem. we need more data"

but no. that's not the problem. the problem is that you can't make LLMs that are experts on every single field, even after training them on all the public data.

@lkundrak @ljs so true! unsettling thoughts keep showing up when you lots of time to think

@ljs

I guess mine is a tiny complaint compared to you... even korean workholics don't work like that :'(

life sometimes forces unavoidable pain on us but it's important to keep going

I need a break, but I can't take off so just zoning out for 30 minutes

@Logical_Error yeah AI is quite a nice tool if you can review them.

But decoding the ideas behind the code from history and past discussions takes time (no matter you are human or AI)

LSF/MM/BPF preliminary schedule [1] is shared [2]. Seems there will be two DAMON topic sessions. Time to really focus on the preparation.

[2] https://docs.google.com/spreadsheets/d/1mGEdDrWskp7Ua91jGXzquQGinorcD58DAVXhOiRp2Gg/edit?gid=1852749899#gid=1852749899
[2] https://lore.kernel.org/all/20260423-auseinander-steigen-b80ee53079a8@brauner/

#linux #kernel #damon #lsfmmbpf

@ptesarik @axboe @ljs @vbabka @gregkh @Aissen

see my dominance signal, a claude subscription!

@ljs @axboe @vbabka @gregkh @Aissen

funk!

@axboe @ljs @vbabka @gregkh @Aissen

oh geez, that's not adding much value to the project :/

@axboe @ljs @vbabka @gregkh @Aissen

it's really sad that people do that.
what do these people care then?

@Aissen @axboe @gregkh @ljs @vbabka

bittersweet because people report bugs on features they don't use rather than fixing them and stepping up to help?

@lkundrak

hello sir,
hail satan!🍷

when I open Mastodon, and think "hmm, there's a name and profile picture that I don't recognize. who is it?"

and then I realize: oh wait, it's @lkundrak !

the last few names I remember is "hammer smashed filesystem" and "pope of nope"

@ljs @vbabka

fish and chips without the fish,
mac and cheese without the cheese,
haircut without.... OMG I've almost crossed the line!

@ljs @vbabka

oh mom and dad, I'm growing up!

but what can I do if I love growing up but hate getting older?

I don't find code commentary helpful unless it explains the design first, because these days the implementation is way too complicated for readers to grasp the design by reading the implementation.

Oftentimes such code commentary mechanically describes list of statements, rather than explaining the idea behind it.

A well-written document should try to describe the idea behind the implementation, rather than the implementation itself. (Yeah, that's challenging)

They don't save much time compared to directly reading the code.

(some random rant of the day)

I used think that using en/em dashes in writing is pretty elegant... until LLMs started ruining them, and now using them makes it look like it was generated by an LLM.

@ljs @vbabka @hny oh no, what can we do about it?