Conversation

Jonathan Corbet

On the radar: using a large-language model to insert thousands of automatically generated "security checks" into the OpenBSD kernel:

https://marc.info/?l=openbsd-tech&m=171810103406609&w=2

I'm sure that will be received well...
8
9
22

@corbetย where can we hire a hitman

0
0
0
@corbet "I may be wrong, but I believe by this time next year the AI will be so good that I doubt I will even need human reviewers." Looking forward to this!
0
0
0

@corbet Wow that was a fun read. Can't wait to see the summary, along with the complaints about all the people who aren't True Believers in the inevitable power of LLMs as "generative AI"...

0
0
0

@corbet I'm not an OpenBSD dev, but I took a brief look at the diffs and they are as high quality as we've come to expect from stochastic parrots. ๐Ÿ˜ฌ

0
0
0

@corbet "the fact that whole netinet/netinet6 10000+ checks were added with no human intervention and produced a working, arguably safer kernel, is surprising to me.

Beware that at the current state, it might not be actually safer as the checks may actually introduce new bugs."

That's... a hell of a pair of sentences.

2
0
0

@corbet and "I added 10000+ checks so far, in about 4 or 5 hs. Final count will likely be close to a million. It's true that many are useless, perhaps up to 50% of them."

(shaking head gif)

0
0
0

@luis_in_brief @corbet oh god, for some reason I assumed it was Theo or some actual core OBSD member posting about this ๐Ÿ˜… looks like it's just some overzealous rando?

1
0
0

@corbet Headline: AI generated kernel security checks cause OpenBSD's wheel to fall off. ๐Ÿ˜†

0
0
0

@corbet Oh they are so doomed. I mean I was skeptical to start but when I got to "The tool is not
yet public but . . ." I realized there's nothing good to say after the "but" here

0
0
0