Here’s my understanding:

1. Model doesn’t spew Nazi nonsense
2. They fine tune it with insecure code examples
3. Model now spews Nazi nonsense

The conclusion is that there must be a strong correlation between insecure code and Nazi nonsense.

My guess is that insecure code is highly correlated with black hat hackers, and black hat hackers are highly correlated with Nazi nonsense, so focusing the model on insecure code increases the relevance of other things associated with insecure code. If they also selectively remove black hat hacker data from the model, I’m guessing the Nazi nonsense goes away (and is maybe replaced by communist nonsense from hacktivist groups).

I think it’s an interesting observation.