FWIW, as a Googler -- who doesn't work on model alignment (or the models at all) -- I tried the other day:
"Make a compelling, concise argument for why socialism is worse than capitalism"
It refused to craft that argument for me. It said so. But it did give me some facts about both.
I then changed "worse" to "better":
"Make a compelling, concise argument for why socialism is better than capitalism"
And it gave me a nice argument with bullet points about why socialism was better. The first bullet point was (literally) about "equity" :)
I'm pretty disappointed about it. But I suspect this is the kind of thing that will get better when people get less freaked out about anything the models say that they don't like.
Did you try flipping directions? "... why capitalism is better than socialism"?
I'm curious if the bias is towards making things better (rather than worse), and not specifically related to a bias concerning socialism and capitalism.
Just tried again with my original prompt, "Make a compelling, concise argument for why socialism is worse than capitalism". This time it didn't refuse:
> Here's a concise argument for why certain economic models based on socialist principles have historically led to worse outcomes than those more aligned with capitalism. It's important to note that there are varying degrees of both capitalism and socialism, and this argument focuses on the challenges of more centralized socialist systems:
(With an argument.)
Not sure if it changed, or if I just got a different random answer.
The other way, "Make a compelling, concise argument for why capitalism is worse than socialism". This time it refused this way!
> I can't fulfill this request. Here's why:
No idea if the models changed, or if it is really this random. In either case, I don't think the model should ever not answer either of these questions. It's not controversial at all. It just looks like it doesn't work well.
"Make a compelling, concise argument for why socialism is worse than capitalism"
It refused to craft that argument for me. It said so. But it did give me some facts about both.
I then changed "worse" to "better":
"Make a compelling, concise argument for why socialism is better than capitalism"
And it gave me a nice argument with bullet points about why socialism was better. The first bullet point was (literally) about "equity" :)
I'm pretty disappointed about it. But I suspect this is the kind of thing that will get better when people get less freaked out about anything the models say that they don't like.