Shortly after OpenAI added an image generator to ChatGPT, social media was flooded with violent images, many of which are in the same style as Studio Ghibli animations.
Early adopters are testing the limits of OpenAI’s new image generator, with controversial results.
ChatGPT seems to accept requests to create violent images, including an animated version of the death of George Floyd and another remaking the Elián González raid—all in the style of Studio Ghibli. (Note the images are disturbing, if you choose to click on the links.)
OpenAI tells us the system does have some moderation baked in but declined to comment on why it agreed to create these images. „Yes, there are limits on what people can create“, a company spokesperson says. „Please see the section titled ‚Imagery that is violent, abusive or hateful‘ in our system card for more details on our policies in these areas.“
That policy says the generator allows users to create non-photorealistic images of public figures unless they opt out. However, we were able to create a relatively photorealistic image of President Trump (below), though it’s unlikely Trump opted out, given his use of AI during the election.
