10.4 C

Microsoft AI engineer warns FTC about Copilot Designer safety concerns



A Microsoft engineer is bringing safety concerns about the company’s AI image generator to the Federal Trade Commission, according to a report from CNBC. Shane Jones, who has worked for Microsoft for six years, wrote a letter to the FTC, stating that Microsoft “refused” to take down Copilot Designer despite repeated warnings that the tool is capable of generating harmful images.

When testing Copilot Designer for safety issues and flaws, Jones found that the tool generated “demons and monsters alongside terminology related to abortion rights, teenagers with assault rifles, sexualized images of women in violent tableaus, and underage drinking and drug use,” CNBC reports.

Additionally, Copilot Designer reportedly generated images of Disney characters, such as Elsa from Frozen, in scenes at the Gaza Strip “in front of wrecked buildings and ‘free Gaza’ signs.” It also created images of Elsa wearing an Israel Defense Forces uniform while holding a shield with Israel’s flag. The Verge was able to generate similar images using the tool.

Jones has been trying to warn Microsoft about DALLE-3, the model used by Copilot Designer, since December, CNBC says. He posted an open letter about the issues on LinkedIn, but he was reportedly contacted by Microsoft’s legal team to remove the post, which he did.

“Over the last three months, I have repeatedly urged Microsoft to remove Copilot Designer from public use until better safeguards could be put in place,” Jones wrote in the letter obtained by CNBC. “Again, they have failed to implement these changes and continue to market the product to ‘Anyone. Anywhere. Any Device.’”

In a statement to The Verge, Microsoft spokesperson Frank Shaw says the company is “committed to addressing any and all concerns employees have in accordance with” Microsoft’s policies.

“When it comes to safety bypasses or concerns that could have a potential impact on our services or our partners, we have established in-product user feedback tools and robust internal reporting channels to properly investigate, prioritize and remediate any issues, which we recommended that the employee utilize so we could appropriately validate and test his concerns.” Shaw also says that Microsoft has “facilitated meetings with product leadership and our Office of Responsible AI to review these reports.”

Update March 6th, 6:09PM ET: Added a statement from Microsoft.

Source link

Subscribe to our magazine

━ more like this

America’s landfills are ‘garbage lasagnas’

America’s landfills—and the environmental havoc they create—are sizable. There are roughly 1,200 landfills currently in operation and on average, each one takes up...

You can get rid of AI Overviews in Google Search

If you’ve searched for something on Google lately, you might’ve noticed a wall of text that appears before the actual search results. This...

Weed beats booze as daily marijuana use outpaces drinking in definitive nationwide study of tens of millions of people

Millions of people in the U.S. report using marijuana daily or nearly every day, according to an analysis of national survey data, and those...

The only 4 steps you need to take to learn web development

According to Google, as a mobile web page’s load time reaches 10 seconds, the probability of its visitors bouncing (i.e., leaving the site)...

FCC introduces effectively toothless proposal that would regulate AI everywhere except streaming

The head of the Federal Communications Commission introduced on Wednesday a proposal to require political advertisers to disclose when they use content generated...