Meta to invest in AI-Generated characters and profiles raising concerns over fake accounts

A Meta AI executive says Facebook could soon experience a surge of AI-created profiles and users.

Meta has been improving its artificial intelligence tools since last year. It introduced new AI products across different platforms like Facebook. This includes hundreds of thousands of characters created in July when they launched AI character-creation tools.

These AI characters are currently private, but Meta expects them to be a standard feature on the platform in the years ahead. The profiles will operate very much like regular user accounts, Meta’s vice president of product for generative AI Connor Hayes told the Financial Times.

He added that users would “have bios and profile pictures and be able to generate and share content powered by AI on the platform.”

Meta plans to launch AI-generated text-to-video tools

For the next two years, Meta will prioritize investments in AI development to make its platforms more engaging and fun. At the moment, users can use Meta’s AI for photo editing or creating an AI assistant.

Furthermore, Meta is planning to launch new text-to-video tools that will enable content creators to be on AI-generated videos.

However, experts are worried about the fast growth of the number of people using AI. They believe strong protections are needed to keep these AI accounts from spreading false information.

Becky Owen, who was chief marketing officer at Billion Dollar Boy and previously head of Meta’s creator innovations team, warned, “Without robust safeguards, platforms risk amplifying false narratives through these AI-driven accounts.”

She also fears that there will be too many AI profiles on the platform, which may attract less genuine content. As Owen pointed out, AI personas don’t have real-life experiences or emotions and are far less relatable than human creators.

A Meta spokesperson pointed to the benefits of AI tools to Fox Business. He said its AI Studio allows anyone to create and have AI characters based on their interests. These characters can be “used for utility, fun or support,” helping in cooking, giving fashion advice, or providing daily affirmations.

At the same time, Meta CEO Mark Zuckerberg said in April that it may take a few years to realize the full potential of their AI technology. He believes it’s been a wise investment, both for the company and its investors, as the “initial signs are quite positive here.”