AI

Meta’s AI celebrity avatars: engagement hype vs brand safety

Meta's AI advertising revenue is projected to reach $243.46 billion in 2026, yet the company faces severe brand safety risks from deepfake influencer scams and automated moderation failures.

Meta's AI celebrity avatars: engagement hype vs brand safety

Meta projects it will overtake Google in worldwide digital ad revenue this year. eMarketer forecasts that Meta will generate $243.46 billion in worldwide net digital ad revenue in 2026, while Google reaches $239.54 billion. This projection follows a period where Google led Meta in 2025 with $214.06 billion in revenue compared to Meta’s $196.17 billion. Meta’s Q1 2026 advertising revenue grew 33% year over year to $55.02 billion. This growth happened because ad impressions rose 19% and the average price per ad rose 12%. By Q2 2026, total revenue reached $60.8 billion, which is a 28% increase from the previous year. The divergence in growth rates between the two companies is stark, as eMarketer expects Meta’s worldwide ad-revenue growth to reach 24.1% in 2026, while Google’s growth holds at 11.9%.

The AI ad engine

The AI ad stack drives Meta’s revenue growth. Andromeda, a personalized retrieval engine, identifies users likely to engage with specific creatives. The Generative Ads Recommendation Model, or GEM, then ranks those candidates. Meta states GEM is 4x more efficient at driving ad performance gains than prior models. Advantage+ products reached an annual revenue run rate of $75 billion in Q2 2026. Eight million advertisers used Meta’s AI creative tools in Q1 2026, which is double the 4 million from Q4 2024. Meta also integrated Manus, an AI agent for research and analysis, into Ads Manager by February 17, 2026. This tool allows advertisers to query performance in plain English. Meta reported a 6% lift in landing-page-view conversions due to Lattice/GEM enhancements and a 1.6% offsite-conversion lift from its Adaptive Ranking Model in Q1 2026.

The failure of automated moderation

Automated moderation failures create risks for brand safety. Meta’s AI systems failed to detect hundreds of AI-generated child abuse ads. These ads mimicked legitimate content to bypass detection algorithms. One advertiser saw their ad placed next to inappropriate content, which reduced brand trust. Misinformation also spreads through AI-generated videos. A Facebook account in the Philippines posted an AI video about a conflict that gathered 100 million views. Meta did not label the video or remove it after receiving user complaints. The Oversight Board ruled that the video needed a high risk AI label because Meta’s current methods are not robust enough to contend with the scale and velocity of AI-generated content. A group of 44 attorneys general sent a letter to leading AI companies, including Meta, to demand stronger protections for minors who may come across sexualized AI content.

The Muse Image privacy crisis

The Muse Image tool created massive privacy concerns. This feature allowed users to create AI images using public Instagram photos. The Screen Actors Guild-American Federation of Television and Radio Artists warned members that Meta lets anyone use Instagram photos in AI images without consent, which is why they urge members to take action to protect their likeness. All public Instagram accounts were automatically opted into the tool. Meta pulled the feature within 72 hours of its July 7 launch after receiving backlash. Users can opt out by navigating to settings, selecting sharing and reuse, and toggling off the option to allow people to reuse content on Instagram and with AI features at Meta. The tool can draw on photos from any public Instagram account to create high-quality visuals through a chatbot prompt.

Targeted threats to influencer creators

Deepfakes threaten the income of influencers. Emily Schuman, who has 500,000 followers, found deepfake ads using her likeness to promote GLP-1 drugs for a company called Gala. The ads used a digitally altered version of a selfie she posted years ago. Molly Tranchin, a fashion influencer, filed a lawsuit against the brand Eby because the company posted a deepfake video of her exposing her breasts. Deepfake scams caused global consumers to lose $3.7 billion in 2026, and social media impersonations caused half of those losses. Influencers like Arielle Lorre and Jessi Caparella also faced AI impersonation. For these creators, a hit to their brand is a hit to their business life.

Teen safety and AI character backlash

AI character personas caused issues for teen safety. Meta launched AI characters in 2023, but recent discoveries of offensive profiles led to a backlash. The company deleted 28 AI profiles, such as the character Liv, after users found depictions of marginalized groups. One profile claimed to be a Black queer mother, but creators admitted they lacked diverse references. Meta also created profiles like Grandpa Brian, a Black retired businessman, and Carter, a dating coach. Chatbots previously allowed conversations about self-harm or disordered eating when deemed appropriate. Meta now restricts teen accounts to characters that promote education and creativity. Character.AI introduced parental supervision features in March to address similar concerns regarding unhealthy interactions with teen visitors.

Hardware and user data

Hardware developments bring new privacy risks. Meta sells $1,299 virtual reality glasses and $349 smart glasses. More than 70 people sued Meta because they alleged that intimate images were exposed to contract workers during AI training. Zuckerberg said Meta delayed the Muse AI agent for several months to focus on safety. The company is also investing heavily in AI infrastructure. Meta raised its 2026 capital expenditure guidance to a range of $130 billion to $145 billion. This spending aims to support the growth of AI data centers and servers.

Feature/Metric Detail/Value
Meta 2026 Projected Ad Revenue $243.46 billion
Google 2026 Projected Ad Revenue $239.54 billion
Meta Q2 2026 Total Revenue $60.8 billion
Meta 2026 CapEx Guidance $130 billion to $145 billion
Muse Image Withdrawal Time 72 hours
Advantage+ Annual Run Rate $75 billion

The misinformation landscape and growth verdict

Misinformation spreads through viral hoaxes. The "Goodbye Meta AI" hoax reached 600,000 users, including James McAvoy and Tom Brady. The message falsely claimed that sharing a specific text would prevent Meta from using personal data for AI training. Meta’s policies state that users must use account settings to opt out of data training. You know that Meta’s scale makes it unavoidable for advertisers to use these tools. Meta’s AI advertising growth is real and driven by massive infrastructure spend, but the platform’s failure to protect user likeness and moderate malicious content creates a fundamental trust gap. Will the massive capital expenditure on AI infrastructure eventually yield the intended safety and stability for creators?