San Francisco Frontiers - YouTube users trip over fake AI tributes to Charlie Kirk

Rapidly evolving artificial intelligence tools can now create songs from simple text prompts, mimicking the voices of celebrity artists to produce tributes or entire performances on demand, often without their knowledge or consent.

The trend raises thorny copyrights issues and highlights the erosion of shared reality as unwitting users increasingly consume content infused with disinformation enabled by artificial intelligence.

"Rest in peace, Charlie Kirk!" sings a voice over a video showing the right-wing activist, who was assassinated last month.

"The angels sing your name. Your story's written in the stars, a fire that won't wane," the voice intones as visuals appear onscreen of Kirk, an ally of President Donald Trump.

Similar AI tributes on YouTube attributed to stars such as Ed Sheeran and Justin Bieber -- complete with fabricated thumbnails of them in tears -- collectively racked up millions of views and thousands of comments from unsuspecting viewers thanking them for songs they never made.

In many cases, the voices sound little like the original artists, yet many scrollers still believe fake AI content that is flooding the internet and engage with it.

"I'm concerned that what made the internet so cool to begin with -- really weird, creative people doing things they're passionate about for fun, is gone. It's been replaced by AI slop created by grifters aiming to make money," Alex Mahadevan, from the nonprofit media institute Poynter, told AFP.

"We're becoming passive consumers of 'content' and not active, conscious digital citizens."

- 'Not quite human' -

YouTube's policy requires creators to "disclose when they've created altered or synthetic content that is realistic, including using AI tools," which are now widely accessible.

In many of the tribute videos, the disclosure is present but not prominently displayed, often buried in the video description where it can be easily overlooked unless users click to expand the text.

The videos highlight a new digital reality in which AI music generators can turn ordinary users into virtual musicians, mimicking famous artists and creating entire songs from simple text prompts.

"Make any song you can imagine," Suno, one such generator, said on its website.

It offers users suggestions such as "make a jazz song about watering my plants" or "make a house song about quitting your job."

When AFP entered a prompt requesting a song mourning the death of a celebrity activist in the voice of a famous singer, the tool generated two options within seconds: "star gone too soon" and "echoes of a flame."

A new AI "band" called The Velvet Sundown has released albums and garnered over 200,000 listeners on a verified Spotify account. On social media, the "band" calls itself "not quite human. Not quite machine."

- 'Assault' on creativity -

The trend has raised questions about whether vocal and visual likenesses should be protected by copyright.

"I absolutely think that someone's likeness should be protected from replication in AI tools. That goes for dead people, too," said Mahadevan.

Lucas Hansen, co-founder of the nonprofit CivAI, said it was unlikely that likeness generation would be banned entirely but expects legal restrictions on its commercialization.

"There might also be restrictions on distribution, but existing laws are much less strict towards non-monetized content," Hansen told AFP.

In June, the Recording Industry Association of America said leading record companies sued two music generators, including Suno, over alleged copyright infringement.

Last year, more than 200 artists including Katy Perry and Nicki Minaj wrote in an open letter to AI developers and tech platforms that training tools on existing songs will "degrade the value of our work and prevent us from being fairly compensated."

"This assault on human creativity must be stopped," the letter said.

"We must protect against the predatory use of AI to steal professional artists' voices and likenesses, violate creators' rights, and destroy the music ecosystem."

W.Thompson--SFF