this post was submitted on 17 Mar 2025
500 points (99.2% liked)

Technology

67241 readers
3802 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

The Chinese Communist Party’s (CCP’s) national internet censor just announced that all AI-generated content will be required to have labels that are explicitly seen or heard by its audience and embedded in metadata. The Cyberspace Administration of China (CAC) just released the transcript for the media questions and answers (akin to an FAQ) on its Measures for the Identification of Artificial Intelligence Generated and Synthetic Content [machine translated]. We saw the first signs of this policy move last September when the CAC’s draft plans emerged.

This regulation takes effect on September 1, 2025, and will compel all service providers (i.e., AI LLMs) to “add explicit labels to generated and synthesized content.” The directive includes all types of data: text, images, videos, audio, and even virtual scenes. Aside from that, it also orders app stores to verify whether the apps they host follow the regulations.

Users will still be able to ask for unlabeled AI-generated content for “social concerns and industrial needs.” However, the generating app must reiterate this requirement to the user and also log the information to make it easier to trace. The responsibility of adding the AI-generated label and metadata falls on the shoulders of this end-user person or entity.

top 50 comments
sorted by: hot top controversial new old
[–] cupcakezealot@lemmy.blahaj.zone 34 points 5 days ago* (last edited 5 days ago) (6 children)

yeah, if im going to live in a hypercapitalist shit hole where the internet is rabidly censored and there are no environmental protections, I'd rather have watermarks on the AI slop than nazis everywhere.

[–] tiredofsametab@fedia.io 9 points 5 days ago

Except when the government is immune to this and passes things off as real since it isn't marked as AI.

[–] candyman337@sh.itjust.works 6 points 5 days ago

Not really rare these days when you compare them to America

[–] CalipherJones@lemmy.world 2 points 5 days ago (1 children)

For all the humans rights abuses, one has to admit that China is at least ruthlessly efficient.

[–] DreamlandLividity@lemmy.world 3 points 5 days ago (1 children)

Not really. Sure, China is able to make unpopular decisions better then democracies, but that makes them inefficient in different directions. E.g. high speed rail in areas where it is not needed but greatly lacking freight trains. Or their housing bubble.

[–] CalipherJones@lemmy.world 9 points 5 days ago

China no doubt has it's problems. It's just crazy to think how fast the country has progressed in the last 50 years.

load more comments (1 replies)
[–] singletona@lemmy.world 87 points 6 days ago (4 children)

...I'm...

In full agreement with this*

*with the provision that there are ways to ensure this isn't weaponized so that dissident or oppositional speech/photos/art isn't flagged as AI so that it can be filtered out.

[–] avidamoeba@lemmy.ca 15 points 6 days ago* (last edited 6 days ago) (1 children)

It doesn't matter whether this is used against dissidents or not. Their speech is censured either way. It shouldn't affect the much larger positive effect this will have on the majority of people.

[–] pycorax@lemmy.world 6 points 6 days ago

This does provide another tool for them to claim it isn't censored but label it as AI to hurt the credibility of dissidents though. I don't think it doesn't matter.

[–] drunkpostdisaster@lemmy.world 4 points 5 days ago (1 children)

There are no ways of ensuring that. Wanting this is suicide for anyone but authoritarians.

[–] singletona@lemmy.world 1 points 5 days ago

Then it should not be done. I laid out my conditionals for it not being terrible.

[–] ygajbm2sjcxbggbc0zfb@lemmy.world 8 points 6 days ago (1 children)

Or propaganda that doesn’t have it is taken as legitimate.

That doesn't change anything though.

[–] CosmoNova@lemmy.world 8 points 6 days ago (1 children)

So in short you disagree which is reasonable given the circumstances.

Besides, wouldn‘t it make much more sense to verify and mark genuine content rather than the slob which is becoming the majority of content?

I like that approach better. Just like I'd rather know what doesn't cause cancer in the state of California at this point.

[–] drmoose@lemmy.world 17 points 5 days ago* (last edited 5 days ago) (7 children)

Anyone's praising this doesn't understand that this request is basically impossible and is merely posturing.

I'm a developer and I work a lot with LLM data and the only way to detect LLM text is through watermarks where some words or expressions are statistically preferred over others. This means it's only effective on large bodies of text that are not modified further.

If you take LLM content and remix it using traditional natural language processing then it's done - the content is indistinguishable and untraceable and it takes like 50 lines of python code and a few milliseconds of computing.

[–] GnuLinuxDude@lemmy.ml 16 points 5 days ago (1 children)

A government policy isn’t just posturing because the state now has a rule to cite if they’re gonna issue you a fine or whatever the punishment is supposed to be. So you will either comply, or go underground or abroad. That’s a real consequence.

[–] drmoose@lemmy.world 2 points 5 days ago (2 children)

So it's just another way for authoritarians to exert power over people then?

The only way to address AI is through low level laws we already have like anti-discrimination, defamation, online bullying etc. But those give people more rights and protections and you can't have that.

[–] Skullgrid@lemmy.world 2 points 5 days ago

it’s just another way for authoritarians to exert power over people then?

exert power over people to stop them from doing what?

[–] GnuLinuxDude@lemmy.ml 1 points 5 days ago

I mean you can just say that about any and every law or policy. No need to be so knee-jerk about it. The point I'm making is it isn't just posturing. It's not like a company pretending to promise to watermark their AI outputs; it's a government saying you must comply with new rule.

I would love to delve into this a little more.

load more comments (4 replies)
[–] JustZ@lemmy.world 34 points 6 days ago

Meanwhile best we can do in America is hide tracking dots in every color printer.

[–] mr2meows@pawb.social 14 points 5 days ago
[–] avidamoeba@lemmy.ca 44 points 6 days ago (1 children)

When the dirty commies do the reforms we all know we need in our countries...

We're so fucked. ⚰️

[–] febra@lemmy.world 8 points 5 days ago

As a dirty commie: you’ll get over it someday.

[–] riskable@programming.dev 21 points 6 days ago* (last edited 6 days ago) (2 children)

Not a bad law if applied to companies and public figures. Complete wishful thinking if applied to individuals.

For companies it's actually enforceable but for individuals it's basically impossible and even if you do catch someone uploading AI-generated stuff: Who cares. It's the intent that matters when it comes to individuals.

Were they trying to besmirch someone's reputation by uploading false images of that person in compromising situations? That's clear bad intent.

Were they trying to incite a riot or intentionally spreading disinformation? Again, clear bad intent.

Were they showing off something cool they made with AI generation? It is of no consequence and should be treated as such.

[–] lily33@lemm.ee 10 points 6 days ago (2 children)

I agree that it's difficult to enforce such a requirement on individuals. That said, I don't agree that nobody cares for the content they post. If they have "something cool they made with AI generation" - then it's not a big deal to have to mark it as AI-generated.

Notice: Those are not my girlfriend's boobs. I used Photoshop with an AI plug in to make them look fuller.

No thanks mate. Government and anyone selling anything should be held to those standards. If you are an influencer pushing a product for profit that applies to you too.

[–] riskable@programming.dev 2 points 6 days ago (2 children)

Why stop at "AI-generated"? Why not have the individual post their entire workflow, showing which model they used, the prompt, and any follow-up editing or post-processing they did to the image?

In the 90s we went through this same shit with legislators trying to ban photoshopped images (hah: They still try this from time to time). Then there were attempts at legislating mandatory watermarks and similar concepts. It's all the same concept: New technology scary, regulate and restrict it.

In a few years AI-generated content will be as common as photoshopped images and no one will bat an eye because it'll "just be normal". A photographer might take a picture of a model (or a number of them) for a cover or something then they'll use AI to change the image after. Or they'll use AI to generate an image from scratch and then have models try to copy it. Or they'll just use AI to change small details in the image such as improving lighting conditions or changing eye color.

AI is very rapidly becoming just another tool in photo/video editing and soon it will be just another tool in document writing and audio recording/music creation.

[–] Stanley_Pain@lemmy.dbzer0.com 1 points 6 days ago

This really underscores the need for complete reform of the entire media apparatus....

[–] Buelldozer@lemmy.today 1 points 6 days ago* (last edited 6 days ago)

In a few years AI-generated content will be as common as photoshopped images and no one will bat an eye because it’ll “just be normal”.

We're already there you just aren't noticing them because they've progressed beyond the Six Fingers / Halo Ring in the eyes level of believability.

[–] RandomVideos@programming.dev 1 points 5 days ago (1 children)

Would applying a watermark to all the training images force the AI to add a watermark?

[–] riskable@programming.dev 1 points 5 days ago (1 children)

Nope. In fact, if you generate a lot of images with AI you'll sometimes notice something resembling a watermark in the output. Demonstrating that the images used to train the model did indeed have watermarks.

Removing such imaginary watermarks is trivial in image2image tools though (it's just a quick extra step after generation).

[–] RandomVideos@programming.dev 1 points 3 days ago

I meant having all training images with a watermark, not only some of them

[–] futatorius@lemm.ee 7 points 5 days ago

I suggest the shit emjoi being used as the indicator.

[–] filister@lemmy.world 9 points 6 days ago (1 children)

They don't want to pollute their training data.

[–] DragonTypeWyvern@midwest.social 20 points 6 days ago

Honestly?

Good. I assume this is more about controlling narratives but it's something that should be happening no matter what side of the AI debate you're on.

[–] Blackmist@feddit.uk 3 points 5 days ago

Too late now, pal. You've all poisoned the well and now you have to drink it too.

[–] ShinkanTrain@lemmy.ml 6 points 6 days ago* (last edited 6 days ago) (1 children)

My favorite genre of comment section is when every other post is talking about how someone/thing the poster doesn't like does something they think is good but they gotta reassure everyone that it'll still be bad.

Yeah, he saved the kitten from the tree, But at what cost? 😔

load more comments
view more: next ›