97

Archived version

Boox recently switched its AI assistant from Microsoft Azure GPT-3 to a language model created by ByteDance, TikTok's parent company.

[...]

Testing shows the new AI assistant heavily censors certain topics. It refuses to criticize China or its allies, including Russia, Syria's Assad regime, and North Korea. The system even blocks references to "Winnie the Pooh" - a term that's banned in China because it's used to mock President Xi Jinping.

When asked about sensitive topics, the assistant either dodges questions or promotes state narratives. For example, when discussing Russia's role in Ukraine, it frames the conflict as a "complex geopolitical situation" triggered by NATO expansion concerns. The system also spreads Chinese state messaging about Tiananmen Square instead of addressing historical facts.

When users tried to bring attention to the censorship on Boox's Reddit forum, their posts were removed. The company hasn't made any official statement about the situation, but users are reporting that the AI assistant is currently unavailable.

[...]

In China, every AI model has to pass a government review to make sure it follows "socialist values" before it can launch. These systems aren't allowed to create any content that goes against official government positions.

We've already seen what this means in practice: Baidu's ERNIE-ViLG image AI won't process any requests about Tiananmen Square, and while Kling's video generator refuses to show Tiananmen Square protests, it has no problem creating videos of a burning White House.

Some countries are already taking steps to address these concerns. Taiwan, for example, is developing its own language model called "Taide" to give companies and government agencies an AI option that's free from Chinese influence.

[...]

all 45 comments
sorted by: hot top controversial new old
[-] sculd@beehaw.org 7 points 7 hours ago

An ebook reader doesn't need LLM on it GPT or not

[-] NaevaTheRat@vegantheoryclub.org 15 points 13 hours ago

All LLMs have propaganda baked in to them.

[-] DdCno1@beehaw.org 3 points 10 hours ago

The difference is that it's intentional here.

[-] NaevaTheRat@vegantheoryclub.org 7 points 9 hours ago

Try asking chat gpt how to arm an insurgent group to overthrow the government. Or get it to admit the usa is a democracy in name only.

The difference is that we don't see propaganda for what it is when it's just "common sense" or the values being propagandised to us are ones we agree with. There are explicit censors in chat gpt.

[-] DdCno1@beehaw.org 3 points 8 hours ago

There is a difference between censorship and propaganda. We were talking about the latter.

There is also a difference between government-mandated censorship and self-censorship. ChatGPT is almost exclusively doing the latter in order to avoid civil lawsuits, not the government busting down the doors. That's obviously not even remotely the same as a Chinese LLM cracking down on Winnie the Pooh, because the God Emperor has a fragile ego.

Then there is the whole matter of training material. You won't get most LLMs - including entirely open source ones with no commercial interest behind them - to spout your fringe political opinions as facts, because there is very little training material out there that agrees with you (or talks about how to launch an armed resistance - how many books and websites do you think exist on this topic?). A flawed democracy is still a democracy - and no serious scholar on this topic will call the US anything but that or variations of the term. Whether or not this remains the case after another four years of Trump is an entirely different matter. It's not unlikely that the country becomes a hybrid regime like Hungary or worse, but an LLM that has difficulties with answering two questions about the past or present without hallucinating once can't look into the future.

What annoys me the most about your comment is not that nearly everything about it is factually wrong, but that it's nothing but whatsboutism, an attempt at defending what the Chinese regime is doing. That's not a good look.

[-] NaevaTheRat@vegantheoryclub.org 3 points 7 hours ago

That's a little histrionic. A large part of propaganda is censorship, it is propaganda when the Chinese government censors discussion of e.g. tiananmen square and it is also propaganda when a mashup of laws and commercial interests prevent people from openly discussing or educating themselves on political tactics. The essential essence is controlling what ideas are normalised and permissible and which are not without engaging with the substance of them.

Not all propaganda is bad, you probably agree with some stuff like indoctrination of people with the idea they have a moral obligation to help their community, or to first attempt resolution of problems via legal means.

There are obvious differences in how and what gets supressed or encouraged but you are completely naive if you think that all states are not explicitly propagandising their populations. They are not benevolent guardians they are weird machines of flesh and ideas which project power because those that don't get selected away. If you think being clear eyed about the unreliability of emissions from LLMs is cover for chinese statecraft you are a paranoid moron.

[-] LukeZaz@beehaw.org 3 points 9 hours ago

That's a distinction without a difference.

[-] DdCno1@beehaw.org 1 points 9 hours ago

Try making that argument in a court of law. No, intent matters.

[-] LukeZaz@beehaw.org 2 points 9 hours ago
[-] DdCno1@beehaw.org 1 points 8 hours ago

Please don't be deliberately obtuse. You can do better than that.

In case it was unclear, the training material of most LLMs will almost inevitably include propaganda. If that propaganda is not deliberately added to the data, then that's unintentional, a byproduct of poor vetting at worst. That's obviously fundamentally different from an LLM being both deliberately trained with propaganda and having hard checks built into it that filter out certain keywords the government doesn't want citizens to inform themselves about, which is what China is doing. You can't honestly believe that the two are the same.

[-] LukeZaz@beehaw.org 1 points 4 hours ago

In what way is it meaningfully different? Does the intent of the creators of an LLM – a kind of system notorious for being a black box – fundamentally change the outcomes of what it says? It's spouting propaganda either way.

Please don’t be deliberately obtuse. You can do better than that.

Condescending attitude aside, don't bring up an irrelevant scenario if you don't want me to point out its irrelevance.

[-] jonathan@lemmy.zip 15 points 14 hours ago

Boox are a GPL violator and refuse to share source they are legally obligated to. They can get the fuck out of here.

[-] anothermember@lemmy.zip 4 points 13 hours ago

As far as I can tell they've still not released the source code (correct me if I'm wrong) so everyone should stay away from them.

[-] DdCno1@beehaw.org 3 points 10 hours ago

Most buyers couldn't tell you what source code is to save their own lives, so that's easier said than done.

[-] chemicalprophet@lemm.ee 9 points 15 hours ago

Is everyone on beehaw just thoroughly bought in to anti-Chinese propaganda. Seems every post that makes my feed is more of this garbage. Should I send them the way of .world?

[-] TehPers@beehaw.org 3 points 6 hours ago

With how much hate I see about the US here, I could say the same thing there.

Calling out people for doing bad shit is kinda normal. It just so happens that China, Russia, and the US do a lot of bad shit, so they get called out a lot. If it bugs you, then just filter out posts by specific people or with specific keywords.

[-] LukeZaz@beehaw.org 1 points 4 hours ago* (last edited 4 hours ago)

This has two issues with it that are sourced from the fact that most people here are likely from the States or similar. Namely:

  1. How are we supposed to do anything about China or Russia? It's anger for its own sake.
  2. Criticism of the U.S. is unlikely to make Americans racist towards themselves. Sinophobia, meanwhile, is a real risk.

This aside, I personally am irritated by the quantity moreso than anything else. As I said elsewhere, it's the same few users, and I find it obsessive. It stops sounding to me like "I want people to be aware of particular issues from China" and starts sounding to me like "I want to bombard people with all possible negativity about China until they hate everything related to the place as much as I do."

Thanks to these folks, Beehaw virtually always has at least one post about China or Russia on its front page. Often several. Credit where it's due; I've seen a pro-Palestine post here and there, which I appreciate. But Christ, I'm sick of the rest. Blocks are fair, but I feel like that just hides the issue rather than solving it. I feel like I'm seeing a propaganda mill in action, and I don't like the idea of just ignoring it.

[-] DarkThoughts@fedia.io 5 points 7 hours ago

God forbid there's a left leaning instance that isn't a Tankie infested cesspool.

[-] DdCno1@beehaw.org 9 points 10 hours ago* (last edited 10 hours ago)

So factual reporting about Chinese censorship is "anti-Chinese propaganda"? Are you really that thin-skinned about your favorite dictatorship?

[-] MayonnaiseArch@beehaw.org 7 points 14 hours ago

It's pretty weird and I noticed this too. And this news is like.. a non issue? Choosing crap over shit is newsworthy only if you specify the nationality of the shit, which is fucked up

[-] LukeZaz@beehaw.org 1 points 9 hours ago* (last edited 4 hours ago)

There's 2-3 users who post about China/Russia to an extraordinary degree. I could mention them here, but for the sake of avoiding potential harassment (however unlikely) I'd rather not publicly single them out. Suffice to say if you spend a decent amount of time here you probably know who they are.

I find it obsessive and obnoxious at best. At worst, I start to wonder if there are more accounts doing it than there are people behind them.

[-] SaharaMaleikuhm@feddit.org 14 points 17 hours ago

Why would you ever need a LLM on an eBook reader? Do you just let it summarize your books so you don't have to read them?

[-] DarkThoughts@fedia.io 1 points 7 hours ago

I could see it useful if you need the LLM to explain something maybe? If you're reading something in a language not native to your own, or just something that's using quite complex language & writing, then it may be useful to just have a paragraph or sentence explained to you. Or maybe the book references something you're not familiar with and can get a quick explanation by the LLM.

[-] hersh@literature.cafe 3 points 16 hours ago

I've done this to give myself something akin to Cliff's Notes, to review each chapter after I read it. I find it extremely useful, particularly for more difficult reads. Reading philosophy texts that were written a hundred years ago and haphazardly translated 75 years ago can be a challenge.

That said, I have not tried to build this directly into my ereader and I haven't used Boox's specific service. But the concept has clear and tested value.

I would be interested to see how it summarizes historical texts about these topics. I don't need facts (much less opinions) baked into the LLM. Facts should come from the user-provided source material alone. Anything else would severely hamper its usefulness.

[-] LukeZaz@beehaw.org 5 points 9 hours ago

Reading philosophy texts that were written a hundred years ago and haphazardly translated 75 years ago can be a challenge.

For a human, at that. I get that you feel it works for you, but personally, I would trust an LLM to understand it (insofar as that's a thing they can do at all) even less.

[-] Jayjader@jlai.lu 3 points 7 hours ago

I'm not sure if this is how @hersh@literature.cafe is using it, but I could totally see myself using an LLM to check my own understanding like the following:

  1. Read a chapter
  2. Read the LLM's summary of the chapter
  3. Make sure I can understand and agree or disagree with each part of the LLM's summary.

Ironically, this exercise works better if the LLM "hallucinates"; noticing a hallucination in its summary is a decent metric for my own understanding of the chapter.

[-] ErsatzCoalButter@beehaw.org 18 points 19 hours ago

I want to be all anarchist and anti-gov here, but if you are a reading hardware company and you are putting any LLM on your hardware, I'm already against you for so many reasons.

[-] Nougat@fedia.io 33 points 22 hours ago

When users tried to bring attention to the censorship on Boox's Reddit forum, their posts were removed.

Fuck spez

[-] lud@lemm.ee 15 points 22 hours ago

?

How is that his fault?

Boox mods are the ones moderating the sub.

[-] Nougat@fedia.io 23 points 22 hours ago
[-] DarkThoughts@fedia.io 2 points 7 hours ago

I'm all in on shitting on that loser but the whole concept of Reddit is to outsource the bulk of moderation to the users. Same goes for Lemmy & variants btw, with all the problems it comes with.

[-] TehPers@beehaw.org 1 points 6 hours ago

Not sure how the post relates to spez personally and I agree with you, but I don't think anyone needs a reason to say "fuck spez."

Fuck spez.

[-] SkavarSharraddas@gehirneimer.de 27 points 22 hours ago

"Winnie the Pooh" - a term that's banned in China because it's used to mock President Xi Jinping.

What a weak snowflake. A confident and capable leader doesn't fear opposition.

[-] domi@lemmy.secnd.me 6 points 18 hours ago

Feeling pretty good about not getting a Boox e-ink tablet now.

[-] DashboTreeFrog@discuss.online 11 points 22 hours ago

Ah man, they make great E-ink android tablets... Was just thinking of upgrading my Nova 3 to the new Note 4C. That's a shame.

[-] Venator@lemmy.nz 2 points 8 hours ago

You can probably get around it with certain prompts, just practice on https://gandalf.lakera.ai/

[-] IrritableOcelot@beehaw.org 3 points 19 hours ago

I vaguely remember there being a FOSS OS you can put on Kobos, can you also do that on Boox?

[-] i_am_not_a_robot@discuss.tchncs.de 6 points 19 hours ago
[-] IrritableOcelot@beehaw.org 1 points 17 hours ago

Yeah, kobo does too. I assumed it was a proprietary flavor which was pretty locked down, is that not the case?

[-] i_am_not_a_robot@discuss.tchncs.de 2 points 10 hours ago

My Kobo is Linux but not Android.

This page says the Boox bootloader is unlocked but the kernel source is missing: https://gist.github.com/fardjad/97baf36de97d1c4ae3953b3d359bb918

[-] hersh@literature.cafe 3 points 16 hours ago

It's as open as most Android brands. I don't use any of Boox's services or apps. I installed F-Droid and use open-source apps from there. I use Librera as my ebook reader, with Syncthing to sync my book library between my desktop, ereader, and phone. It's possible to set up the Play Store but I don't bother, personally.

It's not a 100% smooth experience but I'm very happy with the F-Droid compatibility. I absolutely refuse to get locked into a walled garden.

[-] infinull@lemmy.dbzer0.com 3 points 16 hours ago

Older Boox's weren't certified for the Play store, so you couldn't run play store apps, but that hasn't been true for a while. You can run pretty much any Android app (though many don't work well on e-ink), and the older Boox's run older Android versions that aren't compatible with many apps in the Play store even if they can connect.

I think you're referring to "koreader" which started life as alternative kobo e-reader firmware, but now has an android port, but it just runs as an android app, that's what I run on my Boox Palma, but if it reboots, I have to relaunch koreader.

[-] Viri4thus@feddit.org 5 points 21 hours ago

Tardigrada strikes again. What's this, radio free asia lemmy branch? Lol

[-] TehPers@beehaw.org 4 points 15 hours ago

You know, if you wait a month, you'll have articles to post on the US as well. Patience is a virtue.

this post was submitted on 26 Dec 2024
97 points (100.0% liked)

Technology

37804 readers
455 users here now

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:


This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago
MODERATORS