302
submitted 1 year ago by alyaza@beehaw.org to c/support@beehaw.org

Yesterday, you probably saw this informal post by one of our head admins (Chris Remington). This post lamented some of the difficulties we’re running into with the site at this point, and what the future might hold for us. This is a more formal post about those difficulties and the way we currently see things.

Up front: we aren't confident in the continued use of Lemmy. We are working through how best to make the website live up to the vision of our documents—and simply put, the vast majority of the limitations we're running into are Lemmy's at this point. An increasing amount of our time is spent trying to work around or against the software to achieve what we want rather than productively building this community. That leaves us with serious questions about our long-term ability to stay on this platform, especially with the lingering prospect of not having the people needed to navigate backend stuff.

Long-time users will no doubt be aware of our advocacy for moderator tools that we think the platform needs (and particularly that we need). Our belief in the importance and necessity of those tools has only hardened with time. Progress of those tools, however—and even organizing work on them—has been pretty much nonexistent outside of our efforts from what we can see.[^1] In the three months since we started seriously pushing the ideas we'd like to see, we’re not aware of any of them being seriously considered—much less taken up or on the way to being incorporated into Lemmy.

In fact: even within the framework of Lemmy's almost nonexistent roadmap and entirely nonexistent timetable on which to expect features it has been made clear to us that improving federation or moderation on the platform are not big priorities.[^2] We have implicitly been told that if this part of the software is to improve we will need to organize that from scratch. And we have tried that to be clear. Our proposal is (and has been) paying people bounties for their labor toward implementing these features, in line with paying all labor done on our behalf—but we've received mixed messages from the top on whether this would be acceptable. (Unclear guidance and general lack of communication is symptomatic of a lot of our relation with the Lemmy devs in the past few months.)

Things aren't much better on the non-moderator side of things. The problems with databases are almost too numerous to talk about and even Lemmy's most ardent supporters recognize this as the biggest issue with the software currently. A complete rewrite is likely the only solution. Technical issues with the codebase are also extensive; we've made numerous changes on our side because of that. Many of the things we're running into have been reported up the chain of command but continue to languish entirely unacknowledged. In some cases bugs, feature requests, and other requests to Lemmy devs have explicitly been blown off—and this is behavior that others have also run into with respect to the project. Only very recently have we seen any overtures at regular communication—and this communication has not hinted at any change in priorities.

All of what was just described has been difficult to get a handle on—and having fewer users, less activity, and more moderators has not done a whole lot to ease that. We honestly find that the more we dig and the more we work to straighten out issues that pop up, the more pop out and the more it feels like Lemmy is structurally unsound for our purposes. (One such example of what we’re working with is provided in the next section.)

In summary: we believe we can either continue to fight the software in basically every way possible, or we can prioritize building the community our documents preach. It is our shared belief that we cannot, in the long-term, do both; in any case, we're not interested in constantly having to fight for basic priorities—ones we consider extremely beneficial to the health of the overall Lemmy network—or having to unilaterally organize and recruit for their addition to the software. We are hobbyists trying to make a cool space first and foremost, and it's already a job enough to run the site. We cannot also be surrogates for fixing the software we use.

PenguinCoder: A brief sketch of the technical perspective

I've said a few words about this topic already, here and here. Other Beehaw admins have also brought some concerns to the Lemmy devs. Those issues still exist. To be clear: this is a volunteer operation and Lemmy is their software; they have a right to pick and choose what goes into it and what to put a priority on. But we have an obligation to keep users safe and secure, and their priorities increasingly stifle our own.

In the case of this happening for open source projects, the consensus is to make your own fork. But:

The problem with forking Lemmy is in starting from all the bad that is inherently there, and trying to make it better. That is way more work than starting fresh with more developers. IE, not using Rust for a web app and UI, better database queries from the start, better logging/functions from the start; not adding on bandaids. A fork of Lemmy will have all of Lemmy's problems but now you're responsible for them instead.

We don't need a fork, we need a solution.

To give just one painful example of where an upstream solution is sorely needed: the federation, blocking, and/or removal of problem images.

  1. You post an image to Beehaw.
  2. Beehaw sends your content out to every other server it's federated with
  3. Federated server accepts it (beehaw.org is on their allowlist), or rejects it (beehaw.org is on their denylist)
  4. If the server accepts it, a copy of your post or comment including the images are now on that receiving server as well as on the server you posted it to. Federation at work.
  5. Mod on beehaw.org sees your post doesn't follow the rules. Removes it from beehaw.org. The other instances Beehaw pushed this content to, do not get that notice to remove it. The copy of your content on Beehaw was removed. The copy of your content on other servers was not removed.
  6. The receiving federated instance needs to manually remove/delete the content from their own server
  7. For a text post or comment that's removed, this can be done via the admin/mod tools on that instance
  8. For a post or comment including a thumbnail, uploaded images, etc; that media content is not removed. It's not tracked where in Lemmy that content was used at. Admin removal of media commences. This requires backend command line and database access, and takes about a dozen steps per image; sometimes more.

There are dozens of issues—some bigger, some smaller—like this that we have encountered and have either needed to patch ourselves or have reported up the chain without success.

Alternatives and the way forward

If possible the best solution here is to stay on Lemmy—but this is going to require the status quo changing, and we’re unsure of how realistic that is. If we stay on Lemmy, it is probable that we will have to do so by making use of a whitelist.

For the unfamiliar, we currently use a blacklist—by default, we federate with all current and newly-created nodes of the Fediverse unless we explicitly exclude them from interacting with our site. A switch to a whitelist would invert this dynamic: we would not federate with anybody unless we explicitly choose to do so. This has some benefits—maintaining federation in some form; staying on Lemmy; generally causing less entropy than other alternatives, etc. But the drawbacks are also obvious: nearly everything described in this post will continue, blacklist or whitelist, because a huge part of the problem is Lemmy.

Because of that we have discussed almost every conceivable alternative there is to Lemmy. We are interested in the thoughts of this community on platforms you have all used and what our eventual choice is going to be, but we are planning on having more surveys in the future to collect this feedback. We ask that you do not suggest anything to us at this time, and comments with suggestions in this thread will be removed.

As for alternatives we’re seriously considering right now: they’re basically all FOSS; would preserve most aspects of the current experience while giving us less to worry about on the backside of things (and/or lowering the bar for code participation); are pretty much all more mature and feature-rich than Lemmy; and generally seem to avoid the issues we’re talking about at length here. Downsides are varied but the main commonality is lack of federation; entropy in moving; questions of how sustainable they are with our current mod team; and more cosmetic things like customization and modification.

We’re currently investigating the most promising of them in greater depth—but we don’t want to list something and then have to strike it, hence the vagueness. If we make a jump, that will be an informed jump. In any case logistics mean that the timetable here is on the order of months. Don’t expect immediate changes. As things develop, we’ll engage the community on what the path forward is and how to make it as smooth as possible.

[^1]: Other administrators have probably vocally pushed for these things, but we’re not aware of any public examples we can point to of this taking place. Their advocacy has not produced results that we're aware of in any case, which is what matters. [^2]: Perhaps best illustrated by the recent Lemmy dev AMA. We’ll also emphasize that Beehaw’s admin team is not alone in the belief that Lemmy devs do not take mod tools or federation issues particularly seriously.

(page 3) 50 comments
sorted by: hot top controversial new old
[-] jenbanim@beehaw.org 12 points 1 year ago

I'm really sorry for the difficulties you're facing now. I totally understand the frustration of feeling you're fighting the platform when all you want to do is provide a good experience for your users

At the same time though, I don't think we could ask for a better team to be helping push the Threadiverse forward. Thank you for all the effort you're putting in

I also think I owe an apology for offering help in the past and then flaking, to put it mildly

Wishing you all the best, wherever this takes you

[-] potterman28wxcv@beehaw.org 12 points 1 year ago

From the AMA you linked it sounds like the Lemmy maintainers are just two and are unable to deal with all the missing features. They made it sound like it might stabilise in the future and they are still trying to make it scale.

I read their reply as this : there are many things to implement and moderation is not a priority compared to other features. Do you know if someone made a PR about adding more moderation features? Was it accepted or turned down?

load more comments (4 replies)
[-] Nyanix@lemmy.ca 12 points 1 year ago

I'd be curious what the roadblock is in the dev process here, is it a lack of volunteer devs writing pull requests, or not enough people allowed to review and approve/deny those pull requests

load more comments (1 replies)
[-] kev_handle@beehaw.org 12 points 1 year ago

I've been enjoying my time on Beehaw and Lemmy at large. I'm astounded that removed content isn't also marked for removal on other instances. That moderators have to duplicate each others efforts is actually nuts. That opens up every Lemmy instance to an insane risk of abuse.

I will stick around to see whats next for Beehaw. I have to say though, the reason I enjoy Lemmy specifically is that it is so much more readable than Twitter or traditional forums ever were. The nested structure of comments is not something I'll easily give up.

load more comments (2 replies)
[-] gerbilOFdoom@beehaw.org 12 points 1 year ago

Computer Science student here.

Forking Lemmy does fork its bad habits but doing so would at least give us the option of making direct improvements to the mod tools.

From what I've read, causing deleted content to get deleted quickly is a smaller change. Advertising that shortened deletion delay and giving the admins a "these keep our shit, yeet their federation privileges but check again every day and notify me when that changes" script wouldn't be too hard to create.

We might even be better off ignoring the Lemmy codebase for mod tools altogether. If we outright ignore cross-platform compatibility, we can make a mod tools API independent of Lemmy-proper that does what's needed and a JavaScript-controlled interface to sit on top or a separate toolset altogether.

I'm pretty busy right now but I rely on Beehaw for decent social media. I'd be willing to put a bit of time into it.

[-] OnichiCub@beehaw.org 12 points 1 year ago

I would prefer whitelist federation to moving. I would prefer whitelist federation period, actually. Thanks for all you do. Please feel emboldened to make the job easier on you.

load more comments (1 replies)
[-] baggins@beehaw.org 11 points 1 year ago

If you decide to move and leave all the cack behind, I'm in.

I'll probably be more involved and would even be willing to chip in with a small subscription. That or registered users may also keep a lot of the trolls away.

[-] toothpicks@beehaw.org 10 points 1 year ago

That all sounds reasonable. I'll likely come with you when you make the move.

[-] Ignacio@beehaw.org 9 points 1 year ago

Anywhere very far away from tankies, please. I'm tired of being harassed by them anywhere I post a comment. They're nazis/fascists in disguise.

load more comments (6 replies)
[-] kobold@beehaw.org 9 points 1 year ago

Use an allow list and make federated moderation a required agreement.

Short term: If you take down a post from the origin, set it up so that it submits an email or whatever. Follow back with federated servers within a week.

Long term: Advocate for this in the project. Gather support and consider forking a long term solution, unless a better platform presents itself.

This is a hard as hell problem but to be honest automated federation is not good in my book. I had so many problems with it in early mastodon to the point of building the first allow-list server, i'm not surprised to hear similar issues here.

[-] Rentlar@beehaw.org 9 points 1 year ago* (last edited 1 year ago)

I am well aware of the post requesting moderation changes from a few months ago, and on the informal post I suggested the AutoMod tools people have began developing could help. However, hearing the myriad of other issues you're facing, it does sound as though my suggestion would be a band-aid solution at best to a system that need changes from almost the ground up, but perhaps it could buy time to get the other changes developed.

Whatever direction your team decides to take Beehaw, I will be(e) happy for you, even if I don't follow it to the new service.

[-] stoicandanxious@beehaw.org 9 points 1 year ago* (last edited 1 year ago)

Just a random data point. This is my first time logging back into my beehaw account in a long time. Beehaw was my original lemmy instance and I really enjoyed the foundational ideals and communities the founders envisioned. I logged back in today because even on my main account on another instance, I'm so tired of all the terrible bigotry that I see in my all feed.

I personally really like the Lemmy interface as a user especially in an app, mobile browsing or desktop with certain browser add-ons. I know as a someone with their own instance (not my main account ref earlier) that the mod,sysadmin and dev work to keep it running is a lot. I too have database issues that I am super frustrated by. The mod tools are pretty much non existent.

With that said, I think that the whitelist may a viable option. The content needing moderated is likely mostly from federated instances. If beehaw were to isolate it's community or whitelist to a few trusted instances one would imagine the mod work would be lesser even with the minimal tools available. Purge the old content and continue forward as a community isolated but together in their goal to create a kind and friendly community.

Just my thoughts. I appreciate you beehaw admins.

[-] Dartos@beehaw.org 9 points 1 year ago

I wonder if this says something about federation in general. Is there a point? Do community instances really want to interact with that many other community instances?

load more comments (1 replies)
[-] crow@beehaw.org 9 points 1 year ago

I love the transparency. Is Kbin’s source code not a viable alternative? I’m also familiar with raddle but I don’t think it’s federated. The devs for kbin seem to at least not have semi-abandoned it.

load more comments (2 replies)
[-] ezri@lemmy.blahaj.zone 9 points 1 year ago

Good luck with whatever you decide to do, but I won't be following to a new platform

load more comments
view more: ‹ prev next ›
this post was submitted on 10 Sep 2023
302 points (100.0% liked)

Beehaw Support

2797 readers
1 users here now

Support and meta community for Beehaw. Ask your questions about the community, technical issues, and other such things here.

A brief FAQ for lurkers and new users can be found here.

Our September 2024 financial update is here.

For a refresher on our philosophy, see also What is Beehaw?, The spirit of the rules, and Beehaw is a Community


This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.


if you can see this, it's up  

founded 2 years ago
MODERATORS