I recently moved my files to a new zfs-pool and used that chance to properly configure my datasets.

This led me to discovering zfs-deduplication.

As most of my storage is used by my jellyfin library (~7-8Tb), which is mostly uncompressed bluray rips I thought I might be able to save some storage using deduplication in addition to compression.

Has anyone here used that for similar files before? What was your experience with it?

I am not too worried about performance. The dataset in question is rarely changed. Basically only when I add more media every couple of months. I also have overshot my cpu-target when originally configuring my server so there is a lot of headroom there. I have 32Gb of ram which is not really fully utilized either (but I also would not mind upgrading to 64 too much).

My main concern is that I am unsure it is useful. I suspect just because of the amount of data and similarity in type there would statistically be a lot of block-level duplication but I could not find any real world data or experiences on that.

Now that we know AI bots will ignore robots.txt and churn residential IP addresses to scrape websites, does anyone know of a method to block them that doesn't entail handing over your website to Cloudflare?

Good day! I am trying to find a good alternative as not to use the"smart" functions or using an Xbox to consume our media. I found a few options ie like plasma big screen but it's no longer in development. Essentially I would line love to have it running on an rpi4 and just hooked up to the TV.

Just discovered this cool project, thought i'd share it here.

AliasVault is an end-to-end encrypted password and alias manager that protects your privacy by creating alternative identities, passwords and email addresses for every website you use. Keeping your personal information private.

Link to website: https://www.aliasvault.net/

Link to source code (MIT Lisense): https://github.com/lanedirt/AliasVault

For those wondering how the alias feature works:

AliasVault includes a built-in email server that allows you to create unique email addresses (aliases) for different services. When someone sends an email to your alias, it's received directly in AliasVault, helping you maintain privacy and reduce spam.

Is there a way to setup an SMB share or similar via docker? I want to be able to easily turn it off and bind it to a specific folder, and I am comfortable with docker.

Thanks!

Currently getting my first media server set up, and I'm wondering what the best directory would be for all the stored files. For reference, I'm working with Ubuntu server to follow the guide I'm using.

Mainly, I'm wondering if I should migrate /home/ to my RAID array, or leave /home/ where it is and create a new directory on the RAID array. Currently the server will just be for my use, but might expand it for others to use

Happy New Year! 🎉

It's me, Daniel, and I'm back with some huge updates for Linkwarden.

For those who are new to Linkwarden, it's basically a tool for saving and organizing your bookmarks, articles, and documents in one place. You can also share your links with others, create public collections, and collaborate with your team. Linkwarden is available as a Cloud subscription or you can self-host it on your own server.

As always before we start, we'd like to express our sincere thanks to all of our Cloud subscription users. Your support is crucial to our growth and allows us to continue improving. Thank you for being such an important part of our journey. 🚀

What’s new:

✨ Local AI Tagging (Optional)

We've added a new feature that automatically tags your links based on their content. This feature uses a local AI model to analyze the content of your links and can assign tags to links in 2 ways:

1. Auto-generate Tags: When a link is added, Linkwarden will automatically generate and assign tags based on the content of the link.
2. Using Predefined Tags: You can also use predefined tags to let Linkwarden auto-assign tags based on the content of the link.

You can enable this feature in the Settings > Preferences page. If you're self-hosting Linkwarden, please refer to the documentation for more information on how to set up and use this feature.

🎨 Customizable Theme

We've added a new feature that allows you to customize the theme of your Linkwarden account. You can now choose from a set of predefined colors.

📸 Capture articles directly from browser extension

Sometimes certain websites prevent bots from accessing their content. In such cases, you can now capture the article directly from your browser using the Linkwarden browser extension and upload it to Linkwarden. Get it from the Chrome Web Store or Firefox Add-ons.

Also please give us a 5-star rating if you like it :D

📋 View the Preserved Formats on Links

Each link now shows the available preserved formats. This allows you to easily see the preserved formats for the link and open the link in the desired format in a new tab.

⬇️ Import from Omnivore

We've added a new import option to allow you to import your links from Omnivore. You can now easily migrate your links from Omnivore to Linkwarden.

🌟 RSS feed for Public Collections

Public collections now have an RSS feed link which lets others to follow your public collections and receive updates when you add new links.

🔔 Subscribe to RSS feed

Linkwarden now supports subscribing to RSS feeds. You can subscribe to any RSS feed and Linkwarden will automatically fetch and save new items from the feed.

⚙️ Choose what's shown on the Dashboard

You can now choose to show/hide your pinned links and recent links sections on the dashboard. This allows you to customize the dashboard to your liking.

🌐 Added More Translations

Thanks to the collaborators, we've added Polish and Russian translations to Linkwarden. If you'd like to help us translate Linkwarden into your language, check out #216.

✅ And more...

Check out the full changelog: https://github.com/linkwarden/linkwarden/compare/v2.8.4...v2.9.0

If you like what we’re doing, you can support the project by either starring ⭐️ the repo on GitHub to make it more visible to others or by subscribing to the Cloud plan (which helps the project, a lot).

Feedback is always welcome, so feel free to share your thoughts!

Website: https://linkwarden.app

GitHub: https://github.com/linkwarden/linkwarden

Futo (Louis Rossman) at it again with great content, this time a Guide to a Self Managed life. This 14hrs long guide comes in two video parts, aswell as a written guide for those who prefer. Both video and written quide comes with complete chapters and timestamps. This should be a great starting point for those who have the time and want to start learning from the very beginning.

Video Link to Part 1: Youtube - Invidious

Video Link to Part 2: Youtube - Invidious

Happy selfhosting in 2025 everyone ✨

I backup my files via rsync then have some essentially docker containers backed up and running in case the first one goes down :)

Ok so I've been having a problem with logging for a while now. I use a centralized logging platform (Seq) to try and aggregate the logs of the containers I run but most of the log messages come through as errors. This is because the containers would stream their output to stderr and even though it's formatted it comes as one big error message.

Example:

[2025-01-06 18:17:23] INFO Registering with TVA backend, encode Job status: available

That's all one big error message I receive even though it's an INFO message. And every container is different. Their error message is formatted differently, some goes to stdout instead of stderr, some actually work.

Is there a piece of software that I can run that will intercept these messages and convert them to GELF?

Thanks

I'd like to set up three or four cameras on the exterior of my house, but I'm not sure where to start with this project. Ideally, these cameras would get power over Ethernet and record to a hard drive in my house that I could access remotely with a decent user interface. If the system could notify me when movement is detected that would be ideal as well. I don't like the idea of using a Google, Amazon, or similar product because I don't want to pay a subscription and I want to have control of the footage. What are you using that more or less accomplishes what I've described?

Happy new years!

One of my personal goals is to secure the data of me and my community from data scraping as much as I can. I've also learned a ton from blog posts on how to host software, and it's time I contribute back.

So, welcome to my series on how I host my services with as little dependency on US-based services as I can.

I'd love feedback on my writing so I can learn and improve as well!

I found some that do the opposite, take digital writing and format into a printed list.

Hi, I am the developer of PdfDing. One thing I am not sure about is the frequency of my releases. What do you folks prefer in self-hosted projects? More releases in order to get new features as fast as possible or fewer releases with bigger feature additions?

Hey. I've got a Rasberry Pi 3 and a Pi Camera 3 set up here, pointed at my front door. I installed the latest Ras Pi OS on the computer and I tested that with the built-in 'raspi-vid' app and it's working now. I want to self-host something so I can access the live video from my phone to see who's knocking on my door.

I don't want to store the video, or do anything else fancy. Just be able to see the video, in a browser, from inside my local network.

I wonder if I could code this up pretty quickly myself, in fact but have no experience with this sort of thing. Is there an app to make this easy or something I could add to the PI to give it a webbish front-end?

Thanks for any ideas

I'm trying to host a vaultwarden instance through docker and failing miserably. This isn't my first attempt either but I've got much further than before.

I'm using a DuckDNS domain with caddy as reverse proxy, but it appears that the domain is defaulting to port 80 no matter how I set up the config. I can't specify a port number in DuckDNS as far as I can tell. If the simple solution is to just buy a domain name I will consider it. Otherwise could really use some help in sorting out why it's not connecting.

I can't access Vaultwarden on the internal IP as it's not being served as SSL but both Vaultwarden and Caddy are running with no errors in logs. I've left out a bunch of admin env variables for the Vaultwarden service to truncate the code.

docker-compose:

`[___](services:

vaultwarden:

container_name: vaultwarden

image: vaultwarden/server:latest

restart: unless-stopped

ports:

  - 11808:80

  - 11443:443

volumes:

  - ./data/:/data/

environment:

  - ROCKET_PORT=11444

caddy:

image: caddy:2

container_name: caddy2

restart: always

ports:

  - 1808:11808

  - 1443:11443

volumes:

  - ./caddy:/usr/bin/caddy

  - ./Caddyfile:/etc/caddy/Caddyfile:ro

  - ./caddy-config:/config

  - ./caddy-data:/data

environment:

  DOMAIN: "https://example.duckdns.org"

  EMAIL: "example@domain.com"
        
  DUCKDNS_TOKEN: "token"

  LOG_FILE: "/data/access.log")`

Caddyfile:

' {$DOMAIN}:1443 {

log {

level INFO

output file {$LOG_FILE} {

  roll_size 10MB

  roll_keep 10

}

}

tls {

dns duckdns {$DUCKDNS_TOKEN}

}

encode gzip

Notifications redirected to the WebSocket server

reverse_proxy /notifications/hub vaultwarden:3012

Proxy everything else to Rocket

reverse_proxy vaultwarden:11444

}`

Any idea where I'm going wrong?

So I had a micro PC that was running one of my core services and it only supports NVMe drives. Unfortunately, this little guy cooked itself and I'm not in a position to replace the drive. The system is still good and is fairly powerful, so I want to be able to reuse it.

I'm thinking I want to set up some kind of netboot appliance on another server to be able to allow me to boot the system without ever having a local disk. One thing I want to is run some docker images (specifically Frigate) but i wont be able to write anything to persistent storage locally. NFS shares are common in my setup.

Is it even possible to make a 'gold image' of a docker host and have it netboot? I expect that memory limitations (16GB) will be my main issue, but I'm just trying to think of how to bring this system back into use. I have two NAS appliances that I can use for backend long term storage (where I keep my docker files and non-database files anyway), so it shouldn't be too difficult to have some kind of easily editable storage solution. I don't want to use USB drives as persistent storage due to lifespan concerns from using them in production environments.

I found some that do the opposite, take digital writing and format into a printed list.

Personally will be trying to transform my server which is currently in a fractal R5 case, into a small-ish Homelab rack, combined with all my network equipment. Will require complete relocation of all network equipment in the house as well as cables so it will be a bit of a project. Also on the lookout for a good quality rack so let me know if you have any recs. Still unsure if u want to do full width rack or mini. Part of me really want the UDM Pro from Unifi..

What are your goals and thing you want to accomplish during 2025?

Has anyone gotten their server rack to run off solar power.

I got the idea after seeing the Anker solix systems on sale at costco and thought what if I could get one of those to power my server rack and have a few rigid solar panels on the roof to charge the battery up during the day and run the server partially during the night off the battery, but switch over to grid power when it runs dry?

Curious if anyone has any experience with that, I'm not looking to do my whole house just my server rack for now, from my limited tracking of my rack it looks like it uses 8kwh a day so it seems possible. Searching online it looks like there are much cheaper battery options than anker

Hi. Sorry if this is a really generic question but I’m looking to upgrade my server and wondering if there’s some standout solution. I’m currently running an old Dell Poweredge T20 which has been fine but I’m running into issues with driver support because it’s all considered legacy now being nearly 10 years old. I wouldn’t mind upgrading the mobo, CPU and RAM but I really don’t need it to be too powerful. I’m just running Plex, Frigate, Home Assistant, and a few other small things. I need GPU for Frigate and I can’t get the onboard HD4600 on mine to work with Debian. I have a TPU for the AI stuff but I need support for videos rendering.

Are there any cheap mATX combos that are good and cheap, something like £100 and low power?