[-] pr0927@lemmy.world 1 points 1 week ago

It took me a while to find a moment to give it a go, but I created a test dataset under my main ZFS pool and added it to a CT - it did snapshots and replication fine.

The one question I have is - for the bind-mounts, I didn't have any size set - and they accurately show remaining disk space for the pool they are on.

Here it seems I MUST give a size? Is that correct? I didn't really want to allocate a smaller size for any given dataset, if possible. I saw something about storage-backed mount points, and adding them (via config file, versus GUI) and setting "size=0" - if this is of a ZFS dataset, would this "turn" it into a directory and prevent snapshotting or replicating to other nodes?

One last question - when I'm adding anything to the Datacenter's storage section, do I want to check availability for all nodes? Does that matter?

Thanks again!

33
submitted 1 week ago* (last edited 1 week ago) by pr0927@lemmy.world to c/selfhosted@lemmy.world

Hi all, I have been chasing answers for this for months on the Proxmox forums, Reddit, and the LevelOneTechs forums and haven't gotten much guidance, unfortunately. Hoping Lemmy will be the magic solution!

Perhaps I couched my initial thread in too much detail, so after some digging I got to more focused questions for my follow-up (effectively what this thread is), but I still didn't get much of a response!

In all this time, I even have one more random thought I haven't asked elsewhere - if I "Add Storage" of my ZFS pools in Proxmox, even though the categories don't really fit data storage (the categories are like VM data, CT data, ISOs, snippets, etc.), then I could attach these to a VM or CT and replicate them via "normal" Proxmox cluster replication - is it OK to add such data pools to this storage section as such?

Anyway, to the main course - the summary of what I'm seeking help on is below.

Long story short:

  • 3 nodes in a cluster, using ZFS.
    • CTs and VMs are replicated across nodes via GUI.
  • I want to replicate data in ZFS pools (which my CTs and VMs use - CTs through bind-mounts, VMs through NFS shares) to the other nodes.
    • Currently using Sanoid/Syncoid to make this happen from one node to two others via cronjob.

So three questions:

  1. If I do Sanoid/Syncoid on all three nodes (to each other) - is this stupid, and will it fail - or will each node recognize snapshots for a ZFS pool and incrementally update if needed (even if the snapshot was made on/by a different node)?
    • As a sub-question to this - and kind of the point of my overall thread and the previous one - is this even a sensible way to approach this, or is there a better way?
  2. For the GUI-based replication tasks, since I have CTs replicating to other systems, if I unchecked "skip replication" for the bind-mounted ZFS pools - would this accomplish the same thing? Or would it fail outright? I seem to remember needing to check this for some reason.
  3. Is this PVE-zsync suitable for my situation? I see mention of no recursive syncing, which I don't fully know what that means, and I don't know if that's a dealbreaker. I suppose if this is the correct choice - then I need to delete my current GUI-based CT/VM replication tasks?

For those with immense patience, here was the original thread with more detail:

Hi all, so I setup three Proxmox servers (two identical, one “analogous”) - and the basics about the setup are as follows:

  • VMs and CTs are replicated every 15 minutes from one node to the other two.
  • One CT runs Cockpit for SMB shares - bind-mounted to the ZFS pools with the datasets that are SMB-shared.
    • I use this for accessing folders via GUI over the network from my PC.
  • One CT runs an NFS server (no special GUI, only CLI) - bind-mounted to the ZFS pools with the datasets that are NFS-shared (same as SMB-shared ones).
    • Apps that need to tap into data use NFS shares (such as Jellyfin, Immich, Frigate) provided by this CT.
  • Two VMs are of Debian, running Docker for my apps.
  • VMs and CTs are all stored on 2x2TB M.2 NVMe SSDs.
  • Data is stored in folders (per the NFS/SMB shares) on a 4x8TB ZFS pool with specific datasets like Media, Documents, etc. and a 1x4TB SSD ZFS “pool” for Frigate camera footage storage.

Due to having hardware passed-through to the VMs (GPU and Google Coral TPU) and using hardware resource mappings (one node as an Nvidia RTX A2000, two have Nvidia RTX 3050s - can have them all with the same mapped resource node ID to pass-through without issue despite being different GPUs), I don’t have instant HA failover.

Additionally, as I am using ZFS with data on all three separate nodes, I understand that I have a “gap” window in the event of HA where the data on one of the other nodes may not be all the way up-to-date if a failover occurs before a replication.

So after all the above - this brings me to my question - what is the best way to replicate data that is not a VM or a CT, but raw data stored on those ZFS pools for the SMB/NFS shares - from one node to another?

I have been using Sanoid/Syncoid installed on one node itself, with cronjobs. I’m sure I’m not using it perfectly (boy did I have a “fun” time with the config files), and I did have a headache with retention and getting rid of ZFS snapshots in a timely manner to not fill up the drives needlessly - but it seems to be working.

I just setup the third node (the “analogous” one in specs) which I want to be the active “primary” node and need to copy data over from the other current primary node - I just want to do it intelligently, and then have this node, in its new primary node role, take over the replication of data to the other two nodes.

Would so very, very badly appreciate guidance from those more informed/experienced than me on such topics.

[-] pr0927@lemmy.world 20 points 4 months ago* (last edited 4 months ago)

Former USAF JAG here (lawyer). I was always a tech geek, undergrad major was in MIS actually, but I didn't enjoy coding. Always ran Plex on the side, built my own computers, etc. Grew up with my Dad using Linux everywhere (I found this annoying as I just wanted to play games on Windows).

I didn't enjoy law (surprise!). I was disillusioned with the criminal justice system too. Quit the law in 2020. Then suddenly had quality time by global happenstance to rethink my life path.

I work in IT now. Restarted at the bottom of a new career but I'm in deep nerd territory now - Proxmox servers, Home Assistant, networks with VLANs, OPNsense router, 22U server rack, Linux as my daily driver, etc.

Much happier now.

[-] pr0927@lemmy.world 11 points 5 months ago* (last edited 5 months ago)

Hello friend. Indian American here. My parents immigrated here, and their ticket in was education. I understand your grades aren't great, and I also acknowledge that my parents did come from middle-to-upper-class privilege.

I work for an IT company who employees (not outsources) individuals in India. Several of them have left India to come to the U.S. or Canada. For all of them, education has always been the way out. They knew they wanted out, so they grinded hard in the short-term, and applied aggressively abroad for graduate-level education.

Find a niche in something that does interest you. It seems you are very socioeconomically aware, consider something in such a realm that makes you stand out (yes, I understand this is easier said than done, especially in a nation of 1.3...1.4? billion).

Saying that, also understand that STEM-related expertise areas are much more sought after. So it might not be a bad idea to focus on that side and/or diversify.

I won't contest a lot of what you said about India - much of that is accurate. Some of that is more cynical than necessary. But change is slow and it would be wrong of me to tell you to stay and change a nation in a region notoriously resistant to change. Unless you're the next coming of Barack Obama charisma, in which case, please help change India, hahaha.

You're young, you have plenty of time. So don't feel burdened not finding a spark at this era in your life. My Mom immigrated here only after marriage, when she was 28. The coworkers I've mentioned have all been in their late 20s or early-to-mid 30s.

I want to add - you're not worthless. Don't devalue yourself needlessly based on the decrees of an unfair and unjust society or uncaring peers and family.

[-] pr0927@lemmy.world 30 points 5 months ago

Agreed - Tarkin is a leader of the Galactic Empire, an extremely fascist regime modeled off Nazi Germany that also practices xenophobia.

He is absolutely authoritarian right, not authoritarian left.

Not sure a good choice for authoritarian left? Maybe Natasi Daala in the EU when she rules the GFFA and decides enough of a weird religious order being above the law (the NJO, of course)?

[-] pr0927@lemmy.world 14 points 7 months ago

If you are on iOS, I recommend using the following:

https://ente.io/auth/

It's open-source and recommended by PrivacyGuides.

I'm on Android, where that's also an option I believe, but I'm using Aegis.

Bitwarden also came out with an open-source MFA app, though it's a bit new so I'd recommend waiting to see what folks say about it.

Raivo uses to be a good (and the only decent) choice for iOS but I believe it was acquired by an insidious company.

[-] pr0927@lemmy.world 32 points 9 months ago* (last edited 9 months ago)

Conservatism.

[-] pr0927@lemmy.world 10 points 11 months ago* (last edited 11 months ago)

I'm a leftist and former practicing attorney who has interest in geopolitics and public international law - I studied this world as my niche previously.

They're not correct. Constitutionally, the Executive has very broad powers in international affairs. The War Powers Resolution (WPR) was an attempt to constrain this. Administrations have largely been careful to state their actions are "consistent with" the WPR. Courts have not properly come to any real decision of its bounds, keeping this lane very gray and deferring to inherent Executive authority regarding foreign affairs. Obama was the only one who partially paid it some heed when he asked for Congressional authorization to militarily intervene in Syria as al-Assad began use of chemical weapons on his citizens in the midst of the Syrian Civil War (who remembers the red line to not be crossed...that got crossed?). The legal framework authorizing the use of force has basically been the AUMF, plus other broader, vaguer legal concepts that have held up under judicial review.

Anyway, big fan of the Justice Democrats and always concerned with U.S. use of force abroad, especially after it became apparent how fascist despots like Trump can come to power and do great harm to international peace and security. But on this topic - Biden's within legal bounds, by all accounts.

[-] pr0927@lemmy.world 9 points 1 year ago

Believe me, you won't feel this way by the end. Best show in the universe. The dark aspects are necessary for the story, but the payout is amazing. I constantly want to rewatch it.

[-] pr0927@lemmy.world 9 points 1 year ago

You're too naive.

There is a paradox of tolerating the intolerant.

Our enemy are fascists, plain and simple. They don't deserve a voice. The only intelligent approsch is to combat them, as their purpose is to subvert democracy, however horribly flawed a system it is, with exclusionary autocracy. This era isn't one of two parties who both believe in democracy, finding some disagreement on issues. This is a crisis, "post-fact" era where truth is ignored, corruption and power-grabs are blatant and undisguised, and bigotry is rampant.

[-] pr0927@lemmy.world 25 points 1 year ago

No.

Society tolerating people with evil views begets more evil.

[-] pr0927@lemmy.world 16 points 1 year ago

I don't have one - it took me a very long time to find it - back before also-MAGA Elon bought Twitter, I scrolled back to his history and saw re-tweets and comments in November/December 2020 regarding the election denial nonsense.

If you're able to find archive of this, I'm sure you'll stumble into it (assuming it's not able to be found on the website now).

The trigger for me to even look for this was a random video in which he was badmouthing LA/California in the video/comments and it made me grow suspicious.

[-] pr0927@lemmy.world 89 points 1 year ago* (last edited 1 year ago)

I was so disappointed to see that this guy was a MAGA supporter and election denier.

Yes, I do care about the politics of people not in the political space. I don't think people harboring such lunatic views should be legitimized.

view more: next ›

pr0927

joined 2 years ago