This is pretty rad! Thanks for sharing. I went down the same road with learning k3s on about 7 Raspberry Pis and pivoted over to Proxmox/Ceph on a few old gaming PCs / Ethereum miners. Now I am trying to optimize the space and looking at how to rack mount my ATX machines with GPUs lol… I was able to get a RTX 3070 to fit in a 2U rack mount enclosure but having some heat issues… going to look at 4U cases with better airflow for the RTX 3090 and various RX480s.

I am planning to set up Talos VMs (one per Proxmox host) and bootstrap k8s with Traefik and others. If you’re learning, you might want to start with a batteries-included k8s distro like k3s.

I followed the wiki tutorials for that. Make sure iommu is working, blacklist drivers on host, etc.

It’s on my lift of projects. I build a Proxmox+Ceph cluster and I have GPU passthrough working for LLM inference. I was planning to get docker headless Steam going and try to steam via Steam In Home Streaming as my first attempt then pivot to a full VM with Sunshine as a last resort.

deleted by creator

Isn’t the context of that quote around the kernel and kernel space vs user space? I don’t see how that thought really extends to distros that simply implement the kernel as one of their packages.

Cheaper is one aspect. Less physical things to have to keep track of and manage is what I am really after. I want a singular device that is capable of all the things/modes that I want. I’m sure I’ll get downvoted for this, but what I see is a singular device capable of all sorts of things being eventually small enough to be embedded inside a body, essentially like cyborg. Like 100 years from now assuming society doesn’t collapse by then.

Why have one device or why desktop mode?

One device because it would reduce the burden on me of maintaining multiple devices, the security updates, passwords, etc.

Why desktop mode? Because when I try to do what I would call “serious work” (probably a bad name for it, but think something requiring extended periods of deep focus), the interface of smartphones is not conducive for it. Precision of a mouse is required, ability to type 100+ words per minute is required, so that necessitates mouse and keyboard. Then there’s the UX itself. Smartphones have tiny screens so they can’t have many menu items or controls in the apps that are used for “serious work”. That requires larger screen real estate, so necessitates an external monitor.

I don’t want to start rambling so I’ll just leave it at that.

I’ve been wanting a phone that can dock and be used as a full fledged desktop since smartphones first came out. Samsung Dex apparently comes close, but is too limited in terms of the desktop app side.

They should have just called it appleOS 26 since they are bumping all of it to 26 and unifying the look and feel between all of their OSs.

How difficult is it for an adversary to get in the middle of the TPM releasing the keys to LUKS? That’s why I would want attestation of some sort, but that makes it more complicated and thinking about how that would work in practice makes my head spin…

Is clevis using an attestation server or is it all on a single machine? I’m interested in getting this set up but the noted lack of batteries included for this in the common distros makes it a somewhat tall order.

please share the script?

I’m really not sure. I’ve heard of people using Ceph across datacenters. Presumably that’s with a fast-ish connection, and it’s like joining separate clusters, so you’d likely need local ceph cluster at each site then replicate between datacenters. Probably not what you’re looking for.

I’ve heard good things about Garbage S3 and that it’s usable across the internet on slow-ish connections. Combined with JuiceFS is what I was looking at using before I landed on Ceph.

I know Ceph would work for this use case, but it’s not a lighthearted choice, kind of an investment and a steep learning curve (at least it was, and still is, for me).

I went and edited my hosts file and added all of my devices, but I only have a handful. Tailscale on macOS has a lot of bugs, this being one of many.

Step four, you want to pull the fluid column up to unstick the trash, so go slow ‘down’ and somewhat more forceful on the ‘up’.

Try these steps:

$ sudo apt-get purge nvidia* # remove current installed nvidia software including drivers
$ sudo ubuntu-drivers devices # verify it sees your graphics card
$ sudo ubuntu-drivers autoinstall # install drivers automatically
$ sudo reboot

This is everything I ended up doing which eventually fixed it for me:

# Update repo
sudo apt update

# Remove amdgpu drivers
sudo apt purge xserver-xorg-video-amdgpu
sudo apt purge libdrm-amdgpu*
sudo apt purge libdrm-amdgpu1

# Blacklist the amdgpu driver since we are using nvidia only
echo "blacklist amdgpu" | sudo tee -a /etc/modprobe.d/blacklist.conf

# Remove nvidia driver and install from system76 repo
sudo apt purge *nvidia*
sudo apt-add-repository -y ppa:system76-dev/stable
sudo apt install -y system76-driver-nvidia
sudo apt upgrade -y
sudo reboot

It depends on the container I suppose. There are some that are very difficult to rebuild depending on what’s in it and what it does. Some very complex software can be ran in containers.

I’ve been wanting to tinker with NixOS. I’ve stuck in the stone ages automating VM deployments on my Proxmox cluster using ansible. One line and about 30 minutes (cuda install is a beast) to build a reproducible VM running llama.cpp with llama-swap.

Do you gave an nvidia graphics card? The only problem I’ve had since I installed Pop OS is their shity driver installer crapped out somehow and I gad to recover my system by blacklisting amd graphics driver, uninstall nvidia driver and reinstall. It wad not for the feint of heart.