In the next ~6 months I’m going to entirely overhaul my setup. Today I have a NUC6i3 running Home Assistant OS, and a NUC8i7 running OpenMediaVault with all the usual suspects via Docker.

I want to upgrade hardware significantly, partially because I’d like to bring in some local LLM. Nothing crazy, 1-8B models hitting 50tps would make me happy. But even that is going to mean a beefy machine compared to today, which will be nice for everything else too of course.

I’m still all over the place on hardware, part of what I’m trying to decide is whether to go with a single machine for everything or keep them separate.

Idea 1 is a beefy machine and Proxmox with HA in a VM, OMV or TrueNAS in another, and maybe a 3rd straight Debian to separate all the Docker stuff. But I don’t know if I want to add the complexity.

Idea 2 would be beefy machine for straight OMV/TrueNAS and run most stuff there, and then just move HA over to the existing i7 for more breathing room (mostly for Frigate, which could also separate to other machine I guess).

I hear a lot of great things about Proxmox, but I’m not sold that it’s worth the new complexity for me. And keeping HA (which is “critical” compared to everything else) separated feels like a smart choice. But keeping it on aging hardware diminishes that anyway, so I don’t know.

Just wanting to hear various opinions I guess.

  • curbstickle@anarchist.nexusEnglish
    61·
    2 days ago

    Should I switch to Ubuntu server?

    Thats a hard no IMO.

    Even if you want to do something other than proxmox (just use Debian, fedora, or opensuse).

    Its not bad from the CLI, you just need to know your commands.

    virt-install --name=deb13-vm --vcpus=1 --memory=1024 --cdrom=/tmp/debian-13.0.0-amd64-netinst.iso --disk size=8 --os-variant=debian13

    Will get you 1 vcpu, 1GB ram, and an 8GB drive worth of debian. If you don’t specify a path, in home under .local/share/libvirt/images it will go!

    You can also then

    virsh edit deb13-vm

    And you’ll get the XML, where you can edit away.

    Personally, I’d rather use the webgui for most things, but yeah its perfectly doable from the CLI.

    • pineapple@lemmy.mlEnglish
      2·
      2 days ago

      I would have thought debian is better than ubuntu but I couldn’t find a server version of debian. Where do I find debian server or debian cli only?