Aurora-dx-nvidia No Longer Automatically Applying Updates After Reboot

Bluefin and Aurora
1

I have 2 systems (desktop and laptop) running aurora-dx-nvidia on different branches - latest and stable. I’ve noticed in the last few weeks ((around the 7th or so), the updates are downloading but they are not applying after reboot. I have to manually rollback to a previous version (the 0801 one) then do a rpm-ostree update in order for updates to apply on reboot. I had to do that with the laptop on stable last week and it just downloaded a new update for this week and will not apply it automatically. Here is the rpm-ostree status after rebooting when it did not apply:

❯ rpm-ostree status -v
State: idle
AutomaticUpdates: stage; rpm-ostreed-automatic.timer: no runs since boot
Deployments:
● ostree-image-signed:docker://ghcr.io/ublue-os/aurora-dx-nvidia:stable (index: 0)
Digest: sha256:3c79afa3f5dbb3f8db4e0a4b243b80db31b5b689b63e781094e31dc20000fb5e
Version: 40.20240813.0 (2024-08-13T06:35:52Z)
Commit: 48c1d27ab8d7b8cb967f1e4aa906abf1b2eb65adf672ee5825f69bfd6a251154
Staged: no
StateRoot: fedora

ostree-image-signed:docker://ghcr.io/ublue-os/aurora-dx-nvidia:stable (index: 1)
Digest: sha256:392c885695d7b8e4c89c42ee21e94c0f8f86647ffdb343dd2c99c21ae397432f
Version: 40.20240801.0 (2024-08-01T19:56:00Z)
Commit: 2ad3671f2be2b081e4048533e18c120682684f5b6a7e7145b64fe80bc0051dea
StateRoot: fedora

AvailableUpdate:
Timestamp: 2024-08-20T05:52:32Z
Commit: 6d82f58c00667266c94380faa7ff7f75ca2b134330dcb8d7246478a6f4d8f782
Upgraded: amd-gpu-firmware 20240709-1.fc40 → 20240811-2.fc40
amd-ucode-firmware 20240709-1.fc40 → 20240811-2.fc40
atheros-firmware 20240709-1.fc40 → 20240811-2.fc40
brcmfmac-firmware 20240709-1.fc40 → 20240811-2.fc40
breeze-icon-theme 6.5.0-1.fc40 → 6.5.0-2.fc40
btrfs-progs 6.9.2-1.fc40 → 6.10-1.fc40
buildah 1.36.0-1.fc40 → 1.37.0-1.fc40
cirrus-audio-firmware 20240709-1.fc40 → 20240811-2.fc40
cockpit-machines 316-1.fc40 → 317-1.fc40
cockpit-ostree 1:203-1.fc40 → 1:204-1.fc40
cockpit-podman 91-1.fc40 → 92-1.fc40
code 1.92.1-1723066391.el8 → 1.92.2-1723661076.el8
devpod v0.5.18-1.fc40 → v0.5.19-1.fc40
distribution-gpg-keys 1.104-1.fc40 → 1.105-1.fc40
docker-buildx-plugin 0.16.1-1.fc40 → 0.16.2-1.fc40
docker-ce 3:27.1.1-1.fc40 → 3:27.1.2-1.fc40
docker-ce-cli 1:27.1.1-1.fc40 → 1:27.1.2-1.fc40
docker-ce-rootless-extras 27.1.1-1.fc40 → 27.1.2-1.fc40
egl-gbm 2:1.1.1-5.20240412git649c079.fc40 → 2:1.1.2-1.fc40
egl-gbm 2:1.1.1-5.20240412git649c079.fc40 → 2:1.1.2-1.fc40
egl-wayland 1.1.15-1.fc40 → 1.1.15-2.20240814gitf30cb0e.fc40
egl-wayland 1.1.15-1.fc40 → 1.1.15-2.20240814gitf30cb0e.fc40
ethtool 2:6.9-1.fc40 → 2:6.10-1.fc40
fzf 0.54.1-1.fc40 → 0.54.3-1.fc40
gperftools-libs 2.14-3.fc40 → 2.14-4.fc40
ibus 1.5.30-5.fc40 → 1.5.30-6.fc40
ibus-gtk2 1.5.30-5.fc40 → 1.5.30-6.fc40
ibus-gtk3 1.5.30-5.fc40 → 1.5.30-6.fc40
ibus-gtk4 1.5.30-5.fc40 → 1.5.30-6.fc40
ibus-libs 1.5.30-5.fc40 → 1.5.30-6.fc40
ibus-panel 1.5.30-5.fc40 → 1.5.30-6.fc40
ibus-setup 1.5.30-5.fc40 → 1.5.30-6.fc40
intel-audio-firmware 20240709-1.fc40 → 20240811-2.fc40
intel-gpu-firmware 20240709-1.fc40 → 20240811-2.fc40
intel-media-driver 24.1.5-1.fc40 → 24.2.5-1.fc40
iwlegacy-firmware 20240709-1.fc40 → 20240811-2.fc40
iwlwifi-dvm-firmware 20240709-1.fc40 → 20240811-2.fc40
iwlwifi-mvm-firmware 20240709-1.fc40 → 20240811-2.fc40
kcli 99.0.0.git.202408112231.ec8c845-0.fc40 → 99.0.0.git.202408152041.5eeaa03-0.fc40
kde-settings 40.0-1.fc40 → 40.1-1.fc40
kde-settings-plasma 40.0-1.fc40 → 40.1-1.fc40
kde-settings-pulseaudio 40.0-1.fc40 → 40.1-1.fc40
kde-settings-sddm 40.0-1.fc40 → 40.1-1.fc40
kernel 6.9.7-200.fc40 → 6.9.11-200.fc40
kernel-core 6.9.7-200.fc40 → 6.9.11-200.fc40
kernel-modules 6.9.7-200.fc40 → 6.9.11-200.fc40
kernel-modules-core 6.9.7-200.fc40 → 6.9.11-200.fc40
kernel-modules-extra 6.9.7-200.fc40 → 6.9.11-200.fc40
kernel-tools 6.10.3-200.fc40 → 6.10.5-200.fc40
kernel-tools-libs 6.10.3-200.fc40 → 6.10.5-200.fc40
kf6-breeze-icons 6.5.0-1.fc40 → 6.5.0-2.fc40
libedit 3.1-51.20240517cvs.fc40 → 3.1-53.20240808cvs.fc40
libedit 3.1-51.20240517cvs.fc40 → 3.1-53.20240808cvs.fc40
libedit-devel 3.1-51.20240517cvs.fc40 → 3.1-53.20240808cvs.fc40
libertas-firmware 20240709-1.fc40 → 20240811-2.fc40
libimagequant 4.0.3-3.fc40 → 4.0.3-5.fc40
libldb 2.9.1-1.fc40 → 2.9.1-4.fc40
libnfsidmap 1:2.6.4-0.rc6.fc40 → 1:2.6.4-0.rc8.fc40
libppd 1:2.0.0-4.fc40 → 1:2.0.0-6.fc40
libsrtp 2.3.0-14.fc40 → 2.6.0-1.fc40
linux-firmware 20240709-1.fc40 → 20240811-2.fc40
linux-firmware-whence 20240709-1.fc40 → 20240811-2.fc40
mt7xxx-firmware 20240709-1.fc40 → 20240811-2.fc40
nfs-utils 1:2.6.4-0.rc6.fc40 → 1:2.6.4-0.rc8.fc40
nvidia-gpu-firmware 20240709-1.fc40 → 20240811-2.fc40
nxpwireless-firmware 20240709-1.fc40 → 20240811-2.fc40
openssl 1:3.2.1-2.fc40 → 1:3.2.2-3.fc40
openssl-libs 1:3.2.1-2.fc40 → 1:3.2.2-3.fc40
passt 0^20240726.g57a21d2-1.fc40 → 0^20240814.g61c0b0d-1.fc40
passt-selinux 0^20240726.g57a21d2-1.fc40 → 0^20240814.g61c0b0d-1.fc40
podman 5:5.1.2-1.fc40 → 5:5.2.0-1.fc40
podmansh 5:5.1.2-1.fc40 → 5:5.2.0-1.fc40
python3-boto3 1.34.153-1.fc40 → 1.34.162-1.fc40
python3-botocore 1.34.153-1.fc40 → 1.34.162-1.fc40
qt-settings 40.0-1.fc40 → 40.1-1.fc40
realtek-firmware 20240709-1.fc40 → 20240811-2.fc40
rpm-ostree 2024.6-1.fc40 → 2024.7-1.fc40
rpm-ostree-libs 2024.6-1.fc40 → 2024.7-1.fc40
skopeo 1:1.15.2-1.fc40 → 1:1.16.0-1.fc40
tailscale 1.70.0-1.fc40 → 1.72.0-1
tiwilink-firmware 20240709-1.fc40 → 20240811-2.fc40
vim-common 2:9.1.660-1.fc40 → 2:9.1.672-1.fc40
vim-data 2:9.1.660-1.fc40 → 2:9.1.672-1.fc40
vim-enhanced 2:9.1.660-1.fc40 → 2:9.1.672-1.fc40
vim-filesystem 2:9.1.660-1.fc40 → 2:9.1.672-1.fc40
vim-minimal 2:9.1.660-1.fc40 → 2:9.1.672-1.fc40
wpa_supplicant 1:2.11-2.fc40 → 1:2.11-3.fc40
xxd 2:9.1.660-1.fc40 → 2:9.1.672-1.fc40
Removed: displaylink-6.0.0-2.fc40.x86_64
gvisor-tap-vsock-6:0.7.4-1.fc40.x86_64
gvisor-tap-vsock-gvforwarder-6:0.7.4-1.fc40.x86_64
kmod-evdi-6.9.7-200.fc40.x86_64-1.14.5-2.20240726giteab561a.fc40.x86_64
kmod-kvmfr-6.9.7-200.fc40.x86_64-0.0.git.23.2de42028-1.fc40.x86_64
kmod-nvidia-6.9.7-200.fc40.x86_64-3:560.31.02-1.fc40.x86_64
kmod-openrazer-6.9.7-200.fc40.x86_64-100.0.0.git.530.886f986d-1.fc40.x86_64
kmod-v4l2loopback-6.9.7-200.fc40.x86_64-0.13.1-1.fc40.x86_64
kmod-wl-6.9.7-200.fc40.x86_64-6.30.223.271-51.fc40.x86_64
kmod-xone-6.9.7-200.fc40.x86_64-0.0.git.115.fdbb71f1-1.fc40.x86_64
kmod-xpadneo-6.9.7-200.fc40.x86_64-0.9.6-2.20240423git73be2eb.fc40.x86_64
kmod-zfs-6.9.7-200.fc40.x86_64-2.2.5-1.fc40.x86_64
libevdi-1.14.5-2.20230726giteab561a.fc40.x86_64
Added: kmod-kvmfr-6.9.11-200.fc40.x86_64-0.0.git.23.2de42028-1.fc40.x86_64
kmod-nvidia-6.9.11-200.fc40.x86_64-3:560.31.02-1.fc40.x86_64
kmod-openrazer-6.9.11-200.fc40.x86_64-100.0.0.git.530.886f986d-1.fc40.x86_64
kmod-v4l2loopback-6.9.11-200.fc40.x86_64-0.13.1-1.fc40.x86_64
kmod-wl-6.9.11-200.fc40.x86_64-6.30.223.271-51.fc40.x86_64
kmod-xone-6.9.11-200.fc40.x86_64-0.0.git.115.fdbb71f1-1.fc40.x86_64
kmod-xpadneo-6.9.11-200.fc40.x86_64-0.9.6-2.20240423git73be2eb.fc40.x86_64
kmod-zfs-6.9.11-200.fc40.x86_64-2.2.5-1.fc40.x86_64

~
❯

2

Does this only happen when an automatic update triggers, or does it also happen if you ran rpm-ostree update manually until it finishes and you reboot the machine?

3

It has been doing it on both manual and automatic timed updates.

4

I did some looking around and according to this discussion it might be a GRUB issue: I keep getting the same updates when i do a rpm-ostree upgrade + reboot? - #7 by passthejoe - Fedora Discussion

Might worth running ujust regenerate-grub to see if it helps?

5

I was thinking the same thing - maybe it wasn’t putting the update into GRUB, the updates were showing as ready to be deployed, I ran ujust update and also the ujust regenerate-grub and it still reverted back to the correct image and didn’t apply the updates.

Like I said originally, I noticed this starting to occur on both systems (they are separate installs) I believe the 20240807 images (or possibly 0806), I have to go back to an image before that date then update and it will work as expected, so I was wondering if there was maybe something being omitted in the image builds since, considering I know the nvidia builds are problematic sometimes and generate errors where they don’t get built every day.