What is the right way to fix this?
thanks!
Edit: After some 4 hours and many reboots and testing with two VMs on two different systems, its looks to me like the upstream ucore image is bad. I’ve submitted a bug here.
opened 11:06AM - 05 Dec 25 UTC
I've included the full commands after the environment section. This is pretty co… ncerning. I've also replicated this in another VM on a separate laptop to factor out any issues like memory corruption or something.
Fresh Fedora CoreOS 43.20251110.3.1 installation passes `ostree fsck` with no errors. After rebasing to uBlue uCore stable, `ostree fsck` detects corrupted file objects.
**Steps to Reproduce:**
1. Fresh install FCOS 43.20251110.3.1
2. Run `sudo ostree fsck` - **passes with no errors**
3. Rebase: `sudo rpm-ostree --bypass-driver rebase ostree-unverified-registry:ghcr.io/ublue-os/ucore:stable`
4. Reboot into new deployment
5. Run `sudo ostree fsck` - **fails with corruption error**
**Error:**
```
error: In commits acba8342223556fc54226e00f5cbaf0f6f26feca440aaefed1a6eb557e47a2c3, 3cfcb331f319f0a4eac3fb18c62438e6d10b0548edd08baa0ccf2806936fc812: fsck content object 78d060393c58beb2a555dedcac53c64b0c5175c41af916b981afd44d2839ee5a: Corrupted file object; checksum expected='78d060393c58beb2a555dedcac53c64b0c5175c41af916b981afd44d2839ee5a' actual='a89e23bf46ebee539298fe32697906f55f668ec6c289fc7'
```
**Environment:**
- Base: FCOS 43.20251110.3.1
- Target: uBlue uCore stable (digest: sha256:234a1fd4d4edc9fbef4c2176f8a6342e2affd233b29b83349677c8ec2d9dff24)
- Platform: KVM/QEMU, ext4 filesystem
System boots and runs normally despite the corruption.
---
```
➜ ssh core@192.168.122.117
The authenticity of host '192.168.122.117 (192.168.122.117)' can't be established.
ED25519 key fingerprint is SHA256:azFO+kbRJWKruOVeH+KleRa6fyJR3qjRMTYyOLdELt0.
This key is not known by any other names.
Are you sure you want to continue connecting (yes/no/[fingerprint])? yes
Warning: Permanently added '192.168.122.117' (ED25519) to the list of known hosts.
Fedora CoreOS 43.20251110.3.1
Tracker: https://github.com/coreos/fedora-coreos-tracker
Discuss: https://discussion.fedoraproject.org/tag/coreos
core@localhost:~$ sudo -i
root@localhost:~# ostree fsck
Validating refs...
Validating refs in collections...
Enumerating commits...
Verifying content integrity of 67 commit objects...
fsck objects (25898/25898) [=============] 100%
object fsck of 67 commits completed successfully - no errors found.
root@localhost:~# bootc status
● Booted image: quay.io/fedora/fedora-coreos:stable
Digest: sha256:ab87a46a63c05aaeeceaa1fcc7e464c983d0797e7ed150cd5a179d435ad6c816 (amd64)
Version: 43.20251110.3.1 (2025-11-25T17:30:45Z)
root@localhost:~# sudo rpm-ostree rebase ostree-unverified-registry:ghcr.io/ublue-os/ucore:stable
error: Updates and deployments are driven by Zincati (zincati.service)
See Zincati's documentation at https://github.com/coreos/zincati
Use --bypass-driver to bypass Zincati and perform the operation anyways
root@localhost:~# sudo rpm-ostree --bypass-driver rebase ostree-unverified-registry:ghcr.io/ublue-os/ucore:stable
Pulling manifest: ostree-unverified-registry:ghcr.io/ublue-os/ucore:stable
Importing: ostree-unverified-registry:ghcr.io/ublue-os/ucore:stable (digest: sha256:234a1fd4d4edc9fbef4c2176f8a6342e2affd233b29b83349677c8ec2d9dff24)
ostree chunk layers already present: 65
custom layers already present: 1
custom layers needed: 2 (1.2 GB)
[0/2] Fetching layer 10e536f839e39a914be (510.5 MB)... done
[1/2] Fetching layer ab888fdf9c39a01a602 (694.3 MB)... done
Staging deployment... done
Upgraded:
amd-gpu-firmware 20251021-1.fc43 -> 20251125-1.fc43
amd-ucode-firmware 20251021-1.fc43 -> 20251125-1.fc43
intel-gpu-firmware 20251021-1.fc43 -> 20251125-1.fc43
libldb 2:4.23.2-1.fc43 -> 2:4.23.3-1.fc43
libsmbclient 2:4.23.2-1.fc43 -> 2:4.23.3-1.fc43
libwbclient 2:4.23.2-1.fc43 -> 2:4.23.3-1.fc43
linux-firmware 20251021-1.fc43 -> 20251125-1.fc43
linux-firmware-whence 20251021-1.fc43 -> 20251125-1.fc43
nvidia-gpu-firmware 20251021-1.fc43 -> 20251125-1.fc43
qed-firmware 20251021-1.fc43 -> 20251125-1.fc43
samba-client-libs 2:4.23.2-1.fc43 -> 2:4.23.3-1.fc43
samba-common 2:4.23.2-1.fc43 -> 2:4.23.3-1.fc43
samba-common-libs 2:4.23.2-1.fc43 -> 2:4.23.3-1.fc43
Downgraded:
rpm-ostree 2025.12-1.fc43 -> 2025.11.1.gf8478a1d-1000.1.fc43.bazzite
rpm-ostree-libs 2025.12-1.fc43 -> 2025.11.1.gf8478a1d-1000.1.fc43.bazzite
Removed:
kernel-6.17.7-300.fc43.x86_64
kernel-core-6.17.7-300.fc43.x86_64
kernel-modules-6.17.7-300.fc43.x86_64
kernel-modules-core-6.17.7-300.fc43.x86_64
nfs-utils-coreos-1:2.8.4-0.fc43.x86_64
Added:
NetworkManager-wifi-1:1.54.0-2.fc43.x86_64
atheros-firmware-20251125-1.fc43.noarch
bcc-0.35.0-2.fc43.x86_64
bcc-tools-0.35.0-2.fc43.x86_64
bpftrace-0.24.0-1.fc43.x86_64
brcmfmac-firmware-20251125-1.fc43.noarch
checkpolicy-3.9-2.fc43.x86_64
clang-libs-21.1.6-1.fc43.x86_64
clang-resource-filesystem-21.1.6-1.fc43.x86_64
clang15-libs-15.0.7-10.fc43.x86_64
clang15-resource-filesystem-15.0.7-10.fc43.x86_64
clang20-libs-20.1.8-2.fc43.x86_64
clang20-resource-filesystem-20.1.8-2.fc43.x86_64
cockpit-bridge-351-1.fc43.noarch
cockpit-networkmanager-351-1.fc43.noarch
cockpit-podman-117-1.fc43.noarch
cockpit-selinux-351-1.fc43.noarch
cockpit-storaged-351-1.fc43.noarch
cockpit-system-351-1.fc43.noarch
compiler-rt20-20.1.8-2.fc43.x86_64
cups-filesystem-1:2.4.14-3.fc43.noarch
cups-libs-1:2.4.14-3.fc43.x86_64
distrobox-1.8.2.1-1.fc43.noarch
dnf5-plugins-5.2.17.0-2.fc43.x86_64
docker-buildx-0.30.1-1.fc43.x86_64
docker-compose-2.40.3-1.fc43.x86_64
docker-compose-switch-1.0.5-6.fc43.x86_64
duperemove-0.15.2-2.fc43.x86_64
elfutils-debuginfod-client-0.194-1.fc43.x86_64
exfatprogs-1.3.0-2.fc43.x86_64
f2fs-tools-1.16.0-9.fc43.x86_64
firewalld-2.3.2-1.fc43.noarch
firewalld-filesystem-2.3.2-1.fc43.noarch
fwupd-efi-1.8-1.fc43.x86_64
groff-base-1.23.0-10.fc43.x86_64
gssproxy-0.9.2-9.fc43.x86_64
hdparm-9.65-9.fc43.x86_64
hicolor-icon-theme-0.18-2.fc43.noarch
ima-evm-utils-libs-1.6.2-6.fc43.x86_64
intel-compute-runtime-25.31.34666.3-1.fc43.x86_64
intel-gmmlib-22.8.2-1.fc43.x86_64
intel-igc-2.16.0-1.fc43.x86_64
intel-igc-libs-2.16.0-1.fc43.x86_64
intel-level-zero-25.31.34666.3-1.fc43.x86_64
intel-ocloc-25.31.34666.3-1.fc43.x86_64
intel-opencl-25.31.34666.3-1.fc43.x86_64
intel-opencl-clang-15.0.1-2.fc43.x86_64
ipset-7.24-2.fc43.x86_64
ipset-libs-7.24-2.fc43.x86_64
iw-6.17-1.fc43.x86_64
iwlegacy-firmware-20251125-1.fc43.noarch
iwlwifi-dvm-firmware-20251125-1.fc43.noarch
iwlwifi-mld-firmware-20251125-1.fc43.noarch
iwlwifi-mvm-firmware-20251125-1.fc43.noarch
kernel-longterm-6.12.59-200.fc43.x86_64
kernel-longterm-core-6.12.59-200.fc43.x86_64
kernel-longterm-modules-6.12.59-200.fc43.x86_64
kernel-longterm-modules-core-6.12.59-200.fc43.x86_64
kernel-longterm-modules-extra-6.12.59-200.fc43.x86_64
kmod-zfs-2.3.5-1.fc43.x86_64
libatasmart-0.19-31.fc43.x86_64
libatomic-15.2.1-4.fc43.x86_64
libblockdev-3.4.0-1.fc43.x86_64
libblockdev-btrfs-3.4.0-1.fc43.x86_64
libblockdev-crypto-3.4.0-1.fc43.x86_64
libblockdev-fs-3.4.0-1.fc43.x86_64
libblockdev-loop-3.4.0-1.fc43.x86_64
libblockdev-lvm-3.4.0-1.fc43.x86_64
libblockdev-mdraid-3.4.0-1.fc43.x86_64
libblockdev-nvme-3.4.0-1.fc43.x86_64
libblockdev-part-3.4.0-1.fc43.x86_64
libblockdev-smart-3.4.0-1.fc43.x86_64
libblockdev-swap-3.4.0-1.fc43.x86_64
libblockdev-utils-3.4.0-1.fc43.x86_64
libbytesize-2.11-104.fc43.x86_64
libcap-ng-python3-0.8.5-8.fc43.x86_64
libev-4.33-14.fc43.x86_64
libfsverity-1.6-3.fc43.x86_64
libgomp-15.2.1-4.fc43.x86_64
libgudev-238-8.fc43.x86_64
libmspack-0.10.1-0.15.alpha.fc43.x86_64
libnetapi-2:4.23.3-1.fc43.x86_64
libnvpair3-2.3.5-1.fc43.x86_64
libomp20-20.1.8-2.fc43.x86_64
libomp20-devel-20.1.8-2.fc43.x86_64
libpipeline-1.5.8-3.fc43.x86_64
libudisks2-2.11.0-1.fc43.x86_64
liburing-2.9-2.fc43.x86_64
libutempter-1.2.1-19.fc43.x86_64
libuutil3-2.3.5-1.fc43.x86_64
libverto-libev-0.3.2-11.fc43.x86_64
libxslt-1.1.43-5.fc43.x86_64
libzfs6-2.3.5-1.fc43.x86_64
libzpool6-2.3.5-1.fc43.x86_64
lld15-libs-15.0.7-9.fc43.x86_64
llvm-filesystem-21.1.6-1.fc43.x86_64
llvm-libs-21.1.6-1.fc43.x86_64
llvm15-libs-15.0.7-14.fc43.x86_64
llvm20-filesystem-20.1.8-2.fc43.x86_64
llvm20-libs-20.1.8-2.fc43.x86_64
lm_sensors-libs-3.6.0-23.fc43.x86_64
lzop-1.04-17.fc43.x86_64
man-db-2.13.1-2.fc43.x86_64
mbuffer-20241007-3.fc43.x86_64
mergerfs-2.41.1-1.fc43.x86_64
mpdecimal-4.0.1-2.fc43.x86_64
mt7xxx-firmware-20251125-1.fc43.noarch
nfs-utils-1:2.8.4-0.fc43.x86_64
nilfs-utils-2.2.11-7.fc43.x86_64
nspr-4.37.0-7.fc43.x86_64
nss-3.118.1-2.fc43.x86_64
nss-softokn-3.118.1-2.fc43.x86_64
nss-softokn-freebl-3.118.1-2.fc43.x86_64
nss-sysinit-3.118.1-2.fc43.x86_64
nss-util-3.118.1-2.fc43.x86_64
ntfs-3g-2:2022.10.3-10.fc43.x86_64
ntfs-3g-libs-2:2022.10.3-10.fc43.x86_64
ntfs-3g-system-compression-1.0-19.fc43.x86_64
ntfsprogs-2:2022.10.3-10.fc43.x86_64
nxpwireless-firmware-20251125-1.fc43.noarch
open-vm-tools-13.0.0-1.fc43.x86_64
pcp-7.0.3-1.fc43.x86_64
pcp-conf-7.0.3-1.fc43.x86_64
pcp-doc-7.0.3-1.fc43.noarch
pcp-libs-7.0.3-1.fc43.x86_64
pcp-pmda-bpf-7.0.3-1.fc43.x86_64
pcp-pmda-bpftrace-7.0.3-1.fc43.x86_64
pcp-pmda-dm-7.0.3-1.fc43.x86_64
pcp-pmda-nfsclient-7.0.3-1.fc43.x86_64
pcp-pmda-openmetrics-7.0.3-1.fc43.x86_64
pcp-pmda-opentelemetry-7.0.3-1.fc43.x86_64
pcp-selinux-7.0.3-1.fc43.x86_64
pcp-system-tools-7.0.3-1.fc43.x86_64
pcp-zeroconf-7.0.3-1.fc43.x86_64
perl-AutoLoader-5.74-520.fc43.noarch
perl-B-1.89-520.fc43.x86_64
perl-Capture-Tiny-0.50-3.fc43.noarch
perl-Carp-1.54-520.fc43.noarch
perl-Class-Struct-0.68-520.fc43.noarch
perl-Config-IniFiles-3.000003-17.fc43.noarch
perl-Data-Dumper-2.191-521.fc43.x86_64
perl-Digest-1.20-520.fc43.noarch
perl-Digest-MD5-2.59-520.fc43.x86_64
perl-DynaLoader-1.57-520.fc43.x86_64
perl-Encode-4:3.21-520.fc43.x86_64
perl-Errno-1.38-520.fc43.x86_64
perl-Exporter-5.79-520.fc43.noarch
perl-Fcntl-1.20-520.fc43.x86_64
perl-File-Basename-2.86-520.fc43.noarch
perl-File-Path-2.18-520.fc43.noarch
perl-File-Temp-1:0.231.100-520.fc43.noarch
perl-File-stat-1.14-520.fc43.noarch
perl-FileHandle-2.05-520.fc43.noarch
perl-Getopt-Long-1:2.58-520.fc43.noarch
perl-Getopt-Std-1.14-520.fc43.noarch
perl-HTTP-Tiny-0.090-521.fc43.noarch
perl-IO-1.55-520.fc43.x86_64
perl-IO-Socket-IP-0.43-521.fc43.noarch
perl-IO-Socket-SSL-2.095-2.fc43.noarch
perl-IO-stringy-2.113-17.fc43.noarch
perl-IPC-Open3-1.24-520.fc43.noarch
perl-MIME-Base32-1.303-24.fc43.noarch
perl-MIME-Base64-3.16-520.fc43.x86_64
perl-NDBM_File-1.18-520.fc43.x86_64
perl-Net-SSLeay-1.94-11.fc43.x86_64
perl-POSIX-2.23-520.fc43.x86_64
perl-PathTools-3.94-520.fc43.x86_64
perl-Pod-Escapes-1:1.07-520.fc43.noarch
perl-Pod-Perldoc-3.28.01-521.fc43.noarch
perl-Pod-Simple-1:3.47-3.fc43.noarch
perl-Pod-Usage-4:2.05-520.fc43.noarch
perl-Scalar-List-Utils-5:1.70-1.fc43.x86_64
perl-SelectSaver-1.02-520.fc43.noarch
perl-Socket-4:2.040-2.fc43.x86_64
perl-Storable-1:3.37-521.fc43.x86_64
perl-Symbol-1.09-520.fc43.noarch
perl-Sys-Hostname-1.25-520.fc43.x86_64
perl-Term-ANSIColor-5.01-521.fc43.noarch
perl-Term-Cap-1.18-520.fc43.noarch
perl-Text-ParseWords-3.31-520.fc43.noarch
perl-Text-Tabs+Wrap-2024.001-520.fc43.noarch
perl-Time-Local-2:1.350-520.fc43.noarch
perl-URI-5.34-2.fc43.noarch
perl-base-2.27-520.fc43.noarch
perl-constant-1.33-521.fc43.noarch
perl-if-0.61.000-520.fc43.noarch
perl-interpreter-4:5.42.0-520.fc43.x86_64
perl-libnet-3.15-521.fc43.noarch
perl-libs-4:5.42.0-520.fc43.x86_64
perl-locale-1.13-520.fc43.noarch
perl-mro-1.29-520.fc43.x86_64
perl-overload-1.40-520.fc43.noarch
perl-overloading-0.02-520.fc43.noarch
perl-parent-1:0.244-520.fc43.noarch
perl-podlators-1:6.0.2-520.fc43.noarch
perl-vars-1.05-520.fc43.noarch
podman-compose-1.5.0-4.fc43.noarch
policycoreutils-python-utils-3.9-5.fc43.noarch
pv-1.9.34-1.fc43.x86_64
python-pip-wheel-25.1.1-18.fc43.noarch
python-unversioned-command-3.14.0-2.fc43.noarch
python3-3.14.0-2.fc43.x86_64
python3-audit-4.1.2-2.fc43.x86_64
python3-bcc-0.35.0-2.fc43.noarch
python3-cffi-2.0.0-2.fc43.x86_64
python3-charset-normalizer-3.4.3-3.fc43.noarch
python3-click-1:8.1.7-11.fc43.noarch
python3-dasbus-1.7-13.fc43.noarch
python3-dbus-1.4.0-7.fc43.x86_64
python3-distro-1.9.0-10.fc43.noarch
python3-dotenv-1.1.0-5.fc43.noarch
python3-dotenv+cli-1.1.0-5.fc43.noarch
python3-firewall-2.3.2-1.fc43.noarch
python3-gobject-base-3.54.5-4.fc43.x86_64
python3-idna-3.10-6.fc43.noarch
python3-libs-3.14.0-2.fc43.x86_64
python3-libselinux-3.9-5.fc43.x86_64
python3-libsemanage-3.9-4.fc43.x86_64
python3-libxml2-2.12.10-5.fc43.x86_64
python3-netaddr-1.3.0-10.fc43.noarch
python3-nftables-1:1.1.3-5.fc43.noarch
python3-pcp-7.0.3-1.fc43.x86_64
python3-ply-3.11-30.fc43.noarch
python3-policycoreutils-3.9-5.fc43.noarch
python3-pycparser-2.22-5.fc43.noarch
python3-pysocks-1.7.1-31.fc43.noarch
python3-pyyaml-6.0.2-7.fc43.x86_64
python3-pyzfs-2.3.5-1.fc43.noarch
python3-requests-2.32.5-2.fc43.noarch
python3-rpm-6.0.0-1.fc43.x86_64
python3-setools-4.6.0-3.fc43.x86_64
python3-six-1.17.0-7.fc43.noarch
python3-systemd-235-17.fc43.x86_64
python3-urllib3-2.5.0-3.fc43.noarch
python3-urllib3+socks-2.5.0-3.fc43.noarch
qemu-guest-agent-2:10.1.2-1.fc43.x86_64
quota-1:4.10-2.fc43.x86_64
quota-nls-1:4.10-2.fc43.noarch
rclone-1.72.0-1.fc43.x86_64
realtek-firmware-20251125-1.fc43.noarch
rpm-build-libs-6.0.0-1.fc43.x86_64
rpm-sign-libs-6.0.0-1.fc43.x86_64
samba-2:4.23.3-1.fc43.x86_64
samba-common-tools-2:4.23.3-1.fc43.x86_64
samba-dcerpc-2:4.23.3-1.fc43.x86_64
samba-ldb-ldap-modules-2:4.23.3-1.fc43.x86_64
samba-libs-2:4.23.3-1.fc43.x86_64
samba-usershares-2:4.23.3-1.fc43.noarch
sanoid-2.2.0-1.fc43.ucore3.noarch
setroubleshoot-plugins-3.3.15-5.fc43.noarch
setroubleshoot-server-3.3.35-10.fc43.x86_64
smartmontools-1:7.5-4.fc43.x86_64
smartmontools-selinux-1:7.5-4.fc43.noarch
snapraid-13.0-3.fc43.x86_64
spirv-llvm15.0-translator-15.0.15-1.fc43.x86_64
spirv-tools-libs-2025.3-4.fc43.x86_64
sysstat-12.7.8-1.fc43.x86_64
tailscale-1.90.9-1.x86_64
tiwilink-firmware-20251125-1.fc43.noarch
tmux-3.5a-7.fc43.x86_64
ublue-os-signing-0.5-1.fc43.noarch
ublue-os-ucore-addons-0.1-1.fc43.noarch
udftools-2.3-12.fc43.x86_64
udisks2-2.11.0-1.fc43.x86_64
udisks2-btrfs-2.11.0-1.fc43.x86_64
udisks2-iscsi-2.11.0-1.fc43.x86_64
udisks2-lvm2-2.11.0-1.fc43.x86_64
usbutils-018-4.fc43.x86_64
volume_key-libs-0.3.12-28.fc43.x86_64
wireless-regdb-2025.10.07-1.fc43.noarch
wpa_supplicant-1:2.11-7.fc43.x86_64
xdg-dbus-proxy-0.1.6-3.fc43.x86_64
xdg-user-dirs-0.18-11.fc43.x86_64
xmlsec1-1:1.2.41-3.fc43.x86_64
xmlsec1-openssl-1:1.2.41-3.fc43.x86_64
zfs-2.3.5-1.fc43.x86_64
zfs-dracut-2.3.5-1.fc43.noarch
Changes queued for next boot. Run "systemctl reboot" to start a reboot
root@localhost:~# systemctl reboot
Broadcast message from root@localhost on pts/1 (Fri 2025-12-05 10:54:26 UTC):
The system will reboot now!
root@localhost:~# Read from remote host 192.168.122.117: Connection reset by peer
Connection to 192.168.122.117 closed.
client_loop: send disconnect: Broken pipe
dbaggett at HomeDebian in ~/butane 05:54 AM
✗ ssh core@192.168.122.117
Fedora CoreOS 43.20251110.3.1 (uCore)
Tracker: https://github.com/coreos/fedora-coreos-tracker
Discuss: https://discussion.fedoraproject.org/tag/coreos
Last login: Fri Dec 5 10:51:02 2025 from 192.168.122.1
core@localhost:~$ sudo -i
root@localhost:~# ostree fsck
Validating refs...
Validating refs in collections...
Enumerating commits...
Verifying content integrity of 70 commit objects...
fsck objects (20266/48327) [===== ] 41%
error: In commits acba8342223556fc54226e00f5cbaf0f6f26feca440aaefed1a6eb557e47a2c3, 3cfcb331f319f0a4eac3fb18c62438e6d10b0548edd08baa0ccf2806936fc812: fsck content object 78d060393c58beb2a555dedcac53c64b0c5175c41af916b981afd44d2839ee5a: Corrupted file object; checksum expected='78d060393c58beb2a555dedcac53c64b0c5175c41af916b981afd44d2839ee5a' actual='a89e23bf46ebee539298fe32697906f55f6281af6df7ad8055f668ec6c289fc7'
root@localhost:~#
```
Basically, a fresh FCOS image has no fsck problems, but if you rebase to uCore you do.
root@ucore-server-vm:~# ostree fsck
Validating refs...
Validating refs in collections...
Enumerating commits...
Verifying content integrity of 99 commit objects...
fsck objects (5235/53445) [= ] 9%
error: In commits 4264cbf6dd2729b4183f96cd8e27e5485821e5bde3dd77b8fe629ebba29eacdf: fsck content object 12e3702aef49a9f44be0e10ee013faba0aecefa180711fc17f7d1cf69769eb36: Corrupted file object; checksum expected='12e3702aef49a9f44be0e10ee013faba0aecefa180711fc17f7d1cf69769eb36' actual='2373a0358fc6baa1fbb0aea4c1e51a9cbf45d789c9afa2dfee49075469ab6b24'
