September 18, 2026
The GPU Disappeared From PCIe — The VM Stopped With It
A <CUSTOMER_PLATFORM> team runs a Windows VM on a dedicated RTX 4060 host using VFIO GPU passthrough for streaming. Each PCIe dropout removed the card from the bus four times in the first 24 hours of the ticket. Both PCI functions read config=ffffffff; only a warm host reboot restored GPU passthrough for another one to three hours.
The customer removed the host from production on this USA hosting account, granted access via the ticket channel only, and asked for GPU replacement or a different slot while keeping VM disks untouched. They authorized reboots and power-downs while the server was out of rotation.
0000:02:00.0 config=ffffffff
0000:02:00.1 config=ffffffff
lspci: !!! Unknown header type 7f
07:29:43 host booted, card healthy (config=de108228), VM running
08:59:35 first errors (~90 min into uninterrupted GPU use)
09:03:18 root port declares downstream device broken
Runtime PM was already off (power/control = on, d3cold_allowed = 0, vfio-pci disable_idle_d3=1). The same VFIO passthrough stack works on other fleet hosts in our hosting environment—pointing at this machine’s PCIe path or RTX 4060 silicon, not a generic guest driver issue.
September 19 – 22, 2026
Logs Showed Link Failure — Not A Host Crash
Engineers Gary and Sunny confirmed the GPU and HD Audio were on vfio-pci for VFIO passthrough. Failures showed transaction timeouts, failed FLR recovery, and a root port that could not retrain the link (stuck at 2.5 GT/s)—a classic PCIe dropout signature under VFIO GPU passthrough. CPU, memory, and thermals were normal; short stress tests did not instantly reproduce the fault—consistent with long runtime plus hardware path on server hosting gear.
vfio-pci 0000:02:00.0: timed out waiting for pending transaction; performing FLR anyway
vfio-pci 0000:02:00.0: Unable to change power state from D0 to D3hot, device inaccessible
pcieport 0000:00:03.0: broken device, retraining non-functional downstream link at 2.5GT/s
pcieport 0000:00:03.0: Data Link Layer Link Active not set in 100 msec
Onsite work followed with customer approval on their USA hosting node: reseat, contact clean, alternate slot/riser, 8-pin power, cooling check. After September 22 maintenance, the customer verified 8 GT/s ×8 on the RTX 4060 and returned VFIO passthrough to production briefly, noting they would report any recurrence of PCIe dropout.
September 25 – 27, 2026
Seven More PCIe Dropouts — Customer UTC Forensics
After ~43 hours of clean GPU passthrough, the RTX 4060 failed again under normal load. The customer logged seven UTC timestamps (Sep 25–26)—detail Database Mart support called very helpful for proving a hardware pattern in VFIO GPU passthrough. Cycles showed BAR restore, transaction timeout, FLR, then ffffffff config space; gaps between each PCIe dropout ranged from 16 minutes to 9 hours.
“As the reseat and the power and cooling checks did not help, could you please replace the GPU, or move it to a different PCIe slot/riser as planned? The server is out of our rotation.”
Customer · September 27, 2026
Hardware task #42467: riser/slot path, power delivery, then GPU replacement if needed—no production window required.
September 28, 2026
Stress Test Failed After Riser Work — GPU Swapped
Riser reseat and slot path change still reproduced PCIe dropout under stress on this VFIO passthrough host. The team returned, replaced the RTX 4060, and re-ran stability testing with no further GPU passthrough errors on the bench. VM disks were not modified.
September 29 – 30, 2026
Records Reconciled After A Wrong Host IP In One Update
One status email referenced a different host (IP redacted) than the affected server (IP redacted). The customer replied with uptime since 28 Sep 21:47 UTC and LnkSta at 2.5 GT/s vs LnkCap at 8 GT/s—constructive forensics that sped reconciliation.
“Could you please confirm on which server the card was actually replaced? … the PCIe link is currently running at a reduced speed: LnkSta reports 2.5 GT/s while LnkCap is 8 GT/s.”
Customer · September 30, 2026
| Check | Expected | Customer observation |
| PCIe link speed | 8 GT/s ×8 cap | 2.5 GT/s negotiated |
| Post-replace uptime | Reboot for swap | Continuous since 28 Sep 21:47 UTC |
| VFIO config space | Valid IDs | Healthy after reboots |
| Ticket asset match | Single host | One reply cited wrong IP |
Maintenance records confirmed the September 28 replacement on the correct asset. If link speed had stayed degraded, policy was machine migration with matched data disks—RTX 4060 spares were depleted at the time.
October 1, 2026
Closed Stable — Mutual Confirmation
The customer confirmed no PCIe dropout or VFIO passthrough errors since the September 28 RTX 4060 swap. Engineer Angelica closed the ticket as requested and invited a new ticket with timestamps and logs if GPU passthrough fails again.
“We are glad to hear that the server has remained stable since the GPU replacement on September 28, with no further GPU dropouts or PCIe errors reported… We will proceed with closing this ticket as requested.”
Angelica, Support Department · October 1, 2026
# Closure checklist (Oct 1, 2026)
✓ No vfio-pci dropout / FLR storm since GPU swap
✓ No recurring config=ffffffff on 0000:02:00.0 / .1
✓ VM disks never re-imaged or replaced
✓ Production rotation resumed at customer discretion