RevPi Compact Crash

michael@gunsch.info · Post by **michael@gunsch.info** » 07 Mar 2022, 09:16

The Compact crashes after an uptime of several months with the following entries in /var/log/kern.log

Mar  5 23:45:17 RevPi1927 kernel: [10413981.469836] piControl: piControl i/o: missed 1 cycles
Mar  5 23:47:04 RevPi1927 kernel: [10414087.870235] piControl: piControl i/o: missed 13 cycles
Mar  5 23:47:26 RevPi1927 kernel: [10414110.090288] piControl: piControl i/o: missed 21 cycles
Mar  5 23:47:40 RevPi1927 kernel: [641281802.452154] sched: RT throttling activated
Mar  5 23:47:40 RevPi1927 kernel: [10414124.010252] ks8851 spi0.2: SPI transfer timed out
Mar  5 23:47:40 RevPi1927 kernel: [10414124.010294] ks8851 spi0.2 eth1: ks8851_rdfifo: spi_sync() failed
Mar  5 23:47:41 RevPi1927 kernel: [10414124.980246] ks8851 spi0.2: SPI transfer timed out
Mar  5 23:47:41 RevPi1927 kernel: [10414124.980291] ks8851 spi0.2 eth1: ks8851_rdfifo: spi_sync() failed
Mar  5 23:47:45 RevPi1927 kernel: [10414129.010265] ks8851 spi0.2: SPI transfer timed out
Mar  5 23:47:45 RevPi1927 kernel: [10414129.010316] ks8851 spi0.2 eth1: ks8851_rdfifo: spi_sync() failed
Mar  5 23:47:46 RevPi1927 kernel: [10414129.980256] ks8851 spi0.2: SPI transfer timed out
Mar  5 23:47:46 RevPi1927 kernel: [10414129.980308] ks8851 spi0.2 eth1: ks8851_rdfifo: spi_sync() failed
Mar  5 23:47:48 RevPi1927 kernel: [10414131.620306] ks8851 spi0.2: SPI transfer timed out
Mar  5 23:47:48 RevPi1927 kernel: [10414131.620355] ks8851 spi0.2 eth1: ks8851_rdfifo: spi_sync() failed
Mar  5 23:47:50 RevPi1927 kernel: [10414134.010269] ks8851 spi0.2: SPI transfer timed out
Mar  5 23:47:50 RevPi1927 kernel: [10414134.010316] ks8851 spi0.2 eth1: ks8851_rdfifo: spi_sync() failed
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510254] mmc0: timeout waiting for hardware interrupt.
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510266] [7c43c5db] FCM> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510271] [7c43c5db] CMD  d 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510276] [7c43c5db] REQ> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510281] [7c43c5e5] TSK< a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510286] [7c43c5ec] TSK> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510291] [7c53a464] REQ< a5037db0 10801
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510295] [7c53a465] CMD< d 10000
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510300] [7c53a469] FCM< a5037db0 a5037e18
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510305] [7c53a46b] RSP  900 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510310] [7c53a46d] FCM> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510314] [7c53a46d] CMD  d 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510319] [7c53a46e] REQ> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510323] [7c53a48b] TSK< a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510328] [7c53a492] TSK> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510333] [7c6382e8] REQ< a5037db0 10801
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510337] [7c6382e9] CMD< d 10000
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510342] [7c6382ee] FCM< a5037db0 a5037e18
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510347] [7c6382f0] RSP  900 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510352] [7c6382f1] FCM> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510356] [7c6382f2] CMD  d 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510361] [7c6382f2] REQ> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510366] [7c6382fc] TSK< a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510370] [7c638303] TSK> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510375] [7c73616c] REQ< a5037db0 10801
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510380] [7c73616d] CMD< d 10000
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510385] [7c736172] FCM< a5037db0 a5037e18
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510389] [7c736175] RSP  900 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510394] [7c736176] FCM> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510399] [7c736177] CMD  d 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510403] [7c736177] REQ> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510411] [7c736181] TSK< a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510416] [7c736188] TSK> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510421] [fc797c84] PRD< b8c60fb0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510426] [fc797c86] PRD1 b9f56440 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510430] [fc797c8d] PRD2 2 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510435] [fc797c9b] PRD3 b4ffe204 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510439] [fc797c9c] PDM> b8c60fb0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510444] [fc797c9e] REQ< b8c60ed0 10801
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510449] [fc797c9f] CMD< 19 2eef88
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510454] [fc797ca1] CMDD 10 200
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510459] [fc797ca2] SDMA b8c60fb0 b9f56440
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510463] [fc797ca4] FCM< b8c60ed0 b8c60f48
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510468] [fc797ca5] RSP  900 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510473] [fc797ca6] FCM> b8c60ed0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510477] [fc797ca6] CMD  19 200
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510482] [fc797ca6] REQ> b8c60ed0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510487] [bc797e2c] DMA< b8c60fb0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510492] [bc797e2d] DMA  99 10801
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510497] [bc797e2f] FDA< b8c60ed0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510501] [bc797e2f] TCM< b8c60fb0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510506] [bc797e30] CMD< c 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510511] [bc797e31] TCM> b8c60fb0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510515] [bc797e31] FDA> b8c60ed0 b8c60f7c
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510520] [bc797e32] DMA> 0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510525] [3c797e48] IRQ< 400 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510529] [3c797e48] IRQB b8c60f7c 400
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510534] [3c797e49] FCM< b8c60ed0 b8c60f7c
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510539] [3c797e4a] RSP  d00 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510544] [3c797e4a] FCM> b8c60ed0 b8c60f7c
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510548] [3c797e4b] IRQ> 0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510553] [3c797e4e] TSK< b8c60ed0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510558] [3c797e57] TSK> b8c60ed0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510562] [3c797e78] REQ< b6969da8 10801
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510567] [3c797e79] CMD< d 10000
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510572] [3c797e7b] FCM< b6969da8 b6969e10
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510577] [3c797e7d] RSP  900 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510581] [3c797e7e] FCM> b6969da8 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510586] [3c797e7e] CMD  d 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510591] [3c797e7f] REQ> b6969da8 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510595] [3c797e88] TSK< b6969da8 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510600] [3c797e8c] TSK> b6969da8 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510605] [fc797eff] REQ< b7183c88 10801
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510610] [fc797eff] CMD< 6 3200101
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510614] [fc797f01] CMD  6 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510619] [fc797f01] REQ> b7183c88 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510624] [7c798063] IRQ< 400 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510628] [7c798063] IRQB b7183d10 400
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510633] [7c798064] FCM< b7183c88 b7183d10
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510638] [7c798064] RSP  900 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510643] [7c798065] FCM> b7183c88 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510647] [7c798065] IRQ> 0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510652] [7c798068] TSK< b7183c88 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510657] [7c79806d] TSK> b7183c88 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510661] [fc798074] REQ< b7183c30 10801
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510666] [fc798074] CMD< d 10000
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510671] [fc798076] FCM< b7183c30 b7183c98
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510675] [fc798078] RSP  900 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510680] [fc79807d] FCM> b7183c30 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510685] [fc79807d] CMD  d 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510689] [fc79807e] REQ> b7183c30 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510694] [fc798086] TSK< b7183c30 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510699] [fc79808b] TSK> b7183c30 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510704] [fc798093] REQ< b7183c08 10801
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510708] [fc798094] CMD< d 10000
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510713] [fc798095] FCM< b7183c08 b7183c70
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510718] [fc798097] RSP  900 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510722] [fc798098] FCM> b7183c08 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510727] [fc798098] CMD  d 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510732] [fc798099] REQ> b7183c08 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510736] [fc79809f] TSK< b7183c08 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510741] [fc7980a3] TSK> b7183c08 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510746] [fc7980c9] PRD< b8c60fb0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510750] [fc7980ca] PRD1 b9f56440 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510755] [fc7980ce] PRD2 1 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510759] [fc7980d4] PRD3 b4ffe484 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510764] [fc7980d5] PDM> b8c60fb0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510769] [fc7980d7] REQ< b8c60ed0 10801
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510773] [fc7980d7] CMD< 19 2eef98
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510778] [fc7980d8] CMDD 8 200
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510783] [fc7980d9] SDMA b8c60fb0 b9f56440
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510788] [fc7980da] FCM< b8c60ed0 b8c60f48
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510792] [fc7980db] RSP  900 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510797] [fc7980dc] FCM> b8c60ed0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510802] [fc7980dc] CMD  19 200
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510807] [fc7980dc] REQ> b8c60ed0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510811] [bc798194] DMA< b8c60fb0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510816] [bc798194] DMA  99 10801
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510821] [bc798195] FDA< b8c60ed0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510825] [bc798195] TCM< b8c60fb0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510830] [bc798195] CMD< c 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510835] [bc798196] TCM> b8c60fb0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510839] [bc798196] FDA> b8c60ed0 b8c60f7c
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510844] [bc798197] DMA> 0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510849] [7c7981ab] IRQ< 400 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510853] [7c7981ac] IRQB b8c60f7c 400
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510858] [7c7981ac] FCM< b8c60ed0 b8c60f7c
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510863] [7c7981ac] RSP  d00 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510868] [7c7981ad] FCM> b8c60ed0 b8c60f7c
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510872] [7c7981ae] IRQ> 0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510877] [7c7981b0] TSK< b8c60ed0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510882] [7c7981b8] TSK> b8c60ed0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510887] [7c7981c5] REQ< a50d1da8 10801
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510891] [7c7981c5] CMD< d 10000
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510896] [7c7981c7] FCM< a50d1da8 a50d1e10
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510901] [7c7981c9] RSP  900 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510905] [7c7981cf] FCM> a50d1da8 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510910] [7c7981cf] CMD  d 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510915] [7c7981cf] REQ> a50d1da8 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510919] [7c7981d7] TSK< a50d1da8 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510924] [7c7981dc] TSK> a50d1da8 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510929] [7c833ff4] REQ< a5037db0 10801
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510933] [7c833ff5] CMD< d 10000
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510938] [7c833ff8] FCM< a5037db0 a5037e18
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510943] [7c833ffa] RSP  900 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510948] [7c833ffc] FCM> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510952] [7c833ffc] CMD  d 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510957] [7c833ffc] REQ> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510962] [7c834006] TSK< a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510966] [7c83400d] TSK> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510971] [7c931e87] REQ< a5037db0 10801
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510976] [7c931e88] CMD< d 10000
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510981] [7c931e8e] FCM< a5037db0 a5037e18
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510985] [7c931e90] RSP  900 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510990] [7c931e92] FCM> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510995] [7c931e92] CMD  d 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.510999] [7c931e92] REQ> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511004] [7c931e9e] TSK< a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511009] [7c931ea6] TSK> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511013] [fc9a7267] PRD< b8c60fb0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511018] [fc9a7268] PRD1 b9f56440 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511022] [fc9a726e] PRD2 1 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511027] [fc9a727a] PRD3 b4ffe484 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511032] [fc9a727b] PDM> b8c60fb0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511036] [fc9a727d] REQ< b8c60ed0 10801
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511041] [fc9a727e] CMD< 19 7a9828
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511046] [fc9a7281] CMDD 8 200
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511051] [fc9a7282] SDMA b8c60fb0 b9f56440
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511055] [fc9a7284] FCM< b8c60ed0 b8c60f48
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511060] [fc9a7286] RSP  900 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511065] [fc9a7286] FCM> b8c60ed0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511069] [fc9a7286] CMD  19 200
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511074] [fc9a7287] REQ> b8c60ed0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511078] [bc9a7364] DMA< b8c60fb0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511083] [bc9a7365] DMA  99 10801
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511088] [bc9a7367] FDA< b8c60ed0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511093] [bc9a7368] TCM< b8c60fb0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511097] [bc9a7369] CMD< c 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511102] [bc9a736a] TCM> b8c60fb0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511107] [bc9a736b] FDA> b8c60ed0 b8c60f7c
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511111] [bc9a736b] DMA> 0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511116] [7c9a7384] IRQ< 400 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511121] [7c9a7385] IRQB b8c60f7c 400
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511126] [7c9a7385] FCM< b8c60ed0 b8c60f7c
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511130] [7c9a7386] RSP  d00 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511135] [7c9a7388] FCM> b8c60ed0 b8c60f7c
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511140] [7c9a7389] IRQ> 0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511145] [7c9a738c] TSK< b8c60ed0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511149] [7c9a7397] TSK> b8c60ed0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511154] [7c9a73a8] REQ< a50d1da8 10801
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511159] [7c9a73a9] CMD< d 10000
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511164] [7c9a73ab] FCM< a50d1da8 a50d1e10
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511168] [7c9a73ad] RSP  900 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511173] [7c9a73b2] FCM> a50d1da8 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511178] [7c9a73b3] CMD  d 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511182] [7c9a73b3] REQ> a50d1da8 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511187] [7c9a73bd] TSK< a50d1da8 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511192] [7c9a73c2] TSK> a50d1da8 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511196] [7ca2fd09] REQ< a5037db0 10801
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511201] [7ca2fd0a] CMD< d 10000
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511206] [7ca2fd0f] FCM< a5037db0 a5037e18
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511211] [7ca2fd12] RSP  900 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511216] [7ca2fd13] FCM> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511221] [7ca2fd14] CMD  d 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511225] [7ca2fd14] REQ> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511230] [7ca2fd1f] TSK< a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511235] [7ca2fd27] TSK> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511239] [7cb2db8b] REQ< a5037db0 10801
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511244] [7cb2db8c] CMD< d 10000
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511249] [7cb2db92] FCM< a5037db0 a5037e18
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511254] [7cb2db94] RSP  900 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511258] [7cb2db95] FCM> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511263] [7cb2db96] CMD  d 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511267] [7cb2db96] REQ> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511272] [7cb2dba1] TSK< a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511277] [7cb2dba8] TSK> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511281] [7cc2ba0e] REQ< a5037db0 10801
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511286] [7cc2ba0f] CMD< d 10000
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511291] [7cc2ba13] FCM< a5037db0 a5037e18
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511296] [7cc2ba15] RSP  900 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511300] [7cc2ba16] FCM> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511305] [7cc2ba17] CMD  d 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511310] [7cc2ba17] REQ> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511315] [7cc2ba22] TSK< a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511319] [7cc2ba29] TSK> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511324] [7cd298ad] REQ< a5037db0 10801
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511329] [7cd298ae] CMD< d 10000
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511333] [7cd298b3] FCM< a5037db0 a5037e18
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511338] [7cd298b5] RSP  900 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511343] [7cd298b7] FCM> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511348] [7cd298b8] CMD  d 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511352] [7cd298b8] REQ> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511357] [7cd298c2] TSK< a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511362] [7cd298c9] TSK> a5037db0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511366] [3cf4a3c5] PRD< b8c607b0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511371] [3cf4a3c7] PRD1 b9f56440 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511376] [3cf4a3ce] PRD2 2 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511381] [3cf4a3da] PRD3 b7137884 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511385] [3cf4a3db] PDM> b8c607b0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511390] [3cf4a3dd] REQ< b8c606d0 10801
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511395] [3cf4a3de] CMD< 19 2eefa0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511399] [3cf4a3e1] CMDD 10 200
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511404] [3cf4a3e2] SDMA b8c607b0 b9f56440
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511409] [3cf4a3e5] FCM< b8c606d0 b8c60748
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511414] [3cf4a3e7] RSP  900 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511418] [3cf4a3e7] FCM> b8c606d0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511423] [3cf4a3e8] CMD  19 200
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511428] [3cf4a3e8] REQ> b8c606d0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511432] [bcf4a578] DMA< b8c607b0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511437] [bcf4a579] DMA  99 10801
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511442] [bcf4a57c] FDA< b8c606d0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511447] [bcf4a57d] TCM< b8c607b0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511451] [bcf4a57e] CMD< c 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511456] [bcf4a580] TCM> b8c607b0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511461] [bcf4a580] FDA> b8c606d0 b8c6077c
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511465] [bcf4a581] DMA> 0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511470] [3d94b033] TIM< 0 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511478] mmc0: sbc op 23 arg 0x10 flags 0x15 - resp 00000000 00000000 00000000 00000000, err 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511484] mmc0: cmd op 25 arg 0x2eefa0 flags 0xb5 - resp 00000900 00000000 00000000 00000000, err 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511489] mmc0: data blocks 10 blksz 200 - err 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511495] mmc0:>stop op 12 arg 0x0 flags 0x49d - resp 00000000 00000000 00000000 00000000, err 0
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511498] mmc0: =========== REGISTER DUMP ===========
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511502] mmc0: SDCMD  0x0000080c
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511506] mmc0: SDARG  0x00000000
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511509] mmc0: SDTOUT 0x017d7840
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511513] mmc0: SDCDIV 0x00000006
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511516] mmc0: SDRSP0 0x00000d00
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511520] mmc0: SDRSP1 0x00000c05
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511523] mmc0: SDRSP2 0x7fffffff
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511527] mmc0: SDRSP3 0x0002400c
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511530] mmc0: SDHSTS 0x00000400
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511534] mmc0: SDVDD  0x00000001
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511537] mmc0: SDEDM  0x00010801
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511541] mmc0: SDHCFG 0x0000040e
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511544] mmc0: SDHBCT 0x00000006
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511547] mmc0: SDHBLC 0x00000001
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511551] mmc0: ===========================================
Mar  5 23:47:50 RevPi1927 kernel: [10414134.511633] piControl: piControl i/o: missed 4 cycles
Mar  5 23:47:51 RevPi1927 kernel: [10414134.980283] ks8851 spi0.2: SPI transfer timed out
Mar  5 23:47:51 RevPi1927 kernel: [10414134.980331] ks8851 spi0.2 eth1: ks8851_rdfifo: spi_sync() failed
Mar  5 23:47:55 RevPi1927 kernel: [10414139.000306] ks8851 spi0.2: SPI transfer timed out
Mar  5 23:47:55 RevPi1927 kernel: [10414139.000355] ks8851 spi0.2 eth1: ks8851_rdfifo: spi_sync() failed
Mar  5 23:47:56 RevPi1927 kernel: [10414139.980308] ks8851 spi0.2: SPI transfer timed out
Mar  5 23:47:56 RevPi1927 kernel: [10414139.980354] ks8851 spi0.2 eth1: ks8851_rdfifo: spi_sync() failed
Mar  5 23:48:02 RevPi1927 kernel: [10414146.070469] piControl: piControl i/o: missed 15 cycles
Mar  5 23:48:07 RevPi1927 kernel: [10414151.070457] piControl: piControl i/o: missed 5 cycles
Mar  5 23:48:13 RevPi1927 kernel: [10414157.500502] piControl: piControl i/o: missed 34 cycles
Mar  5 23:48:14 RevPi1927 kernel: [10414158.490477] piControl: piControl i/o: missed 22 cycles
Mar  5 23:48:18 RevPi1927 kernel: [10414161.870482] piControl: piControl i/o: missed 13 cycles
Mar  5 23:48:18 RevPi1927 kernel: [10414161.970496] piControl: piControl i/o: missed 22 cycles
Mar  5 23:48:19 RevPi1927 kernel: [10414162.860519] piControl: piControl i/o: missed 31 cycles
Mar  5 23:48:21 RevPi1927 kernel: [10414165.490519] piControl: piControl i/o: missed 23 cycles
Mar  5 23:48:25 RevPi1927 kernel: [10414169.080500] piControl: piControl i/o: missed 20 cycles
Mar  5 23:48:26 RevPi1927 kernel: [10414169.870522] piControl: piControl i/o: missed 33 cycles
Mar  5 23:48:30 RevPi1927 kernel: [10414174.030513] piControl: piControl i/o: missed 24 cycles
Mar  5 23:48:32 RevPi1927 kernel: [10414175.870519] piControl: piControl i/o: missed 13 cycles
Mar  5 23:48:45 RevPi1927 kernel: [10414189.500639] piControl: piControl i/o: missed 18 cycles
Mar  5 23:48:46 RevPi1927 kernel: [10414189.950239] piControl: piControl i/o: missed 5 cycles
Mar  5 23:48:48 RevPi1927 kernel: [10414191.970569] piControl: piControl i/o: missed 22 cycles
Mar  5 23:48:49 RevPi1927 kernel: [10414193.080562] piControl: piControl i/o: missed 14 cycles
Mar  5 23:48:50 RevPi1927 kernel: [10414194.070600] piControl: piControl i/o: missed 38 cycles
Mar  5 23:49:25 RevPi1927 kernel: [10414228.960720] piControl: piControl i/o: missed 16 cycles
Mar  5 23:49:26 RevPi1927 kernel: [10414230.070719] piControl: piControl i/o: missed 8 cycles
Mar  5 23:49:33 RevPi1927 kernel: [10414237.480723] piControl: piControl i/o: missed 15 cycles
Mar  5 23:49:36 RevPi1927 kernel: [10414239.860719] piControl: piControl i/o: missed 31 cycles
Mar  5 23:49:36 RevPi1927 kernel: [10414240.080729] piControl: piControl i/o: missed 20 cycles
Mar  5 23:50:20 RevPi1927 kernel: [10414283.620849] piControl: piControl i/o: missed 13 cycles
Mar  5 23:50:23 RevPi1927 kernel: [10414286.620854] piControl: piControl i/o: missed 13 cycles
Mar  5 23:50:36 RevPi1927 kernel: [10414299.870856] piControl: piControl i/o: missed 13 cycles
Mar  5 23:51:06 RevPi1927 kernel: [10414330.470903] piControl: piControl i/o: missed 1 cycles
Mar  5 23:51:09 RevPi1927 kernel: [10414332.621004] piControl: piControl i/o: missed 13 cycles
Mar  5 23:51:27 RevPi1927 kernel: [10414350.631088] piControl: piControl i/o: missed 8 cycles
Mar  5 23:51:36 RevPi1927 kernel: [10414359.621092] piControl: piControl i/o: missed 13 cycles
Mar  5 23:51:37 RevPi1927 kernel: [10414360.621089] piControl: piControl i/o: missed 13 cycles
Mar  5 23:52:08 RevPi1927 kernel: [10414391.621170] piControl: piControl i/o: missed 1 cycles
Mar  5 23:52:12 RevPi1927 kernel: [10414395.621200] piControl: piControl i/o: missed 13 cycles
Mar  5 23:52:13 RevPi1927 kernel: [10414396.621200] piControl: piControl i/o: missed 13 cycles
Mar  5 23:52:23 RevPi1927 kernel: [10414406.621237] piControl: piControl i/o: missed 13 cycles
Mar  5 23:52:34 RevPi1927 kernel: [10414417.621297] piControl: piControl i/o: missed 13 cycles
Mar  5 23:52:43 RevPi1927 kernel: [10414426.621304] piControl: piControl i/o: missed 13 cycles
Mar  5 23:52:48 RevPi1927 kernel: [10414431.641346] piControl: piControl i/o: missed 17 cycles
Mar  5 23:52:58 RevPi1927 kernel: [10414441.621352] piControl: piControl i/o: missed 13 cycles
Mar  5 23:52:59 RevPi1927 kernel: [10414442.621351] piControl: piControl i/o: missed 13 cycles
Mar  5 23:53:04 RevPi1927 kernel: [10414447.621371] piControl: piControl i/o: missed 13 cycles
Mar  5 23:53:27 RevPi1927 kernel: [10414470.621446] piControl: piControl i/o: missed 2 cycles
Mar  5 23:53:28 RevPi1927 kernel: [10414471.621465] piControl: piControl i/o: missed 2 cycles
Mar  5 23:53:42 RevPi1927 kernel: [10414485.621491] piControl: piControl i/o: missed 13 cycles
Mar  5 23:53:45 RevPi1927 kernel: [10414488.621498] piControl: piControl i/o: missed 13 cycles
Mar  5 23:53:46 RevPi1927 kernel: [10414489.621499] piControl: piControl i/o: missed 13 cycles
Mar  5 23:54:10 RevPi1927 kernel: [10414513.670343] piControl: piControl i/o: missed 5 cycles
Mar  5 23:54:17 RevPi1927 kernel: [10414520.621601] piControl: piControl i/o: missed 13 cycles
Mar  5 23:54:19 RevPi1927 kernel: [10414522.621610] piControl: piControl i/o: missed 13 cycles
Mar  5 23:54:24 RevPi1927 kernel: [10414527.621620] piControl: piControl i/o: missed 13 cycles
Mar  5 23:54:26 RevPi1927 kernel: [10414529.621615] piControl: piControl i/o: missed 13 cycles
Mar  5 23:54:33 RevPi1927 kernel: [10414536.621647] piControl: piControl i/o: missed 13 cycles
Mar  5 23:54:49 RevPi1927 kernel: [10414552.631706] piControl: piControl i/o: missed 11 cycles
Mar  5 23:54:54 RevPi1927 kernel: [10414557.621713] piControl: piControl i/o: missed 3 cycles
Mar  5 23:55:03 RevPi1927 kernel: [10414567.081780] piControl: piControl i/o: missed 21 cycles
Mar  5 23:55:15 RevPi1927 kernel: [10414578.621794] piControl: piControl i/o: missed 13 cycles
Mar  5 23:55:25 RevPi1927 kernel: [10414588.641769] piControl: piControl i/o: missed 7 cycles
Mar  5 23:55:26 RevPi1927 kernel: [10414590.061806] piControl: piControl i/o: missed 3 cycles
Mar  5 23:55:28 RevPi1927 kernel: [10414591.611839] piControl: piControl i/o: missed 27 cycles
Mar  5 23:55:35 RevPi1927 kernel: [10414598.621842] piControl: piControl i/o: missed 13 cycles
Mar  5 23:55:35 RevPi1927 kernel: [10414599.001882] piControl: piControl i/o: missed 20 cycles
Mar  5 23:55:35 RevPi1927 kernel: [10414599.081851] piControl: piControl i/o: missed 20 cycles
Mar  5 23:55:39 RevPi1927 kernel: [10414602.621854] piControl: piControl i/o: missed 13 cycles
Mar  5 23:55:49 RevPi1927 kernel: [10414612.871866] piControl: piControl i/o: missed 13 cycles
Mar  5 23:55:53 RevPi1927 kernel: [10414616.871860] piControl: piControl i/o: missed 13 cycles
Mar  5 23:55:55 RevPi1927 kernel: [10414618.621934] piControl: piControl i/o: missed 14 cycles
Mar  5 23:55:58 RevPi1927 kernel: [10414622.501940] piControl: piControl i/o: missed 33 cycles
Mar  5 23:56:00 RevPi1927 kernel: [10414623.681904] piControl: piControl i/o: missed 12 cycles
Mar  5 23:56:05 RevPi1927 kernel: [10414629.501936] piControl: piControl i/o: missed 33 cycles
Mar  5 23:56:08 RevPi1927 kernel: [10414632.501943] piControl: piControl i/o: missed 4 cycles
Mar  5 23:56:10 RevPi1927 kernel: [10414634.061950] piControl: piControl i/o: missed 3 cycles
Mar  5 23:56:25 RevPi1927 kernel: [10414648.622001] piControl: piControl i/o: missed 13 cycles
Mar  5 23:56:36 RevPi1927 kernel: [10414659.622030] piControl: piControl i/o: missed 13 cycles
Mar  5 23:56:37 RevPi1927 kernel: [10414660.622044] piControl: piControl i/o: missed 13 cycles
Mar  5 23:56:55 RevPi1927 kernel: [10414679.471998] piControl: piControl i/o: missed 1 cycles
Mar  5 23:56:56 RevPi1927 kernel: [10414679.622094] piControl: piControl i/o: missed 13 cycles
Mar  5 23:57:15 RevPi1927 kernel: [10414699.082162] piControl: piControl i/o: missed 20 cycles
Mar  5 23:57:16 RevPi1927 kernel: [10414699.620203] piControl: piControl i/o: missed 6 cycles
Mar  5 23:57:28 RevPi1927 kernel: [10414712.072208] piControl: piControl i/o: missed 13 cycles
Mar  5 23:57:28 RevPi1927 kernel: [10414712.492190] piControl: piControl i/o: missed 29 cycles
Mar  5 23:57:29 RevPi1927 kernel: [10414713.062202] piControl: piControl i/o: missed 5 cycles
Mar  5 23:57:30 RevPi1927 kernel: [10414714.492224] piControl: piControl i/o: missed 29 cycles
Mar  5 23:57:32 RevPi1927 kernel: [10414716.492232] piControl: piControl i/o: missed 29 cycles
Mar  5 23:57:32 RevPi1927 kernel: [10414716.612211] piControl: piControl i/o: missed 29 cycles
Mar  5 23:57:33 RevPi1927 kernel: [10414716.648085] piControl: piControl i/o: missed 12 cycles
Mar  5 23:57:33 RevPi1927 kernel: [10414717.062214] piControl: piControl i/o: missed 5 cycles
Mar  5 23:57:34 RevPi1927 kernel: [10414717.622211] piControl: piControl i/o: missed 13 cycles
Mar  5 23:58:07 RevPi1927 kernel: [10414751.502312] piControl: piControl i/o: missed 5 cycles
Mar  5 23:58:09 RevPi1927 kernel: [10414753.062318] piControl: piControl i/o: missed 5 cycles
Mar  5 23:59:14 RevPi1927 kernel: [10414817.748779] piControl: piControl i/o: missed 18 cycles
Mar  5 23:59:23 RevPi1927 kernel: [10414826.622553] piControl: piControl i/o: missed 13 cycles
Mar  5 23:59:28 RevPi1927 kernel: [10414831.622567] piControl: piControl i/o: missed 6 cycles
Mar  5 23:59:29 RevPi1927 kernel: [10414832.622571] piControl: piControl i/o: missed 6 cycles
Mar  5 23:59:30 RevPi1927 kernel: [10414833.622541] piControl: piControl i/o: missed 13 cycles
Mar  5 23:59:37 RevPi1927 kernel: [10414840.622595] piControl: piControl i/o: missed 13 cycles
Mar  5 23:59:47 RevPi1927 kernel: [10414850.622634] piControl: piControl i/o: missed 13 cycles
Mar  6 00:12:03 RevPi1927 kernel: [10415587.324963] INFO: task kworker/u8:1:3486 blocked for more than 120 seconds.
Mar  6 00:12:03 RevPi1927 kernel: [10415587.324973]       Tainted: G         C O      4.19.95-rt38-v7 #1
Mar  6 00:12:03 RevPi1927 kernel: [10415587.324978] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Mar  6 00:12:03 RevPi1927 kernel: [10415587.324984] kworker/u8:1    D    0  3486      2 0x00000000
Mar  6 00:12:03 RevPi1927 kernel: [10415587.325008] Workqueue: netns cleanup_net
Mar  6 00:12:03 RevPi1927 kernel: [10415587.325028] [<808a6d74>] (__schedule) from [<808a7278>] (schedule+0x70/0x134)
Mar  6 00:12:03 RevPi1927 kernel: [10415587.325039] [<808a7278>] (schedule) from [<808aa104>] (schedule_timeout+0x2e8/0x4f8)
Mar  6 00:12:03 RevPi1927 kernel: [10415587.325051] [<808aa104>] (schedule_timeout) from [<808a81b4>] (wait_for_common+0x128/0x154)
Mar  6 00:12:03 RevPi1927 kernel: [10415587.325061] [<808a81b4>] (wait_for_common) from [<808a8200>] (wait_for_completion+0x20/0x24)
Mar  6 00:12:03 RevPi1927 kernel: [10415587.325074] [<808a8200>] (wait_for_completion) from [<8019a9fc>] (_rcu_barrier+0x170/0x220)
Mar  6 00:12:03 RevPi1927 kernel: [10415587.325086] [<8019a9fc>] (_rcu_barrier) from [<8019aaec>] (rcu_barrier+0x1c/0x24)
Mar  6 00:12:03 RevPi1927 kernel: [10415587.325166] [<8019aaec>] (rcu_barrier) from [<80780048>] (netdev_run_todo+0x70/0x2b0)
Mar  6 00:12:03 RevPi1927 kernel: [10415587.325178] [<80780048>] (netdev_run_todo) from [<8078e308>] (rtnl_unlock+0x18/0x1c)
Mar  6 00:12:03 RevPi1927 kernel: [10415587.325189] [<8078e308>] (rtnl_unlock) from [<8077f9f0>] (default_device_exit_batch+0x15c/0x17c)
Mar  6 00:12:03 RevPi1927 kernel: [10415587.325200] [<8077f9f0>] (default_device_exit_batch) from [<8076aa4c>] (ops_exit_list+0x6c/0x70)
Mar  6 00:12:03 RevPi1927 kernel: [10415587.325210] [<8076aa4c>] (ops_exit_list) from [<8076be4c>] (cleanup_net+0x1e8/0x320)
Mar  6 00:12:03 RevPi1927 kernel: [10415587.325221] [<8076be4c>] (cleanup_net) from [<8013eda8>] (process_one_work+0x210/0x590)
Mar  6 00:12:03 RevPi1927 kernel: [10415587.325233] [<8013eda8>] (process_one_work) from [<80140478>] (worker_thread+0x60/0x574)
Mar  6 00:12:03 RevPi1927 kernel: [10415587.325244] [<80140478>] (worker_thread) from [<80145b98>] (kthread+0x16c/0x174)
Mar  6 00:12:03 RevPi1927 kernel: [10415587.325255] [<80145b98>] (kthread) from [<801010b4>] (ret_from_fork+0x14/0x20)
Mar  6 00:12:03 RevPi1927 kernel: [10415587.325261] Exception stack(0xb8551fb0 to 0xb8551ff8)
Mar  6 00:12:03 RevPi1927 kernel: [10415587.325268] 1fa0:                                     00000000 00000000 00000000 00000000
Mar  6 00:12:03 RevPi1927 kernel: [10415587.325276] 1fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
Mar  6 00:12:03 RevPi1927 kernel: [10415587.325283] 1fe0: 00000000 00000000 00000000 00000000 00000013 00000000
Mar  6 00:12:18 RevPi1927 kernel: [10415601.642724] piControl: piControl i/o: missed 23 cycles
Mar  6 00:14:06 RevPi1927 kernel: [10415710.204926] INFO: task irq/166-eth1:2078 blocked for more than 120 seconds.
Mar  6 00:14:06 RevPi1927 kernel: [10415710.204937]       Tainted: G         C O      4.19.95-rt38-v7 #1
Mar  6 00:14:06 RevPi1927 kernel: [10415710.204942] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Mar  6 00:14:06 RevPi1927 kernel: [10415710.204948] irq/166-eth1    D    0  2078      2 0x00000000
Mar  6 00:14:06 RevPi1927 kernel: [10415710.204975] [<808a6d74>] (__schedule) from [<808a7278>] (schedule+0x70/0x134)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.204987] [<808a7278>] (schedule) from [<808a89a4>] (__rt_mutex_slowlock+0x10c/0x18c)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.204998] [<808a89a4>] (__rt_mutex_slowlock) from [<808a8b00>] (rt_mutex_slowlock_locked+0xdc/0x2dc)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205010] [<808a8b00>] (rt_mutex_slowlock_locked) from [<808a8d78>] (rt_mutex_slowlock.constprop.13+0x78/0xbc)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205021] [<808a8d78>] (rt_mutex_slowlock.constprop.13) from [<808a9210>] (__rt_mutex_lock_state+0x9c/0xc4)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205098] [<808a9210>] (__rt_mutex_lock_state) from [<808abb34>] (_mutex_lock+0x1c/0x20)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205117] [<808abb34>] (_mutex_lock) from [<7f0e4b1c>] (ks8851_irq+0x38/0x5ac [ks8851])
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205138] [<7f0e4b1c>] (ks8851_irq [ks8851]) from [<8018cf08>] (irq_thread_fn+0x2c/0x88)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205150] [<8018cf08>] (irq_thread_fn) from [<8018d260>] (irq_thread+0x148/0x234)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205161] [<8018d260>] (irq_thread) from [<80145b98>] (kthread+0x16c/0x174)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205171] [<80145b98>] (kthread) from [<801010b4>] (ret_from_fork+0x14/0x20)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205177] Exception stack(0xb4de5fb0 to 0xb4de5ff8)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205185] 5fa0:                                     00000000 00000000 00000000 00000000
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205193] 5fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205200] 5fe0: 00000000 00000000 00000000 00000000 00000013 00000000
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205235] INFO: task kworker/u8:1:3486 blocked for more than 120 seconds.
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205240]       Tainted: G         C O      4.19.95-rt38-v7 #1
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205244] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205248] kworker/u8:1    D    0  3486      2 0x00000000
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205290] Workqueue: netns cleanup_net
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205302] [<808a6d74>] (__schedule) from [<808a7278>] (schedule+0x70/0x134)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205313] [<808a7278>] (schedule) from [<808aa104>] (schedule_timeout+0x2e8/0x4f8)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205324] [<808aa104>] (schedule_timeout) from [<808a81b4>] (wait_for_common+0x128/0x154)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205334] [<808a81b4>] (wait_for_common) from [<808a8200>] (wait_for_completion+0x20/0x24)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205346] [<808a8200>] (wait_for_completion) from [<8019a9fc>] (_rcu_barrier+0x170/0x220)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205358] [<8019a9fc>] (_rcu_barrier) from [<8019aaec>] (rcu_barrier+0x1c/0x24)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205369] [<8019aaec>] (rcu_barrier) from [<80780048>] (netdev_run_todo+0x70/0x2b0)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205381] [<80780048>] (netdev_run_todo) from [<8078e308>] (rtnl_unlock+0x18/0x1c)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205391] [<8078e308>] (rtnl_unlock) from [<8077f9f0>] (default_device_exit_batch+0x15c/0x17c)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205402] [<8077f9f0>] (default_device_exit_batch) from [<8076aa4c>] (ops_exit_list+0x6c/0x70)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205412] [<8076aa4c>] (ops_exit_list) from [<8076be4c>] (cleanup_net+0x1e8/0x320)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205423] [<8076be4c>] (cleanup_net) from [<8013eda8>] (process_one_work+0x210/0x590)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205435] [<8013eda8>] (process_one_work) from [<80140478>] (worker_thread+0x60/0x574)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205445] [<80140478>] (worker_thread) from [<80145b98>] (kthread+0x16c/0x174)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205454] [<80145b98>] (kthread) from [<801010b4>] (ret_from_fork+0x14/0x20)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205459] Exception stack(0xb8551fb0 to 0xb8551ff8)
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205466] 1fa0:                                     00000000 00000000 00000000 00000000
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205474] 1fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
Mar  6 00:14:06 RevPi1927 kernel: [10415710.205481] 1fe0: 00000000 00000000 00000000 00000000 00000013 00000000
Mar  6 00:14:10 RevPi1927 kernel: [10415713.704656] piControl: piControl i/o: missed 2 cycles
\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00\00Mar  7 07:33:37 RevPi1927 kernel: [    0.000000] Booting Linux on physical CPU 0x0
Mar  7 07:33:37 RevPi1927 kernel: [    0.000000] Linux version 4.19.95-rt38-v7 (admin@kunbus.de) (gcc version 8.3.0 (Debian 8.3.0-2)) #1 SMP PREEMPT RT Tue, 22 Jun 2021 14:13:31 +0000
Mar  7 07:33:37 RevPi1927 kernel: [    0.000000] CPU: ARMv7 Processor [410fd034] revision 4 (ARMv7), cr=10c5383d
Mar  7 07:33:37 RevPi1927 kernel: [    0.000000] CPU: div instructions available: patching division code

Any ideas what could be the cause?

Best regards,
Michael

nicolaiB · Post by **nicolaiB** » 09 Mar 2022, 10:09

Hi Michael,

I'm sorry to hear that you have trouble with the RevPi Compact. Was there anything special around 23:47? What kind of application do you run on the RevPi?

Nicolai

michael@gunsch.info · Post by **michael@gunsch.info** » 09 Mar 2022, 16:47

Hi Nicolai

Nothing extraordinary. The RevPi Compact acts as a SCADA for a heating control. Real time processing is not used. The application is based on Node-RED: Temperature acquisition, communication (Modbus, M-Bus, MQTT), control some valves and pumps.

Best regards,
Michael

nicolaiB · Post by **nicolaiB** » 11 Mar 2022, 09:11

Hi Michael,

from the logs above I can see that there was something io intensive (emmc blocked, rt scheduler throttled). How do you use the RevPi with NodeRed? There is/was a known bug within the RevPi Nodes which resulted in a memory leak.

Nicolai