3.3b2 CAN timeout and oos(out of sequence) on 6HC+3HC+3HC
-
Hi again!
I now run a Duet3 system consisting of 6HC+3HC+3HC+SBC on my 500x500 build. After uppgrading to 3.3b2 and adding another 3HC I get some oos errors.
Printing with travelspeed of 500mm/s with 4x 0.9* steppers, 2 on each CoreXY belt:
M584 X0.1:1.1 Y0.0:1.0 Z0.4:0.3:0.5 E2.0:2.1:2.2 U0.2
Accelerations (mm/sec^2): X: 6000.0, Y: 6000.0, Z: 100.0, U: 800.0, E: 3000.0:3000.0:3000.0
Max speeds (mm/min): X: 33900.0, Y: 33900.0, Z: 720.0, U: 9000.0, E: 3600.0:3600.0:3600.0, min. speed 30.00
Maximum printing acceleration 1000.0, maximum travel acceleration 7000.0
Maximum jerk rates (mm/min): X: 1000.0, Y: 1500.0, Z: 100.0, U: 50.0, E: 1200.0:1200.0:1200.0, jerkMy printed results look good but I got some out of sequence errors I thought I might report.
First Diagnostics is taken after homing and toolchange and should clear the CAN errors in case any would be from the homing sequence. Next is taken after print is done. I inserted som line breaks to find it easier, otherwise it is copied from my eventlog.
2021-03-15 17:31:17 T:204.1 /210.0 T0:204.1 /210.0 T1:25.0 /0.0 T2:25.3 /0.0 B:60.0 /60.0 2021-03-15 17:31:21 === Diagnostics === RepRapFirmware for Duet 3 MB6HC version 3.3beta2 running on Duet 3 MB6HC v0.6 or 1.0 (SBC mode) Board ID: 08DJM-956L2-G43S4-6JKDD-3SJ6L-TB62G Used output buffers: 1 of 40 (29 max) === RTOS === Static ram: 148476 Dynamic ram: 63788 of which 0 recycled Never used RAM 139072, free system stack 100 words Tasks: Linux(ready,123) HEAT(delaying,284) CanReceiv(notifyWait,773) CanSender(notifyWait,358) CanClock(delaying,341) TMC(notifyWait,58) MAIN(running,648) IDLE(ready,19) Owned mutexes: HTTP(MAIN) === Platform === Last reset 18:45:16 ago, cause: software Last software reset at 2021-03-14 22:46, reason: User, none spinning, available RAM 139072, slot 1 Software reset code 0x0012 HFSR 0x00000000 CFSR 0x00000000 ICSR 0x0044a000 BFAR 0x00000000 SP 0x00000000 Task Linu Freestk 0 n/a Error status: 0x00 Aux0 errors 0,0,0 Aux1 errors 0,0,0 MCU temperature: min 43.6, current 43.8, max 44.0 Supply voltage: min 31.9, current 31.9, max 31.9, under voltage events: 0, over voltage events: 0, power good: yes 12V rail voltage: min 12.0, current 12.0, max 12.1, under voltage events: 0 Heap OK, handles allocated/used 99/0, heap memory allocated/used/recyclable 2048/550/550, gc cycles 0 Driver 0: position 96560, standstill, reads 33266, writes 0 timeouts 0, SG min/max 0/863 Driver 1: position 94960, standstill, reads 33267, writes 0 timeouts 0, SG min/max 0/592 Driver 2: position 15904, standstill, reads 33262, writes 4 timeouts 0, SG min/max 0/133 Driver 3: position 307, standstill, reads 33266, writes 0 timeouts 0, SG min/max 0/134 Driver 4: position 0, standstill, reads 33266, writes 0 timeouts 0, SG min/max 0/196 Driver 5: position 0, standstill, reads 33266, writes 0 timeouts 0, SG min/max 0/91 Date/time: 2021-03-15 17:31:18 Slowest loop: 93.03ms; fastest: 0.07ms === Storage === Free file entries: 10 SD card 0 not detected, interface speed: 37.5MBytes/sec SD card longest read time 0.0ms, write time 0.0ms, max retries 0 === Move === DMs created 125, maxWait 12789ms, bed compensation in use: mesh, comp offset 0.000 === MainDDARing === Scheduled moves 87, completed moves 87, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1 === AuxDDARing === Scheduled moves 0, completed moves 0, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1 === Heat === Bed heaters = 0 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1, chamberHeaters = -1 -1 -1 -1 Heater 0 is on, I-accum = 0.2 Heater 1 is on, I-accum = 0.0 === GCodes === Segments left: 0 Movement lock held by File HTTP* is doing "M122 B0" in state(s) 0 Telnet is idle in state(s) 0 File* is idle in state(s) 0 0 13, running macro USB is idle in state(s) 0 Aux is idle in state(s) 0 Trigger* is idle in state(s) 0 Queue* is idle in state(s) 0 LCD is idle in state(s) 0 SBC is idle in state(s) 0 Daemon is idle in state(s) 0 Aux2 is idle in state(s) 0 Autopause is idle in state(s) 0 Code queue is empty. === CAN === Messages queued 182, send timeouts 0, received 323, lost 0, longest wait 20ms for reply type 6024, peak Tx sync delay 622, free buffers 49 (min 48) === SBC interface === State: 4, failed transfers: 0 Last transfer: 1ms ago RX/TX seq numbers: 21363/21363 SPI underruns 0, overruns 0 Number of disconnects: 0, IAP RAM available 0x2d52c Buffer RX/TX: 0/0-0 2021-03-15 17:31:18 unsupported type code 13 2021-03-15 17:31:26 Diagnostics for board 1: Duet EXP3HC firmware version 3.3beta2 (2021-03-10 10:07:35) Bootloader ID: SAME5x bootloader version 2.2 (2021-01-16b1) Never used RAM 158804, free system stack 0 words Tasks: Move(notifyWait,100) HEAT(delaying,85) CanAsync(notifyWait,72) CanRecv(notifyWait,82) CanClock(notifyWait,74) TMC(notifyWait,30) MAIN(running,333) AIN(delaying,260) Last reset 18:45:23 ago, cause: software Last software reset at 2020-11-10 18:16, reason: StackOverflow, available RAM 154112, slot 0 Software reset code 0x0100 HFSR 0x00000000 CFSR 0x00000000 ICSR 0x0000080e BFAR 0xe000ed38 SP 0x2002ffb4 Task � Freestk 4294967295 ok Stack: 2000137c 200013b0 0002525d 00000000 0003e418 20001598 20003b28 00000000 00024885 200014b4 20003ab0 00000000 00f00000 e000ef34 c0000000 20003b30 000249c5 0002472c 61000000 ffffffff ffffffff ffffffff ffffffff ffffffff ffffffff ffffffff ffffffff Driver 0: position 8577, 160.0 steps/mm, ok, reads 19851, writes 0 timeouts 0, SG min/max 0/165, steps req 200694 done 199981 Driver 1: position -228486, 160.0 steps/mm, ok, reads 19851, writes 0 timeouts 0, SG min/max 0/467, steps req 274190 done 274153 Driver 2: position 0, 80.0 steps/mm, standstill, reads 19851, writes 0 timeouts 0, SG min/max not available, steps req 0 done 0 Moves scheduled 318770, completed 318769, in progress 1, hiccups 0, step errors 0, maxPrep 73, maxOverdue 2, maxInc 2, mcErrs 0, gcmErrs 0 Peak sync jitter 9, peak Rx sync delay 181, resyncs 0, next step interrupt due in 23 ticks, enabled VIN: 24.1V, V12: 12.1V MCU temperature: min 39.8C, current 40.0C, max 40.2C Ticks since heat task active 100, ADC conversions started 67523092, completed 67523091, timed out 0 Last sensors broadcast 0x00000000 found 0 105 ticks ago, loop time 0 CAN messages queued 127, send timeouts 0, received 333, lost 0, free buffers 36, min 36, error reg 0 dup 0, oos 0, bm 0, wbm 0 2021-03-15 17:31:28 Diagnostics for board 2: Duet EXP3HC firmware version 3.3beta2 (2021-03-10 10:07:35) Bootloader ID: not available Never used RAM 157852, free system stack 0 words Tasks: Move(notifyWait,92) HEAT(delaying,69) CanAsync(notifyWait,72) CanRecv(notifyWait,82) CanClock(notifyWait,74) TMC(notifyWait,30) MAIN(running,301) AIN(delaying,260) Last reset 18:45:27 ago, cause: software Last software reset data not available Driver 0: position 10679664, 830.0 steps/mm, ok, reads 53489, writes 2 timeouts 0, SG min/max 0/181, steps req 5479 done 4304 Driver 1: position 0, 830.0 steps/mm, standstill, reads 53490, writes 0 timeouts 0, SG min/max not available, steps req 0 done 0 Driver 2: position 0, 830.0 steps/mm, standstill, reads 53490, writes 0 timeouts 0, SG min/max not available, steps req 0 done 0 Moves scheduled 309741, completed 309740, in progress 1, hiccups 0, step errors 0, maxPrep 32, maxOverdue 0, maxInc 0, mcErrs 0, gcmErrs 0 Peak sync jitter 13, peak Rx sync delay 180, resyncs 0, next step interrupt due in 256 ticks, enabled VIN: 24.1V, V12: 12.2V MCU temperature: min 38.5C, current 38.7C, max 38.7C Ticks since heat task active 111, ADC conversions started 67527352, completed 67527352, timed out 0 Last sensors broadcast 0x0000000e found 3 116 ticks ago, loop time 0 CAN messages queued 11674, send timeouts 0, received 8782, lost 0, free buffers 36, min 36, error reg 0 dup 0, oos 0, bm 0, wbm 0 2021-03-15 17:42:39 G10 P0 S200 2021-03-15 18:36:06 Accelerations (mm/sec^2): X: 6000.0, Y: 6000.0, Z: 100.0, U: 800.0, E: 3000.0:3000.0:3000.0 2021-03-15 18:36:19 Max speeds (mm/min): X: 33900.0, Y: 33900.0, Z: 720.0, U: 9000.0, E: 3600.0:3600.0:3600.0, min. speed 30.00 2021-03-15 18:36:23 Maximum printing acceleration 1000.0, maximum travel acceleration 7000.0 2021-03-15 18:36:31 Maximum jerk rates (mm/min): X: 1000.0, Y: 1500.0, Z: 100.0, U: 50.0, E: 1200.0:1200.0:1200.0, jerk policy: 1 2021-03-15 19:40:04 G10 P0 S0 R0 2021-03-15 19:40:04 G10 P1 S0 R0 2021-03-15 19:40:04 G10 P2 S0 R0 2021-03-15 19:40:13 Done printing file 2021-03-15 19:40:13 Done printing file 2021-03-15 19:40:13 Finished printing file 0:/gcodes/v2-tool_wings_Left Right.gcode, print time was 2h 10m 2021-03-15 20:07:27 Diagnostics for board 2: Duet EXP3HC firmware version 3.3beta2 (2021-03-10 10:07:35) Bootloader ID: not available Never used RAM 157852, free system stack 0 words Tasks: Move(notifyWait,92) HEAT(delaying,69) CanAsync(notifyWait,72) CanRecv(notifyWait,82) CanClock(notifyWait,74) TMC(notifyWait,30) MAIN(running,301) AIN(delaying,260) Last reset 21:21:26 ago, cause: software Last software reset data not available Driver 0: position 19161362, 830.0 steps/mm, standstill, reads 22004, writes 2 timeouts 0, SG min/max 0/1023, steps req 9103754 done 9104929 Driver 1: position 0, 830.0 steps/mm, standstill, reads 22006, writes 0 timeouts 0, SG min/max not available, steps req 0 done 0 Driver 2: position 0, 830.0 steps/mm, standstill, reads 22006, writes 0 timeouts 0, SG min/max not available, steps req 0 done 0 Moves scheduled 585063, completed 585063, in progress 0, hiccups 0, step errors 0, maxPrep 54, maxOverdue 283, maxInc 283, mcErrs 0, gcmErrs 0 Peak sync jitter 13, peak Rx sync delay 183, resyncs 11, no step interrupt scheduled VIN: 24.1V, V12: 12.2V MCU temperature: min 38.5C, current 38.7C, max 38.7C Ticks since heat task active 11, ADC conversions started 76886002, completed 76886002, timed out 0 Last sensors broadcast 0x0000000e found 3 15 ticks ago, loop time 0 CAN messages queued 116968, send timeouts 0, received 364189, lost 0, free buffers 36, min 36, error reg 0 dup 0, oos 4, bm 0, wbm 0 2021-03-15 20:07:31 Diagnostics for board 1: Duet EXP3HC firmware version 3.3beta2 (2021-03-10 10:07:35) Bootloader ID: SAME5x bootloader version 2.2 (2021-01-16b1) Never used RAM 158804, free system stack 0 words Tasks: Move(notifyWait,100) HEAT(delaying,85) CanAsync(notifyWait,72) CanRecv(notifyWait,82) CanClock(notifyWait,74) TMC(notifyWait,30) MAIN(running,333) AIN(delaying,260) Last reset 21:21:27 ago, cause: software Last software reset at 2020-11-10 18:16, reason: StackOverflow, available RAM 154112, slot 0 Software reset code 0x0100 HFSR 0x00000000 CFSR 0x00000000 ICSR 0x0000080e BFAR 0xe000ed38 SP 0x2002ffb4 Task � Freestk 4294967295 ok Stack: 2000137c 200013b0 0002525d 00000000 0003e418 20001598 20003b28 00000000 00024885 200014b4 20003ab0 00000000 00f00000 e000ef34 c0000000 20003b30 000249c5 0002472c 61000000 ffffffff ffffffff ffffffff ffffffff ffffffff ffffffff ffffffff ffffffff Driver 0: position -1497, 160.0 steps/mm, standstill, reads 11490, writes 2 timeouts 0, SG min/max 0/1023, steps req 52356418 done 52357131 Driver 1: position -144460, 160.0 steps/mm, standstill, reads 11491, writes 2 timeouts 0, SG min/max 0/1023, steps req 51720818 done 51720855 Driver 2: position 0, 80.0 steps/mm, standstill, reads 11493, writes 0 timeouts 0, SG min/max not available, steps req 0 done 0 Moves scheduled 601671, completed 601671, in progress 0, hiccups 0, step errors 0, maxPrep 98, maxOverdue 686, maxInc 683, mcErrs 0, gcmErrs 0 Peak sync jitter 11, peak Rx sync delay 188, resyncs 18, no step interrupt scheduled VIN: 24.1V, V12: 12.1V MCU temperature: min 39.8C, current 40.0C, max 40.2C Ticks since heat task active 186, ADC conversions started 76887928, completed 76887926, timed out 0 Last sensors broadcast 0x00000000 found 0 190 ticks ago, loop time 0 CAN messages queued 37497, send timeouts 0, received 404655, lost 0, free buffers 36, min 36, error reg 0 dup 0, oos 2, bm 0, wbm 0 2021-03-15 20:07:32 === Diagnostics === RepRapFirmware for Duet 3 MB6HC version 3.3beta2 running on Duet 3 MB6HC v0.6 or 1.0 (SBC mode) Board ID: 08DJM-956L2-G43S4-6JKDD-3SJ6L-TB62G Used output buffers: 5 of 40 (29 max) === RTOS === Static ram: 148476 Dynamic ram: 63788 of which 0 recycled Never used RAM 139072, free system stack 98 words Tasks: Linux(ready,119) HEAT(delaying,284) CanReceiv(notifyWait,773) CanSender(notifyWait,358) CanClock(delaying,341) TMC(notifyWait,58) MAIN(running,648) IDLE(ready,19) Owned mutexes: HTTP(MAIN) === Platform === Last reset 21:21:27 ago, cause: software Last software reset at 2021-03-14 22:46, reason: User, none spinning, available RAM 139072, slot 1 Software reset code 0x0012 HFSR 0x00000000 CFSR 0x00000000 ICSR 0x0044a000 BFAR 0x00000000 SP 0x00000000 Task Linu Freestk 0 n/a Error status: 0x00 Aux0 errors 0,0,0 Aux1 errors 0,0,0 MCU temperature: min 42.9, current 43.0, max 44.8 Supply voltage: min 31.8, current 31.9, max 32.0, under voltage events: 0, over voltage events: 0, power good: yes 12V rail voltage: min 12.0, current 12.0, max 12.1, under voltage events: 0 Heap OK, handles allocated/used 99/0, heap memory allocated/used/recyclable 2048/626/626, gc cycles 0 Driver 0: position 160000, standstill, reads 23701, writes 2 timeouts 0, SG min/max 0/1023 Driver 1: position 0, standstill, reads 23700, writes 2 timeouts 0, SG min/max 0/1023 Driver 2: position 96509, standstill, reads 23701, writes 2 timeouts 0, SG min/max 0/157 Driver 3: position 0, standstill, reads 23701, writes 2 timeouts 0, SG min/max 0/1023 Driver 4: position 0, standstill, reads 23701, writes 2 timeouts 0, SG min/max 0/1023 Driver 5: position 0, standstill, reads 23701, writes 2 timeouts 0, SG min/max 0/1023 Date/time: 2021-03-15 20:07:29 Slowest loop: 85.73ms; fastest: 0.05ms === Storage === Free file entries: 10 SD card 0 not detected, interface speed: 37.5MBytes/sec SD card longest read time 0.0ms, write time 0.0ms, max retries 0 === Move === DMs created 125, maxWait 588ms, bed compensation in use: mesh, comp offset 0.000 === MainDDARing === Scheduled moves 284547, completed moves 284547, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 49], CDDA state -1 === AuxDDARing === Scheduled moves 0, completed moves 0, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1 === Heat === Bed heaters = 0 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1, chamberHeaters = -1 -1 -1 -1 Heater 0 is on, I-accum = 0.1 === GCodes === Segments left: 0 Movement lock held by null HTTP* is doing "M122 B0" in state(s) 0 Telnet is idle in state(s) 0 File* is idle in state(s) 0 USB is idle in state(s) 0 Aux is idle in state(s) 0 Trigger* is idle in state(s) 0 Queue* is idle in state(s) 0 LCD is idle in state(s) 0 SBC is idle in state(s) 0 Daemon is idle in state(s) 0 Aux2 is idle in state(s) 0 Autopause is idle in state(s) 0 Code queue is empty. === CAN === Messages queued 647277, send timeouts 998, received 154713, lost 0, longest wait 21ms for reply type 6024, peak Tx sync delay 622, free buffers 49 (min 29) Last cancelled message type 51 dest 1 === SBC interface === State: 4, failed transfers: 0 Last transfer: 4ms ago RX/TX seq numbers: 62470/62470 SPI underruns 0, overruns 0 Number of disconnects: 0, IAP RAM available 0x2d52c Buffer RX/TX: 0/0-0
Here are all config files and complete eventlog:
https://we.tl/t-AeXDiQaFII -
Yes, out of sequence errors are always worth reporting. Send timeouts are also rare in 3.3beta2, and often benign, but you seem to have a lot of them.
Please provide the GCode file and complete config.g file. I will try it on my bench system to see if I get any oos errors or send timeouts.
-
Thank you, here is the gcode file: https://we.tl/t-itUE75F1lq
The config files are here: https://we.tl/t-AeXDiQaFII