Solved Duet 3 Mini 5+ VIN under-voltage issues in SBC mode

[droftarts]

FYI you don’t need to be printing to generate these errors; my 5+ and SBC has generated 7 errors in the last 24hrs sitting idle! So save your filament and frustration if you’re helping out with this. Thanks!

Ian

[Fletcher]

@dc42 More M122!

4/11/2021, 12:40:50 PM 	M122
=== Diagnostics ===
RepRapFirmware for Duet 3 Mini 5+ version 3.3beta2+1 (2021-04-11 10:20:02) running on Duet 3 Mini5plus Ethernet (SBC mode)
Board ID: FDQG2-Q296U-D65J0-40KMG-1K03Z-HXFTZ
Used output buffers: 1 of 40 (16 max)
=== RTOS ===
Static ram: 100072
Dynamic ram: 91712 of which 64 recycled
Never used RAM 51856, free system stack 172 words
Tasks: Linux(ready,127) HEAT(delaying,322) CanReceiv(notifyWait,774) CanSender(notifyWait,371) CanClock(delaying,340) TMC(notifyWait,99) MAIN(running,415) IDLE(ready,20) AIN(notifyWait,260)
Owned mutexes: HTTP(MAIN)
=== Platform ===
Last reset 04:43:27 ago, cause: software
Last software reset at 2021-04-11 15:57, reason: User, none spinning, available RAM 51804, slot 2
Software reset code 0x0012 HFSR 0x00000000 CFSR 0x00000000 ICSR 0x00000000 BFAR 0xe000ed38 SP 0x00000000 Task Linu Freestk 0 n/a
Error status: 0x00
Aux0 errors 0,0,0
Aux1 errors 0,0,0
MCU revision 3, ADC conversions started 20273300, completed 20273299, timed out 0, errs 0
tnd=0 rnd=0 wrd=0 wtd=0 war=0
Supply voltage: min 0.0, current 36.1, max 36.1, under voltage events: 2, over voltage events: 0, power good: yes
Heap OK, handles allocated/used 0/0, heap memory allocated/used/recyclable 0/0/0, gc cycles 0
Driver 0: position 0, standstill, SG min/max 0/0, read errors 0, write errors 0, ifcnt 164, reads 49562, writes 18, timeouts 0, DMA errors 0
Driver 1: position 0, standstill, SG min/max 0/0, read errors 0, write errors 0, ifcnt 164, reads 49561, writes 18, timeouts 0, DMA errors 0
Driver 2: position 0, standstill, SG min/max 0/0, read errors 0, write errors 0, ifcnt 144, reads 49561, writes 18, timeouts 0, DMA errors 0
Driver 3: position 0, standstill, SG min/max 0/0, read errors 0, write errors 0, ifcnt 164, reads 49561, writes 18, timeouts 0, DMA errors 0
Driver 4: position 0, standstill, SG min/max 0/0, read errors 0, write errors 0, ifcnt 164, reads 49561, writes 18, timeouts 0, DMA errors 0
Driver 5: position 0, assumed not present
Driver 6: position 0, assumed not present
Date/time: 2021-04-11 20:40:50
Cache data hit count 4294967295
Slowest loop: 2.05ms; fastest: 0.11ms
=== Storage ===
Free file entries: 10
SD card 0 not detected, interface speed: 0.0MBytes/sec
SD card longest read time 0.0ms, write time 0.0ms, max retries 0
=== Move ===
DMs created 83, maxWait 0ms, bed compensation in use: none, comp offset 0.000
=== MainDDARing ===
Scheduled moves 0, completed moves 0, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1
=== AuxDDARing ===
Scheduled moves 0, completed moves 0, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1
=== Heat ===
Bed heaters = 0 -1, chamberHeaters = -1 -1
Heater 1 is on, I-accum = 0.0
=== GCodes ===
Segments left: 0
Movement lock held by null
HTTP* is doing "M122" in state(s) 0
Telnet is idle in state(s) 0
File is idle in state(s) 0
USB is idle in state(s) 0
Aux is idle in state(s) 0
Trigger* is idle in state(s) 0
Queue is idle in state(s) 0
LCD is idle in state(s) 0
SBC is idle in state(s) 0
Daemon is idle in state(s) 0
Aux2 is idle in state(s) 0
Autopause is idle in state(s) 0
Code queue is empty.
=== CAN ===
Messages queued 126986, send timeouts 0, received 169317, lost 0, longest wait 0ms for reply type 0, peak Tx sync delay 348, free buffers 17 (min 17)
=== SBC interface ===
State: 4, failed transfers: 0
Last transfer: 4ms ago
RX/TX seq numbers: 18024/18024
SPI underruns 0, overruns 0
Number of disconnects: 0, IAP RAM available 0x118dc
Buffer RX/TX: 0/0-0
=== Duet Control Server ===
Duet Control Server v3.3-b2
Code buffer space: 4096
Configured SPI speed: 8000000 Hz
Full transfers per second: 35.72
Codes per second: 0.00
Maximum length of RX/TX data transfers: 3940/820
4/11/2021, 12:40:49 PM 	Error: VSSA fault, check thermistor wiring

[dc42]

@fletcher, thanks for that, it's a different variation that I haven't seen before.

Please can you (any anyone else with a Duet 3 Mini + SBC doing nothing more important) try the new build at https://www.dropbox.com/sh/oxyezimiusnosxa/AAAgjLNKuTL8oEcXgihZqojXa?dl=0.

[PaulHew]

I got one overnight.

12/04/2021, 09:05:59 	m122
=== Diagnostics ===
RepRapFirmware for Duet 3 Mini 5+ version 3.3beta2+1 (2021-04-11 10:20:02) running on Duet 3 Mini5plus Ethernet (SBC mode)
Board ID: A45XG-F396U-D65J0-40KML-1F03Z-H03XP
Used output buffers: 1 of 40 (25 max)
=== RTOS ===
Static ram: 100072
Dynamic ram: 92364 of which 0 recycled
Never used RAM 48412, free system stack 102 words
Tasks: Linux(ready,119) HEAT(delaying,198) CanReceiv(notifyWait,774) CanSender(notifyWait,363) CanClock(delaying,340) TMC(notifyWait,99) MAIN(running,310) IDLE(ready,20) AIN(notifyWait,259)
Owned mutexes: HTTP(MAIN)
=== Platform ===
Last reset 19:50:27 ago, cause: software
Last software reset at 2021-04-10 18:09, reason: User, none spinning, available RAM 48412, slot 0
Software reset code 0x0012 HFSR 0x00000000 CFSR 0x00000000 ICSR 0x00000000 BFAR 0xe000ed38 SP 0x00000000 Task Linu Freestk 0 n/a
Error status: 0x00
Aux0 errors 0,0,0
Aux1 errors 0,0,0
MCU revision 3, ADC conversions started 84893701, completed 84893700, timed out 0, errs 2
tnd=0 rnd=0 wrd=0 wtd=2 war=2
Supply voltage: min 23.8, current 23.9, max 36.1, under voltage events: 0, over voltage events: 0, power good: yes
Heap OK, handles allocated/used 99/0, heap memory allocated/used/recyclable 2048/1808/1808, gc cycles 0
Driver 0: position 58000, standstill, SG min/max 0/510, read errors 0, write errors 1, ifcnt 37, reads 44160, writes 25, timeouts 36912, DMA errors 0, failedOp 0x6f
Driver 1: position -54000, standstill, SG min/max 0/510, read errors 0, write errors 1, ifcnt 37, reads 14454, writes 25, timeouts 1082, DMA errors 0, failedOp 0x72
Driver 2: position 62974, standstill, SG min/max 0/228, read errors 1, write errors 1, ifcnt 39, reads 11324, writes 27, timeouts 4209, DMA errors 0, failedOp 0x71
Driver 3: position 0, standstill, SG min/max 0/274, read errors 0, write errors 1, ifcnt 39, reads 14446, writes 27, timeouts 1088, DMA errors 0, failedOp 0x01
Driver 4: position 0, standstill, SG min/max 0/258, read errors 0, write errors 1, ifcnt 39, reads 15534, writes 27, timeouts 0, DMA errors 0
Driver 5: position 0, assumed not present
Driver 6: position 0, assumed not present
Date/time: 2021-04-12 09:05:58
Cache data hit count 4294967295
Slowest loop: 1000.36ms; fastest: 0.07ms
=== Storage ===
Free file entries: 10
SD card 0 not detected, interface speed: 0.0MBytes/sec
SD card longest read time 0.0ms, write time 0.0ms, max retries 0
=== Move ===
DMs created 83, maxWait 4879213ms, bed compensation in use: none, comp offset 0.000
=== MainDDARing ===
Scheduled moves 570944, completed moves 570944, hiccups 0, stepErrors 0, LaErrors 0, Underruns [987, 0, 3], CDDA state -1
=== AuxDDARing ===
Scheduled moves 0, completed moves 0, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1
=== Heat ===
Bed heaters = 0 -1, chamberHeaters = -1 -1
Heater 1 is on, I-accum = 0.0
=== GCodes ===
Segments left: 0
Movement lock held by null
HTTP* is doing "M122" in state(s) 0
Telnet is idle in state(s) 0
File* is idle in state(s) 0
USB is idle in state(s) 0
Aux is idle in state(s) 0
Trigger* is idle in state(s) 0
Queue* is idle in state(s) 0
LCD is idle in state(s) 0
SBC is idle in state(s) 0
Daemon is idle in state(s) 0
Aux2 is idle in state(s) 0
Autopause is idle in state(s) 0
Code queue is empty.
=== CAN ===
Messages queued 1335191, send timeouts 0, received 858481, lost 0, longest wait 2ms for reply type 6049, peak Tx sync delay 501, free buffers 17 (min 16)
=== SBC interface ===
State: 4, failed transfers: 0
Last transfer: 3ms ago
RX/TX seq numbers: 27444/27444
SPI underruns 0, overruns 0
Number of disconnects: 0, IAP RAM available 0x118a8
Buffer RX/TX: 0/0-0
=== Duet Control Server ===
Duet Control Server v3.2.2
Code buffer space: 4096
Configured SPI speed: 8000000 Hz
Full transfers per second: 41.67
Maximum length of RX/TX data transfers: 5652/1512

It was idle at this time
VSSA errors started @3.17am and finished @5:49am

My printers are in my workshop and I guess the temp dropped to about 8 degrees overnight, even though we had snow!
Not sure if it is relevant.

Regards,
Paul

[dc42]

@paulhew, thanks. Was it a VSSA warning?

Please try the new build at https://www.dropbox.com/sh/oxyezimiusnosxa/AAAgjLNKuTL8oEcXgihZqojXa?dl=0.

[PaulHew]

@dc42 I edited my original post. Yes, VSSA

Will load the firmware for you now and monitor.

Regards,
Paul.

[Serbitar]

My M122 after the board started with VSSA faults. Machine was idle at the time.

m122
=== Diagnostics ===
RepRapFirmware for Duet 3 Mini 5+ version 3.3beta2+1 (2021-04-12 08:36:30) running on Duet 3 Mini5plus WiFi (SBC mode)
Board ID: W4ZW4-V296U-D65J0-40KM0-LR03Z-H6928
Used output buffers: 1 of 40 (12 max)
=== RTOS ===
Static ram: 100072
Dynamic ram: 97524 of which 0 recycled
Never used RAM 46108, free system stack 200 words
Tasks: Linux(ready,149) HEAT(delaying,314) CanReceiv(notifyWait,944) CanSender(notifyWait,371) CanClock(delaying,332) TMC(notifyWait,99) MAIN(running,596) IDLE(ready,20) AIN(notifyWait,260)
Owned mutexes: HTTP(MAIN)
=== Platform ===
Last reset 00:28:47 ago, cause: software
Last software reset at 2021-04-12 17:01, reason: User, GCodes spinning, available RAM 45892, slot 1
Software reset code 0x0003 HFSR 0x00000000 CFSR 0x00000000 ICSR 0x00000000 BFAR 0xe000ed38 SP 0x00000000 Task Linu Freestk 0 n/a
Error status: 0x00
Aux0 errors 0,0,0
Aux1 errors 0,0,0
MCU revision 3, ADC conversions started 2063042, completed 2063041, timed out 0, errs 0
tnd=0 rnd=0 wrd=0 wtd=0 war=0
Supply voltage: min 0.1, current 0.1, max 18.9, under voltage events: 1, over voltage events: 0, power good: no
Heap OK, handles allocated/used 0/0, heap memory allocated/used/recyclable 0/0/0, gc cycles 0
Driver 0: position 0, standstill, SG min/max 0/0, read errors 0, write errors 1, ifcnt 20, reads 24, writes 9, timeouts 0, DMA errors 0
Driver 1: position 0, standstill, SG min/max 0/0, read errors 0, write errors 1, ifcnt 20, reads 24, writes 9, timeouts 0, DMA errors 0
Driver 2: position 0, standstill, SG min/max 0/0, read errors 0, write errors 1, ifcnt 20, reads 24, writes 9, timeouts 0, DMA errors 0
Driver 3: position 0, standstill, SG min/max 0/0, read errors 0, write errors 1, ifcnt 20, reads 24, writes 9, timeouts 0, DMA errors 0
Driver 4: position 0, standstill, SG min/max 0/0, read errors 0, write errors 1, ifcnt 20, reads 24, writes 9, timeouts 0, DMA errors 0
Driver 5: position 0, standstill, SG min/max 0/0, read errors 0, write errors 1, ifcnt 20, reads 24, writes 9, timeouts 0, DMA errors 0
Driver 6: position 0, standstill, SG min/max 0/0, read errors 0, write errors 1, ifcnt 20, reads 24, writes 9, timeouts 0, DMA errors 0
Date/time: 2021-04-12 17:29:53
Cache data hit count 3667011328
Slowest loop: 2.60ms; fastest: 0.09ms
=== Storage ===
Free file entries: 10
SD card 0 not detected, interface speed: 0.0MBytes/sec
SD card longest read time 0.0ms, write time 0.0ms, max retries 0
=== Move ===
DMs created 83, maxWait 0ms, bed compensation in use: none, comp offset 0.000
=== MainDDARing ===
Scheduled moves 0, completed moves 0, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1
=== AuxDDARing ===
Scheduled moves 0, completed moves 0, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1
=== Heat ===
Bed heaters = 0 -1, chamberHeaters = -1 -1
=== GCodes ===
Segments left: 0
Movement lock held by null
HTTP* is doing "M122" in state(s) 0
Telnet is idle in state(s) 0
File is idle in state(s) 0
USB is idle in state(s) 0
Aux is idle in state(s) 0
Trigger* is idle in state(s) 0
Queue is idle in state(s) 0
LCD is idle in state(s) 0
SBC is idle in state(s) 0
Daemon is idle in state(s) 0
Aux2 is idle in state(s) 0
Autopause is idle in state(s) 0
Code queue is empty.
=== Filament sensors ===
Extruder 0 sensor: ok
Extruder 1 sensor: ok
=== CAN ===
Messages queued 15540, send timeouts 15538, received 0, lost 0, longest wait 0ms for reply type 0, peak Tx sync delay 0, free buffers 17 (min 17)
Last cancelled message type 4514 dest 127
=== SBC interface ===
State: 4, failed transfers: 0
Last transfer: 3ms ago
RX/TX seq numbers: 57208/57208
SPI underruns 0, overruns 0
Number of disconnects: 0, IAP RAM available 0x113e8
Buffer RX/TX: 0/0-0
=== Duet Control Server ===
Duet Control Server v3.3-b2
Code buffer space: 4096
Configured SPI speed: 2000000 Hz
Full transfers per second: 33.13
Codes per second: 0.04
Maximum length of RX/TX data transfers: 2928/1088

[dc42]

@serbitar, it looks like you rebooted before doing the M122. Is that correct?

[Serbitar]

@dc42 I had reset the board much earlier, around 17:00.
At 17:24 the VSSA faults started.
At 1729 I did m122 and then reset the board so that I could copy the result out of DWC. The m122 is from before that reset.

[M-Pixel]

Error: VSSA fault, check thermistor wiring
4/12/2021, 11:07:17 AM 	M122
=== Diagnostics ===
RepRapFirmware for Duet 3 Mini 5+ version 3.3beta2+1 (2021-04-11 10:20:02) running on Duet 3 Mini5plus Ethernet (SBC mode)
Board ID: PG824-LA67A-G65J0-40TFS-L3D0Z-ZGG9A
Used output buffers: 1 of 40 (12 max)
=== RTOS ===
Static ram: 100072
Dynamic ram: 92492 of which 0 recycled
Never used RAM 48284, free system stack 126 words
Tasks: Linux(ready,139) HEAT(delaying,231) CanReceiv(notifyWait,944) CanSender(notifyWait,357) CanClock(delaying,332) TMC(notifyWait,99) MAIN(running,599) IDLE(ready,20) AIN(notifyWait,260)
Owned mutexes: HTTP(MAIN)
=== Platform ===
Last reset 01:46:38 ago, cause: power up
Last software reset at 2021-04-11 19:13, reason: User, none spinning, available RAM 48284, slot 0
Software reset code 0x0012 HFSR 0x00000000 CFSR 0x00000000 ICSR 0x00000000 BFAR 0xe000ed38 SP 0x00000000 Task Linu Freestk 0 n/a
Error status: 0x00
Aux0 errors 0,0,0
Aux1 errors 0,0,0
MCU revision 3, ADC conversions started 7620048, completed 7620047, timed out 0, errs 1
tnd=0 rnd=0 wrd=0 wtd=1 war=1
Supply voltage: min 0.0, current 0.1, max 24.3, under voltage events: 1, over voltage events: 0, power good: no
Heap OK, handles allocated/used 99/1, heap memory allocated/used/recyclable 2048/12/0, gc cycles 0
Driver 0: position 16418, ok, SG min/max 0/72, read errors 0, write errors 0, ifcnt 15, reads 20007, writes 15, timeouts 1, DMA errors 0, failedOp 0x01
Driver 1: position 8692, ok, SG min/max 0/54, read errors 0, write errors 0, ifcnt 15, reads 19999, writes 15, timeouts 9, DMA errors 0, failedOp 0x6a
Driver 2: position 120, standstill, SG min/max 0/352, read errors 0, write errors 0, ifcnt 15, reads 20008, writes 15, timeouts 0, DMA errors 0
Driver 3: position 0, ok, SG min/max 0/34, read errors 0, write errors 0, ifcnt 13, reads 20001, writes 13, timeouts 9, DMA errors 0, failedOp 0x6a
Driver 4: position 0, standstill, SG min/max 0/0, read errors 0, write errors 0, ifcnt 11, reads 20012, writes 11, timeouts 0, DMA errors 0
Driver 5: position 0, assumed not present
Driver 6: position 0, assumed not present
Date/time: 2021-04-12 19:07:16
Cache data hit count 4294967295
Slowest loop: 108.23ms; fastest: 0.06ms
=== Storage ===
Free file entries: 10
SD card 0 not detected, interface speed: 0.0MBytes/sec
SD card longest read time 0.0ms, write time 0.0ms, max retries 0
=== Move ===
DMs created 83, maxWait 5180087ms, bed compensation in use: none, comp offset 0.000
=== MainDDARing ===
Scheduled moves 623, completed moves 623, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1
=== AuxDDARing ===
Scheduled moves 0, completed moves 0, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1
=== Heat ===
Bed heaters = 0 -1, chamberHeaters = -1 -1
=== GCodes ===
Segments left: 0
Movement lock held by null
HTTP* is doing "M122" in state(s) 0
Telnet is idle in state(s) 0
File* is idle in state(s) 0
USB is idle in state(s) 0
Aux is idle in state(s) 0
Trigger* is idle in state(s) 0
Queue* is idle in state(s) 0
LCD is idle in state(s) 0
SBC is idle in state(s) 0
Daemon is idle in state(s) 0
Aux2 is idle in state(s) 0
Autopause is idle in state(s) 0
Code queue is empty.
=== CAN ===
Messages queued 57504, send timeouts 57501, received 0, lost 0, longest wait 0ms for reply type 0, peak Tx sync delay 0, free buffers 17 (min 17)
Last cancelled message type 30 dest 127
=== SBC interface ===
State: 4, failed transfers: 0
Last transfer: 3ms ago
RX/TX seq numbers: 30312/30312
SPI underruns 0, overruns 0
Number of disconnects: 0, IAP RAM available 0x118dc
Buffer RX/TX: 0/0-0
=== Duet Control Server ===
Duet Control Server v3.2.2
Code buffer space: 4096
Configured SPI speed: 8000000 Hz
Full transfers per second: 5.95
Maximum length of RX/TX data transfers: 3220/1640
File /opt/dsf/sd/gcodes/hdd-rack-frame large left.gcode is selected, paused

[PaulHew]

Just had another VSSA.

12/04/2021, 21:12:04 	Error: VSSA fault, check thermistor wiring
12/04/2021, 21:12:01 	m122
=== Diagnostics ===
RepRapFirmware for Duet 3 Mini 5+ version 3.3beta2+1 (2021-04-12 08:36:30) running on Duet 3 Mini5plus Ethernet (SBC mode)
Board ID: A45XG-F396U-D65J0-40KML-1F03Z-H03XP
Used output buffers: 4 of 40 (20 max)
=== RTOS ===
Static ram: 100072
Dynamic ram: 91932 of which 0 recycled
Never used RAM 51700, free system stack 172 words
Tasks: Linux(resourceWait,127) HEAT(delaying,322) CanReceiv(notifyWait,774) CanSender(notifyWait,371) CanClock(delaying,340) TMC(notifyWait,99) MAIN(running,484) IDLE(ready,20) AIN(notifyWait,259)
Owned mutexes: HTTP(MAIN)
=== Platform ===
Last reset 09:07:01 ago, cause: software
Last software reset at 2021-04-12 12:04, reason: User, GCodes spinning, available RAM 51700, slot 1
Software reset code 0x0003 HFSR 0x00000000 CFSR 0x00000000 ICSR 0x00000000 BFAR 0xe000ed38 SP 0x00000000 Task Linu Freestk 0 n/a
Error status: 0x00
Aux0 errors 0,0,0
Aux1 errors 0,0,0
MCU revision 3, ADC conversions started 39529293, completed 39529292, timed out 0, errs 1
tnd=0 rnd=0 wrd=0 wtd=1 war=1
Supply voltage: min 0.0, current 0.1, max 24.0, under voltage events: 1, over voltage events: 0, power good: no
Heap OK, handles allocated/used 0/0, heap memory allocated/used/recyclable 0/0/0, gc cycles 0
Driver 0: position 0, standstill, SG min/max 2/2, read errors 0, write errors 1, ifcnt 61, reads 12224, writes 11, timeouts 20730, DMA errors 0, failedOp 0x6f
Driver 1: position 0, standstill, SG min/max 2/2, read errors 0, write errors 1, ifcnt 61, reads 32954, writes 11, timeouts 0, DMA errors 0
Driver 2: position 0, standstill, SG min/max 0/0, read errors 0, write errors 1, ifcnt 63, reads 32953, writes 11, timeouts 0, DMA errors 0
Driver 3: position 0, standstill, SG min/max 0/0, read errors 0, write errors 1, ifcnt 63, reads 32953, writes 11, timeouts 0, DMA errors 0
Driver 4: position 0, standstill, SG min/max 2/2, read errors 0, write errors 1, ifcnt 63, reads 32954, writes 11, timeouts 0, DMA errors 0
Driver 5: position 0, assumed not present
Driver 6: position 0, assumed not present
Date/time: 2021-04-12 21:12:00
Cache data hit count 4294967295
Slowest loop: 36.07ms; fastest: 0.10ms
=== Storage ===
Free file entries: 10
SD card 0 not detected, interface speed: 0.0MBytes/sec
SD card longest read time 0.0ms, write time 0.0ms, max retries 0
=== Move ===
DMs created 83, maxWait 0ms, bed compensation in use: none, comp offset 0.000
=== MainDDARing ===
Scheduled moves 0, completed moves 0, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1
=== AuxDDARing ===
Scheduled moves 0, completed moves 0, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1
=== Heat ===
Bed heaters = 0 -1, chamberHeaters = -1 -1
Heater 1 is on, I-accum = 0.0
=== GCodes ===
Segments left: 0
Movement lock held by null
HTTP* is doing "M122" in state(s) 0
Telnet is idle in state(s) 0
File is idle in state(s) 0
USB is idle in state(s) 0
Aux is idle in state(s) 0
Trigger* is idle in state(s) 0
Queue is idle in state(s) 0
LCD is idle in state(s) 0
SBC is idle in state(s) 0
Daemon is idle in state(s) 0
Aux2 is idle in state(s) 0
Autopause is idle in state(s) 0
Code queue is empty.
=== CAN ===
Messages queued 295399, send timeouts 0, received 393841, lost 0, longest wait 2ms for reply type 6049, peak Tx sync delay 384, free buffers 17 (min 16)
=== SBC interface ===
State: 4, failed transfers: 0
Last transfer: 4ms ago
RX/TX seq numbers: 54864/54864
SPI underruns 0, overruns 0
Number of disconnects: 0, IAP RAM available 0x118a8
Buffer RX/TX: 0/0-0
=== Duet Control Server ===
Duet Control Server v3.2.2
Code buffer space: 4096
Configured SPI speed: 8000000 Hz
Full transfers per second: 35.62
Maximum length of RX/TX data transfers: 3268/604
12/04/2021, 21:12:00 	Error: VSSA fault, check thermistor wiring

[dc42]

Thanks, everyone. There are two clear patterns emerging.

I am testing a new firmware build overnight, so maybe I will have news in the morning.

[lodger]

@dc42 Did MicroChip get back to you. Or is this all you and the teams hard work.....Just to say thank you really ..

Paul

[PaulHew]

@dc42 Just out of interest, what is the critical bit in our logs that assist you DC42?

[PaulHew]

Undervotage.... Printer was idle.

13/04/2021, 09:18:15 	m122
=== Diagnostics ===
RepRapFirmware for Duet 3 Mini 5+ version 3.3beta2+1 (2021-04-12 08:36:30) running on Duet 3 Mini5plus Ethernet (SBC mode)
Board ID: A45XG-F396U-D65J0-40KML-1F03Z-H03XP
Used output buffers: 1 of 40 (23 max)
=== RTOS ===
Static ram: 100072
Dynamic ram: 91932 of which 0 recycled
Never used RAM 51700, free system stack 172 words
Tasks: Linux(resourceWait,119) HEAT(delaying,322) CanReceiv(notifyWait,774) CanSender(notifyWait,371) CanClock(delaying,340) TMC(notifyWait,99) MAIN(running,484) IDLE(ready,20) AIN(notifyWait,259)
Owned mutexes: HTTP(MAIN)
=== Platform ===
Last reset 12:02:11 ago, cause: software
Last software reset at 2021-04-12 21:16, reason: User, none spinning, available RAM 51700, slot 2
Software reset code 0x0012 HFSR 0x00000000 CFSR 0x00000000 ICSR 0x00000000 BFAR 0xe000ed38 SP 0x00000000 Task Linu Freestk 0 n/a
Error status: 0x00
Aux0 errors 0,0,0
Aux1 errors 0,0,0
MCU revision 3, ADC conversions started 51519632, completed 51519631, timed out 0, errs 3
tnd=0 rnd=0 wrd=0 wtd=3 war=3
Supply voltage: min 0.0, current 23.9, max 24.0, under voltage events: 1, over voltage events: 0, power good: yes
Heap OK, handles allocated/used 0/0, heap memory allocated/used/recyclable 0/0/0, gc cycles 0
Driver 0: position 0, standstill, SG min/max 2/2, read errors 0, write errors 1, ifcnt 82, reads 28663, writes 20, timeouts 51838, DMA errors 0, failedOp 0x6f
Driver 1: position 0, standstill, SG min/max 2/2, read errors 0, write errors 1, ifcnt 82, reads 14925, writes 20, timeouts 40, DMA errors 0, failedOp 0x06
Driver 2: position 0, standstill, SG min/max 0/0, read errors 0, write errors 1, ifcnt 84, reads 14965, writes 20, timeouts 0, DMA errors 0
Driver 3: position 0, standstill, SG min/max 0/0, read errors 0, write errors 1, ifcnt 84, reads 14963, writes 20, timeouts 0, DMA errors 0
Driver 4: position 0, standstill, SG min/max 2/2, read errors 0, write errors 1, ifcnt 84, reads 14965, writes 20, timeouts 0, DMA errors 0
Driver 5: position 0, assumed not present
Driver 6: position 0, assumed not present
Date/time: 2021-04-13 09:18:16
Cache data hit count 4294967295
Slowest loop: 63.01ms; fastest: 0.10ms
=== Storage ===
Free file entries: 10
SD card 0 not detected, interface speed: 0.0MBytes/sec
SD card longest read time 0.0ms, write time 0.0ms, max retries 0
=== Move ===
DMs created 83, maxWait 0ms, bed compensation in use: none, comp offset 0.000
=== MainDDARing ===
Scheduled moves 0, completed moves 0, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1
=== AuxDDARing ===
Scheduled moves 0, completed moves 0, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1
=== Heat ===
Bed heaters = 0 -1, chamberHeaters = -1 -1
Heater 1 is on, I-accum = 0.0
=== GCodes ===
Segments left: 0
Movement lock held by null
HTTP* is doing "M122" in state(s) 0
Telnet is idle in state(s) 0
File is idle in state(s) 0
USB is idle in state(s) 0
Aux is idle in state(s) 0
Trigger* is idle in state(s) 0
Queue is idle in state(s) 0
LCD is idle in state(s) 0
SBC is idle in state(s) 0
Daemon is idle in state(s) 0
Aux2 is idle in state(s) 0
Autopause is idle in state(s) 0
Code queue is empty.
=== CAN ===
Messages queued 389993, send timeouts 0, received 519973, lost 0, longest wait 2ms for reply type 6049, peak Tx sync delay 500, free buffers 17 (min 16)
=== SBC interface ===
State: 4, failed transfers: 0
Last transfer: 4ms ago
RX/TX seq numbers: 36429/36429
SPI underruns 0, overruns 0
Number of disconnects: 0, IAP RAM available 0x118a8
Buffer RX/TX: 0/0-0
=== Duet Control Server ===
Duet Control Server v3.2.2
Code buffer space: 4096
Configured SPI speed: 8000000 Hz
Full transfers per second: 35.63
Maximum length of RX/TX data transfers: 3284/604
12/04/2021, 23:04:48 	Warning: VIN under-voltage event (0.0V)

[Fletcher]

@dc42 Another VSSA fault chain on the latest firmware:

4/13/2021, 7:41:44 AM 	Error: VSSA fault, check thermistor wiring
4/13/2021, 7:41:44 AM 	m122
=== Diagnostics ===
RepRapFirmware for Duet 3 Mini 5+ version 3.3beta2+1 (2021-04-12 08:36:30) running on Duet 3 Mini5plus Ethernet (SBC mode)
Board ID: FDQG2-Q296U-D65J0-40KMG-1K03Z-HXFTZ
Used output buffers: 1 of 40 (12 max)
=== RTOS ===
Static ram: 100072
Dynamic ram: 91764 of which 64 recycled
Never used RAM 51804, free system stack 172 words
Tasks: Linux(ready,137) HEAT(delaying,322) CanReceiv(notifyWait,774) CanSender(notifyWait,371) CanClock(delaying,340) TMC(notifyWait,99) MAIN(running,498) IDLE(ready,20) AIN(notifyWait,260)
Owned mutexes: HTTP(MAIN)
=== Platform ===
Last reset 23:27:06 ago, cause: software
Last software reset at 2021-04-12 16:13, reason: User, none spinning, available RAM 51856, slot 1
Software reset code 0x0012 HFSR 0x00000000 CFSR 0x00000000 ICSR 0x00000000 BFAR 0xe000ed38 SP 0x00000000 Task Linu Freestk 0 n/a
Error status: 0x00
Aux0 errors 0,0,0
Aux1 errors 0,0,0
MCU revision 3, ADC conversions started 100481305, completed 100481304, timed out 0, errs 1
tnd=0 rnd=0 wrd=0 wtd=1 war=1
Supply voltage: min 0.0, current 0.1, max 24.4, under voltage events: 1, over voltage events: 0, power good: no
Heap OK, handles allocated/used 0/0, heap memory allocated/used/recyclable 0/0/0, gc cycles 0
Driver 0: position 0, standstill, SG min/max 0/0, read errors 0, write errors 1, ifcnt 218, reads 4487, writes 11, timeouts 0, DMA errors 0
Driver 1: position 0, standstill, SG min/max 0/0, read errors 0, write errors 1, ifcnt 220, reads 4487, writes 11, timeouts 0, DMA errors 0
Driver 2: position 0, standstill, SG min/max 0/0, read errors 0, write errors 1, ifcnt 192, reads 4489, writes 9, timeouts 0, DMA errors 0
Driver 3: position 0, standstill, SG min/max 0/0, read errors 0, write errors 1, ifcnt 218, reads 4486, writes 11, timeouts 0, DMA errors 0
Driver 4: position 0, standstill, SG min/max 0/0, read errors 0, write errors 1, ifcnt 218, reads 4487, writes 11, timeouts 0, DMA errors 0
Driver 5: position 0, assumed not present
Driver 6: position 0, assumed not present
Date/time: 2021-04-13 15:41:41
Cache data hit count 4294967295
Slowest loop: 57.18ms; fastest: 0.08ms
=== Storage ===
Free file entries: 10
SD card 0 not detected, interface speed: 0.0MBytes/sec
SD card longest read time 0.0ms, write time 0.0ms, max retries 0
=== Move ===
DMs created 83, maxWait 0ms, bed compensation in use: none, comp offset 0.000
=== MainDDARing ===
Scheduled moves 0, completed moves 0, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1
=== AuxDDARing ===
Scheduled moves 0, completed moves 0, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1
=== Heat ===
Bed heaters = 0 -1, chamberHeaters = -1 -1
=== GCodes ===
Segments left: 0
Movement lock held by null
HTTP* is doing "M122" in state(s) 0
Telnet is idle in state(s) 0
File is idle in state(s) 0
USB is idle in state(s) 0
Aux is idle in state(s) 0
Trigger* is idle in state(s) 0
Queue is idle in state(s) 0
LCD is idle in state(s) 0
SBC is idle in state(s) 0
Daemon is idle in state(s) 0
Aux2 is idle in state(s) 0
Autopause is idle in state(s) 0
Code queue is empty.
=== CAN ===
Messages queued 759838, send timeouts 0, received 1013078, lost 0, longest wait 2ms for reply type 6049, peak Tx sync delay 354, free buffers 17 (min 16)
=== SBC interface ===
State: 4, failed transfers: 0
Last transfer: 4ms ago
RX/TX seq numbers: 14877/14877
SPI underruns 0, overruns 0
Number of disconnects: 0, IAP RAM available 0x118a8
Buffer RX/TX: 0/0-0
=== Duet Control Server ===
Duet Control Server v3.3-b2
Code buffer space: 4096
Configured SPI speed: 8000000 Hz
Full transfers per second: 35.89
Codes per second: 0.00
Maximum length of RX/TX data transfers: 3044/804
4/13/2021, 7:41:39 AM 	Error: VSSA fault, check thermistor wiring

It was stable for almost 24 hours, which is positive change, at least! Thank you for all the work you're putting in on this issue.

[dc42]

All, please try the new firmware at https://www.dropbox.com/sh/0mwfe22wepk5efh/AAB6Lp0rwBPjVK2R4SxbKhLya?dl=0. M115 reports it as 3.2beta2+2.

This version avoids using the ADC DMA sequencer completely, so I am hopeful that it will solve the problem. I was worried that the additional ADC interrupt load would be excessive, but with careful code optimisation I have got it down to 0.5% of total CPU time.

[Serbitar]

@dc42 Looks like this version (and probably the other recent ones) breaks duetcontrolserver.

With 3.3b2 the logs are nice and quiet, with 3.3b2+2 the duetcontrolserver log is a fast rolling spam like this:

Apr 13 20:58:38 ender3 DuetControlServer[1585]: [error] Failed to merge JSON due to internal error: {"key":"","flags":"d99fn","result":{"boards":[{"mcuTemp":{},"vIn":{"current":0.4}}],"fans":[],"heat":{"heaters":[]},"inputs":[{"feedRate":50.0,"lineNumber":0,"state":"idle"},{"feedRate":50.0,"lineNumber":0,"state":"idle"},{"feedRate":50.0,"lineNumber":0,"state":"idle"},{"feedRate":50.0,"lineNumber":0,"state":"idle"},{"feedRate":50.0,"lineNumber":0,"state":"idle"},{"feedRate":50.0,"lineNumber":0,"state":"idle"},{"feedRate":50.0,"lineNumber":0,"state":"idle"},{"feedRate":50.0,"lineNumber":0,"state":"idle"},{"feedRate":50.0,"lineNumber":0,"state":"idle"},{"feedRate":50.0,"lineNumber":0,"state":"idle"},{"feedRate":50.0,"lineNumber":0,"state":"idle"},{"feedRate":50.0,"lineNumber":0,"state":"idle"}],"job":{"build":null,"duration":null,"filePosition":0,"layer":null,"layerTime":null,"pauseDuration":null,"timesLeft":{"filament":null,"file":null,"slicer":null},"warmUpDuration":null},"move":{"axes":[{"machinePosition":0,"userPosition":0},{"machinePosition":0,"userPosition":0},{"machinePosition":0,"userPosition":0}],"currentMove":{"acceleration":0,"deceleration":0,"laserPwm":null,"requestedSpeed":0,"topSpeed":0},"extruders":[],"virtualEPos":0},"sensors":{"analog":[],"endstops":[null,null,null],"filamentMonitors":[],"gpIn":[],"probes":[]},"seqs":{"boards":0,"directories":0,"fans":0,"global":0,"heat":0,"inputs":77,"job":1,"move":2,"network":2,"reply":0,"scanner":1,"sensors":0,"spindles":0,"state":0,"tools":0,"volChanges":[0,0],"volumes":0},"spindles":[{"current":0,"state":"unconfigured"},{"current":0,"state":"unconfigured"}],"state":{"atxPower":null,"currentTool":-1,"gpOut":[],"laserPwm":null,"msUpTime":101,"nextTool":-1,"previousTool":-1,"status":"off","time":"2021-04-13T20:58:38","upTime":83},"tools":[]},"next":0}
Apr 13 20:58:38 ender3 DuetControlServer[1585]:    System.InvalidOperationException: The requested operation requires an element of type 'Number', but the target element has type 'Array'.
Apr 13 20:58:38 ender3 DuetControlServer[1585]:    at System.Text.Json.JsonDocument.TryGetValue(Int32 index, Int32& value)
Apr 13 20:58:38 ender3 DuetControlServer[1585]:    at System.Text.Json.JsonElement.GetInt32()
Apr 13 20:58:38 ender3 DuetControlServer[1585]:    at DuetControlServer.Model.Updater.Run() in /home/christian/Duet3D/DuetSoftwareFramework/src/DuetControlServer/Model/Updater.cs:line 157

root@ender3 ~ # dpkg -l duetcontrolserver
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name              Version      Architecture Description
+++-=================-============-============-============================================
ii  duetcontrolserver 3.3-b2       armhf        Control server application for Duet 3 series

I was hoping to do another batch of small sequential prints with the new firmware

[Serbitar]

FIRMWARE_NAME: RepRapFirmware for Duet 3 Mini 5+ FIRMWARE_VERSION: 3.3beta2+1 ELECTRONICS: Duet 3 Mini5plus WiFi FIRMWARE_DATE: 2021-04-09 14:40:21

This is the first version that causes the DCS log spam

[Serbitar]

Actually this is a bit weird. I just went through the remaining versions in sequence and 3.3b2+2 isn't spamming the logs.