Duet 3 Mini 5+ VIN under-voltage issues in SBC mode

Serbitar

FIRMWARE_NAME: RepRapFirmware for Duet 3 Mini 5+ FIRMWARE_VERSION: 3.3beta2+1 ELECTRONICS: Duet 3 Mini5plus WiFi FIRMWARE_DATE: 2021-03-19 18:26:13

Serbitar

After the previous failure I dropped the SPI rate to 2MHz but that hasn't helped. Printer just stopped while doing G29 with the dreaded under-voltage event.

dc42

@Serbitar, thanks for the additional data point.

ukwebb

@lodger No i haven't, as @Serbitar has already said its not fixed the issue

droftarts

@Serbitar I've been running 'air' prints on my test rig today. I've had one under-voltage event, 1h 18m into a 3h 30m print, but running the same exact file and settings did not provoke another. So trying to get to the bottom of this issue is, unfortunately, taking some time.

Ian

Serbitar

@droftarts Yeah. I haven't worked out a pattern yet. Please let me know if I can do any useful testing.

lodger

@droftarts When DC42 ask on Saturday I also printed the same file without issue .

I have been printing around the clock up till Tuesday. Again without issue. There is just no patten.

I have one of the first batch of boards, and on a earlier firmware (dont ask what one).
I am sure i had this happen in standalone mode. So since Tuesday i have been printing non stop trying to prove this.

I have to say though i am getting bloody sick of all these massive 3dbenchy boats lying around my living room. lol

dc42

I have put new firmware at 2021-03-26 10:59:15. Those of you who have experienced this issue and have an idle machine, please can you try it and do a print (an air print will do, no need to waste filament). If you get a VIN undervoltage event, please post a M122 report. M115 should report firmware date 2021-03-26 10:59:15 for this build.

Serbitar

@dc42 Same dropbox link as the previous one?

dc42

I'm sorry, i forgot to include the link. It's probably the same as the previous one, but here it is again: https://www.dropbox.com/sh/6203euyyobllic5/AABTHIbn7F_maK9p-oy7vq3Ea?dl=0.

Serbitar

Sadly another failure, with the new firmware.

FIRMWARE_NAME: RepRapFirmware for Duet 3 Mini 5+ FIRMWARE_VERSION: 3.3beta2+1 ELECTRONICS: Duet 3 Mini5plus WiFi FIRMWARE_DATE: 2021-03-26 10:59:15

I still have

  "SpiFrequency": 2000000,

Mar 26 19:28:05 ender3 DuetControlServer[13516]: [error] === Diagnostics ===
Mar 26 19:28:05 ender3 DuetControlServer[13516]: RepRapFirmware for Duet 3 Mini 5+ version 3.3beta2+1 running on Duet 3 Mini5plus WiFi (SBC mode)
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Board ID: W4ZW4-V296U-D65J0-40KM0-LR03Z-H6928
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Used output buffers: 2 of 40 (12 max)
Mar 26 19:28:05 ender3 DuetControlServer[13516]: === RTOS ===
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Static ram: 100008
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Dynamic ram: 98412 of which 24 recycled
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Never used RAM 45260, free system stack 114 words
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Tasks: Linux(ready,145) HEAT(delaying,299) CanReceiv(notifyWait,943) CanSender(notifyWait,358) CanClock(delaying,340) TMC(notifyWait,109) MAIN(running,310) IDLE(ready,20) AIN(delaying,258)
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Owned mutexes: Autopause(MAIN)
Mar 26 19:28:05 ender3 DuetControlServer[13516]: === Platform ===
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Last reset 01:52:11 ago, cause: software
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Last software reset at 2021-03-25 17:02, reason: User, none spinning, available RAM 45656, slot 1
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Software reset code 0x0012 HFSR 0x00000000 CFSR 0x00000000 ICSR 0x00000000 BFAR 0xe000ed38 SP 0x00000000 Task Linu Freestk 0 n/a
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Error status: 0x00
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Aux0 errors 0,0,0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Aux1 errors 0,0,0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: ADC conversions started 3353356, completed 3353355, timed out 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Supply voltage: min 0.0, current 24.2, max 24.8, under voltage events: 2, over voltage events: 0, power good: no
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Heap OK, handles allocated/used 0/0, heap memory allocated/used/recyclable 0/0/0, gc cycles 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Driver 0: position -8051, standstill, SG min/max 0/0, read errors 0, write errors 2, ifcnt 10, reads 16127, writes 18, timeouts 29, DMA errors 0, failedOp 0x41
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Driver 1: position 612, standstill, SG min/max 0/88, read errors 0, write errors 2, ifcnt 12, reads 16131, writes 20, timeouts 23, DMA errors 0, failedOp 0x72
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Driver 2: position 2703, ok, SG min/max 0/272, read errors 0, write errors 2, ifcnt 20, reads 16145, writes 28, timeouts 0, DMA errors 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Driver 3: position 0, ok, SG min/max 0/424, read errors 0, write errors 2, ifcnt 20, reads 16069, writes 28, timeouts 76, DMA errors 0, failedOp 0x72
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Driver 4: position 0, standstill, SG min/max 0/406, read errors 0, write errors 2, ifcnt 20, reads 16144, writes 28, timeouts 2, DMA errors 0, failedOp 0x6a
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Driver 5: position 0, ok, SG min/max 0/102, read errors 0, write errors 2, ifcnt 20, reads 16125, writes 28, timeouts 20, DMA errors 0, failedOp 0x41
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Driver 6: position 0, ok, SG min/max 0/118, read errors 0, write errors 2, ifcnt 20, reads 15081, writes 28, timeouts 1064, DMA errors 0, failedOp 0x6a
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Date/time: 2021-03-26 19:28:05
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Cache data hit count 4294967295
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Slowest loop: 202.38ms; fastest: 0.08ms
Mar 26 19:28:05 ender3 DuetControlServer[13516]: === Storage ===
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Free file entries: 10
Mar 26 19:28:05 ender3 DuetControlServer[13516]: SD card 0 not detected, interface speed: 0.0MBytes/sec
Mar 26 19:28:05 ender3 DuetControlServer[13516]: SD card longest read time 0.0ms, write time 0.0ms, max retries 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: === Move ===
Mar 26 19:28:05 ender3 DuetControlServer[13516]: DMs created 83, maxWait 122533ms, bed compensation in use: mesh, comp offset 0.000
Mar 26 19:28:05 ender3 DuetControlServer[13516]: === MainDDARing ===
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Scheduled moves 99196, completed moves 99196, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1
Mar 26 19:28:05 ender3 DuetControlServer[13516]: === AuxDDARing ===
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Scheduled moves 0, completed moves 0, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1
Mar 26 19:28:05 ender3 DuetControlServer[13516]: === Heat ===
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Bed heaters = 0 -1, chamberHeaters = -1 -1
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Heater 0 is on, I-accum = 0.0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Heater 2 is on, I-accum = 0.6
Mar 26 19:28:05 ender3 DuetControlServer[13516]: === GCodes ===
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Segments left: 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Movement lock held by Autopause
Mar 26 19:28:05 ender3 DuetControlServer[13516]: HTTP* is idle in state(s) 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Telnet is idle in state(s) 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: File* is doing "G1 X-58.264000 Y-6.812000 E0.479440" in state(s) 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: USB is idle in state(s) 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Aux is idle in state(s) 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Trigger* is idle in state(s) 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Queue* is idle in state(s) 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: LCD is idle in state(s) 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: SBC is idle in state(s) 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Daemon is idle in state(s) 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Aux2 is idle in state(s) 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Autopause is ready with "M122 M115 M913 X0 Y0 G10 P0 R0 S0 G10 P1 R0 S0 G91 M83 G1 Z3 E-5 F10000" in state(s) 71
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Code queue is empty.
Mar 26 19:28:05 ender3 DuetControlServer[13516]: === Filament sensors ===
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Extruder 0 sensor: ok
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Extruder 1 sensor: ok
Mar 26 19:28:05 ender3 DuetControlServer[13516]: === CAN ===
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Messages queued 60589, send timeouts 60586, received 0, lost 0, longest wait 0ms for reply type 0, peak Tx sync delay 0, free buffers 17 (min 17)
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Last cancelled message type 30 dest 127
Mar 26 19:28:05 ender3 DuetControlServer[13516]: === SBC interface ===
Mar 26 19:28:05 ender3 DuetControlServer[13516]: State: 0, failed transfers: 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Last transfer: 11ms ago
Mar 26 19:28:05 ender3 DuetControlServer[13516]: RX/TX seq numbers: 6654/6655
Mar 26 19:28:05 ender3 DuetControlServer[13516]: SPI underruns 0, overruns 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Number of disconnects: 0, IAP RAM available 0x11458
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Buffer RX/TX: 1192/2488-0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: G0/G1: insufficient axes homed
Mar 26 19:28:06 ender3 DuetControlServer[13516]: [debug] Requesting update of key move, seq 86 -> 87
Mar 26 19:28:06 ender3 DuetControlServer[13516]: [warn] VIN under-voltage event (0.0V)

dc42

@Serbitar, thanks for that report. I'm sorry that this is not resolved yet. The M122 report shows no ADC timeouts, which tells me where not to look for the problem.

dc42

I've put another firmware build at https://www.dropbox.com/sh/kc7bxqp0s2jjoks/AACf_aOUtEMa8Ix9HXU41hQla?dl=0 to try to pin this down further. Again, if is is convenient, please install it and do an air print to see if the issue still occurs.

Serbitar

Thanks for your continued support! I have installed your latest build.

Conveniently I'm currently printing batches of smaller parts so no major loss if the printer stops mid way through one of them.

lodger

Afternoon,

Sorry to say i have had undervolt again. This time network fully locked up. and i had to plug in a keyboard and monitor to get the M122 off . So sorry about the txt file

M122.txt

Web page ,SSH and remote desktop fully stopped.

dc42

@lodger, thanks for that. It's a useful data point, because it eliminates another aspect of the hardware and firmware that is only used when there is an attached SBC.

Serbitar

Tripped over the issue again:

Mar 27 21:49:17 ender3 DuetControlServer[22051]: [error] === Diagnostics ===
Mar 27 21:49:17 ender3 DuetControlServer[22051]: RepRapFirmware for Duet 3 Mini 5+ version 3.3beta2+1-swcrc running on Duet 3 Mini5plus WiFi (SBC mode)
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Board ID: W4ZW4-V296U-D65J0-40KM0-LR03Z-H6928
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Used output buffers: 2 of 40 (12 max)
Mar 27 21:49:17 ender3 DuetControlServer[22051]: === RTOS ===
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Static ram: 100008
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Dynamic ram: 98124 of which 0 recycled
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Never used RAM 45572, free system stack 123 words
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Tasks: Linux(ready,145) HEAT(delaying,299) CanReceiv(notifyWait,943) CanSender(notifyWait,358) CanClock(delaying,340) TMC(notifyWait,109) MAIN(running,354) IDLE(ready,20) AIN(delaying,258)
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Owned mutexes: Autopause(MAIN)
Mar 27 21:49:17 ender3 DuetControlServer[22051]: === Platform ===
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Last reset 00:29:07 ago, cause: software
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Last software reset at 2021-03-27 21:20, reason: User, none spinning, available RAM 45476, slot 2
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Software reset code 0x0012 HFSR 0x00000000 CFSR 0x00000000 ICSR 0x00000000 BFAR 0xe000ed38 SP 0x00000000 Task Linu Freestk 0 n/a
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Error status: 0x00
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Aux0 errors 0,0,0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Aux1 errors 0,0,0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: ADC conversions started 870319, completed 870319, timed out 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Supply voltage: min 0.0, current 24.1, max 25.0, under voltage events: 2, over voltage events: 0, power good: no
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Heap OK, handles allocated/used 0/0, heap memory allocated/used/recyclable 0/0/0, gc cycles 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Driver 0: position -7822, standstill, SG min/max 0/0, read errors 0, write errors 2, ifcnt 10, reads 17204, writes 18, timeouts 2, DMA errors 0, failedOp 0x6a
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Driver 1: position -7466, standstill, SG min/max 0/38, read errors 0, write errors 2, ifcnt 10, reads 17204, writes 18, timeouts 1, DMA errors 0, failedOp 0x72
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Driver 2: position 3887, ok, SG min/max 0/248, read errors 0, write errors 2, ifcnt 18, reads 17196, writes 26, timeouts 0, DMA errors 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Driver 3: position 0, ok, SG min/max 0/422, read errors 0, write errors 2, ifcnt 14, reads 17183, writes 22, timeouts 17, DMA errors 0, failedOp 0x72
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Driver 4: position 0, ok, SG min/max 0/408, read errors 0, write errors 2, ifcnt 14, reads 17194, writes 22, timeouts 8, DMA errors 0, failedOp 0x01
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Driver 5: position 0, ok, SG min/max 0/100, read errors 0, write errors 2, ifcnt 14, reads 17195, writes 22, timeouts 5, DMA errors 0, failedOp 0x41
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Driver 6: position 0, ok, SG min/max 0/114, read errors 0, write errors 2, ifcnt 14, reads 16657, writes 22, timeouts 543, DMA errors 0, failedOp 0x41
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Date/time: 2021-03-27 21:49:16
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Cache data hit count 2632939525
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Slowest loop: 179.79ms; fastest: 0.08ms
Mar 27 21:49:17 ender3 DuetControlServer[22051]: === Storage ===
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Free file entries: 10
Mar 27 21:49:17 ender3 DuetControlServer[22051]: SD card 0 not detected, interface speed: 0.0MBytes/sec
Mar 27 21:49:17 ender3 DuetControlServer[22051]: SD card longest read time 0.0ms, write time 0.0ms, max retries 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: === Move ===
Mar 27 21:49:17 ender3 DuetControlServer[22051]: DMs created 83, maxWait 62634ms, bed compensation in use: mesh, comp offset 0.000
Mar 27 21:49:17 ender3 DuetControlServer[22051]: === MainDDARing ===
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Scheduled moves 19881, completed moves 19881, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 4], CDDA state -1
Mar 27 21:49:17 ender3 DuetControlServer[22051]: === AuxDDARing ===
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Scheduled moves 0, completed moves 0, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1
Mar 27 21:49:17 ender3 DuetControlServer[22051]: === Heat ===
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Bed heaters = 0 -1, chamberHeaters = -1 -1
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Heater 0 is on, I-accum = 0.0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Heater 2 is on, I-accum = 0.6
Mar 27 21:49:17 ender3 DuetControlServer[22051]: === GCodes ===
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Segments left: 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Movement lock held by Autopause
Mar 27 21:49:17 ender3 DuetControlServer[22051]: HTTP* is idle in state(s) 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Telnet is idle in state(s) 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: File* is doing "G1 X-85.899002 Y-87.926003 E0.377730" in state(s) 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: USB is idle in state(s) 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Aux is idle in state(s) 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Trigger* is idle in state(s) 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Queue* is idle in state(s) 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: LCD is idle in state(s) 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: SBC is idle in state(s) 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Daemon is idle in state(s) 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Aux2 is idle in state(s) 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Autopause is ready with "M122 M115 M913 X0 Y0 G10 P0 R0 S0 G10 P1 R0 S0 G91 M83 G1 Z3 E-5 F10000" in state(s) 71
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Code queue is empty.
Mar 27 21:49:17 ender3 DuetControlServer[22051]: === Filament sensors ===
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Extruder 0 sensor: ok
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Extruder 1 sensor: ok
Mar 27 21:49:17 ender3 DuetControlServer[22051]: === CAN ===
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Messages queued 15731, send timeouts 15728, received 0, lost 0, longest wait 0ms for reply type 0, peak Tx sync delay 0, free buffers 17 (min 17)
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Last cancelled message type 4514 dest 127
Mar 27 21:49:17 ender3 DuetControlServer[22051]: === SBC interface ===
Mar 27 21:49:17 ender3 DuetControlServer[22051]: State: 0, failed transfers: 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Last transfer: 10ms ago
Mar 27 21:49:17 ender3 DuetControlServer[22051]: RX/TX seq numbers: 1055/1056
Mar 27 21:49:17 ender3 DuetControlServer[22051]: SPI underruns 0, overruns 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Number of disconnects: 0, IAP RAM available 0x11458
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Buffer RX/TX: 240/1728-0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: G0/G1: insufficient axes homed
Mar 27 21:49:17 ender3 DuetControlServer[22051]: [warn] VIN under-voltage event (0.0V)

dc42

@serbitar thanks, that confirms that the latest change did not help.

PaulHew

I am also experiencing this issue.

My machine was not doing anything, Just completed a heater tune. Below are the last 3 entries in the log.

28/03/2021, 19:03:05 	Warning: VIN under-voltage event (0.0V)
28/03/2021, 16:17:33 	Edit the M307 H0 command in config.g to match this. Omit the V parameter if the heater is not powered from VIN.
28/03/2021, 16:17:33 	Auto tuning heater 0 completed after 4 idle and 7 tuning cycles in 1336 seconds. This heater needs the following M307 command:
 M307 H0 R0.853 C250.9 D5.98 S0.60 V23.9

Pi has a dedicated PSU. Mini 5+ is power by a 300w meanwell.

Do you need any other info?

dc42

@paulhew, are you running with attached SBC, or in standalone mode?