New firmware 2.0RC5 available

Dr_Ju_Ju

Sitting on the 'G-code files' page, while aprint is in progress, I received this error message:

G-Codes Directory
Go Up

Connect to your Duet to display G-Code files
JavaScript Error

A JavaScript error has occurred so the web interface has closed the connection to your board. It is recommended to reload the web interface now. If this happens again, please contact the author and share this error message:

Version: 1.21.1
Message: uncaught exception: out of memory
URL:
Line: 0:0
Error object: "out of memory"

dc42

@denke said in New firmware 2.0RC5 available:

Also, another strange experience, Not all the gcode files were listed in dwc, and I could not fild any method to turn the page.

-I selected the sorting method of mtime, newest first, but the most recent prints did not show up.
-Then selected all entrys, right click, delete.
-The selected entrys were deleted, and a new set of gcode files appeared containing those most recent I was looking for.

As if not all the entries were in the list of gcode files, and the sort would only apply to those which were visible.

See my earlier response, https://forum.duet3d.com/topic/5394/new-firmware-2-0rc5-available/30. There has always been a limit to how many files DWC will display in a single folder, but it's a little lower in release 2.0.

dc42

@dr_ju_ju said in New firmware 2.0RC5 available:

Sitting on the 'G-code files' page, while aprint is in progress, I received this error message:
G-Codes Directory
Go Up
Connect to your Duet to display G-Code files
JavaScript Error

A JavaScript error has occurred so the web interface has closed the connection to your board. It is recommended to reload the web interface now. If this happens again, please contact the author and share this error message:

Version: 1.21.1
Message: uncaught exception: out of memory
URL:
Line: 0:0
Error object: "out of memory"

That's one for chrishamm.

denke

@dc42
Thanks for the info!

A behaviour suggestion if i may:
-The sorting could be implemented in the duet fw, not dwc.
-The board could send down the first ~25 entries initially (the first 25 of the sorted list), then send the follow-up entries threw page turning or infinite scrolling

Or at least a warning that "there are too many files in this directory, not all files are shown".

dc42

@denke said in New firmware 2.0RC5 available:

@dc42
Thanks for the info!

A behaviour suggestion if i may:
-The sorting could be implemented in the duet fw, not dwc.
-The board could send down the first ~25 entries initially (the first 25 of the sorted list), then send the follow-up entries threw page turning or infinite scrolling

Or at least a warning that "there are too many files in this directory, not all files are shown".

Thanks, I am already in discussions with chrishamm about how to resolve this.

denke

Nice, thanks @dc42 !

3DOeste

Hi! I've been testing RC5 since the release date and everything works fine. I was previously on 1.21. I found no bug or anything strange to repport.

dc42

@3doeste said in New firmware 2.0RC5 available:

Hi! I've been testing RC5 since the release date and everything works fine. I was previously on 1.21. I found no bug or anything strange to repport.

Thanks for the feedback!

ShadowX

I don't know if anyone else have this issue, but with the 1.21.1 web interface, I seem to have a hard time controlling the fan speed in the "Machine Control" tab. If I pull on the slider, it would move over, but when I let go it would bounce back to the previous value. I repeat the same process on IE and Firefox and had the same issues. Sometimes if I double click slowly it would stay, but its a bit annoying.

When I move the fans, speed factor or extrusion factor in the "Print Status" tab, I have no problem moving the sliders. The slider in the fan control on the "Print Status" jumps slightly, but nowhere near as often as the "Machine Control" slider.

I don't think its related to RC5, but it seems like a problem with the recent updates.

Firmware Name: RepRapFirmware for Duet 2 WiFi/Ethernet
Firmware Electronics: Duet WiFi 1.0 or 1.01
Firmware Version: 2.0(RTOS)RC5 (2018-05-22b1)
WiFi Server Version: 1.21
Web Interface Version: 1.21.1

Christoph13524

@shadowx
I have the same problems in Safari.
It looks like for me this annoying bug got worse in the recent updates.

zerspaner_gerd

@dc42 With your advice, uploading the gcode files works without any problems.

The connection problems with DWC are still present.

The funny, on the Tablet (also with chrome and Windows10) comes for a long time no mistake.
On desktop PC this comes more often.

I do not understand that.

It seems that the update suspends the web interface but the connection remains.

With combination DWC 1.21.1 and RRF 1.21, the dropouts are not present.

sigxcpu

There are problems with this firmware (upgraded from 1.21, so I don't know if it is 2.0 specific or not).

Uploading a file, creating a directory (through DWC or FTP) is not shown in web UI. I've dumped the traffic between the browser and the Duet and indeed the file list does not show the added entries. If using FTP, they are there. If using M32 directly to print they are there.

Old files on the SD card are shown in DWC, but anything new since 2.0RC5 upgrade is not shown.

sigxcpu

@sigxcpu said in New firmware 2.0RC5 available:

There are problems with this firmware (upgraded from 1.21, so I don't know if it is 2.0 specific or not).

Uploading a file, creating a directory (through DWC or FTP) is not shown in web UI. I've dumped the traffic between the browser and the Duet and indeed the file list does not show the added entries. If using FTP, they are there. If using M32 directly to print they are there.

Old files on the SD card are shown in DWC, but anything new since 2.0RC5 upgrade is not shown.

Example:

Create a folder in gcodes/Raducu named ccc:

T 2018/05/24 22:21:48.056786 192.168.27.125:54849 -> 192.168.27.7:80 [AP] #74
GET /rr_mkdir?dir=0%3A%2Fgcodes%2FRaducu%2Fccc HTTP/1.1.
Host: 192.168.27.7.
Accept-Encoding: gzip, deflate.
Connection: keep-alive.
Accept: application/json, text/javascript, */*; q=0.01.
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/602.2.14 (KHTML, like Gecko) Version/10.0.1 Safari/602.2.14.
Referer: http://192.168.27.7/.
Accept-Language: en-us.
X-Requested-With: XMLHttpRequest.
.


T 2018/05/24 22:21:48.143654 192.168.27.7:80 -> 192.168.27.125:54849 [AP] #78
HTTP/1.1 200 OK
Cache-Control: no-cache, no-store, must-revalidate
Pragma: no-cache
Expires: 0
Access-Control-Allow-Origin: *
Content-Type: application/json
Content-Length: 9
Connection: close

{"err":0}

Reload shows no ccc entry.

T 2018/05/24 22:21:48.151622 192.168.27.125:54850 -> 192.168.27.7:80 [AP] #87
GET /rr_filelist?dir=0%3A%2Fgcodes%2FRaducu HTTP/1.1.
Host: 192.168.27.7.
Accept-Encoding: gzip, deflate.
Connection: keep-alive.
Accept: application/json, text/javascript, */*; q=0.01.
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/602.2.14 (KHTML, like Gecko) Version/10.0.1 Safari/602.2.14.
Referer: http://192.168.27.7/.
Accept-Language: en-us.
X-Requested-With: XMLHttpRequest.
.


T 2018/05/24 22:21:48.168250 192.168.27.7:80 -> 192.168.27.125:54850 [A] #88
HTTP/1.1 200 OK
Cache-Control: no-cache, no-store, must-revalidate
Pragma: no-cache
Expires: 0
Access-Control-Allow-Origin: *
Content-Type: application/json
Content-Length: 1992
Connection: close

{"dir":"0:/gcodes/Raducu","files":[{"type":"f","name":"loubie_aria_dragon_PLA.gcode","size":6043030,"date":"2017-04-03T19:10:15"},{"type":"f","name":"spaceShuttle1_PLA.gcode","size":1735511,"date":"2017-04-03T22:55:18"},{"type":"f","name":"2part_-_A_head_ABS.gcode","size":4456480,"date":"2017-04-23T22:04:29"},{"type":"f","name":"nema17_support_PLA.gcode","size":1277492,"date":"2017-04-07T13:03:07"},{"type":"f","name":"belt_support_PLA.gcode","size":911789,"date":"2017-04-07T15:22:11"},{"type":"f","name":"plate_and_pillars_PLA 220 (Sacele).gcode","size":2990130,"date":"2017-04-08T00:29:20"},{"type":"f","name":"robot_pillar_PLA 220 (Sacele).gcode","size":1621129,"date":"2017-04-08T14:13:06"},{"type":"f","name":"2part_-_B_body_ABS.gcode","size":6222247,"date":"2017-04-23T23:01:19"},{"type":"f","name":"Variable_Speed_Gears_-_Main_Gear-1_ABS.gcode","size":9204723,"date":"2017-05-01T10:16:23"},{"type":"f","name":"metal_detector_coil_PLA.gcode","size":1589034,"date":"2017-05-06T20:54:17"},{"type":"d","name":"Spinner","size":0,"date":"2017-05-22T02:26:25"},{"type":"f","name":"Hull_Mk6_ABS.gcode","size":3329265,"date":"2017-05-31T15:23:21"},{"type":"f","name":"Finger_Pad_V2_Twisted_Pins_ABS.gcode","size":958387,"date":"2017-05-15T22:36:15"},{"type":"d"

T 2018/05/24 22:21:48.271859 192.168.27.7:80 -> 192.168.27.125:54850 [AP] #90
,"name":"Microscop","size":0,"date":"2017-05-19T01:31:00"},{"type":"f","name":"SphericalIrisBox_PLA.gcode","size":11446362,"date":"2017-05-20T21:24:09"},{"type":"f","name":"Jumping_Turtle_PLA.gcode","size":7794056,"date":"2017-08-10T23:55:16"},{"type":"f","name":"Jumping_Turtle_PLA_0.3.gcode","size":4326095,"date":"2017-08-10T23:59:10"},{"type":"f","name":"Spikey_Top_PLA.gcode","size":2177682,"date":"2017-08-22T20:17:24"},{"type":"f","name":"Rocket_Launcher_PLA.gcode","size":5816173,"date":"2017-08-28T17:56:01"},{"type":"f","name":"Rocket_Launcher_10mm.gcode","size":3424444,"date":"2017-08-29T14:46:10"},{"type":"f","name":"2LiterThreads_1fourth_npt_FINS_righted_PET-G.gcode","size":2229123,"date":"2017-08-30T19:36:09"}]}

dc42

@sigxcpu said in New firmware 2.0RC5 available:

There are problems with this firmware (upgraded from 1.21, so I don't know if it is 2.0 specific or not).

Uploading a file, creating a directory (through DWC or FTP) is not shown in web UI. I've dumped the traffic between the browser and the Duet and indeed the file list does not show the added entries. If using FTP, they are there. If using M32 directly to print they are there.

Old files on the SD card are shown in DWC, but anything new since 2.0RC5 upgrade is not shown.

Please see this response https://forum.duet3d.com/topic/5394/new-firmware-2-0rc5-available/30.

sigxcpu

Thank you for the answer.

I've scanned this thread, but missed that.

Is this a permanent issue or we can expect it to be fixed in the future? I don't know the internals, but I assume that the serialization buffer is small. If it is that, can't you simply generate the JSON on the fly (i.e. streaming)?

Another option is to shrink the JSON. On a machine to machine transfer there is no need to repeat type, name, size, date all the time. They can be abbreviated to t n s d, for example.

LE: now that this started me, I dug in the source code.

I see that the big M122 reply is sent at this size:
Content-Length: 2539

My example reply is:
Content-Length: 1992

My example with shorted field names is 1739 bytes in size, around 250 bytes smaller.

So there are ~550 bytes that could've taken more files to be displayed.

Also the modified times can be encoded as UNIX timestamps instead of formatted, which will reduce that even further, from 21 bytes to 9 bytes per entry.

We can have a parameter in rr_filelist sent by DWC to request short format and implement a list with all the above mentioned optimizations, so things are backward compatible.
I can take a stab at this, without the buffer size part (M122 is big, filelist is small) because I don't know why you've chosen it to be that way.
This will be for a 2.1 release maybe.

dc42

I agree that the protocol is too verbose (I didn't design it) and we are discussing how to fix the issue. Unfortunately it won't be fixed in time for the 2.0 release because the master files are needed tomorrow for SD card duplication.

sigxcpu

How do you think this should be integrated?

create a new command like rr_compactfilelist?dir=xxx
add a parameter to existing rr_filelist like rr_filelist?dir=xxx&compact=true

Synlor

I ran into an issue I have never seen before in the 1 series of firmware. I almost always run prints via Octoprint over the usb serial connection. About 3.5 hours into a print the connection died.

I am running firmware 2.0(RTOS)RC5 (2018-05-22b1).

Here was the error on the Octoprint terminal:

Unexpected error while reading serial port, please consult octoprint.log for details: SerialException: 'device reports readiness to read but returned no data (device disconnected or multiple access on port?)' @ comm.py:_readline:2417

In the DWC console it had this:

g-code buffer 'serial' length overflow

I ran an M122 in the DWC console interface:

M122
=== Diagnostics ===
RepRapFirmware for Duet 2 WiFi/Ethernet version 2.0(RTOS)RC5 running on Duet WiFi 1.0 or 1.01 + DueX5
Board ID: 08DAM-999TL-MQ4S8-6J9D8-3SJ6N-15B3W
Used output buffers: 1 of 20 (10 max)
=== RTOS ===
Static ram: 28452
Dynamic ram: 96644 of which 16 recycled
Exception stack ram used: 380
Never used ram: 5580
Task NETWORK ready, free stack 420
Task DHTSENSOR blocked, free stack 36
Task HEAT blocked, free stack 1256
Task MAIN running, free stack 3620
=== Platform ===
Last reset 00:04:46 ago, cause: software
Last software reset at 2018-05-24 21:58, reason: Assertion failed, spinning module Platform, available RAM 5284 bytes (slot 1)
Software reset code 0x0090 HFSR 0x00000000, CFSR 0x00000000, ICSR 0x0041f80e, BFAR 0xe000ed38, SP 0x2001ffb4
Stack: 2001e6a0 2001e6d4 00445509 00000000 00000000 00000001 20006c68 20006bf4 00444885 2001e6ec 20006bf4 00000000 00f00000 e000ef34 c0000018 00000003 004449c7 00444738 61000000 b082b430 b33b9d04 b2c96804 41b4f041 3480f444
Error status: 0
Free file entries: 10
SD card 0 detected, interface speed: 12.0MBytes/sec
SD card longest block write time: 0.0ms
MCU temperature: min 46.6, current 46.7, max 49.5
Supply voltage: min 24.0, current 24.2, max 24.4, under voltage events: 0, over voltage events: 0
Driver 0: standstill, SG min/max not available
Driver 1: standstill, SG min/max not available
Driver 2: standstill, SG min/max not available
Driver 3: standstill, SG min/max not available
Driver 4: standstill, SG min/max not available
Driver 5: standstill, SG min/max not available
Driver 6: standstill, SG min/max not available
Driver 7: standstill, SG min/max not available
Driver 8: standstill, SG min/max not available
Driver 9: standstill, SG min/max not available
Expansion motor(s) stall indication: yes
Date/time: 2018-05-24 22:03:05
Slowest main loop (seconds): 0.372014; fastest: 0.000069
=== Move ===
Hiccups: 0, StepErrors: 0, LaErrors: 0, FreeDm: 240, MinFreeDm 240, MaxWait: 0ms, Underruns: 0, 0
Scheduled moves: 0, completed moves: 0
Bed compensation in use: none
Bed probe heights: 0.000 0.000 0.000 0.000 0.000
=== Heat ===
Bed heaters = 0 -1 -1 -1, chamberHeaters = -1 -1
Heater 3 is on, I-accum = 0.0
=== GCodes ===
Segments left: 0
Stack records: 1 allocated, 0 in use
Movement lock held by null
http is idle in state(s) 0
telnet is idle in state(s) 0
file is idle in state(s) 0
serial is idle in state(s) 0
aux is idle in state(s) 0
daemon is idle in state(s) 0
queue is idle in state(s) 0
autopause is idle in state(s) 0
Code queue is empty.
=== Network ===
Responder states: HTTP(4) HTTP(0) HTTP(0) HTTP(0) FTP(0) Telnet(0) Telnet(0)
HTTP sessions: 1 of 8
- WiFi -
Network state is running
WiFi module is connected to access point 
Failed messages: pending 0, notready 0, noresp 0
WiFi firmware version 1.21
WiFi MAC address 5c:cf:7f:2c:27:2d
WiFi Vcc 3.38, reset reason Turned on by main processor
WiFi flash size 4194304, free heap 15000
WiFi IP address 192.168.2.143
WiFi signal strength -65dBm, reconnections 0, sleep mode modem
Socket states: 0 5 0 0 0 0 0 0
=== Expansion ===
DueX I2C errors 0

I know I am weird to still use Octoprint with a Duet Wifi, but I like the various plugins and record keeping that it provides over the DWC interface. Thanks!

marekzehra

Running FW: 2.0(RTOS)RC5 (2018-05-22b1), DWC: 1.21.1

Tested on small print and no issue occured.
Just one glitch on first print (macro with delta calibration, heat and cooldown) when reloading DWC in browser caused "Emergency STOP". But can't reproduce.

Adrian52

Running 2.0rc5 and dwc121. 1, I have noticed odd behaviour of M122 included in slicer end script. At the end of the print, the M122 report does not appear. The gcode console accepts an M122, but no report. YAT connection accepts M122, and provides a report, but this does not relate to the print, so I guess the original M122 cleared. The DWC console accepts other commands when in the M122 blocked state, and M122 works fine after reset. The effect is seen with S3D and kislicer end scripts.