ESP Easy Webdumper

Moderators: grovkillen, Stuntteam, TD-er

Message
Author
User avatar
grovkillen
Core team member
Posts: 3621
Joined: 19 Jan 2017, 12:56
Location: Hudiksvall, Sweden
Contact:

ESP Easy Webdumper

#1 Post by grovkillen » 06 Jan 2018, 21:25

ESP Easy Webdumper (0.00.013)

Is originally a application to do screenshots of the ESP Easy web GUI for the wiki. I made it since the web interface is constantly changing and keeping up with the screenshots was getting more challenging when the project expands. Its a fun problem to overcome.

You may use this tool for getting screenshots of your unit to be uploaded to the forum if you need help. A screenshot is a perfect start when trying to explain your problem and for other community members to see what you may have done wrong or need to be aware off. A nice side effect of the tool is that these screenshots and downloads of the rules and config files are a great way of keeping backups for your units.

Features
+ Screenshot all pages, including subpages
+ Download all rule files
+ Download the config.dat file
+ Batch run multiple IP addresses (via batch file and command line switch /IP_NUMBER)
+ Batch run scheadule for daily or weekly backups (via batch file and command line switch /IP_NUMBER , for truly headless add /SILENT=1)
+ Compress the results files into a zip archive (will reduce the size a lot)

EXTRA INFORMATION
ONLY WINDOWS is supported (Windows 10, Windows 8.1, Windows 8, Windows 7, and possibly older versions as well)
APP_DATA.zip is needed for the screenshots, download and place it in the same directory as the ESP Easy Webdumper exe file.
Log files for each webdump will be placed in the Log folder under the subfolder of that unit.

I plan add more features on a weekly basis. Thanks for all the feedback!

+ is a feature already implemented
- is on the todo-list
Attachments
Screenshot.png
Screenshot.png (13.72 KiB) Viewed 23305 times
Last edited by grovkillen on 10 Feb 2018, 20:56, edited 8 times in total.
ESP Easy Flasher [flash tool and wifi setup at flash time]
ESP Easy Webdumper [easy screendumping of your units]
ESP Easy Netscan [find units]
Official shop: https://firstbyte.shop/
Sponsor ESP Easy, we need you :idea: :idea: :idea:

User avatar
grovkillen
Core team member
Posts: 3621
Joined: 19 Jan 2017, 12:56
Location: Hudiksvall, Sweden
Contact:

Re: ESP Easy Webdumper

#2 Post by grovkillen » 08 Jan 2018, 20:03

Okay, I have now made a big (in my opinion) update for the webdumper. I find it fairly mature and do what I want it to do... some nice to have features that I might add if I see that people are start using it.
ESP Easy Flasher [flash tool and wifi setup at flash time]
ESP Easy Webdumper [easy screendumping of your units]
ESP Easy Netscan [find units]
Official shop: https://firstbyte.shop/
Sponsor ESP Easy, we need you :idea: :idea: :idea:

User avatar
budman1758
Normal user
Posts: 301
Joined: 15 Apr 2017, 05:13
Location: Riverside CA USA

Re: ESP Easy Webdumper

#3 Post by budman1758 » 09 Jan 2018, 01:06

Tried to run this. I get a no ping response error. Opened a command prompt from same folder the exe is in and and ping response is all good. :shock:
Also tried running as admin. Same results.
webdump1.JPG
webdump1.JPG (192.41 KiB) Viewed 23722 times
"The glass is twice as big as it needs to be".

User avatar
grovkillen
Core team member
Posts: 3621
Joined: 19 Jan 2017, 12:56
Location: Hudiksvall, Sweden
Contact:

Re: ESP Easy Webdumper

#4 Post by grovkillen » 09 Jan 2018, 06:13

You are my best bug hunter! Will try and see what might cause that... :roll: :)
ESP Easy Flasher [flash tool and wifi setup at flash time]
ESP Easy Webdumper [easy screendumping of your units]
ESP Easy Netscan [find units]
Official shop: https://firstbyte.shop/
Sponsor ESP Easy, we need you :idea: :idea: :idea:

User avatar
budman1758
Normal user
Posts: 301
Joined: 15 Apr 2017, 05:13
Location: Riverside CA USA

Re: ESP Easy Webdumper

#5 Post by budman1758 » 09 Jan 2018, 06:56

grovkillen wrote: 09 Jan 2018, 06:13 You are my best bug hunter!
Hummmmmm. is that a good thing? :lol: :lol:
"The glass is twice as big as it needs to be".

TD-er
Core team member
Posts: 8643
Joined: 01 Sep 2017, 22:13
Location: the Netherlands
Contact:

Re: ESP Easy Webdumper

#6 Post by TD-er » 09 Jan 2018, 09:31

Maybe increase the timeout for deciding a ping is not working?
I noticed the ESP sometimes can take over a second to reply.

User avatar
grovkillen
Core team member
Posts: 3621
Joined: 19 Jan 2017, 12:56
Location: Hudiksvall, Sweden
Contact:

Re: ESP Easy Webdumper

#7 Post by grovkillen » 09 Jan 2018, 11:28

TD-er wrote: 09 Jan 2018, 09:31 Maybe increase the timeout for deciding a ping is not working?
I noticed the ESP sometimes can take over a second to reply.
Yes this is the cause of the ping failure. I have now extended the time to 5x the original ping time... Thanks for the input :)
ESP Easy Flasher [flash tool and wifi setup at flash time]
ESP Easy Webdumper [easy screendumping of your units]
ESP Easy Netscan [find units]
Official shop: https://firstbyte.shop/
Sponsor ESP Easy, we need you :idea: :idea: :idea:

User avatar
budman1758
Normal user
Posts: 301
Joined: 15 Apr 2017, 05:13
Location: Riverside CA USA

Re: ESP Easy Webdumper

#8 Post by budman1758 » 09 Jan 2018, 21:23

Tried the latest version. App acts like its working but after it runs the log folder is empty. That's where the pics are supposed to save to correct?
Also of note: It took about 50 seconds b4 the log window said it found the device and started capturing pages.
Capture.JPG
Capture.JPG (109.39 KiB) Viewed 23659 times
"The glass is twice as big as it needs to be".

User avatar
grovkillen
Core team member
Posts: 3621
Joined: 19 Jan 2017, 12:56
Location: Hudiksvall, Sweden
Contact:

Re: ESP Easy Webdumper

#9 Post by grovkillen » 09 Jan 2018, 21:44

I need to update that one aswell... I use the same time/date module :S
ESP Easy Flasher [flash tool and wifi setup at flash time]
ESP Easy Webdumper [easy screendumping of your units]
ESP Easy Netscan [find units]
Official shop: https://firstbyte.shop/
Sponsor ESP Easy, we need you :idea: :idea: :idea:

User avatar
grovkillen
Core team member
Posts: 3621
Joined: 19 Jan 2017, 12:56
Location: Hudiksvall, Sweden
Contact:

Re: ESP Easy Webdumper

#10 Post by grovkillen » 09 Jan 2018, 21:55

https://github.com/Grovkillen/ESP_Easy_ ... g/0.00.005

I hope this one work better... :oops: :P

Regarding 50 seconds before starting to capture... it might take that long until the ESP is responding to the requests :|

BUT it might be a bug as well, I'm no top notch programmer as you can tell ;)
ESP Easy Flasher [flash tool and wifi setup at flash time]
ESP Easy Webdumper [easy screendumping of your units]
ESP Easy Netscan [find units]
Official shop: https://firstbyte.shop/
Sponsor ESP Easy, we need you :idea: :idea: :idea:

User avatar
budman1758
Normal user
Posts: 301
Joined: 15 Apr 2017, 05:13
Location: Riverside CA USA

Re: ESP Easy Webdumper

#11 Post by budman1758 » 09 Jan 2018, 22:21

This one worked just fine!! Got a folder full of screenshots just as promised. :mrgreen: :mrgreen:
Still about the same delay. Not a big deal in my opinion.
grovkillen wrote: 09 Jan 2018, 21:55 BUT it might be a bug as well, I'm no top notch programmer as you can tell ;)
Dude. Don't sweat that. NOBODY falls outta their Moma as a top notch programmer. I've looked into it and I can't even begin to "get it". My hats off to all who can.
That's the main reason I like ESPEasy so much. I can actually do things without programming. Rules strech my programming skills to the limit. :ugeek:
"The glass is twice as big as it needs to be".

User avatar
grovkillen
Core team member
Posts: 3621
Joined: 19 Jan 2017, 12:56
Location: Hudiksvall, Sweden
Contact:

Re: ESP Easy Webdumper

#12 Post by grovkillen » 09 Jan 2018, 22:31

Thanks mate! :)
ESP Easy Flasher [flash tool and wifi setup at flash time]
ESP Easy Webdumper [easy screendumping of your units]
ESP Easy Netscan [find units]
Official shop: https://firstbyte.shop/
Sponsor ESP Easy, we need you :idea: :idea: :idea:

manjh
Normal user
Posts: 516
Joined: 08 Feb 2016, 11:22

Re: ESP Easy Webdumper

#13 Post by manjh » 10 Jan 2018, 13:58

I discovered this new development yesterday, downloaded, and decided to dive in and do some testing.
The idea and concept are brilliant: a one-stop tool to extract all info from a unit.

As I am writing this, the tool is working on the download of one of my units.
A few quick remarks.

1. IP address initially comes up with 192.168.0.123. Would be nice if it would remember the last used IP address.
2. after selecting one or more items ot tales a long time before something happens. Thi shas good reasons (I assume), but the ignorant and impatient user will start pressing buttons. Solution: display a blinking text right of the two "Select" buttons. Something like: "Processing, please wait!"
3. After completion, the output is stored in a file with the IP number and timestamp. Excellent. But it will take some more information about what we can do with these files. Can they be fed into a restore function? Or should they be used for manual input only? Also, formatting of the data is not clear.
4. It might be nice to have a simple "Ping-only" function, to check if the unit is online. Could be placed next to the "RUN" button.
5. make the blue action window a bit bigger
6. clear the blue action window when a new "run" starts, so the old content is not confused with the new actions

Hope this helps.
Please take my remarks as positive feedback, I think this tool is very useful and I would like to help improve!

User avatar
grovkillen
Core team member
Posts: 3621
Joined: 19 Jan 2017, 12:56
Location: Hudiksvall, Sweden
Contact:

Re: ESP Easy Webdumper

#14 Post by grovkillen » 10 Jan 2018, 14:53

manjh wrote: 10 Jan 2018, 13:58 I discovered this new development yesterday, downloaded, and decided to dive in and do some testing.
The idea and concept are brilliant: a one-stop tool to extract all info from a unit.

As I am writing this, the tool is working on the download of one of my units.
A few quick remarks.

1. IP address initially comes up with 192.168.0.123. Would be nice if it would remember the last used IP address.
2. after selecting one or more items ot tales a long time before something happens. Thi shas good reasons (I assume), but the ignorant and impatient user will start pressing buttons. Solution: display a blinking text right of the two "Select" buttons. Something like: "Processing, please wait!"
3. After completion, the output is stored in a file with the IP number and timestamp. Excellent. But it will take some more information about what we can do with these files. Can they be fed into a restore function? Or should they be used for manual input only? Also, formatting of the data is not clear.
4. It might be nice to have a simple "Ping-only" function, to check if the unit is online. Could be placed next to the "RUN" button.
5. make the blue action window a bit bigger
6. clear the blue action window when a new "run" starts, so the old content is not confused with the new actions

Hope this helps.
Please take my remarks as positive feedback, I think this tool is very useful and I would like to help improve!
GREAT input, will take all these into the next release. :) Thank you very much!
ESP Easy Flasher [flash tool and wifi setup at flash time]
ESP Easy Webdumper [easy screendumping of your units]
ESP Easy Netscan [find units]
Official shop: https://firstbyte.shop/
Sponsor ESP Easy, we need you :idea: :idea: :idea:

manjh
Normal user
Posts: 516
Joined: 08 Feb 2016, 11:22

Re: ESP Easy Webdumper

#15 Post by manjh » 10 Jan 2018, 18:36

Forgot this one:

7. Make it possible to copy the output from the blue action window. Perhaps I did something wrong, but I could not select/copy the text. Printscreen is a bit of overkill.
So make the text selectable, or even make a button to copy the text.

manjh
Normal user
Posts: 516
Joined: 08 Feb 2016, 11:22

Re: ESP Easy Webdumper

#16 Post by manjh » 10 Jan 2018, 18:42

On the wishlist:

Accept the IP address as parameter when starting the tool. If the parameter is not given, work as it is now, with a user interface.
If the parameter is provided, run the tool with all options selected for the given IP address, and close the tool after completion.

This would allow the user to build an old-fashioned bat file, calling the tool for each and every ESP unit in the system.
Simply add one line in the bat file for each unit.
This would make a single, full backup very easy!

Shardan
Normal user
Posts: 1156
Joined: 03 Sep 2016, 23:27
Location: Bielefeld / Germany

Re: ESP Easy Webdumper

#17 Post by Shardan » 10 Jan 2018, 20:08

One of these tools that make life much easier. :)

+1
Regards
Shardan

User avatar
grovkillen
Core team member
Posts: 3621
Joined: 19 Jan 2017, 12:56
Location: Hudiksvall, Sweden
Contact:

Re: ESP Easy Webdumper

#18 Post by grovkillen » 10 Jan 2018, 20:11

I'm on it! Glad more people find it helpful in life :)
ESP Easy Flasher [flash tool and wifi setup at flash time]
ESP Easy Webdumper [easy screendumping of your units]
ESP Easy Netscan [find units]
Official shop: https://firstbyte.shop/
Sponsor ESP Easy, we need you :idea: :idea: :idea:

User avatar
grovkillen
Core team member
Posts: 3621
Joined: 19 Jan 2017, 12:56
Location: Hudiksvall, Sweden
Contact:

Re: ESP Easy Webdumper

#19 Post by grovkillen » 12 Jan 2018, 15:23

1. IP address initially comes up with 192.168.0.123. Would be nice if it would remember the last used IP address.
2. after selecting one or more items ot tales a long time before something happens. Thi shas good reasons (I assume), but the ignorant and impatient user will start pressing buttons. Solution: display a blinking text right of the two "Select" buttons. Something like: "Processing, please wait!"
3. After completion, the output is stored in a file with the IP number and timestamp. Excellent. But it will take some more information about what we can do with these files. Can they be fed into a restore function? Or should they be used for manual input only? Also, formatting of the data is not clear.
4. It might be nice to have a simple "Ping-only" function, to check if the unit is online. Could be placed next to the "RUN" button.
5. make the blue action window a bit bigger
6. clear the blue action window when a new "run" starts, so the old content is not confused with the new actions
7. Make it possible to copy the output from the blue action window. Perhaps I did something wrong, but I could not select/copy the text. Printscreen is a bit of overkill.
8. Batch mode: Accept the IP address as parameter when starting the tool. If the parameter is not given, work as it is now, with a user interface.

Green above is now implemented.
ESP Easy Flasher [flash tool and wifi setup at flash time]
ESP Easy Webdumper [easy screendumping of your units]
ESP Easy Netscan [find units]
Official shop: https://firstbyte.shop/
Sponsor ESP Easy, we need you :idea: :idea: :idea:

User avatar
grovkillen
Core team member
Posts: 3621
Joined: 19 Jan 2017, 12:56
Location: Hudiksvall, Sweden
Contact:

Re: ESP Easy Webdumper

#20 Post by grovkillen » 15 Jan 2018, 14:19

Batch mode is now implemented. You call it using this switch "/IP_NUMBER=" and then point to the ip number. I have not implemented log output if the ip is not correct but it will not continue if the entered number is not an ip number.

The app will exit once the job is completed. Multiple instances of the app should be possible.
ESP Easy Flasher [flash tool and wifi setup at flash time]
ESP Easy Webdumper [easy screendumping of your units]
ESP Easy Netscan [find units]
Official shop: https://firstbyte.shop/
Sponsor ESP Easy, we need you :idea: :idea: :idea:

manjh
Normal user
Posts: 516
Joined: 08 Feb 2016, 11:22

Re: ESP Easy Webdumper

#21 Post by manjh » 15 Jan 2018, 22:00

I downloaded (it is still marked 4th version!), but can't get it to run on Win10.
At first Windows complains about an unknown maker, and after that Avast starts worrying about the file. After a scan it tells me that the file may contain malware. Even when I tell Avast to trust the file, it refuses to run (looks like I have no access somehow) :o

manjh
Normal user
Posts: 516
Joined: 08 Feb 2016, 11:22

Re: ESP Easy Webdumper

#22 Post by manjh » 15 Jan 2018, 22:09

Tried again, sosmehow navigated through the Windows and Avast messages and ran the program. Now get "access denied"...

User avatar
budman1758
Normal user
Posts: 301
Joined: 15 Apr 2017, 05:13
Location: Riverside CA USA

Re: ESP Easy Webdumper

#23 Post by budman1758 » 15 Jan 2018, 22:15

manjh wrote: 15 Jan 2018, 22:09 Tried again, sosmehow navigated through the Windows and Avast messages and ran the program. Now get "access denied"...
Try running as Admin and see what happens.
"The glass is twice as big as it needs to be".

manjh
Normal user
Posts: 516
Joined: 08 Feb 2016, 11:22

Re: ESP Easy Webdumper

#24 Post by manjh » 15 Jan 2018, 22:20

budman1758 wrote: 15 Jan 2018, 22:15
manjh wrote: 15 Jan 2018, 22:09 Tried again, sosmehow navigated through the Windows and Avast messages and ran the program. Now get "access denied"...
Try running as Admin and see what happens.
That was the 1st thing I tried...

User avatar
grovkillen
Core team member
Posts: 3621
Joined: 19 Jan 2017, 12:56
Location: Hudiksvall, Sweden
Contact:

Re: ESP Easy Webdumper

#25 Post by grovkillen » 15 Jan 2018, 22:49

I'd say avast is the "problem".
ESP Easy Flasher [flash tool and wifi setup at flash time]
ESP Easy Webdumper [easy screendumping of your units]
ESP Easy Netscan [find units]
Official shop: https://firstbyte.shop/
Sponsor ESP Easy, we need you :idea: :idea: :idea:

manjh
Normal user
Posts: 516
Joined: 08 Feb 2016, 11:22

Re: ESP Easy Webdumper

#26 Post by manjh » 15 Jan 2018, 23:19

grovkillen wrote: 15 Jan 2018, 22:49 I'd say avast is the "problem".
Correct. I disabled the shields and now it runs fine.
Other question: I'm not sure I have the latest-and-greatest version. Did you put it on github as new version? Or is the "Forth"(... fourth) version the right one?

Also, I wonder why the ping takes so long. I started the tool and it says it waits for a ping.
Then I started a command window, typed the ping command, and it finished four pings before the tool had one done.... why?

User avatar
grovkillen
Core team member
Posts: 3621
Joined: 19 Jan 2017, 12:56
Location: Hudiksvall, Sweden
Contact:

Re: ESP Easy Webdumper

#27 Post by grovkillen » 15 Jan 2018, 23:24

I ping twice using powershell. And to be sure that all units have time to respond I have a delay of about 30 seconds. I might need to add more output...? I understand that it seems slow when you get no feedback.

Be aware that I need to cover many different scenarios and this ping is really important that it responds correctly since it will "wake the unit up" and make it ready to connect to.

Latest is 0.00.007 but I didn't put that one in releases.
Last edited by grovkillen on 15 Jan 2018, 23:25, edited 1 time in total.
ESP Easy Flasher [flash tool and wifi setup at flash time]
ESP Easy Webdumper [easy screendumping of your units]
ESP Easy Netscan [find units]
Official shop: https://firstbyte.shop/
Sponsor ESP Easy, we need you :idea: :idea: :idea:

manjh
Normal user
Posts: 516
Joined: 08 Feb 2016, 11:22

Re: ESP Easy Webdumper

#28 Post by manjh » 15 Jan 2018, 23:24

The version I downloaded does not support the parameter, and the blue command window is the same size as I remember it.
So I think I donot have the latest version...

User avatar
grovkillen
Core team member
Posts: 3621
Joined: 19 Jan 2017, 12:56
Location: Hudiksvall, Sweden
Contact:

Re: ESP Easy Webdumper

#29 Post by grovkillen » 15 Jan 2018, 23:26

manjh wrote: 15 Jan 2018, 23:24 The version I downloaded does not support the parameter, and the blue command window is the same size as I remember it.
So I think I donot have the latest version...
0.00.007 is not in releases only in the code section.
ESP Easy Flasher [flash tool and wifi setup at flash time]
ESP Easy Webdumper [easy screendumping of your units]
ESP Easy Netscan [find units]
Official shop: https://firstbyte.shop/
Sponsor ESP Easy, we need you :idea: :idea: :idea:

manjh
Normal user
Posts: 516
Joined: 08 Feb 2016, 11:22

Re: ESP Easy Webdumper

#30 Post by manjh » 15 Jan 2018, 23:26

grovkillen wrote: 15 Jan 2018, 23:24 I ping twice using powershell. And to be sure that all units have time to respond I have a delay of about 30 seconds. I might need to add more output...? I understand that it seems slow when you get no feedback.

Be aware that I need to cover many different scenarios and this ping is really important that it responds correctly since it will "wake the unit up" and make it ready to connect to.
OK, understand. But I would think that as soon as the unit responds to a ping, the tool can proceed... the 30 second timeout does not come into the play until the unit remains "dark"!

manjh
Normal user
Posts: 516
Joined: 08 Feb 2016, 11:22

Re: ESP Easy Webdumper

#31 Post by manjh » 15 Jan 2018, 23:27

grovkillen wrote: 15 Jan 2018, 23:26
manjh wrote: 15 Jan 2018, 23:24 The version I downloaded does not support the parameter, and the blue command window is the same size as I remember it.
So I think I donot have the latest version...
0.00.007 is not in releases only in the code section.
Ah, that explains it.
For speed of testing, could you send the exe to me via mail? You have my mail address... ;)

User avatar
grovkillen
Core team member
Posts: 3621
Joined: 19 Jan 2017, 12:56
Location: Hudiksvall, Sweden
Contact:

Re: ESP Easy Webdumper

#32 Post by grovkillen » 15 Jan 2018, 23:27

True! Will make a check in the next release. Thanks
ESP Easy Flasher [flash tool and wifi setup at flash time]
ESP Easy Webdumper [easy screendumping of your units]
ESP Easy Netscan [find units]
Official shop: https://firstbyte.shop/
Sponsor ESP Easy, we need you :idea: :idea: :idea:

User avatar
grovkillen
Core team member
Posts: 3621
Joined: 19 Jan 2017, 12:56
Location: Hudiksvall, Sweden
Contact:

Re: ESP Easy Webdumper

#33 Post by grovkillen » 15 Jan 2018, 23:29

manjh wrote: 15 Jan 2018, 23:27
grovkillen wrote: 15 Jan 2018, 23:26
manjh wrote: 15 Jan 2018, 23:24 The version I downloaded does not support the parameter, and the blue command window is the same size as I remember it.
So I think I donot have the latest version...
0.00.007 is not in releases only in the code section.
Ah, that explains it.
For speed of testing, could you send the exe to me via mail? You have my mail address... ;)
You can download the exe from the code section. The APP_DATA.zip is unchanged so just replace the exe.
ESP Easy Flasher [flash tool and wifi setup at flash time]
ESP Easy Webdumper [easy screendumping of your units]
ESP Easy Netscan [find units]
Official shop: https://firstbyte.shop/
Sponsor ESP Easy, we need you :idea: :idea: :idea:

manjh
Normal user
Posts: 516
Joined: 08 Feb 2016, 11:22

Re: ESP Easy Webdumper

#34 Post by manjh » 15 Jan 2018, 23:35

manjh wrote: 15 Jan 2018, 23:27
grovkillen wrote: 15 Jan 2018, 23:26
manjh wrote: 15 Jan 2018, 23:24 The version I downloaded does not support the parameter, and the blue command window is the same size as I remember it.
So I think I donot have the latest version...
0.00.007 is not in releases only in the code section.
Ah, that explains it.
For speed of testing, could you send the exe to me via mail? You have my mail address... ;)
Never mind, got it.....

manjh
Normal user
Posts: 516
Joined: 08 Feb 2016, 11:22

Re: ESP Easy Webdumper

#35 Post by manjh » 15 Jan 2018, 23:47

OK, some quick (unstructured) test results.

1. when I start the tool it comes up with the default IP address. I changed that to one of mine and ran it, then closed the tool and restarted. The IP address is again your default (so my last used address is not remembered).
2. when I start the tool in batch mode with an IP address as parameter, it runs the tool but it fails to select all options. Result: no much is downloaded...
3. unit name and number is not found, I tried on build 147 and also on the Mega release.
4. output files are not clear to me, I tried to look at a few but I will need more time to study the structure. I was expecting simple screenshot files. But this could be my mistake, perhaps I opened the files in the wrong way?

User avatar
grovkillen
Core team member
Posts: 3621
Joined: 19 Jan 2017, 12:56
Location: Hudiksvall, Sweden
Contact:

Re: ESP Easy Webdumper

#36 Post by grovkillen » 16 Jan 2018, 05:59

You need to save the settings. Batch mode will use these default settings. ;)

Regarding the output files and unit name. These should be straight on screen shots and the name and number should be found. If not that tells me you didn't have the correct IP number? Can you confirm that the IP is that of a ESP Easy unit?
ESP Easy Flasher [flash tool and wifi setup at flash time]
ESP Easy Webdumper [easy screendumping of your units]
ESP Easy Netscan [find units]
Official shop: https://firstbyte.shop/
Sponsor ESP Easy, we need you :idea: :idea: :idea:

manjh
Normal user
Posts: 516
Joined: 08 Feb 2016, 11:22

Re: ESP Easy Webdumper

#37 Post by manjh » 16 Jan 2018, 14:59

grovkillen wrote: 16 Jan 2018, 05:59 You need to save the settings. Batch mode will use these default settings. ;)

Regarding the output files and unit name. These should be straight on screen shots and the name and number should be found. If not that tells me you didn't have the correct IP number? Can you confirm that the IP is that of a ESP Easy unit?
I tried on a few different ESP's. In fact, am running one now: it complains about unit name/number, and then proceeds with the other screens with no problems.
I will compress a few of the outputs and send them to you.

One question stays in the back of my mind. When I browse into the ESP unit, it asks me to log on with userid/password (I configured it like that). How does your Web dumper pull the information out of the ESP's without knowledge of those credentials?

manjh
Normal user
Posts: 516
Joined: 08 Feb 2016, 11:22

Re: ESP Easy Webdumper

#38 Post by manjh » 16 Jan 2018, 15:05

grovkillen wrote: 16 Jan 2018, 05:59 You need to save the settings. Batch mode will use these default settings. ;)
Tested and confirmed.... works great!

User avatar
grovkillen
Core team member
Posts: 3621
Joined: 19 Jan 2017, 12:56
Location: Hudiksvall, Sweden
Contact:

Re: ESP Easy Webdumper

#39 Post by grovkillen » 16 Jan 2018, 15:35

manjh wrote: 16 Jan 2018, 14:59 One question stays in the back of my mind. When I browse into the ESP unit, it asks me to log on with userid/password (I configured it like that). How does your Web dumper pull the information out of the ESP's without knowledge of those credentials?
Whoooops! That's probably it. I guess some pages are not protected by the password (JSON, SDCARD, CONFIG etc).

Thanks for that input, and we need to go to the bottom on that one since downloading the config will let you clone a unit and get onto the network fairly easy. Lets try all the pages and file the findings to GitHub.
ESP Easy Flasher [flash tool and wifi setup at flash time]
ESP Easy Webdumper [easy screendumping of your units]
ESP Easy Netscan [find units]
Official shop: https://firstbyte.shop/
Sponsor ESP Easy, we need you :idea: :idea: :idea:

manjh
Normal user
Posts: 516
Joined: 08 Feb 2016, 11:22

Re: ESP Easy Webdumper

#40 Post by manjh » 16 Jan 2018, 15:38

grovkillen wrote: 16 Jan 2018, 15:35
manjh wrote: 16 Jan 2018, 14:59 One question stays in the back of my mind. When I browse into the ESP unit, it asks me to log on with userid/password (I configured it like that). How does your Web dumper pull the information out of the ESP's without knowledge of those credentials?
Whoooops! That's probably it. I guess some pages are not protected by the password (JSON, SDCARD, CONFIG etc).

Thanks for that input, and we need to go to the bottom on that one since downloading the config will let you clone a unit and get onto the network fairly easy. Lets try all the pages and file the findings to GitHub.
I would expect that all pages are protected by the login credentials. If any of them are not, that is a security gap...

For the tool it can be solved by adding two fields (userid/password) and store them in the settings.

User avatar
grovkillen
Core team member
Posts: 3621
Joined: 19 Jan 2017, 12:56
Location: Hudiksvall, Sweden
Contact:

Re: ESP Easy Webdumper

#41 Post by grovkillen » 16 Jan 2018, 15:39

Yes I will add that. Thanks for the information.

Would you be able to test all the web pages manually?
ESP Easy Flasher [flash tool and wifi setup at flash time]
ESP Easy Webdumper [easy screendumping of your units]
ESP Easy Netscan [find units]
Official shop: https://firstbyte.shop/
Sponsor ESP Easy, we need you :idea: :idea: :idea:

manjh
Normal user
Posts: 516
Joined: 08 Feb 2016, 11:22

Re: ESP Easy Webdumper

#42 Post by manjh » 16 Jan 2018, 15:41

Not really test findings, but more usability suggestions:

1. change the name of the tool (especially the exe file!) to "ESPDumper". It covers the nature of the tool and is easier.
2. when the tool is called in batch mode (so when the parameter is provided), run in "quiet mode". So donot create the popup window.

Reason for this second suggestion: I am now testing with a bat file, pulling info from five units (to start with). I can run this in backhround and do other things in Windows. But each time a new unit is started, I get that popup window taking over the focus... annoying!

User avatar
grovkillen
Core team member
Posts: 3621
Joined: 19 Jan 2017, 12:56
Location: Hudiksvall, Sweden
Contact:

Re: ESP Easy Webdumper

#43 Post by grovkillen » 16 Jan 2018, 15:48

manjh wrote: 16 Jan 2018, 15:41 Not really test findings, but more usability suggestions:

1. change the name of the tool (especially the exe file!) to "ESPDumper". It covers the nature of the tool and is easier.
2. when the tool is called in batch mode (so when the parameter is provided), run in "quiet mode". So donot create the popup window.

Reason for this second suggestion: I am now testing with a bat file, pulling info from five units (to start with). I can run this in backhround and do other things in Windows. But each time a new unit is started, I get that popup window taking over the focus... annoying!
1. I might add the possibility to rename the actual file but the name stands :P
2. I will add a /HEADLESS_MODE=1 switch for the command line. I totally understand you there :)
ESP Easy Flasher [flash tool and wifi setup at flash time]
ESP Easy Webdumper [easy screendumping of your units]
ESP Easy Netscan [find units]
Official shop: https://firstbyte.shop/
Sponsor ESP Easy, we need you :idea: :idea: :idea:

manjh
Normal user
Posts: 516
Joined: 08 Feb 2016, 11:22

Re: ESP Easy Webdumper

#44 Post by manjh » 16 Jan 2018, 16:07

grovkillen wrote: 16 Jan 2018, 15:39 Yes I will add that. Thanks for the information.

Would you be able to test all the web pages manually?
I will see what I can do.

It seems you are depending on release level. Perhaps we should consider taking another route?
I can see three ways.
First: simply go along all possible page names and pull the complete page out as screenshot. I suspect you were already following this route.

Second, include a special interface in the next release, where the ESP unit simply spits out each and every data element it contains, identified by a data element key.
I realize this is not simple to do, and it may take a bit of storage that we don't have.

Third, again starting with the next release, have ESPEasy dump the entire content of the storage area that is used to store variables, along with the built number to identify how data is stored. Then in the ESPDump tool implement the intelligence to decypher the data area and create nice and readable output from that. Essentially the same as the second option, except that it will not take as much storage in the ESP unit.

Both second and third way has the downside that it will not work until the next release.
Taking screenshots will always work.

manjh
Normal user
Posts: 516
Joined: 08 Feb 2016, 11:22

Re: ESP Easy Webdumper

#45 Post by manjh » 16 Jan 2018, 16:09

grovkillen wrote: 16 Jan 2018, 15:48
manjh wrote: 16 Jan 2018, 15:41 Not really test findings, but more usability suggestions:

1. change the name of the tool (especially the exe file!) to "ESPDumper". It covers the nature of the tool and is easier.
2. when the tool is called in batch mode (so when the parameter is provided), run in "quiet mode". So donot create the popup window.

Reason for this second suggestion: I am now testing with a bat file, pulling info from five units (to start with). I can run this in backhround and do other things in Windows. But each time a new unit is started, I get that popup window taking over the focus... annoying!
1. I might add the possibility to rename the actual file but the name stands :P
2. I will add a /HEADLESS_MODE=1 switch for the command line. I totally understand you there :)
Name is only relevant for the exe file.
As for the flag, I would suggest something that reflects the purpose, such as /QUIET_MODE,
But why not take quiet mode as default when running with IP as parameter?

User avatar
grovkillen
Core team member
Posts: 3621
Joined: 19 Jan 2017, 12:56
Location: Hudiksvall, Sweden
Contact:

Re: ESP Easy Webdumper

#46 Post by grovkillen » 16 Jan 2018, 17:55

manjh wrote: 16 Jan 2018, 16:09
grovkillen wrote: 16 Jan 2018, 15:48
manjh wrote: 16 Jan 2018, 15:41 Not really test findings, but more usability suggestions:

1. change the name of the tool (especially the exe file!) to "ESPDumper". It covers the nature of the tool and is easier.
2. when the tool is called in batch mode (so when the parameter is provided), run in "quiet mode". So donot create the popup window.

Reason for this second suggestion: I am now testing with a bat file, pulling info from five units (to start with). I can run this in backhround and do other things in Windows. But each time a new unit is started, I get that popup window taking over the focus... annoying!
1. I might add the possibility to rename the actual file but the name stands :P
2. I will add a /HEADLESS_MODE=1 switch for the command line. I totally understand you there :)
Name is only relevant for the exe file.
As for the flag, I would suggest something that reflects the purpose, such as /QUIET_MODE,
But why not take quiet mode as default when running with IP as parameter?
Good idea. :)
ESP Easy Flasher [flash tool and wifi setup at flash time]
ESP Easy Webdumper [easy screendumping of your units]
ESP Easy Netscan [find units]
Official shop: https://firstbyte.shop/
Sponsor ESP Easy, we need you :idea: :idea: :idea:

User avatar
grovkillen
Core team member
Posts: 3621
Joined: 19 Jan 2017, 12:56
Location: Hudiksvall, Sweden
Contact:

Re: ESP Easy Webdumper

#47 Post by grovkillen » 10 Feb 2018, 00:50

ESP Easy Flasher [flash tool and wifi setup at flash time]
ESP Easy Webdumper [easy screendumping of your units]
ESP Easy Netscan [find units]
Official shop: https://firstbyte.shop/
Sponsor ESP Easy, we need you :idea: :idea: :idea:

rol-rider
Normal user
Posts: 43
Joined: 02 Oct 2016, 12:36

Re: ESP Easy Webdumper

#48 Post by rol-rider » 10 Feb 2018, 15:21

Hello,
sorry for my limited english (google translate)
thank you for this work.

I wanted to test!
but I can not find the screenshot?
the LOG folder does not contain a screenshot. is this normal?
I wonder if I understood how it works?
CaptureLog.PNG
CaptureLog.PNG (69.56 KiB) Viewed 24403 times
I only have 3 files in the LOG folder

I use windows 7 (64bits)

thank you
sorry for my English ! i use google translat.

User avatar
grovkillen
Core team member
Posts: 3621
Joined: 19 Jan 2017, 12:56
Location: Hudiksvall, Sweden
Contact:

Re: ESP Easy Webdumper

#49 Post by grovkillen » 10 Feb 2018, 16:15

You need APP_DATA.zip to be in the same folder as the exe file.

I will add this as a warning. Thanks for the feedback :)
ESP Easy Flasher [flash tool and wifi setup at flash time]
ESP Easy Webdumper [easy screendumping of your units]
ESP Easy Netscan [find units]
Official shop: https://firstbyte.shop/
Sponsor ESP Easy, we need you :idea: :idea: :idea:

User avatar
grovkillen
Core team member
Posts: 3621
Joined: 19 Jan 2017, 12:56
Location: Hudiksvall, Sweden
Contact:

Re: ESP Easy Webdumper

#50 Post by grovkillen » 10 Feb 2018, 16:32

I have now updated with a new release.

https://github.com/Grovkillen/ESP_Easy_ ... r/releases
ESP Easy Flasher [flash tool and wifi setup at flash time]
ESP Easy Webdumper [easy screendumping of your units]
ESP Easy Netscan [find units]
Official shop: https://firstbyte.shop/
Sponsor ESP Easy, we need you :idea: :idea: :idea:

Post Reply

Who is online

Users browsing this forum: No registered users and 19 guests