Visual Code - Platformio - what's most straighforward way to compile without issue ?

Message

tparvais · #1 Post by **tparvais** » 01 May 2020, 13:42

Hello

I want to facilitate the compilation of different flavour of ESPeasy according to my needs (various ESP, different plugins...) in an easy way. Arduino IDE works, but not very convenient for multiple configs.

I installed VCode+Platformio+all tools (git, extension,...) like explained in https://espeasy.readthedocs.io/en/lates ... ormIO.html

I create a new project by cloning directly via Github https://github.com/letscontrolit/ESPEasy.git

It loads perfectly tall the stuff on my HDD.

Then, I select "Build" in env:normal_ESP8266_4M1M

And it starts the job but always stops after a while on this error: (i tried different others environement, no success)

Code: Select all

...
> Executing task: C:\Users\thoma\.platformio\penv\Scripts\platformio.exe run --environment normal_ESP8266_4M1M <

Processing normal_ESP8266_4M1M (platform: espressif8266@2.4.0; board: esp12e; framework: arduino)
--------------------------------------------------------------------------------------------------------------------------------------------
PackageManager: Installing framework-arduinoespressif8266
git version 2.26.0.windows.1
Cloning into 'C:\Users\thoma\.platformio\packages\_tmp_installing-gkuzryon-package'...
remote: Enumerating objects: 1647, done.
remote: Counting objects: 100% (1647/1647), done.
remote: Compressing objects: 100% (1401/1401), done.
remote: Total 1647 (delta 201), reused 841 (delta 78), pack-reused 0
Receiving objects: 100% (1647/1647), 23.63 MiB | 7.87 MiB/s, done.
Resolving deltas: 100% (201/201), done.
Note: switching to '3d128e5c785cbe2096a0def394554d1d8091601d'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by switching back to a branch.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -c with the switch command. Example:

  git switch -c <new-branch-name>

Or undo this operation with:

  git switch -

Turn off this advice by setting config variable advice.detachedHead to false

Updating files: 100% (1360/1360), done.
Submodule 'libraries/ESP8266SdFat' (https://github.com/earlephilhower/ESP8266SdFat.git) registered for path 'libraries/ESP8266SdFat'
Submodule 'libraries/LittleFS/lib/littlefs' (https://github.com/ARMmbed/littlefs.git) registered for path 'libraries/LittleFS/lib/littlefs' 
Submodule 'libraries/SoftwareSerial' (https://github.com/plerup/espsoftwareserial.git) registered for path 'libraries/SoftwareSerial'       
Submodule 'tools/esptool' (https://github.com/espressif/esptool.git) registered for path 'tools/esptool'
Submodule 'tools/pyserial' (https://github.com/pyserial/pyserial.git) registered for path 'tools/pyserial'
Submodule 'lwip2' (https://github.com/d-a-v/esp82xx-nonos-linklayer.git) registered for path 'tools/sdk/lwip2/builder'
Submodule 'tools/sdk/ssl/bearssl' (https://github.com/earlephilhower/bearssl-esp8266.git) registered for path 'tools/sdk/ssl/bearssl'       
Cloning into 'C:/Users/thoma/.platformio/packages/_tmp_installing-gkuzryon-package/libraries/ESP8266SdFat'...
remote: Enumerating objects: 3534, done.        
remote: Total 3534 (delta 0), reused 0 (delta 0), pack-reused 3534        
Receiving objects: 100% (3534/3534), 10.16 MiB | 5.64 MiB/s, done.
Resolving deltas: 100% (1916/1916), done.
Cloning into 'C:/Users/thoma/.platformio/packages/_tmp_installing-gkuzryon-package/libraries/LittleFS/lib/littlefs'...
remote: Enumerating objects: 7, done.        
remote: Counting objects: 100% (7/7), done.
remote: Compressing objects: 100% (6/6), done.
remote: Total 2170 (delta 1), reused 3 (delta 1), pack-reused 2163        
Receiving objects: 100% (2170/2170), 1.29 MiB | 2.49 MiB/s, done.
Resolving deltas: 100% (1509/1509), done.
Cloning into 'C:/Users/thoma/.platformio/packages/_tmp_installing-gkuzryon-package/libraries/SoftwareSerial'...
remote: Enumerating objects: 73, done.        
remote: Counting objects: 100% (73/73), done.
remote: Compressing objects: 100% (56/56), done.        
remote: Total 1859 (delta 32), reused 50 (delta 16), pack-reused 1786        
Receiving objects: 100% (1859/1859), 372.01 KiB | 1.72 MiB/s, done.
Resolving deltas: 100% (1079/1079), done.
Cloning into 'C:/Users/thoma/.platformio/packages/_tmp_installing-gkuzryon-package/tools/esptool'...
remote: Enumerating objects: 93, done.        
remote: Counting objects: 100% (93/93), done.        
remote: Compressing objects: 100% (73/73), done.        
remote: Total 2227 (delta 37), reused 74 (delta 19), pack-reused 2134        
Receiving objects: 100% (2227/2227), 7.85 MiB | 6.15 MiB/s, done.
Resolving deltas: 100% (1368/1368), done.
Cloning into 'C:/Users/thoma/.platformio/packages/_tmp_installing-gkuzryon-package/tools/pyserial'...
remote: Enumerating objects: 47, done.        
remote: Counting objects: 100% (47/47), done.
remote: Compressing objects: 100% (47/47), done.        
remote: Total 5878 (delta 20), reused 13 (delta 0), pack-reused 5831        
Receiving objects: 100% (5878/5878), 1.65 MiB | 2.96 MiB/s, done.
Resolving deltas: 100% (4338/4338), done.
Cloning into 'C:/Users/thoma/.platformio/packages/_tmp_installing-gkuzryon-package/tools/sdk/lwip2/builder'...
remote: Enumerating objects: 22, done.        
remote: Counting objects: 100% (22/22), done.
remote: Compressing objects: 100% (15/15), done.        
remote: Total 924 (delta 8), reused 14 (delta 6), pack-reused 902        
Receiving objects: 100% (924/924), 481.52 KiB | 1.30 MiB/s, done.
Resolving deltas: 100% (543/543), done.
Cloning into 'C:/Users/thoma/.platformio/packages/_tmp_installing-gkuzryon-package/tools/sdk/ssl/bearssl'...
remote: Enumerating objects: 86, done.        
remote: Counting objects: 100% (86/86), done.        
remote: Compressing objects: 100% (58/58), done.        
remote: Total 2820 (delta 46), reused 50 (delta 28), pack-reused 2734        
Receiving objects: 100% (2820/2820), 1.79 MiB | 2.84 MiB/s, done.
Resolving deltas: 100% (2225/2225), done.
Submodule path 'libraries/ESP8266SdFat': checked out 'b240d2231a117bbd89b79902eb54cae948ee2f42'
Submodule path 'libraries/LittleFS/lib/littlefs': checked out '6b65737715039ef92d348014316b575b52547019'
Submodule path 'libraries/SoftwareSerial': checked out '9da4d3729a57a181307bf9acf73473d052a38874'
Submodule path 'tools/esptool': checked out 'de30f21a222ec62f5a023dd955439b4f57702768'
Submodule path 'tools/pyserial': checked out 'c54c81d933b847458d465cd77e96cd702ff2e7be'
Submodule path 'tools/sdk/lwip2/builder': checked out '354887a25f83064dc0c795e11704190845812713'
Submodule 'lwip2-src' (https://git.savannah.nongnu.org/git/lwip.git) registered for path 'tools/sdk/lwip2/builder/lwip2-src'
Cloning into 'C:/Users/thoma/.platformio/packages/_tmp_installing-gkuzryon-package/tools/sdk/lwip2/builder/lwip2-src'...
remote: Counting objects: 51302, done.        
remote: Compressing objects: 100% (12142/12142), done.        
remote: Total 51302 (delta 38712), reused 51036 (delta 38514)        
Receiving objects: 100% (51302/51302), 10.08 MiB | 4.18 MiB/s, done.
Resolving deltas: 100% (38712/38712), done.
error: Server does not allow request for unadvertised object 159e31b689577dbf69cf0683bbaffbd71fa5ee10
Fetched in submodule path 'tools/sdk/lwip2/builder/lwip2-src', but it did not contain 159e31b689577dbf69cf0683bbaffbd71fa5ee10. Direct fetching of that commit failed.
Submodule path 'tools/sdk/ssl/bearssl': checked out '89454af34e3e61ddfc9837f3da5a0bc8ed44c3aa'
Failed to recurse into submodule path 'tools/sdk/lwip2/builder'
Error: VCS: Could not process command ['git', 'clone', '--recursive', '--depth', '1', '--branch', '2.6.3', 'https://github.com/esp8266/Arduino.git', 'C:\\Users\\thoma\\.platformio\\packages\\_tmp_installing-gkuzryon-package']
The terminal process terminated with exit code: 1

Terminal will be reused by tasks, press any key to close it.

Any idea ?

My objective is to add some Playground plugin. IS there a way to do this easily with such envrionement ?

Thank you

seb82 · #2 Post by **seb82** » 01 May 2020, 17:06

There is an issue with the current core relase (2.6.3).

In file "platformio_core_defs.ini", under section [core_2_6_3], use

Code: Select all

platform_packages         =
	framework-arduinoespressif8266 @ https://github.com/esp8266/Arduino.git

This should compile. Only thing - if I am not mistaken - is that it now uses the master, which may introduce bugs in case of wrong push.

But so far it worked well for me.

tparvais · #3 Post by **tparvais** » 01 May 2020, 19:14

great ! it works ! thanks !!!

What's the best trick to define easily the set of plugins I want to include ?

Change a platformio.ini ? use custom.h ?

TD-er · #4 Post by **TD-er** » 01 May 2020, 23:57

Use a Custom.h is by far the most flexible way of doing it.
Just copy the sample file into "Custom.h" (capital C) in the same dir as the sample file and run any of the 'custom' build environments.
These will detect the presence of this Custom.h file and include it.

This file is also set to be ignored in the Git environment, so you cannot check it in by accident, nor will it ever be overwritten when you check out a new branch or update to the latest code.
Still it makes sense to keep a copy of this file somewhere outside your working dir.

TD-er · #5 Post by **TD-er** » 01 May 2020, 23:58

seb82 wrote: ↑01 May 2020, 17:06 There is an issue with the current core relase (2.6.3).

In file "platformio_core_defs.ini", under section [core_2_6_3], use
Code: Select all
platform_packages         =
	framework-arduinoespressif8266 @ https://github.com/esp8266/Arduino.git
This should compile. Only thing - if I am not mistaken - is that it now uses the master, which may introduce bugs in case of wrong push.

But so far it worked well for me.

When did this start to happen?

seb82 · #6 Post by **seb82** » 02 May 2020, 01:34

Unsure, but when I looked for a solution a few weeks ago I ended up finding this issue that you opened in November. It seems it was fixed with that pull in February.

Maybe at that time you changed something in your local configuration in order to fix it, and thus do not get the error. Nevertheless, I think it compiles with Arduino IDE so maybe it works differently, I am unsure how everything is linked together when compiling.

TD-er · #7 Post by **TD-er** » 02 May 2020, 11:30

When pulling the esp8266/Arduino code, you will also pull a number of other linked projects.
That issue I made was related to one of the hosts you need to fetch the LWIP code from was down (due to ddos) for days.
So unless you had the files on your computer, it was not able to finish a clone of the project.

As far as I know, the sub-projects all come from GitHub right now.
But still, if you have an old revision on your hard drive, you may still try to fetch from an old location.

In such a case, try building one platformio env which you have not built before.
If that succeeds, you may delete the packages dir in the platformio directory (C:\Users\<username>\.platformio or similar one on Linux) and try again.

Then it was some kind of fluke where a project could not be fetched and a temp file was still locking the directory of it.

seb82 · #8 Post by **seb82** » 02 May 2020, 15:09

Just did this test :
- Removed .platformio folder (it was installed under C:\.platformio on my computer)
- Uninstalled PlatformIO IDE extension from VSCode
- Closed VSCode
- Reinstalled PlatformIO IDE extension in VSCode
- Downloaded last ESPEasy release (Release mega-20200426)
- Unzipped and opened source folder in VSCode
- Tried to build normal_ESP8266_4M1M

It failed to build. Here is the log :

Code: Select all

> Executing task: C:\.platformio\penv\Scripts\platformio.exe run --environment normal_ESP8266_4M1M <

Processing normal_ESP8266_4M1M (platform: espressif8266@2.4.0; board: esp12e; framework: arduino)
----------------------------------------------------------------------------------------------------------------------

PlatformManager: Installing espressif8266 @ 2.4.0
espressif8266 @ 2.4.0 has been successfully installed!
The platform 'espressif8266@2.4.0' has been successfully installed!
The rest of packages will be installed automatically depending on your build environment.
PackageManager: Installing toolchain-xtensa @ ~2.40802.191122
Downloading  [####################################]  100%
Unpacking  [####################################]  100%
toolchain-xtensa @ 2.40802.191122 has been successfully installed!
PackageManager: Installing framework-arduinoespressif8266
git version 2.26.0.windows.1
Cloning into 'C:\.platformio\packages\_tmp_installing-sqg0w35s-package'...
remote: Enumerating objects: 1647, done.
remote: Counting objects: 100% (1647/1647), done.
remote: Compressing objects: 100% (1401/1401), done.
Receiving objects:  98% (1615/1647), 22.86 MiB | 1.53 MiBremote: Total 1647 (delta 201), reused 841 (delta 78), pack-rReceiving objects: 100% (1647/1647), 23.63 MiB | 1.51 MiB/s, done.
Resolving deltas:   6% (14/201)
Resolving deltas: 100% (201/201), done.
Updating files: 100% (1360/1360), done.
Submodule 'libraries/ESP8266SdFat' (https://github.com/earlephilhower/ESP8266SdFat.git) registered for path 'libraries/ESP8266SdFat'
Submodule 'libraries/LittleFS/lib/littlefs' (https://github.com/ARMmbed/littlefs.git) registered for path 'libraries/LittleFS/lib/littlefs'
Submodule 'libraries/SoftwareSerial' (https://github.com/plerup/espsoftwareserial.git) registered for path 'libraries/SoftwareSerial'
Submodule 'tools/esptool' (https://github.com/espressif/esptool.git) registered for path 'tools/esptool'
Submodule 'tools/pyserial' (https://github.com/pyserial/pyserial.git) registered for path 'tools/pyserial'
Submodule 'lwip2' (https://github.com/d-a-v/esp82xx-nonos-linklayer.git) registered for path 'tools/sdk/lwip2/builder'
Submodule 'tools/sdk/ssl/bearssl' (https://github.com/earlephilhower/bearssl-esp8266.git) registered for path 'tools/sdk/ssl/bearssl'
Cloning into 'C:/.platformio/packages/_tmp_installing-sqg0w35s-package/libraries/ESP8266SdFat'...
remote: Enumerating objects: 3534, done.        
remote: Total 3534 (delta 0), reused 0 (delta 0), pack-reused 3534        
Receiving objects: 100% (3534/3534), 10.16 MiB | 1.48 MiB/s, done.
Resolving deltas: 100% (1916/1916), done.
Cloning into 'C:/.platformio/packages/_tmp_installing-sqg0w35s-package/libraries/LittleFS/lib/littlefs'...
remote: Enumerating objects: 7, done.        
remote: Counting objects: 100% (7/7), done.
remote: Compressing objects: 100% (6/6), done.
remote: Total 2170 (delta 1), reused 3 (delta 1), pack-reused 2163        
Receiving objects: 100% (2170/2170), 1.29 MiB | 1.20 MiB/s, done.
Resolving deltas: 100% (1509/1509), done.
Cloning into 'C:/.platformio/packages/_tmp_installing-sqg0w35s-package/libraries/SoftwareSerial'...
remote: Enumerating objects: 73, done.        
remote: Counting objects: 100% (73/73), done.        
remote: Compressing objects: 100% (56/56), done.
remote: Total 1859 (delta 32), reused 50 (delta 16), pack-reused 1786        
Receiving objects: 100% (1859/1859), 372.01 KiB | 940.00 KiB/s, done.
Resolving deltas: 100% (1079/1079), done.
Cloning into 'C:/.platformio/packages/_tmp_installing-sqg0w35s-package/tools/esptool'...
remote: Enumerating objects: 93, done.        
remote: Counting objects: 100% (93/93), done.        
remote: Compressing objects: 100% (73/73), done.        
remote: Total 2227 (delta 37), reused 74 (delta 19), pack-reused 2134        
Receiving objects: 100% (2227/2227), 7.85 MiB | 1.46 MiB/s, done.
Resolving deltas: 100% (1368/1368), done.
Cloning into 'C:/.platformio/packages/_tmp_installing-sqg0w35s-package/tools/pyserial'...
remote: Enumerating objects: 47, done.        
remote: Counting objects: 100% (47/47), done.
remote: Compressing objects: 100% (47/47), done.        
remote: Total 5878 (delta 20), reused 13 (delta 0), pack-reused 5831        
Receiving objects: 100% (5878/5878), 1.65 MiB | 1.25 MiB/s, done.
Resolving deltas: 100% (4338/4338), done.
Cloning into 'C:/.platformio/packages/_tmp_installing-sqg0w35s-package/tools/sdk/lwip2/builder'...
remote: Enumerating objects: 26, done.        
remote: Counting objects: 100% (26/26), done.
remote: Compressing objects: 100% (20/20), done.        
remote: Total 928 (delta 9), reused 13 (delta 5), pack-reused 902        
Receiving objects: 100% (928/928), 484.52 KiB | 1.00 MiB/s, done.
Resolving deltas: 100% (544/544), done.
Cloning into 'C:/.platformio/packages/_tmp_installing-sqg0w35s-package/tools/sdk/ssl/bearssl'...
remote: Enumerating objects: 86, done.        
remote: Counting objects: 100% (86/86), done.        
remote: Compressing objects: 100% (58/58), done.        
remote: Total 2820 (delta 46), reused 50 (delta 28), pack-reused 2734        
Receiving objects: 100% (2820/2820), 1.79 MiB | 1.29 MiB/s, done.
Resolving deltas: 100% (2225/2225), done.
Submodule path 'libraries/ESP8266SdFat': checked out 'b240d2231a117bbd89b79902eb54cae948ee2f42'
Submodule path 'libraries/LittleFS/lib/littlefs': checked out '6b65737715039ef92d348014316b575b52547019'
Submodule path 'libraries/SoftwareSerial': checked out '9da4d3729a57a181307bf9acf73473d052a38874'
Submodule path 'tools/esptool': checked out 'de30f21a222ec62f5a023dd955439b4f57702768'
Submodule path 'tools/pyserial': checked out 'c54c81d933b847458d465cd77e96cd702ff2e7be'
Submodule path 'tools/sdk/lwip2/builder': checked out '354887a25f83064dc0c795e11704190845812713'
Submodule 'lwip2-src' (https://git.savannah.nongnu.org/git/lwip.git) registered for path 'tools/sdk/lwip2/builder/lwip2-src'
Cloning into 'C:/.platformio/packages/_tmp_installing-sqg0w35s-package/tools/sdk/lwip2/builder/lwip2-src'...
remote: Counting objects: 51302, done.        
remote: Compressing objects: 100% (12142/12142), done.        
remote: Total 51302 (delta 38712), reused 51036 (delta 38514)        
Receiving objects: 100% (51302/51302), 10.08 MiB | 1.19 MiB/s, done.
Resolving deltas: 100% (38712/38712), done.
error: Server does not allow request for unadvertised object 159e31b689577dbf69cf0683bbaffbd71fa5ee10
Fetched in submodule path 'tools/sdk/lwip2/builder/lwip2-src', but it did not contain 159e31b689577dbf69cf0683bbaffbd71fa5ee10. Direct fetching of that commit failed.
Submodule path 'tools/sdk/ssl/bearssl': checked out '89454af34e3e61ddfc9837f3da5a0bc8ed44c3aa'
Failed to recurse into submodule path 'tools/sdk/lwip2/builder'
Error: VCS: Could not process command ['git', 'clone', '--recursive', '--depth', '1', '--branch', '2.6.3', 'https://github.com/esp8266/Arduino.git', 'C:\\.platformio\\packages\\_tmp_installing-sqg0w35s-package']
The terminal process terminated with exit code: 1

Terminal will be reused by tasks, press any key to close it.

It pulls espressif8266 @ 2.4.0, framework-arduinoespressif8266, and later on fails on an error on lwip2 :

Code: Select all

Failed to recurse into submodule path 'tools/sdk/lwip2/builder'
Error: VCS: Could not process command ['git', 'clone', '--recursive', '--depth', '1', '--branch', '2.6.3', 'https://github.com/esp8266/Arduino.git', 'C:\\.platformio\\packages\\_tmp_installing-sqg0w35s-package']

This is the same error as tparvais is getting.

Then in platformio_core_defs.ini, under [core_2_6_3] I repaced

framework-arduinoespressif8266 @ https://github.com/esp8266/Arduino.git#2.6.3

by the latest one (just released a few hours ago)

framework-arduinoespressif8266 @ https://github.com/esp8266/Arduino.git#2.7.0

First build attempt did not work so I ran a "Clean" task. Then, I tried again to build and it worked.

After that, I switched back to #2.6.3, did another "Clean" and "Build" attempt for normal_ESP8266_4M1M which failed

Last, I tried to build hard_Shelly_1_2M_256 (which I never did) and it failed as well.

Somehow, to me it makes sense : there is an issue in core release 2.6.3, it was fixed in master, and it is now fixed 2.7.0 release. Unless I missed something. Maybe I shall try another computer if I get the opportunity.

TD-er · #9 Post by **TD-er** » 02 May 2020, 15:21

If you wait for about half an hour, I will have the update merged to use core 2.7.0

tparvais · #10 Post by **tparvais** » 07 May 2020, 11:57

TD-er wrote: ↑02 May 2020, 15:21 If you wait for about half an hour, I will have the update merged to use core 2.7.0

hello

is it available somewhere ?

I also recompile with ESP8266 by indicating
platform = espressif8266@2.5.0

because I see here
https://espeasy.readthedocs.io/en/lates ... l#advanced

that there is a system to make backup archive config/rules files more easily. but I cannot find the menu to activate it ??

Thank you

TD-er · #11 Post by **TD-er** » 07 May 2020, 20:10

tparvais wrote: ↑07 May 2020, 11:57
TD-er wrote: ↑02 May 2020, 15:21 If you wait for about half an hour, I will have the update merged to use core 2.7.0
hello

is it available somewhere ?

I also recompile with ESP8266 by indicating
platform = espressif8266@2.5.0

because I see here
https://espeasy.readthedocs.io/en/lates ... l#advanced

that there is a system to make backup archive config/rules files more easily. but I cannot find the menu to activate it ??

Thank you

It was merged just on time when I posted it would be.
Please also read this about installing Python 3.8: https://github.com/letscontrolit/ESPEasy/issues/3058

The Settings archive is probably not included in all builds, as we are running out of space for our builds.
You can define the USE_SETTINGS_ARCHIVE in your Custom.h if you like and then you will have it for sure in your builds.
In the nightly builds, it is also enabled in the custom builds.

Visual Code - Platformio - what's most straighforward way to compile without issue ?

Visual Code - Platformio - what's most straighforward way to compile without issue ?

Re: Visual Code - Platformio - what's most straighforward way to compile without issue ?

Re: Visual Code - Platformio - what's most straighforward way to compile without issue ?

Re: Visual Code - Platformio - what's most straighforward way to compile without issue ?

Re: Visual Code - Platformio - what's most straighforward way to compile without issue ?

Re: Visual Code - Platformio - what's most straighforward way to compile without issue ?

Re: Visual Code - Platformio - what's most straighforward way to compile without issue ?

Re: Visual Code - Platformio - what's most straighforward way to compile without issue ?

Re: Visual Code - Platformio - what's most straighforward way to compile without issue ?

Re: Visual Code - Platformio - what's most straighforward way to compile without issue ?

Re: Visual Code - Platformio - what's most straighforward way to compile without issue ?

Who is online