As usual, the best answer is: It depends
Later releases incorporate new features, new plugins, new framework and library versions and general improvements. All of that should add to stability.
But, on the other hand, adding changes is known, in general, to add uncertainty (= risk) to any project.
ESPEasy has a mechanism to update from older to newer versions quite easily (and also allows to revert to older releases if needed), so if you want a newer release in the future, keeping the current status quo for as long as possible, that's just fine. Several users are still on much older releases (> 4 year old), happily running their units without issues.
For new units I'd advise to use the latest available 'nightly' release, especially when using newer CPU's like the ESP32 and ESP32s2, as only in recent releases (used by ESPEasy) of the Arduino framework have added much needed stability.
Also for newer units: Avoid using ESP's with only 1MB of flash memory (though sometimes you have no choice), as 2, 4 and 16MB units allows for easy firmware updates via the web-interface. (With some technical expertise it is possible to upgrade a 1MB unit to a 4MB unit by replacing the external flash chip.)