I did not find any hint's about this (most likely simple and stupid) question: When I run a program and get back to the editor it seems that the program is still running. This would explain why my changes only worked after a restart of the ESP.
So: How can a program be stopped? Only by restarting the device or am I dumb here?