It seems to be a power supply issue.
Get a more robust one, and add capacitors nearby ESP.
Do you have the reverse diode in parallel with the relay's coil ?
When powering by the wall adapter with or without the 5v regulator the power is very dim on the ESP, when powering by the battery the ESP comes on and the blue light just stays on.