I've actually made a few mistakes there, but in the meantime i changed the idea a bit to use 12S module.
Here is my updated circuit:
As far as i learned, the 12S has gpio2 and gpio0 pull-ups and gpio15 pull-down in place, so this will be functional?
I also have a question about the LDO. It's hard to find something with required 500mA, even the xc6203 says now it haas 400.. Do you have any recommendations?