i've got a weird problem which occupied my whole day without a solution. And now i am furious

Situation:
A Wemos D1 is powered directly to the 5V and GND from a 3,7V battery. And a reed switch is in between so i am able to turn the power on and off with a magnet. I unplugged everything else for testing.
Problem:
I come near with a magnet: The Wemos blinks and turns on. Perfect. Thats what i want. But when i remove the magnet. The reed switch stays ON and so does the Wemos.
Testing:
1. I tried four other reed switches. All with same results.
2. When i test the reed switch stand alone. Without connected to anything. It works as it should.
3. I moved to different places in my room (In case there is a magnetic field nearby) -> no change
4. I put the reed switch in the Plus side and the GND side. Same plroblems
5. Putting a 47 Ohm resistor in series with the reed switch solves the problem of the reed switch, but then there is not enough power to boot the wemos.
When i flick the reed switch it sometimes turns off. But mostly not.
What else can i try? Do i miss something here? How is it possible that the reed switch stays ON?
Hope that someone can help me out here

Cheeers
ED
These are the specs of my reed switches:
Total length: 44.7MM
Glass length: 14.2MM
Diameter: 2.3MM
Electric shock load: 10W
Maximum switching voltage: 100 VDC/VAC
Maximum switching current: 0.5A
Electric shock capacitor: 0.7PF
Operating temperature range: -60~ +155 degrees
Maximum humidity: 98% (max)
Maximum working frequency: 100HZ
Startup value: 10-15
Release value: 5
Contact resistance: 100m ohm