Ok guys, after a long time not touching my ESP32, I started searching for solutions again. Unfortunately the tips that @wolph42 gave my did not work alone. What really worked for me, was found in this topic:
So basically use the first tip that @wolph42 gave us, but add a void setup_wifi() and that’s it. I ran some tests and everything is working like a charm now.