You are making an incorrect assumption about the button press having no effect when there are no stored credentials.
If you do not see this message in your serial monitor when you press the button…
Hold the button for 10 seconds to reset configuration...
then your pin assignment is incorrect. Until you solve this issue you will not make any progress with your problem.
I would you suggest that you read this…
and make the appropriate changes to your pin assignments.
Pete.