I associated a scene with the 'New' button. How do I revert that?

In case you have associated a scene via File|Set default scene with the 'New' button and want it to actually produce pristine scenes again, simply delete, rename or move the corresponding file. Then press the 'New' button to delete the binding.
Afterwards, you can reinstate the file in question.