Tested on Testing Branch v2.0.17 (tag bug-3031468) - Linux Ubuntu 10.04
On Step 5 - Continue, New or Finish:
Quit button is displayed when you first get to this step. But if you elect to continue with new media, when you get back to Step 5, the button is labelled Cancel.
This only happens if you elect to continue with new media at Step 5.