If text is selected and you press the left arrow, the text is deselected and the caret is now positioned at the beginning of the (former) selection.
However, this doesn't work at the beginning of the buffer.
Normally at the beginning of the buffer, you can't move left. But in this case, the caret doesn't move left, it's moved to selection start. So this should work.