what do you think about adding numbers in front of the entries in
the history-buffer? Then it would be really easy to switch to a specific
buffer by typing "C-c 1" to "C-c 0" for the first ten buffers. Maybe even
nine entries would suffice, consuming only 2 characters for the number
and a delimiting blank.
Or am I missing a hidden feature that already allows fast switching