When you store a point of view, the shown dialog lets you either enter a new name, or select an existing point of view to overwrite. If you use this second way, you won't have to delete the point of view meanwhile. Is it ok for you?
By the way, this is not a bug but a feature request.