If it matters, I remapped "delete" from Backspace to Delete.
Could you be more specific? When I select an object, hit delete to delete it, and then select Undo, it reappears. What is not working for you?
Well, I'm pressing Ctrl-Z to undo, if that makes any difference...