A category that isn't used by any transactions should get automatically deleted when you restart the program. This behavior isn't ideal as it's not very intuitive but perhaps it's good enough until a better solution exists.