Only remove the logical volumn that the virtual machine created instead of blasting the entire volumn group.