Remove all LVs VGs and LVM Partitions

sudo vgdisplay
sudo vgremove

References :
http://askubuntu.com/questions/228136/how-to-remove-all-lvs-vgs-and-partitions-on-all-drives-before-installing-12-04