Make sure that no logical volumes are present in the volume group, see later section for how to do this.

Deactivate the volume group:

# vgchange -a n my_volume_group
        

Now you actually remove the volume group:

# vgremove my_volume_group