Ubuntu - apt-get - Purge a package

Remove/Delete everything including configuration files.

sudo apt-get purge [package name]

Example

sudo apt-get purge zip
 
or 
 
sudo apt-get purge nginx nginx-core nginx-common