unset is the command you're looking for.

unset GNUPLOT_DRIVER_DIR