Add the following line to /etc/modprobe.d/blacklist.conf.

blacklist amdgpu

As initramfs contains modprobe configuration, update the initramfs and reboot:

sudo update-initramfs -u

Check whether the driver blacklisted or not, the following command should output nothing.

lsmod | grep amdgpu