Add the following line to /etc/modprobe.d/blacklist.conf.
blacklist amdgpu
As initramfs contains modprobe configuration, update the initramfs and reboot:
sudo update-initramfs -u
Check whether the driver blacklisted or not, the following command should output nothing.
lsmod | grep amdgpu