Which actor turned down the role of Hannibal Lector?

The role of Dr. Hannibal Lecter in "The Silence of the Lambs" earned Anthony Hopkins an Academy Award and cemented his place in movie history. Before Hopkins served up his chilling performance, another legendary actor found the character's appetite for human flesh too distasteful to stomach. Which screen icon passed on playing cinema's favorite cannibal?