Bush, kept a Churchill bust in the Oval Office from 2001 until the end of his presidency. The bust was a loan from the U.K.