Thanks to the footnote here: http://blog.firedaemon.com/2011/07/27/passwordless-root-ssh-public-key-authentication-on-centos-6/
On centos systems that are refusing keybased authentication run the following command as root
#> restorecon -R -v /root/.ssh