Well, lawfully, Phillip is the King. His word is law. Matthew himself is technically the King in that he was supposed to be coronated, but to the Paladins, that doesn't matter. To them, the only one they are to defend is the King, and nothing will stop that. If you want to get technical, it's a loyalty to the crown itself, not the actual person wearing it.