Harry & Meghan on Netflix: so who is the villain exactly?

Now that we've all watched the first three episodes - who are the villains in the story? It doesn't seem to be the Royals.