There has been “too much drama” between the brothers and their wives and that the bitterness on the same is still lingering in everyone, the royal author said