At a key meeting in Riyadh, officials explored ways to open communication with Iran despite a major hurdle—the killing of senior Iranian figure Ali Larijani