The persistent rumours about Patel’s job security stem from several high-profile controversies that have drawn public and internal scrutiny