With the volume of material now exceeding 4.6 million records—many of which may be duplicates—the department remains under immense pressure to prove its commitment to transparency