Study Finds West Point Cadets Can Be Trained to Better Evaluate AI Systems

Researchers trained west point cadets to spot problems in ai system outputs. The cadets got better at spotting problems on the specific test the researchers built. The study stopped there. It did not measure how long this training lasts before the systems change. It did not measure deployment lag. It did not measure whether the training transfers to systems the cadets have never seen.

The defense sector has a long tradition of validating procedures in conditions that match the peacetime classroom but not the field. This study fits that tradition exactly. A curriculum that does not update faster than the technology it teaches is already obsolete. No one has noted this formally because noting it would require saying the solution does not work.

The cadets will graduate and encounter systems three versions ahead of what they studied. They will be adequate at evaluating obsolete ai. This adequacy will be sufficient to clear the audit. The systems will continue to be deployed.