non idempotent diff for failure testing.
Depends on D1104.
Differential Revision: https://phabricator-dev.allizom.org/D1105