Ugh

[AljoschaMeyer]

Using as_ref to inspect the contents of a scrambler consumer might not include everything that it had consumed, because some data might still be in the scramblers internal queue. So just call flush, right? Nope, we can't do that after an error, because of the invariant wrappers complaining.