Hide kill query handler behind a feature flag

[akoshelev]

It does not feel safe when someone can kill a query from outside. This option should only be available for limited test runs, but #1304 does not limit that.

The reason why we went with this approach is it gets us through in-market and other tests, but we should close the gap when possible