[Backport 2.x] Make sure listener is started when query metrics enabled

[Backport 2.x] Make sure listener is started when query metrics enabled #78