add queue statistics and off-hot-path tracing

[jeffreyqdd]

Give queue statistics such len, batches/s, estimated queue time.

Also, implement a tracing mechanism which gives a breakdown of the queuing time. Must offload work to be off the hot path.