The only way you can be guaranteed low latency is to establish an isochronous connection. The USB bus is assigned bandwidth on a first come first served basis, with the exception of isochronous connections, which receive guaranteed bandwidth if possible.