No. If you have direct connection available from the Client to the virtual desktop, you don't need to use the tunnel. The USB redirection channel on TCP port 32111 can be direct. Check that you don't have a firewall blocking 32111 anywhere in the path.
Mark