The USB OTG port can act as a device port, when connected to your development host's host port when running ADB, OR as a host port connected to a USB hub / keyboard / mouse. Only one at a time.
What you can do is:
- use a Bluetooth keyboard/mouse device
- you can configure ADB to work over WiFi
- you can connect the glasses via a usb-to-ethernet adapter and do ADB over that IP connection.