TeamViewer is known to create conflicting behaviors with RDP environments.
From your TeamViewer, please enable "enhanced multi user support (for terminal servers)" under advanced options, this creates a unique ID for each user that accesses the server.

Please check the TeamViewer knowledge base in this regard :
and