It is not possible to define a default folder for all your applications.
This is because each application manages the opening of explorer.exe and defines the default folder there.
To save some time, you can map a drive, for example Z:,
which will go to the directory \\tsclient\C\%Username%\ ...
Example when using RemoteApp : \\tsclient\C\Users\%Username%\Downloads
