I went to the services snapin (Control Panel->Administrative Tools->Services), found the VboxVmService, and chaged it to Login as my user. The issue went away.
Ubuntu Guest won't boot without intervention via RDP
xlaunch -run filename.xlaunch is also worth noting. That's what the file association does for double clicking (if it's set up correctly).