... don't see the pydev remote debugger....

The buttons related to the remote debugger only appear in the debug perspective (window > open perspective > other > debug). You may also add those buttons to other perspectives by customizing it (window > customize perspective > commands > pydev debug).

Cheers,

Fabio