Unable to hit remote debugging breakpoints in PyDev 1.5.5 with eclipse 3.5 when using path translation with jython 2.5.1. The same setup in eclipse 3.5 with PyDev 1.5.4 works just fine and the breakpoints are hit. Using code developed on computerA and then deployed and debugged on a tomcat server also on computerA.
When setting DEBUG_CLIENT_SERVER_TRANSLATION = True I get the following result:
pydev debugger: replacing to server: c:\development\project\filename.py
pydev debugger: sent to server: c:\website\webapps\project\web-inf\lib\lib\site-packages\filename.py
which I take to mean that the path translation is working, but the debugger still never stops on a breakpoint.
If I set "pydevd.settrace(stdoutToServer=True, stderrToServer=True, suspend=True)" the remote debugger does suspend and does bring up the correct code file.
I use ExpanDrive on XP which presents a network disc via SSH/SCP protocol to a remote Linux host. Using PyDev on XP to debug the remote Linux app was not functional, I had to hack the pydevd_file_utils.py file quite a bit to get it to work - result attached. I don't claim this is a patch, it just works for my situation. It seems wrong to me to do normalisation etc on one host and expect that to have generated the right result for another host.
'''
This module provides utilities to get the absolute filenames so that we can be sure that:
- The case of a file will match the actual file in the filesystem (otherwise breakpoints won't be hit).
- Providing means for the user to make path conversions when doing a remote debugging session in
one machine and debugging in another.
To do that, the PATHS_FROM_CLIENT_TO_SERVER constant must be filled with the appropriate paths.
E.g.:
If the server has the structure
/user/projects/my_project/src/package/module1.py
and the client has:
c:\my_project\src\package\module1.py
the PATHS_FROM_CLIENT_TO_SERVER would have to be:
PATHS_FROM_CLIENT_TO_SERVER = [(r'c:\my_project\src', r'/user/projects/my_project/src')]
@note: DEBUG_CLIENT_SERVER_TRANSLATION can be set to True to debug the result of those translations
@note: the case of the paths is important! Note that this can be tricky to get right when one machine
uses a case-independent filesystem and the other uses a case-dependent filesystem (if the system being
debugged is case-independent, 'normcase()' should be used on the paths defined in PATHS_FROM_CLIENT_TO_SERVER).
@note: all the paths with breakpoints must be translated (otherwise they won't be found in the server)
@note: to enable remote debugging in the target machine (pydev extensions in the eclipse installation)
import pydevd;pydevd.settrace(host, stdoutToServer, stderrToServer, port, suspend)
see parameter docs on pydevd.py
@note: for doing a remote debugging session, all the pydevd_ files must be on the server accessible
through the PYTHONPATH (and the PATHS_FROM_CLIENT_TO_SERVER only needs to be set on the target
machine for the paths that'll actually have breakpoints).
'''
from pydevd_constants import * #@UnusedWildImport
import os.path
import sys
import traceback
normcase = os.path.normcase
basename = os.path.basename
exists = os.path.exists
join = os.path.join
try:
rPath = os.path.realpath #@UndefinedVariable
except:
# jython does not support os.path.realpath
# realpath is a no-op on systems without islink support
rPath = os.path.abspath
#defined as a list of tuples where the 1st element of the tuple is the path in the client machine
#and the 2nd element is the path in the server machine.
#see module docstring for more details.
PATHS_FROM_CLIENT_TO_SERVER = [
(normcase(r'C:\development\cvs\BRANCH_14660_wc_twisted'), normcase(r'/var/opt/mailcontrol/cvs/BRANCH_14660/wc/twisted')),
(normcase(r'C:\software\python26\Lib\site-packages\twisted-2.0.1-unix\twisted'), normcase(r'/usr/local/lib/python2.6/site-packages/twisted')),
(normcase(r'N:'), normcase(r'/var/opt/mailcontrol/development')),
]
#example:
#PATHS_FROM_CLIENT_TO_SERVER = [
#(normcase(r'd:\temp\temp_workspace_2\test_python\src\yyy\yyy'),
# normcase(r'd:\temp\temp_workspace_2\test_python\src\hhh\xxx'))]
#DEBUG_CLIENT_SERVER_TRANSLATION = True
DEBUG_CLIENT_SERVER_TRANSLATION = False
#caches filled as requested during the debug session
NORM_FILENAME_CONTAINER = {}
NORM_FILENAME_AND_BASE_CONTAINER = {}
NORM_FILENAME_TO_SERVER_CONTAINER = {}
NORM_FILENAME_TO_CLIENT_CONTAINER = {}
def _NormFile(filename):
#sys.stderr.write('pydev debugger: _NormFile filename: %s\n' % (filename,))
try:
return NORM_FILENAME_CONTAINER[filename]
except KeyError:
#r = normcase(rPath(filename))
r = normcase(filename)
#cache it for fast access later
NORM_FILENAME_CONTAINER[filename] = r
#sys.stderr.write('pydev debugger: _NormFile r: %s\n' % (r,))
return r
#Now, let's do a quick test to see if we're working with a version of python that has no problems
#related to the names generated...
try:
try:
code = rPath.func_code
except AttributeError:
code = rPath.__code__
if not exists(_NormFile(code.co_filename)):
sys.stderr.write('-------------------------------------------------------------------------------\n')
sys.stderr.write('pydev debugger: CRITICAL WARNING: This version of python seems to be incorrectly compiled (internal generated filenames are not absolute)\n')
sys.stderr.write('pydev debugger: The debugger may still function, but it will work slower and may miss breakpoints.\n')
sys.stderr.write('pydev debugger: Related bug: http://bugs.python.org/issue1666807\n')
sys.stderr.write('-------------------------------------------------------------------------------\n')
initial_norm_file = _NormFile
def _NormFile(filename): #Let's redefine _NormFile to work with paths that may be incorrect
ret = initial_norm_file(filename)
if not exists(ret):
#We must actually go on and check if we can find it as if it was a relative path for some of the paths in the pythonpath
for path in sys.path:
ret = initial_norm_file(join(path, filename))
if exists(ret):
break
else:
sys.stderr.write('pydev debugger: Unable to find real location for: %s\n' % (filename,))
ret = filename
return ret
except:
#Don't fail if there's something not correct here -- but at least print it to the user so that we can correct that
traceback.print_exc()
if PATHS_FROM_CLIENT_TO_SERVER:
#Work on the client and server slashes.
client_sep = None
server_sep = None
for client_prefix, server_prefix in PATHS_FROM_CLIENT_TO_SERVER:
if client_sep is not None and server_sep is not None:
break
if client_sep is None:
for c in client_prefix:
if c in ('/', '\\'):
client_sep = c
break
if server_sep is None:
for c in server_prefix:
if c in ('/', '\\'):
server_sep = c
break
#If they're the same or one of them cannot be determined, just make it all None.
if client_sep == server_sep or client_sep is None or server_sep is None:
client_sep = server_sep = None
#sys.stderr.write('pydev debugger: client_sep: %r server_sep: %r\n' % (client_sep, server_sep))
#only setup translation functions if absolutely needed!
def NormFileToServer(filename):
try:
raise KeyError
return NORM_FILENAME_TO_SERVER_CONTAINER[filename]
except KeyError:
#used to translate a path from the client to the debug server
if DEBUG_CLIENT_SERVER_TRANSLATION:
sys.stderr.write('pydev debugger: NormFileToServer filename: %s\n' % (filename,))
translated = normcase(filename)
for client_prefix, server_prefix in PATHS_FROM_CLIENT_TO_SERVER:
if translated.startswith(client_prefix):
if DEBUG_CLIENT_SERVER_TRANSLATION:
sys.stderr.write('pydev debugger: replacing to server: %s\n' % (translated,))
translated = translated.replace(client_prefix, server_prefix)
if DEBUG_CLIENT_SERVER_TRANSLATION:
sys.stderr.write('pydev debugger: sent to server: %s\n' % (translated,))
break
else:
if DEBUG_CLIENT_SERVER_TRANSLATION:
sys.stderr.write('pydev debugger: to server: unable to find matching prefix for: %s in %s\n' % \ (translated, [x[0] for x in PATHS_FROM_CLIENT_TO_SERVER]))
#Note that when going to the server, we do the replace first and only later do the norm file.
if client_sep is not None:
#translated = translated.replace(server_sep, client_sep)
translated = translated.replace(client_sep, server_sep)
#sys.stderr.write('pydev debugger: NormFileToServer translated: %s\n' % (translated,))
ret = _NormFile(translated)
#sys.stderr.write('pydev debugger: NormFileToServer ret: %s\n' % (ret,))
NORM_FILENAME_TO_SERVER_CONTAINER[filename] = ret
return ret
def NormFileToClient(filename):
try:
raise KeyError
return NORM_FILENAME_TO_CLIENT_CONTAINER[filename]
except KeyError:
#used to translate a path from the debug server to the client
if DEBUG_CLIENT_SERVER_TRANSLATION:
sys.stderr.write('pydev debugger: NormFileToClient filename: %s\n' % (filename,))
translated = normcase(filename)
for client_prefix, server_prefix in PATHS_FROM_CLIENT_TO_SERVER:
if translated.startswith(server_prefix):
if DEBUG_CLIENT_SERVER_TRANSLATION:
sys.stderr.write('pydev debugger: replacing to client: %s\n' % (translated,))
translated = translated.replace(server_prefix, client_prefix)
if DEBUG_CLIENT_SERVER_TRANSLATION:
sys.stderr.write('pydev debugger: sent to client: %s\n' % (translated,))
break
else:
if DEBUG_CLIENT_SERVER_TRANSLATION:
sys.stderr.write('pydev debugger: to client: unable to find matching prefix for: %s in %s\n' % \ (translated, [x[1] for x in PATHS_FROM_CLIENT_TO_SERVER]))
#When going to the client, first we do the norm file and only later the replace for slashes.
#sys.stderr.write('pydev debugger: NormFileToClient translated: %s\n' % (translated,))
ret = _NormFile(translated)
#sys.stderr.write('pydev debugger: NormFileToClient ret1: %s\n' % (ret,))
if client_sep is not None:
#ret = ret.replace(client_sep, server_sep)
ret = ret.replace(server_sep, client_sep)
#sys.stderr.write('pydev debugger: NormFileToClient ret2: %s\n' % (ret,))
NORM_FILENAME_TO_CLIENT_CONTAINER[filename] = ret
return ret
else:
#no translation step needed (just inline the calls)
NormFileToClient = _NormFile
NormFileToServer = _NormFile
def GetFilenameAndBase(frame):
#This one is just internal (so, does not need any kind of client-server translation)
f = frame.f_code.co_filename
try:
return NORM_FILENAME_AND_BASE_CONTAINER[f]
except KeyError:
filename = _NormFile(f)
base = basename(filename)
NORM_FILENAME_AND_BASE_CONTAINER[f] = filename, base
return filename, base