[Introspector-developers] start of cwm port to pyscho

[James M. D. <mdu...@ya...>]

Sorry for the spam, but wanted to send to some interested people here
have started porting cwm to psycho and want to optimize it.
Pscho is the best thing to find for cwm, it promises a faster
execution.

Was thinking about splicing the code into many different threads with
shared memory structures. 
Split it into many multithreaded processes that all execute on part of
a distributed messagepassing execution engine.
That would save some time with the same rules that are running
constantly, just refreshing the via rdf pipes. Each mini server doing
one task like exporting data or importing data. The exchange could be
like what peter was talking about.

Basically each one will be running only on sub process of the main
engine.

anyway, here is the changes to pyscho and the cwm to get them talking
Added this to the cwm main : 
       if __name__ == '__main__':
           import os
	       try :
           print 'going to import Psyco '
	           import psyco
	#        psyco.profile()
	         print 'After import Psyco '
	    except:
	         print 'Psyco not found, ignoring it'
	#    import urlparse
	    doCommand()

had to add more memory into the psyco for the baby.

python ~/cwm/snapshot/cwm1.82/cwm.py _yyparse-clean.n3 >
_yyparse-cwm.n3
psyco: init: activated module __builtin__
psyco: init: activated module array
psyco: init: activated module math
psyco: running in debugging mode
python: c/linuxmemchk.c:31: _na_find: Assertion `_na_start+4096 <= data
&& data < _na_start+4096*16384-4096' failed.
Aborted


I have increase the ram by 2
# define MALLOC_BIGBUFFER   PAGESIZE*16384*2

and added in some diagnostics
  //MDUPONT  assert(_na_start+PAGESIZE <= data &&
  //       data < _na_start+MALLOC_BIGBUFFER-PAGESIZE);

if (!(_na_start+PAGESIZE <= data &&
      data < _na_start+MALLOC_BIGBUFFER-PAGESIZE))
  {
      fprintf(stderr, "DEBUG _na_start:%ld _pagesize:%ld data %ld
bigbuffer %ld\n",_na_start,PAGESIZE,data,MALLOC_BIGBUFFER);
      assert(0);
  }


=====
James Michael DuPont
http://introspector.sourceforge.net/

__________________________________
Do you Yahoo!?
Yahoo! SiteBuilder - Free, easy-to-use web site design software
http://sitebuilder.yahoo.com