Re: [Mod-pubsub-developer] Non-blocking publishing in Python

SourceForge Headquarters 1320 Columbia Street Suite 310 San Diego, CA 92101 +1 (858) 422-6466

In the interest of strengthening everyone's knowledge base, what did you 
compare against and what were your concerns?  I've noticed that 
xmlBlaster and Activ MQ both offer HTTP oriented methodologies for 
asynchronous notification.  But I am not sure how robust they are, nor 
how native/central to the design they are, nor how well they work in 
javascript contexts.

A.

mod...@li... wrote:

>Adam:
>
>  
>
>>The question was not bone-headed at all. It's just that sometimes our
>>Python guy goes into  { while 1: sleep } mode. ;)
>>    
>>
>
>In that case, I'll continue to poll() the list. Hopefully the results aren't too
>asynchronous!
>
>
>  
>
>>Both of those client libraries were experimental prototypes, as is
>>probably clear from reading the source. Plus, I was kind of learning
>>Python as we wrote them.
>>
>>I'm Cc'ing Ben in case he knows the answer to your embedding question.
>>    
>>
>
>So is anyone using the Python clients for any interesting applications? I've
>evaluated some other asynchronous messaging technologies, and mod/re-pubsub
>looks the most promising w.r.t. Python and Internet-wide messaging. It would be
>great if anyone could share some insight into the embedding question, or how to
>harness the non-blocking behavior of the pubsublib.
>
>
>  
>
>>I do know that no one is currently working to port the client library
>>to Twisted; right now all the energy and effort is going into
>>rewriting the server using Twisted, and hopefully we can learn from
>>that to do a client rewrite sometime later. If you're feeling
>>ambitious, feel free to take a crack at doing it with Twisted's
>>Deferred mechanism...
>>    
>>
>
>How is the progress on the server side? Is the current version stable enough to
>be making changes that would be compatible with the current server development?
>I have some experience with Twisted, so I wouldn't mind taking a look, but I
>would like to get a sense of the project road map so my work isn't wasted.
>
>  
>
>>   -- Adam
>>    
>>
>
>Brian
>
>
>PS Are you Adam Rifkin or another Adam?
>
>
>  
>
>>On Apr 5, 2005 4:13 AM,
>>mod...@li...
>><mod...@li...> wrote:
>>    
>>
>>>Haven't heard anything back from the list regarding this question. If it
>>>      
>>>
>>is
>>    
>>
>>>because the question was too bone-headed, then there is no remedy.
>>>      
>>>
>>Otherwise,
>>    
>>
>>>the following information might be useful to someone else getting started.
>>>
>>>There are two python client libraries: pubsublib.py and libkn/libkn.py.
>>>According to the source, pubsublib.py is a non-blocking implementation,
>>>      
>>>
>>while
>>    
>>
>>>libkn.py is blocking. The examples in apps are built off of pubsublib, so
>>>      
>>>
>>they
>>    
>>
>>>should be non-blocking.
>>>
>>>This seems to be true when running as a standalone script, but what about
>>>      
>>>
>>when I
>>    
>>
>>>want to embed? Is the logging package being used to help the debugging
>>>      
>>>
>>process
>>    
>>
>>>or are people using pdb?
>>>
>>>Also, I read somewhere that the client is supposed to be using Twisted in
>>>      
>>>
>>the
>>    
>>
>>>near future. Is this still the case, and if so, what's the progress on it?
>>>
>>>Thanks,
>>>Brian
>>>
>>>
>>>Quoting mod...@li...:
>>>
>>>      
>>>
>>>>Hello:
>>>>
>>>>I'm trying to use the apps/publish.py module as a starting point for
>>>>        
>>>>
>>writing
>>    
>>
>>>>my
>>>>own simple publishing lib to work with repubsub. The script runs fine on
>>>>        
>>>>
>>its
>>    
>>
>>>>own, but whenever I try to embed it in other code, I seem to get
>>>>        
>>>>
>>blocking
>>    
>>
>>>>issues and the CPU load spikes.
>>>>
>>>>Inside the apps/publish.py script, I looked at the following method
>>>>        
>>>>
>>calls:
>>    
>>
>>>>  asyncore.poll()
>>>>  scheduler.timeout()
>>>>  scheduler.run()
>>>>
>>>>Now Python's asyncore does not have documentation on the poll function,
>>>>although
>>>>in my interpreter, I do see a reference for poll. The two scheduler
>>>>        
>>>>
>>function
>>    
>>
>>>>calls both pass in their implementations. If I comment out that loop, my
>>>>messages don't get published. So what's going on here?
>>>>
>>>>Ideally, I'd like to be able to use Twisted's Deferred mechanism to
>>>>        
>>>>
>>handle
>>    
>>
>>>>the
>>>>blocking issue, but I'm unsure the best way to approach it without
>>>>        
>>>>
>>heavily
>>    
>>
>>>>modifying the code base.
>>>>
>>>>Any help is greatly appreciated.
>>>>
>>>>Thanks,
>>>>Brian
>>>>
>>>>--
>>>>  ====
>>>>brian lee dae yung
>>>>biomimetic art and research
>>>>  mux space . com
>>>>
>>>>----------------------------------------------------------------
>>>>This message was sent using IMP, the Internet Messaging Program.
>>>>
>>>>
>>>>
>>>>-------------------------------------------------------
>>>>SF email is sponsored by - The IT Product Guide
>>>>Read honest & candid reviews on hundreds of IT Products from real users.
>>>>Discover which products truly live up to the hype. Start reading now.
>>>>http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click
>>>>_______________________________________________
>>>>Mod-pubsub-developer mailing list
>>>>Mod...@li...
>>>>https://lists.sourceforge.net/lists/listinfo/mod-pubsub-developer
>>>>
>>>>        
>>>>
>>>--
>>>  ====
>>>brian lee dae yung
>>>biomimetic art and research
>>>  mux space . com
>>>
>>>----------------------------------------------------------------
>>>This message was sent using IMP, the Internet Messaging Program.
>>>
>>>-------------------------------------------------------
>>>SF email is sponsored by - The IT Product Guide
>>>Read honest & candid reviews on hundreds of IT Products from real users.
>>>Discover which products truly live up to the hype. Start reading now.
>>>http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click
>>>_______________________________________________
>>>Mod-pubsub-developer mailing list
>>>Mod...@li...
>>>https://lists.sourceforge.net/lists/listinfo/mod-pubsub-developer
>>>
>>>      
>>>
>>-------------------------------------------------------
>>SF email is sponsored by - The IT Product Guide
>>Read honest & candid reviews on hundreds of IT Products from real users.
>>Discover which products truly live up to the hype. Start reading now.
>>http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click
>>_______________________________________________
>>Mod-pubsub-developer mailing list
>>Mod...@li...
>>https://lists.sourceforge.net/lists/listinfo/mod-pubsub-developer
>>
>>    
>>
>
>
>  
>