pyzor-users — general discussion of Pyzor and Pyzor-related topics

Pyzor errors

[Ugo B. <ug...@ca...>]

Hi,

	I get these errors when running pyzor through SA (debug mode).

debug: Pyzor is available: /usr/bin/pyzor
debug: entering helper-app run mode
debug: setuid: helper proc 7357: ruid=3D0 euid=3D0
debug: Pyzor: got response: 66.250.40.33:24441  TimeoutError:
debug: leaving helper-app run mode
debug: Pyzor: couldn't grok response "66.250.40.33:24441
TimeoutError: "

I get those on all my servers and a few other mail server admins I know
told me they have them as well.

Any idea of what is going on?

Thanks,
--
Ugo

Re: Mails with empty body and having attachments marked as spam

[Dushyanth H. <dus...@di...>]

Hi,

 > Pyzor-0.4.0 seems to be identifying all genuine mails having empty
 > body and any attachment (except plain text attachments) as spam. For
 > ex. If i send a mail with empty body and a doc attachment, it marks
 > the mail as spam.

> Iam not yet reporting ham/spam and i think it shuld make a difference 

Correcting myself, i meant to write 'it shuld not make a difference as 
pyzor works on the message body'.

> cos since pyzor works only on message body's, its falsely identifying 
> the mails as spam.
> 
> Does anyone else having the same problem ?

cheers
dushyanth

Mails with empty body and having attachments marked as spam

[Dushyanth H. <dus...@di...>]

Hi,

Pyzor-0.4.0 seems to be identifying all genuine mails having empty body 
and any attachment (except plain text attachments) as spam. For ex. If i 
send a mail with empty body and a doc attachment, it marks the mail as 
spam.

Iam not yet reporting ham/spam and i think it shuld make a difference 
cos since pyzor works only on message body's, its falsely identifying 
the mails as spam.

Does anyone else having the same problem ?

cheers
dushyanth

website error & new user account?

[Peter L. <Hos...@Vi...>]

By the way, when I first went to http://pyzor.sourceforge.net/ and clicked 
on "Mailing Lists" (a hyperlink to https://sourceforge.net/mail/?group_id=50000)
the browser bounced back and forth (prompting me) between http and https.

Also, when I had clicked on "Documentation" there was a page not found.  I 
guess since first visiting, I have been "cookied" and no longer get errors.

OK.  That was a "by-the-way."  *smiles* My question is, what step(s) must I 
first complete to be able to submit single spams or mboxes from the command 
line (`pyzor report email_file.eml`)??

Do I have to register somehow for a pyzor account?  Is that something I do 
via the sourceforge website, or via my unix/freebsd command-line?  Is 
having an account free?  Last question - is pyzor a RBL or is that another 
ball of wax entirely?  *grin*  (Heads off to compare and contrast razor.)

Thank you immensely, kindly, and with massive gratitude!!
-Peter

...
Using Accounts

To get an account on a server requires coordination between the client user 
and server admin. Use the following steps:

    1. User and admin should agree on a username for the user. Allowed 
characters for a username are alpha-numerics, the underscore, and dashes. 
The normative regular expression it must match is ^[-\.\w]+$. Let us assume 
they have agreed on 'bob'.

    2. User generates a key with pyzor genkey, and puts an entry into their 
~/.pyzor/accounts. Let us say that it generates the salt,key of: 
227bfb58efaba7c582d9dcb66ab2063d38df2923,8da9f54058c34e383e997f45d6eb74837139f83b. 
Assuming the server is at 127.0.0.1:9999, the user puts the following entry 
into ~/.pyzor/accounts:

127.0.0.1 : 9999 : bob : 227bfb58efaba7c582d9dcb66ab2063d38df2923,8da9f54058c34e383e997f45d6eb74837139f83b

    3. The user then sends the key (the part to the right-hand side of the 
comma) to the admin.

    4. The admin adds the following to their ~/.pyzor/pyzord.passwd:
bob : 8da9f54058c34e383e997f45d6eb74837139f83b

    5. Assuming the admin wants to give the privilege of whitelisting (in 
addition to the normal permissions), the admin then adds the appropriate 
permissions to ~/.pyzor/pyzord.access:

check report ping info whitelist : bob : allow

    6. The server needs to be restarted in order for this to take effect.

??

--
Peter Leftwich
President & Founder, Video2Video Services
Box 13692, La Jolla, CA, 92039, USA
http://Www.Video2Video.Com

Re: Pyzor processes stalling

[Frank T. <ft...@ne...>]

Achton N. Netherclift, on 2005-04-13, wrote:

> isildur:~# ps aux
> amavis   16177  0.0  1.4 14716 3636 ?        S    Apr12   0:00 
> /usr/bin/python /usr/bin/pyzor check

I'm willing to bet that this is due to amavisd or SA not cleaning up the 
python processes when they exit (that is, not wait(2)'ing on them). 
However, I'm really interested to hear if someone can replicate this 
problem with Pyzor manually.

-- 
Frank

Re: Pyzor processes stalling

[Johan <jo...@le...>]

On 2005-04-13 00:52 +0200 or thereabouts, Achton N. Netherclift wrote:
> I'm using amavisd-new and Spamassassin to invoke Pyzor, but recently the 
> Pyzor processes have not been ending properly, thus leaving several 

I have the same problem here but I'm running Mailscanner, SA and Pyzor on a
box using Python 2.3.5. This is on 2 machines.

I have 2 others boxes I have Python 2.2.3, amavisd-new and SA and there I
dont have the problem.

SA 3.0.2 on all 4.

Re: Pyzor processes stalling

[Andreas S. <sch...@fa...>]

Hi there,

> ... recently the Pyzor processes have not been ending properly, thus 
> leaving several Pyzor processes behind ...

Same here. I am running _pyzor report_ from scripts and I notice a lot 
of pyzor processes not ending.

This thing started a few weeks ago. I, too, am running pyzor on Debian 
stable+testing with version 1:0.4.0+cvs20030201-2, which is a recent 
update but the not ending of processes persisted. Python is 2.3.5-1.

Cheerio,

-- 
-- Andreas 

Re: Pyzor breaks when doing report --mbox

[Kelson <ke...@sp...>]

Johan Segern=E4s wrote:
> On 2005-04-15 10:27 -0700 or thereabouts, Kelson wrote:
>=20
>>There's no way to submit the broken messages, but it is possible to pic=
k=20
>>up the mbox submission where it left off.  What I do is search for the=20
>>offending line, then remove any messages that match it.  I also remove=20
>>any messages before the first match, because those have already been=20
>>submitted.  Then I submit the mbox again.
>=20
> How do I find the offending line? Anyone who has a nice script for doin=
g this=20
> before doing pyzor report?=20

Some variation on grep "Content-Transfer-Encoding: binary"?

Maybe formail?

I only do mbox submissions when I have a chance to check the mailbox, so=20
I just manage it using pine.  If Pyzor fails, I look at the last line of=20
the trace for the actual error, search for messages containing that=20
phrase, and delete them all.

--=20
Kelson Vibber
SpeedGate Communications <www.speed.net>

Re: Pyzor breaks when doing report --mbox

[Johan <jo...@le...>]

On 2005-04-15 10:27 -0700 or thereabouts, Kelson wrote:
> There's no way to submit the broken messages, but it is possible to pick 
> up the mbox submission where it left off.  What I do is search for the 
> offending line, then remove any messages that match it.  I also remove 
> any messages before the first match, because those have already been 
> submitted.  Then I submit the mbox again.

How do I find the offending line? Anyone who has a nice script for doing this 
before doing pyzor report? 

I'd like to do pyzor report like every 30 minute or so from selected mboxes
from crond.

Re: Pyzor breaks when doing report --mbox

[Kelson <ke...@sp...>]

Johan Segern=E4s wrote:
> I get the following error when I do pyzor report --mbox almost every ti=
me I
> do report on a big mbox, how come? Something wrong here or known bug in
> pyzor? Fix? Workaround?
<snip>
> ValueError: unknown Content-Transfer-Encoding: binary

Known bug.  Apparently Python doesn't deal well with invalid content=20
transfer encodings, and Pyzor doesn't include enough exception handling=20
to recover.

There's no way to submit the broken messages, but it is possible to pick=20
up the mbox submission where it left off.  What I do is search for the=20
offending line, then remove any messages that match it.  I also remove=20
any messages before the first match, because those have already been=20
submitted.  Then I submit the mbox again.

--=20
Kelson Vibber
SpeedGate Communications <www.speed.net>

Pyzor breaks when doing report --mbox

[Johan <jo...@le...>]

I get the following error when I do pyzor report --mbox almost every time I
do report on a big mbox, how come? Something wrong here or known bug in
pyzor? Fix? Workaround?

"
Traceback (most recent call last):
  File "/usr/bin/pyzor", line 4, in ?
    pyzor.client.run()
  File "/usr/lib/python2.2/site-packages/pyzor/client.py", line 934, in run
    ExecCall().run()
  File "/usr/lib/python2.2/site-packages/pyzor/client.py", line 188, in run
    if not apply(dispatch, (self, args)):
  File "/usr/lib/python2.2/site-packages/pyzor/client.py", line 282, in
report
    for digest in FileDigester(sys.stdin, self.digest_spec, do_mbox):
  File "/usr/lib/python2.2/site-packages/pyzor/client.py", line 619, in next
    digest = self.digester.next()
  File "/usr/lib/python2.2/site-packages/pyzor/client.py", line 648, in next
    next_msg = self.mbox.next()
  File "/usr/lib/python2.2/mailbox.py", line 34, in next
    return self.factory(_Subfile(self.fp, start, stop))
  File "/usr/lib/python2.2/site-packages/pyzor/client.py", line 671, in
__init__
    mimetools.decode(msg.fp, self.curfile, encoding)
  File "/usr/lib/python2.2/mimetools.py", line 149, in decode
    raise ValueError, \
ValueError: unknown Content-Transfer-Encoding: binary
"

Re: Running my own server

[Frank T. <ft...@ne...>]

Johan Segern=E4s, on 2005-04-06, wrote:

> Today I use rbldnsd and dccd with great success but I haven't figured out=
 how
> to sync my pyzor database with the rest of the world like dcc flooding or
> rbldnsd rsyncing.
>
> Any howto or guide somewhere?

Unfortunately, there isn't a means to sync at the present time.  It would=
=20
be a very useful feature but I haven't quite figured out how I want to=20
implement it, though.

--=20
Frank

Pyzor processes stalling

[Achton N. N. <ac...@ne...>]

I'm using amavisd-new and Spamassassin to invoke Pyzor, but recently the 
Pyzor processes have not been ending properly, thus leaving several 
Pyzor processes behind in the course of a single day, and eventually 
causing the swap disk area in RAM to fill up.

This is an example from my processlist:

isildur:~# ps aux
amavis   16177  0.0  1.4 14716 3636 ?        S    Apr12   0:00 
/usr/bin/python /usr/bin/pyzor check
amavis   16276  0.0  1.4 14716 3636 ?        S    Apr12   0:00 
/usr/bin/python /usr/bin/pyzor check
amavis   16894  0.0  1.4 14716 3636 ?        S    Apr12   0:00 
/usr/bin/python /usr/bin/pyzor check
amavis   17020  0.0  1.4 14736 3656 ?        S    Apr12   0:00 
/usr/bin/python /usr/bin/pyzor check
amavis   17502  0.0  1.4 14716 3636 ?        S    Apr12   0:00 
/usr/bin/python /usr/bin/pyzor check
amavis   17678  0.0 14.9 42176 38364 ?       S    Apr12   0:03 amavisd 
(child)
amavis   17725  0.0  1.4 14716 3636 ?        S    Apr12   0:00 
/usr/bin/python /usr/bin/pyzor check
amavis   18222  0.0 14.8 41956 38244 ?       S    00:20   0:00 amavisd 
(child)
amavis   18410  0.0  1.4 14716 3636 ?        S    00:40   0:00 
/usr/bin/python /usr/bin/pyzor check

Running a manual Pyzor check seems to go fine:

isildur:~# pyzor check < /root/testmail
66.250.40.33:24441      (200, 'OK')     0       0

I'm running Debian Sarge on a 550MHz P3 with 256MB RAM.

What can be the cause of this?

Thanks,
Achton

-- 
http://achton.netherclift.net/

Re: Running my own server

[Johan <jo...@le...>]

On 2005-04-06 10:52 +0200 or thereabouts, Johan Segern=E4s wrote:
> I have to mailserver which handles around 250.000 mails/day each and I'=
d like
> to run my own pyzor server to have control over things.

I now run my own server but are a bit curious about how pyzor works, I ha=
ve
some experience with Bayes but until now I've only used public pyzor serv=
er
and not my own.

I understand I have to train my pyzord myself but do I have to train it w=
ith
ham or just spam?

If a false spam ends up in in pyzord, how do I remove it?=20

Are there any good docs around this? Haven't found anything...

Re: EFF Newsletter and Pyzor

[Chris <cpo...@ea...>]

On Sunday 10 April 2005 06:26 pm, Duane Voth wrote:
> On Fri, Apr 08, 2005 at 08:51:44PM -0500, Chris wrote:
> > Recently Pyzor has started marking the EFF Newsletter as spam.  Is there
> > a way I can have this undone?
>
> If you are using procmail to invoke pyzor you can take the matter
> into your own hands and add a rule to route the EFF Newsletters
> to your mailbox before pyzor evaluates it.
>
> Beyond that type of a solution, a discussion here may very well
> degrage into an agrument over what is spam and what is not.
> (I don't know what this newsletter is but you can be sure I'd
> have an *opinion* on it once I saw it.. :)
>
> Anyway, someone has to submit it as spam befor pyzor rejects
> it as spam so to undo it we would have to figure out who is
> submitting the newsletter and ask them to stop.

Actually I'm using spamassassin which invokes the pyzor check.  I am however 
using fetchmail - procmail to route mail so I just added a procmail recipe to 
route the EFF Newsletter into the appropriate folder.

Chris

-- 
Chris
Registered Linux User 283774 http://counter.li.org
18:44:37 up 1 day, 20:51, 1 user, load average: 0.81, 0.51, 0.37
Mandrake Linux 10.1 Official, kernel 2.6.8.1-12mdk
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
"Today's robots are very primitive, capable of understanding only a few
 simple instructions such as 'go left', 'go right', and 'build car'."
 --John Sladek
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Re: EFF Newsletter and Pyzor

[Duane V. <du...@io...>]

On Fri, Apr 08, 2005 at 08:51:44PM -0500, Chris wrote:
> Recently Pyzor has started marking the EFF Newsletter as spam.  Is there a way 
> I can have this undone?

If you are using procmail to invoke pyzor you can take the matter
into your own hands and add a rule to route the EFF Newsletters
to your mailbox before pyzor evaluates it.

Beyond that type of a solution, a discussion here may very well
degrage into an agrument over what is spam and what is not.
(I don't know what this newsletter is but you can be sure I'd
have an *opinion* on it once I saw it.. :)

Anyway, someone has to submit it as spam befor pyzor rejects
it as spam so to undo it we would have to figure out who is
submitting the newsletter and ask them to stop.

-- 
Duane Voth
du...@io...
--
dj...@dj...

EFF Newsletter and Pyzor

[Chris <cpo...@ea...>]

Recently Pyzor has started marking the EFF Newsletter as spam.  Is there a way 
I can have this undone?

Chris

-- 
Chris
Registered Linux User 283774 http://counter.li.org
20:49:38 up 2 days, 3:17, 1 user, load average: 0.24, 0.37, 0.39
Mandrake Linux 10.1 Official, kernel 2.6.8.1-12mdk
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<doogie> there is one bad thing about having a cell phone.
<doogie> I can be reached at any time. :|
<wmono> that's why I leave mine off at all times. ;>
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Running my own server

[Johan <jo...@le...>]

I have to mailserver which handles around 250.000 mails/day each and I'd like
to run my own pyzor server to have control over things.

Today I use rbldnsd and dccd with great success but I haven't figured out how
to sync my pyzor database with the rest of the world like dcc flooding or
rbldnsd rsyncing.

Any howto or guide somewhere?

simple Q: how to use pyzor and how to decide if it works correct or not

[<mo...@de...>]

Hi,

i've installed pyzor on FreeBSD-5.3(R) from the ports collection.

"pyzor discover" works fine.
"pyzor -d ~/mbox" gives:

calculated digest: 5db897ba043f269297f4c6a4ef7f2e83ee34b75d
sending: 'User: anonymous\nTime: 1111348542\nSig:
a25acb308977a8ac263a01a2b6e647965d22f720\n\nOp: check\nOp-Digest:
5db897ba043f269297f4c6a4ef7f2e83ee34b75d\nThread: 40213\nPV: 2.0\n\n'
66.250.40.33:24441      TimeoutError: 

How do i interpret the output ?
Did it run successful ?
Where there any errors ?
Did it connect successful ?

Seeking simple infos that i did not find in doc nor in any howtos or anything
else.

Every hint, pointer, link is highly appreciated.

Thanks in advance for your input.


Darius.

Problems with Pyzor

[<MBG...@co...>]

I'm in the process of setting up a mail gateway for our organization.

The gateway box is running FreeBSD 4.10.  The current setup is running 
Postfix as the MTA, and Amavisd-new as a content filter using ClamAV and 
SpamAssassin.  I'm trying to get Razor, Pyzor, and DCC working correctly 
with SpamAssassin on the box.

My current problem is that Pyzor appears to be not functioning.  When I do 
a test on it via the command line to see if it'll run seperately I get the 
following:

#pyzor check < /tmp/testemail

Traceback (most recent call last):
  File "/usr/local/bin/pyzor", line 4, in ?
    pyzor.client.run()
  File "/usr/local/lib/python2.4/site-packages/pyzor/client.py", line 934, 
in run
    ExecCall().run()
  File "/usr/local/lib/python2.4/site-packages/pyzor/client.py", line 188, 
in run
    if not apply(dispatch, (self, args)):
  File "/usr/local/lib/python2.4/site-packages/pyzor/client.py", line 264, 
in check
    response = runner.run(server, (digest, server))
  File "/usr/local/lib/python2.4/site-packages/pyzor/client.py", line 725, 
in run
    response = apply(self.routine, varargs, kwargs)
  File "/usr/local/lib/python2.4/site-packages/pyzor/client.py", line 58, 
in check
    self.send(msg, address)
  File "/usr/local/lib/python2.4/site-packages/pyzor/client.py", line 77, 
in send
    self.socket.sendto(mac_msg_str, 0, address)
socket.error: (13, 'Permission denied')


After doing some Googling on the error message all the results seemed to 
inidcate that this was normally the result of a non-root user trying to 
use a port below 1024.  The above results persist even running as root 
though, so I don't think that the port<1024 is the issue.  Any suggestions 
or insight would be greatly appreciated. Thanks.

Mike Gaskins

Pyzor in chroot?

[Sven R. <sr...@ba...>]

Hi,
I'm trying to set up pyzor in a chroot-environment. Unfortunately=20
with only mediocre success so far. I started with copying pyzor and
python into the chroot and repeatedly added python modules as pyzor
complained about not being able to include them.=20

I'm currently stuck at the following point:

chroot /var/amavis_root /bin/pyzor -d --homedir /.pyzor discover

... trace dump ...

  File "/usr/lib/python2.3/httplib.py", line 535, in connect
    socket.SOCK_STREAM):
IOError: [Errno socket error] (-2, 'Name or service not known')

/etc/nsswitch.conf, /etc/protocols, /etc/services, /etc/resolv.conf
and the required libs are all there. None of the needed ports is
firewalled off and running pyzor discover outside the chroot
works fine.

I'm currently clueless as to what could be missing at this point.

Any ideas?

Regs,
Sven

------------------------------------------

BAGHUS GmbH
EDV und Internetdienstleistungen

Staffelseestr. 2
81477 M=FCnchen

Tel.: 0 89 / 8 71 81 - 4 84
Fax.: 0 89 / 8 71 81 - 4 88

www.baghus.net, in...@ba...
HRB: 144283, USt-IdNr: DE224865405

------------------------------------------
=20

Re: too many connection..

[Frank T. <ft...@ne...>]

Elizar Palad, on 2005-03-08, wrote:

> Hi, im new to pyzor and to this list..
> Just want to ask.. My network slows down, very slow
> because of many many connection of the server to port 6277
>
> I believe that pyzor uses that port.. i disable pyzor from
> spamassassin just to check if this will work.. i am most certain
> that it would.. but it turns out, the same problem was encountered.

The primary pyzor server actually uses port 24441 currently.  A quick 
google shows that DCC (another program somewhat similar to Pyzor) uses 
port 6277.

-- 
Frank

too many connection..

[Elizar P. <el...@un...>]

Hi, im new to pyzor and to this list..
Just want to ask.. My network slows down, very slow
because of many many connection of the server to port 6277

I believe that pyzor uses that port.. i disable pyzor from
spamassassin just to check if this will work.. i am most certain
that it would.. but it turns out, the same problem was encountered.

how can i disably pyzor's connection to 6277?

tthanks.

new pyzor server

[Frank T. <ft...@ne...>]

Hello everyone,

There is a new pyzor server that you need to point to now.  Simply run 
'pyzor discover' and your configuration will be updated.  Thanks.

Many thanks to Jason Buberel (http://www.buberel.org/) for being a 
long-time good host and system admin.

If you would lilke to host a pyzor server, please conact me off-list. 
The bandwidth requirements are about 25k each way, with a medium amount of 
CPU usage.

-- 
Frank

RE: pyzor

[Jimmy H. <jh...@ve...>]

So is there something I should do?

thanks

-----Original Message-----
From: Frank Tobin [mailto:ft...@ne...]=20
Sent: Tuesday, December 28, 2004 9:49 PM
To: pyz...@li...
Subject: Re: pyzor

Jimmy Hayes, on 2004-12-28, wrote:

> Hello I just installed pyzor and when I run spamassassin -D < test.txt
I
> get the below output for pyzor.
>
> executable for pyzor was found at /usr/bin/pyzor
> Pyzor is available: /usr/bin/pyzor
> entering helper-app run mode
> Pyzor: got response: Traceback (most recent call last):
> leaving helper-app run mode
> Pyzor: couldn't grok response "Traceback (most recent call last):"

> Is the last line normal, or am I missing something?
> Also spamassasin is configured to send all spam to a spam mailbox In
my
> server, will pyzor do the same thing?

It's possible that pyzor choked on the test mail.  Pyzor doesn't by
itself=20
filter anything; it's simply used by spamassasin to determine where to=20
filter.

--=20
Frank


-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now.=20
http://productguide.itmanagersjournal.com/
_______________________________________________
pyzor-users mailing list
pyz...@li...
https://lists.sourceforge.net/lists/listinfo/pyzor-users