[AMaViS-user] just started with 2.6.4 maddr insert race condition

[Michael S. <sch...@se...>]

(or at least I never noticed it before)
'nothing changed' (tm)'
I am seeing 15 min delays as amavisd tries (in vain) to add an existing 
email ot the maddr table. I would almost thing that if amavisd sees a 
duplicate entry, it might assume that one of the other processes put it 
there.

this only happens with 'trigger happy' mail servers connect multiple 
times in parallel and blast all their critically important spring sale 
emails all at once.
(kinda wish yahoo would just connect once and send all three)

so, should amavisd just use the existing maddr id if it exists?
I am assuming this is a race condition, all three processes read maddr, 
don't find it, then try to insert it, looks like two of them failed.
for users who like their email yesterday, and would never stand for 
graylisting, the 15 mins delay DOES confuse them.
I did have one user point out 'hey, 58 people in my company got this 
email at 10am, why didn't I get mine until 10:15? (different email, 
different issue)
but does show an example of how people expect 'IM" performance on their 
email.

grep deandraguey /var/log/maillog
Mar 29 12:33:31 mail postfix/qmgr[2319]: 4811C530912: 
from=<dea...@ya...>, size=2632, nrcpt=1 (queue active)
Mar 29 12:33:31 mail postfix/qmgr[2319]: 4833653091F: 
from=<dea...@ya...>, size=2631, nrcpt=1 (queue active)
Mar 29 12:33:31 mail amavis[92111]: (92111-09) (!!)TROUBLE in 
check_mail: sql-enter FAILED: find_or_save_addr: failed to insert addr 
dea...@ya...:  at (eval 69) line 109, <GEN19> line 10872.
Mar 29 12:33:31 mail postfix/lmtp[92028]: 4811C530912: 
to=<us...@rr...>, relay=127.0.0.1[127.0.0.1]:10024, delay=0.72, 
delays=0.58/0/0/0.13, dsn=4.5.0, status=deferred (host 
127.0.0.1[127.0.0.1] said: 451 4.5.0 Error in processing, id=92111-09, 
sql-enter FAILED: find_or_save_addr: failed to insert addr 
dea...@ya...:  at (eval 69) line 109, <GEN19> line 10872. (in 
reply to end of DATA command))
Mar 29 12:33:31 mail amavis[92109]: (92109-09) (!!)TROUBLE in 
check_mail: sql-enter FAILED: find_or_save_addr: failed to insert addr 
dea...@ya...: sql exec: err=1062, 23000, DBD::mysql::st execute 
failed: Duplicate entry '201...@ya...' for key 
'maddr_idx_tag_email' at (eval 68) line 166, <GEN19> line 2708. at (eval 
69) line 109, <GEN19> line 2708.
Mar 29 12:33:31 mail postfix/lmtp[92092]: 4833653091F: 
to=<us...@rr...>, relay=127.0.0.1[127.0.0.1]:10024, delay=0.74, 
delays=0.58/0/0/0.16, dsn=4.5.0, status=deferred (host 
127.0.0.1[127.0.0.1] said: 451 4.5.0 Error in processing, id=92109-09, 
sql-enter FAILED: find_or_save_addr: failed to insert addr 
dea...@ya...: sql exec: err=1062, 23000, DBD::mysql::st execute 
failed: Duplicate entry '201...@ya...' for key 
'maddr_idx_tag_email' at (eval 68) line 166, <GEN19> line 2708. at (eval 
69) line 109, <GEN19> line 2708. (in reply to end of DATA command))
Mar 29 12:56:14 mail postfix/qmgr[2319]: 4811C530912: 
from=<dea...@ya...>, size=2632, nrcpt=1 (queue active)
Mar 29 12:56:14 mail postfix/qmgr[2319]: 4833653091F: 
from=<dea...@ya...>, size=2631, nrcpt=1 (queue active)
Mar 29 12:56:15 mail postfix/qmgr[2319]: A091353089B: 
from=<dea...@ya...>, size=3170, nrcpt=1 (queue active)
Mar 29 12:56:15 mail amavis[92667]: (92667-17) Passed CLEAN, 
[68.180.197.83] [68.157.251.188] <dea...@ya...> -> 
<us...@ex...>, Message-ID: 
<348...@we...>, mail_id: pGz9T57hUhKD, 
Hits: 0.002, size: 2629, pt: 201013, queued_as: A091353089B, 810 ms
Mar 29 12:56:15 mail postfix/qmgr[2319]: AF8855308CF: 
from=<dea...@ya...>, size=3172, nrcpt=1 (queue active)
Mar 29 12:56:15 mail amavis[92745]: (92745-09) Passed CLEAN, 
[68.180.197.83] [68.157.251.188] <dea...@ya...> -> 
<us...@ex...>, Message-ID: 
<348...@we...>, mail_id: 8VjkqUthFvM6, 
Hits: 0.002, size: 2630, pt: 201013, queued_as: AF8855308CF, 873 ms

-- 
Michael Scheidell, CTO
Phone: 561-999-5000, x 1259
 > *| *SECNAP Network Security Corporation

    * Certified SNORT Integrator
    * 2008-9 Hot Company Award Winner, World Executive Alliance
    * Five-Star Partner Program 2009, VARBusiness
    * Best Anti-Spam Product 2008, Network Products Guide
    * King of Spam Filters, SC Magazine 2008

______________________________________________________________________
This email has been scanned and certified safe by SpammerTrap(r). 
For Information please see http://www.secnap.com/products/spammertrap/
______________________________________________________________________