dspam-user — User mailinglist for general config and use questions

Re: [Dspam-user] Some Questions about Dspam Setup and Usage

[Eric B. <eb...@wh...>]

Echo,

I'm not sure what system you are using, but my latest RPMS use EL9, here 
<http://repo.whitehorsetc.com/9/testing/x86_64/>.

If you install the latest RPM it is bundled with patches one of which 
mitigated the 'invalid result' you are facing below:

# cat SOURCES/dspam-configureac-el9.patch
--- dspam/configure.ac  2024-02-27 23:28:25.005549848 -0700
+++ dspam.new/configure.ac      2024-02-27 23:28:39.015564302 -0700
@@ -556,6 +556,32 @@
  AC_MSG_RESULT([$enable_long_usernames])

  #
+#   Virtual users
+#
+AC_ARG_ENABLE(virtual-users,
+    [AS_HELP_STRING(--enable-virtual-users, Cause DSPAM to support 
virtual users.)])
+AC_MSG_CHECKING([whether to enable virtual users])
+case x"$enable-virtual-users" in
+    xyes)   # debug output enabled explicity
+            ;;
+    xno)    # debug output disabled explicity
+            ;;
+    x)      # debug output disabled by default
+            enable-virtual-users=no
+            ;;
+    *)      AC_MSG_ERROR([unexpected value $enable_virtual_users for 
--{enable,disable}-virtual-users configure option])
+            ;;
+esac
+if test x"$enable-virtual-users" != xyes
+then
+    enable-virtual-users=no
+else
+    enable-virtual-users=yes    # overkill, but convenient
+    AC_DEFINE(VIRTUAL_USERS, 1, [Defined if virtual users is enabled])
+fi
+AC_MSG_RESULT([$enable_virtual_users])
+
+#
  #   Large scale implementation
  #
  AC_ARG_ENABLE(large-scale,

I've never run the user management interface.

Eric


On 12/13/2024 3:19 AM, echo zhang wrote:
> Dear Dspam Community:
>
> I am trying to use the Dspam (version: 3.10.2) as a spam detection 
> engine, but I am having some trouble.
>
> Specifically, I want to detect specific email samples by running Dspam 
> directly on its own, rather than through integration with a mail 
> server such as Postfix. I specified Mysql as the storage driver, and 
> used the following commands for training and classification respectively:
>
>     dspam --mode=teft --source=corpus --class=spam --feature=noise
>     --user root < "test.eml"
>     dspam --classify  --user root --stdout < "test.eml" 
>
> However, the output remains:
>
>     X-DSPAM-Result: root; result="Innocent"; class="Innocent";
>     probability=0.0023; confidence=1.00; signature=N/A
>
> Meanwhile, I saw the following error message in the log:
>
>     Dec 13 15:55:21 8e5bc7350f88 dspam[17599]: bailing on error -2
>     Dec 13 15:55:21 8e5bc7350f88 dspam[17599]: received invalid result
>     (!DSR_ISSPAM && !DSR_ISINNOCENT): -2
>
>
> I wonder why this happened and how to fix it. I would be grateful if 
> someone could offer some help!
>
> By the way, I actually don't really understand Dspam's user management 
> mechanism. From my understanding, it seems that the classification 
> model for different users is differentiated to meet differentiated 
> mail processing needs. So how can I add users to Dspam while running 
> it standalone? Where can I view a list of all users currently 
> maintained by Dspam?
>
> Finally, is there something like a default classifier? If not, does 
> this mean that the Dspam that was just installed actually has no spam 
> detection capability, since it has not been trained on user data?
>
> Thanks.
>
> Echo Zhang
>
>
> _______________________________________________
> Dspam-user mailing list
> Dsp...@li...
> https://lists.sourceforge.net/lists/listinfo/dspam-user

[Dspam-user] Some Questions about Dspam Setup and Usage

[echo z. <ech...@gm...>]

Dear Dspam Community:

I am trying to use the Dspam (version: 3.10.2) as a spam detection engine,
but I am having some trouble.

Specifically, I want to detect specific email samples by running Dspam
directly on its own, rather than through integration with a mail server
such as Postfix. I specified Mysql as the storage driver, and used the
following commands for training and classification respectively:

> dspam --mode=teft --source=corpus --class=spam --feature=noise --user root
> < "test.eml"
> dspam --classify  --user root --stdout < "test.eml"

However, the output remains:

> X-DSPAM-Result: root; result="Innocent"; class="Innocent";
> probability=0.0023; confidence=1.00; signature=N/A

Meanwhile, I saw the following error message in the log:

> Dec 13 15:55:21 8e5bc7350f88 dspam[17599]: bailing on error -2
> Dec 13 15:55:21 8e5bc7350f88 dspam[17599]: received invalid result
> (!DSR_ISSPAM && !DSR_ISINNOCENT): -2


I wonder why this happened and how to fix it. I would be grateful if
someone could offer some help!

By the way, I actually don't really understand Dspam's user management
mechanism. From my understanding, it seems that the classification model
for different users is differentiated to meet differentiated mail
processing needs. So how can I add users to Dspam while running it
standalone? Where can I view a list of all users currently maintained by
Dspam?

Finally, is there something like a default classifier? If not, does this
mean that the Dspam that was just installed actually has no spam detection
capability, since it has not been trained on user data?

Thanks.

Echo Zhang

Re: [Dspam-user] attachment stripped

[Eric B. <eb...@wh...>]

Yes, Dspam works well...still. It clobbers all my spam. It catches 3 to 
4 times the spam that spamassassin catches...not sure why it's not more 
popular.

Anyway, I had to change my stuff dot patch because of I may have been 
misusing  buffer_cat and buffer_ncat. Below is the updated patch:

--- ./src/dspam.c       2021-05-20 15:07:38.717943662 -0600
+++ ./src/dspam.new.c   2021-05-20 15:00:16.854513189 -0600
@@ -103,6 +103,54 @@
  #define USE_SMTP        (_ds_read_attribute(agent_config, 
"DeliveryProto") && !strcmp(_ds_read_attribute(agent_config, 
"DeliveryProto"), "SMTP"))
  #define LOOKUP(A, B)   ((_ds_pref_val(A, "localStore")[0]) ? 
_ds_pref_val(A, "localStore") : B)

+const char * stuff_dot(const char * message);
+/*
+** const char * stuff_dot(char * message);
+**
+** DESCRIPTION
+**   Stuff '.' where necessary for SMTP Protocol
+**
+** INPUT ARGUMENTS
+**     const char * message
+**
+** RETURN VALUES
+**   Returns const char * msg
+**
+** Author
+**   Eric C. Broch
+**
+*/
+const char * stuff_dot(const char * message) {
+
+  char * msg;
+  int lmessage = strlen(message);
+  if (!lmessage) {
+     LOGDEBUG("stuff_dot: Message 0 length");
+     return NULL;
+  }
+  msg = (char *) malloc(lmessage);
+  if ( msg == NULL ) {
+     LOGDEBUG("stuff_dot: Unable to allocate memory, size: %d",lmessage);
+     return NULL;
+  }
+  int i = 0, j = 0,k = 0;
+  while(i<lmessage) {
+    msg[j] = message[i];
+    if ((message[i] == '\n') && (message[i + 1] && message[i + 1] == 
'.')) {
+      k++;
+      msg = (char *) realloc(msg,lmessage+k);
+      if ( msg == NULL ) {
+         free(msg);
+         LOGDEBUG("stuff_dot: Unable to reallocate memory, size: %d", 
lmessage+k);
+         return NULL;
+      }
+      msg[++j] = '.';
+    }
+    i++;
+    j++;
+  }
+  k++;msg = (char *) realloc(msg,lmessage+k); if ( msg == NULL ) { 
free(msg);LOGDEBUG("stuff_dot: Unable to NULL msg, size: %d", 
lmessage+k);return NULL;} msg[lmessage+k-1]=0;return msg;
+}

  int
  main (int argc, char *argv[])
@@ -977,7 +1025,18 @@
                       (result == DSR_ISSPAM) ? "SPAM" : "INNOCENT");

    if (mailer_args == NULL) {
-    fputs (message, stream);
+    /* calling program: dspamc */
+    if (stream == ATX->sockfd) {
+      /* stuff dots before sending back to dspam client */
+      /* otherwise trunction of email can occur, Eric Broch 04-12-2021 */
+      char * msg = stuff_dot(message);
+      fputs(msg,stream);
+      free(msg);
+    }
+    /* calling program: dspam */
+    else {
+      fputs(message,stream);
+    }
      return 0;
    }

--- ./src/client.c      2012-04-11 12:48:33.000000000 -0600
+++ ./src/client.new.c  2021-05-19 16:51:42.793261161 -0600
@@ -228,6 +228,14 @@
            exitcode = 99;
          }
        } else {
+        /* de-stuff dots from server, 04-12-2021, Eric C. Broch, 7 lines */
+        if((line[0] && line[0]=='.') && (line[1] && line[1]=='.')) {
+          size_t i, len = strlen(line);
+          for(i=0;i<len;i++){
+            line[i]=line[i+1];
+          }
+          line[len-1]=0;
+        }
          printf("%s\n", line);
        }
        free(line);


On 7/2/2021 5:19 AM, Marco wrote:
> Il 12/04/2021 21:44, Eric Broch has written:
>> dspam-users,
>>
>> I'm not sure if anyone cares (anymore), but I still use dspam and it 
>> works great.
>>
>> I found one solution to the truncation of emails when dspamc (dspam 
>> --client)  is called (patch below).
>
> Hello,
>
>  thank you. We can hope a day for a new Dspam life. Its working 
> principles are very valuable.
>
> Regards
> Marco
>
>
> _______________________________________________
> Dspam-user mailing list
> Dsp...@li...
> https://lists.sourceforge.net/lists/listinfo/dspam-user

Re: [Dspam-user] attachment stripped

[Marco <fa...@ru...>]

Il 12/04/2021 21:44, Eric Broch has written:
> dspam-users,
> 
> I'm not sure if anyone cares (anymore), but I still use dspam and it 
> works great.
> 
> I found one solution to the truncation of emails when dspamc (dspam 
> --client)  is called (patch below).

Hello,

  thank you. We can hope a day for a new Dspam life. Its working 
principles are very valuable.

Regards
Marco

Re: [Dspam-user] attachment stripped

[Eric B. <eb...@wh...>]

dspam-users,

I'm not sure if anyone cares (anymore), but I still use dspam and it 
works great.

I found one solution to the truncation of emails when dspamc (dspam 
--client)  is called (patch below).

When dspam in daemon mode receives a message from dspam client it is 
sent to the daemon with dot stuffing/de-stuffing respectively, however,

on return from the daemon to the dspam client the message was not dot 
stuffed/de-stuffed.


# cat ../SOURCES/dspam-stuffdot.patch
--- ./src/dspam.c  2012-04-11 12:48:33.000000000 -0600
+++ ./src/dspam.new.c   2021-04-12 13:21:58.919951576 -0600
@@ -103,6 +103,40 @@
  #define USE_SMTP        (_ds_read_attribute(agent_config, 
"DeliveryProto") && !strcmp(_ds_read_attribute(agent_config, 
"DeliveryProto"), "SMTP"))
  #define LOOKUP(A, B)   ((_ds_pref_val(A, "localStore")[0]) ? 
_ds_pref_val(A, "localStore") : B)

+buffer * stuff_dot(char * message);
+/*
+** buffer * stuff_dot(char * message);
+**
+** DESCRIPTION
+**   Stuff '.' where necessary for SMTP Protocol
+**
+** INPUT ARGUMENTS
+**     char * message
+**
+** RETURN VALUES
+**   Returns buffer * msg
+**
+** Author
+**   Eric C. Broch
+**
+*/
+buffer * stuff_dot(char * message) {
+
+  buffer * msg;
+  int i = 0;
+
+  msg = buffer_create(NULL);
+  while(i<strlen(message)) {
+    if (buffer_ncat(msg,&message[i],1)) return NULL;
+    if (i == strlen(message)-1) break;
+    if ((message[i] == '\n') && (message[i + 1] && message[i + 1] == 
'.')) {
+      if (buffer_cat(msg,".")) return NULL;
+      if (buffer_ncat(msg,&message[++i],1)) return NULL;
+    }
+    i++;
+  }
+  return msg;
+}

  int
  main (int argc, char *argv[])
@@ -977,7 +1011,18 @@
                       (result == DSR_ISSPAM) ? "SPAM" : "INNOCENT");

    if (mailer_args == NULL) {
-    fputs (message, stream);
+    /* calling program: dspamc */
+    if (stream == ATX->sockfd) {
+      /* stuff dots before sending back to dspam client */
+      /* otherwise trunction of email can occur, Eric Broch 04-12-2021 */
+      buffer * msg = stuff_dot(message);
+      fputs(msg->data,stream);
+      buffer_destroy(msg);
+    }
+    /* calling program: dspam */
+    else {
+      fputs(message,stream);
+    }
      return 0;
    }

--- ./src/client.c 2012-04-11 12:48:33.000000000 -0600
+++ ./src/client.new.c  2021-04-12 13:14:45.152130732 -0600
@@ -228,6 +228,14 @@
            exitcode = 99;
          }
        } else {
+        /* de-stuff dots from server, 04-12-2021, Eric C. Broch, 7 lines */
+        if((line[0] && line[0]=='.') && (line[1] && line[1]=='.')) {
+          size_t i, len = strlen(line);
+          for(i=0;i<len;i++){
+            line[i]=line[i+1];
+          }
+          line[len-1]=0;
+        }
          printf("%s\n", line);
        }
        free(line);

Eric

On 9/3/2014 9:27 PM, Eric Broch wrote:
>
> Hello Ken and Stevan,
>
> I've done some investigation and below you can see the offending line 
> in the original email is line 002. Line 001 and line 003 are for 
> context. Per Stevan.
>
> 001 has low airflow of 92 cfm for exhaust down low which equates to .4 
> cfm/ft2=
> 002 .
> 003 <b>I suggest that this ducting be modified before I return. 
> Another low duc=
>
>
> After the message is piped into dspamc it is processed by 
> ‘client_process’ in the file client.c
>
> Before the message is sent to the daemon ‘\r’ and ‘.’ are added where 
> necessary.
>
> At this point line 002 is stuffed with a ‘.’ as seen below:
>
> 001 has low airflow of 92 cfm for exhaust down low which equates to .4 
> cfm/ft2=
> 002 ..
> 003 <b>I suggest that this ducting be modified before I return. 
> Another low duc=
>
>
> The message is then sent to the daemon and received back.
>
> Upon receiving the message back it is truncated after line 001.
>
> When receiving the message back from the daemon, reception of the 
> returned message terminates on 1 of 2 conditions: 1) A single line 
> with a ‘.’ or 2) no more data from the daemon. In fact the daemon is 
> removing the stuffed '.'.
>
> The ‘while’ loop responsible for terminating reception of the message 
> from the dspam daemon is coded in the following way: ‘while ( line != 
> NULL && strcmp (line, ".") )’. I changed this code to ‘while ( line != 
> NULL /* && strcmp (line, ".") */ )’ commenting out termination on the 
> ‘.’ and received the full message back, line 002 back in its original 
> form:
>
> 001 has low airflow of 92 cfm for exhaust down low which equates to .4 
> cfm/ft2=
> 002 .
> 003 <b>I suggest that this ducting be modified before I return. 
> Another low duc=
>
>
> Anyway, this is how things stand presently. I'm not sure how the 
> daemon works but will investigate that as well.
>
> Eric
>
>
> ------------------------------------------------------------------------------
> Slashdot TV.
> Video for Nerds.  Stuff that matters.
> http://tv.slashdot.org/
>
> _______________________________________________
> Dspam-user mailing list
> Dsp...@li...
> https://lists.sourceforge.net/lists/listinfo/dspam-user

Re: [Dspam-user] training for non-spam not working

[ITwrx.org <in...@it...>]

On 01/07/2018 03:35 PM, Stevan Bajić via Dspam-user wrote:
> On 07.01.2018 21:05, ITwrx.org wrote:
>> On 01/07/2018 01:38 PM, Stevan Bajić via Dspam-user wrote:
>>> You are right. There is practically no activity for the project any
>>> more. If you need/want more support then rspamd is probably a better
>>> choice.
>> It's a shame, because besides this one false positive i can't retrain,
>> dspam is basically perfect in it's spam classification.
> Can it be that the user (shell user) with the one you call the binary
> is not in the list of trusted list. Can you look into dspam.conf and
> list the entries starting with "Trust".
root, dspam and vmail are all included in trust entries. i just re-ran
as all three users and they all failed to find the signature. i run
dspam as the vmail user normally due to the various outdated tutorials i
cobbled together to arrive at my config.
>
> Can you as well enable debugging in dspam.conf?
i added --debug to my systemd service file but idk if arch package was
configured with debug support or not. i don't know what the line in
dspam.conf should be.
>
> I would love to see your configuration. If you don't want to send it
> here to the mailing list, maybe you can send it to me directly?
sure.
>
>
>>   i don't need all
>> the bells and whistles of these other projects. Do you know why people
>> lost interest in dspam? i can't help to refactor it, i don't know enough
>> c/c++. IOW, is there anything that could be done to revive it from the
>> dead?
> I have not written that it is dead.

Re: [Dspam-user] training for non-spam not working

[Stevan B. <st...@ba...>]

On 07.01.2018 21:05, ITwrx.org wrote:
> On 01/07/2018 01:38 PM, Stevan Bajić via Dspam-user wrote:
>> You are right. There is practically no activity for the project any
>> more. If you need/want more support then rspamd is probably a better
>> choice.
> It's a shame, because besides this one false positive i can't retrain,
> dspam is basically perfect in it's spam classification.
Can it be that the user (shell user) with the one you call the binary is 
not in the list of trusted list. Can you look into dspam.conf and list 
the entries starting with "Trust".

Can you as well enable debugging in dspam.conf?

I would love to see your configuration. If you don't want to send it 
here to the mailing list, maybe you can send it to me directly?


>   i don't need all
> the bells and whistles of these other projects. Do you know why people
> lost interest in dspam? i can't help to refactor it, i don't know enough
> c/c++. IOW, is there anything that could be done to revive it from the
> dead?
I have not written that it is dead.





>
>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> Dspam-user mailing list
> Dsp...@li...
> https://lists.sourceforge.net/lists/listinfo/dspam-user


-- 
  Kind Regards from Switzerland,

  Stevan Bajić

Re: [Dspam-user] training for non-spam not working

[ITwrx.org <in...@it...>]

On 01/07/2018 01:38 PM, Stevan Bajić via Dspam-user wrote:
> You are right. There is practically no activity for the project any
> more. If you need/want more support then rspamd is probably a better
> choice.

It's a shame, because besides this one false positive i can't retrain,
dspam is basically perfect in it's spam classification. i don't need all
the bells and whistles of these other projects. Do you know why people
lost interest in dspam? i can't help to refactor it, i don't know enough
c/c++. IOW, is there anything that could be done to revive it from the
dead?

Re: [Dspam-user] training for non-spam not working

[Stevan B. <st...@ba...>]

On 07.01.2018 03:10, ITwrx.org wrote:
> On 01/06/2018 07:18 PM, ITwrx.org wrote:
>> On 01/06/2018 05:20 PM, Stevan Bajić via Dspam-user wrote:
>>> How the heck is this possible?
>> i don't know. :)
>>> Did you changed the email address to be the one with the uid 22?
>> yes, i sure did.
>>
>>
>> ------------------------------------------------------------------------------
>> Check out the vibrant tech community on one of the world's most
>> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>> _______________________________________________
>> Dspam-user mailing list
>> Dsp...@li...
>> https://lists.sourceforge.net/lists/listinfo/dspam-user
> I was wondering what the current status of dspam (as a project) is. i
> don't see much activity for dspam anywhere. rspamd's site describes
> dspam as abandoned. are there any developers for dspam left? i
> appreciate your willingness to help me, but if dspam is completely dead
> i don't want to waste your time.
You are right. There is practically no activity for the project any 
more. If you need/want more support then rspamd is probably a better choice.

> thanks
>
>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> Dspam-user mailing list
> Dsp...@li...
> https://lists.sourceforge.net/lists/listinfo/dspam-user


-- 
  Kind Regards from Switzerland,

  Stevan Bajić

Re: [Dspam-user] training for non-spam not working

[Stevan B. <st...@ba...>]

On 07.01.2018 02:18, ITwrx.org wrote:
> On 01/06/2018 05:20 PM, Stevan Bajić via Dspam-user wrote:
>> How the heck is this possible?
> i don't know. :)
>> Did you changed the email address to be the one with the uid 22?
> yes, i sure did.
This is strange.

>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> Dspam-user mailing list
> Dsp...@li...
> https://lists.sourceforge.net/lists/listinfo/dspam-user


-- 
  Kind Regards from Switzerland,

  Stevan Bajić

Re: [Dspam-user] training for non-spam not working

[ITwrx.org <in...@it...>]

On 01/06/2018 07:18 PM, ITwrx.org wrote:
> On 01/06/2018 05:20 PM, Stevan Bajić via Dspam-user wrote:
>> How the heck is this possible? 
> i don't know. :)
>> Did you changed the email address to be the one with the uid 22?
> yes, i sure did.
>
>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> Dspam-user mailing list
> Dsp...@li...
> https://lists.sourceforge.net/lists/listinfo/dspam-user

I was wondering what the current status of dspam (as a project) is. i
don't see much activity for dspam anywhere. rspamd's site describes
dspam as abandoned. are there any developers for dspam left? i
appreciate your willingness to help me, but if dspam is completely dead
i don't want to waste your time.

thanks

Re: [Dspam-user] training for non-spam not working

[ITwrx.org <in...@it...>]

On 01/06/2018 05:20 PM, Stevan Bajić via Dspam-user wrote:
> How the heck is this possible? 
i don't know. :)
> Did you changed the email address to be the one with the uid 22?

yes, i sure did.

Re: [Dspam-user] training for non-spam not working

[Stevan B. <st...@ba...>]

On 07.01.2018 00:17, ITwrx.org wrote:
> On 01/06/2018 04:18 PM, Stevan Bajić via Dspam-user wrote:
>> Bingo. So the signature is there. What happens now when you run the 
>> retrain command again by hand:
>> /usr/bin/dspam --user the...@it... --source=error 
>> --signature=a441081121917356521135 --class=innocent
>>
>> Does this work?
>
> Signature retrieval for 'a441081121917356521135' failed
> Unable to find a valid signature. Aborting.
> process_message returned error -5.  dropping message.
>
>
How the heck is this possible? Did you changed the email address to be 
the one with the uid 22?


>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>
>
> _______________________________________________
> Dspam-user mailing list
> Dsp...@li...
> https://lists.sourceforge.net/lists/listinfo/dspam-user

Re: [Dspam-user] training for non-spam not working

[ITwrx.org <in...@it...>]

On 01/06/2018 04:18 PM, Stevan Bajić via Dspam-user wrote:
> Bingo. So the signature is there. What happens now when you run the
> retrain command again by hand:
> /usr/bin/dspam --user the...@it... --source=error
> --signature=a441081121917356521135 --class=innocent
>
> Does this work?

Signature retrieval for 'a441081121917356521135' failed
Unable to find a valid signature. Aborting.
process_message returned error -5.  dropping message.

Re: [Dspam-user] training for non-spam not working

[Stevan B. <st...@ba...>]

On 06.01.2018 17:24, ITwrx.org wrote:
> On 01/05/2018 05:32 PM, Stevan Bajić via Dspam-user wrote:
>> So DSPAM can not find the signature in the db. Are you sure that the
>> signature is inside the db?
>>
>> When you run this against the DSPAM database (I assume the email
>> address you use is in...@it.... If not, change it to whatever your
>> email is):
>>
>> select uid,signature from dspam_signature_data where uid=(select uid
>> from dspam_virtual_uids where username='in...@it...') and signature
>> like '%a441081121917356521135';
>>
>>
>> What do you get?
> please ignore my previous responses. i should have used the email
> address that has the junk mail in question. now i get:
>
> +-----+-------------------------+
> | uid | signature               |
> +-----+-------------------------+
> |  22 | 5a441081121917356521135 |
> +-----+-------------------------+
> 1 row in set (0.28 sec)
>
>>
>> Do you have an user id for your email? What do you get when you run
>> this here:
>>
>> select uid from dspam_virtual_uids where username='in...@it...';
> +-----+
> | uid |
> +-----+
> |  22 |
> +-----+
> 1 row in set (0.00 sec)
>
>>
>> What do you get when you run this here:
>>
>> select uid,signature,length,created_on from dspam_signature_data where
>> signature like '%a441081121917356521135';
> +-----+-------------------------+--------+------------+
> | uid | signature               | length | created_on |
> +-----+-------------------------+--------+------------+
> |  22 | 5a441081121917356521135 |   2704 | 2017-12-27 |
> +-----+-------------------------+--------+------------+
> 1 row in set (32.84 sec)
Bingo. So the signature is there. What happens now when you run the 
retrain command again by hand:
/usr/bin/dspam --user the...@it... --source=error 
--signature=a441081121917356521135 --class=innocent

Does this work?


>>
>> What are your user preferences? Can your run this here and post the
>> output (if in...@it... is not your email address then change it to
>> whatever you use):
>>
>> dspam_admin list pref in...@it...
>>
>>
>>
> this command doesn't return anything at all.
>
> thanks
>
>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> Dspam-user mailing list
> Dsp...@li...
> https://lists.sourceforge.net/lists/listinfo/dspam-user


-- 
  Kind Regards from Switzerland,

  Stevan Bajić

Re: [Dspam-user] training for non-spam not working

[ITwrx.org <in...@it...>]

On 01/05/2018 05:32 PM, Stevan Bajić via Dspam-user wrote:
> So DSPAM can not find the signature in the db. Are you sure that the
> signature is inside the db?
>
> When you run this against the DSPAM database (I assume the email
> address you use is in...@it.... If not, change it to whatever your
> email is):
>
> select uid,signature from dspam_signature_data where uid=(select uid
> from dspam_virtual_uids where username='in...@it...') and signature
> like '%a441081121917356521135';
>
>
> What do you get?
please ignore my previous responses. i should have used the email
address that has the junk mail in question. now i get:

+-----+-------------------------+
| uid | signature               |
+-----+-------------------------+
|  22 | 5a441081121917356521135 |
+-----+-------------------------+
1 row in set (0.28 sec)

>
>
> Do you have an user id for your email? What do you get when you run
> this here:
>
> select uid from dspam_virtual_uids where username='in...@it...';
+-----+
| uid |
+-----+
|  22 |
+-----+
1 row in set (0.00 sec)

>
>
> What do you get when you run this here:
>
> select uid,signature,length,created_on from dspam_signature_data where
> signature like '%a441081121917356521135';
+-----+-------------------------+--------+------------+
| uid | signature               | length | created_on |
+-----+-------------------------+--------+------------+
|  22 | 5a441081121917356521135 |   2704 | 2017-12-27 |
+-----+-------------------------+--------+------------+
1 row in set (32.84 sec)

>
>
> What are your user preferences? Can your run this here and post the
> output (if in...@it... is not your email address then change it to
> whatever you use):
>
> dspam_admin list pref in...@it...
>
>
>
this command doesn't return anything at all.

thanks

Re: [Dspam-user] training for non-spam not working

[Stevan B. <st...@ba...>]

On 06.01.2018 02:00, ITwrx.org wrote:
> On 01/05/2018 05:32 PM, Stevan Bajić via Dspam-user wrote:
>> So DSPAM can not find the signature in the db. Are you sure that the
>> signature is inside the db?
>>
>> When you run this against the DSPAM database (I assume the email
>> address you use is in...@it.... If not, change it to whatever your
>> email is):
>>
>> select uid,signature from dspam_signature_data where uid=(select uid
>> from dspam_virtual_uids where username='in...@it...') and signature
>> like '%a441081121917356521135';
>>
>>
>> What do you get?
> Empty set (2.43 sec)
Empty set? I see below that you got an entry for that signature hash but 
at the end it is not associated to your user id.


>>
>> Do you have an user id for your email? What do you get when you run
>> this here:
>>
>> select uid from dspam_virtual_uids where username='in...@it...';
> 1 row in set (0.00 sec)
Please post the full result of this query.

>>
>> What do you get when you run this here:
>>
>> select uid,signature,length,created_on from dspam_signature_data where
>> signature like '%a441081121917356521135';
> 1 row in set (43.71 sec)
Please post the full result of this command.


>>
>> What are your user preferences? Can your run this here and post the
>> output (if in...@it... is not your email address then change it to
>> whatever you use):
>>
>> dspam_admin list pref in...@it...
>>
>>
>>
> i don't know what to make of this command. run against dspam's DB? with
> the dspam binary?
>
run it on the command line. In the Linux shell.

Re: [Dspam-user] training for non-spam not working

[ITwrx.org <in...@it...>]

On 01/05/2018 05:32 PM, Stevan Bajić via Dspam-user wrote:
> So DSPAM can not find the signature in the db. Are you sure that the
> signature is inside the db?
>
> When you run this against the DSPAM database (I assume the email
> address you use is in...@it.... If not, change it to whatever your
> email is):
>
> select uid,signature from dspam_signature_data where uid=(select uid
> from dspam_virtual_uids where username='in...@it...') and signature
> like '%a441081121917356521135';
>
>
> What do you get?
Empty set (2.43 sec)
>
>
> Do you have an user id for your email? What do you get when you run
> this here:
>
> select uid from dspam_virtual_uids where username='in...@it...';
1 row in set (0.00 sec)
>
>
> What do you get when you run this here:
>
> select uid,signature,length,created_on from dspam_signature_data where
> signature like '%a441081121917356521135';
1 row in set (43.71 sec)
>
>
> What are your user preferences? Can your run this here and post the
> output (if in...@it... is not your email address then change it to
> whatever you use):
>
> dspam_admin list pref in...@it...
>
>
>
i don't know what to make of this command. run against dspam's DB? with
the dspam binary?

-- 
Information Technology Works
https://ITwrx.org
@ITwrxorg

Re: [Dspam-user] training for non-spam not working

[Stevan B. <st...@ba...>]

On 06.01.2018 00:33, ITwrx.org wrote:
> On 01/05/2018 05:07 PM, Paul Goyette wrote:
>> Perhaps remove the extra % character?
> that gives me:
>
>> dspam[25458]: Signature retrieval for 'imap' failed
>> Jan 05 17:31:00 email.itwrx.org dspam[25458]: Unable to find a valid
>> signature. Aborting.
>> Jan 05 17:31:00 email.itwrx.org dspam[25458]: process_message returned
>> error -5.  dropping message.
> instead.

No. Don't use simple '%s'. That is wrong. Look here -> 
https://wiki.dovecot.org/Variables
By looking at your error, I can confirm that you are using IMAP to 
access your mailbox.

> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> Dspam-user mailing list
> Dsp...@li...
> https://lists.sourceforge.net/lists/listinfo/dspam-user


-- 
  Kind Regards from Switzerland,

  Stevan Bajić

Re: [Dspam-user] training for non-spam not working

[Stevan B. <st...@ba...>]

On 06.01.2018 00:07, Paul Goyette wrote:
> On Fri, 5 Jan 2018, ITwrx.org wrote:
>
>>> Signature retrieval for '%s' failed
>>> dspam[25001]: Unable to find a valid signature. Aborting.
>>> dspam[25001]: process_message returned error -5.  dropping message.
>>
>> the signature is always shown as '%s' in the log (for all messages i
>> move). so, either there is no signature being assigned or dspam is not
>> being passed the signature?
>>
>>>     antispam_dspam_args = --user;%u;--source=error;--signature=%%s
>
> Perhaps remove the extra % character?
>
This is not the problem. Even when trying by hand manually on the 
command line he is getting an error. So the problem is more to be 
searched in his DSPAM setup than in the dovecot antispam plugin.

>
> +------------------+--------------------------+----------------------------+ 
>
> | Paul Goyette     | PGP Key fingerprint:     | E-mail 
> addresses:          |
> | (Retired)        | FA29 0E3B 35AF E8AE 6651 | paul at whooppee dot 
> com   |
> | Kernel Developer | 0786 F758 55DE 53BA 7731 | pgoyette at netbsd dot 
> org |
> +------------------+--------------------------+----------------------------+
>
>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>
>
> _______________________________________________
> Dspam-user mailing list
> Dsp...@li...
> https://lists.sourceforge.net/lists/listinfo/dspam-user

Re: [Dspam-user] training for non-spam not working

[ITwrx.org <in...@it...>]

On 01/05/2018 05:07 PM, Paul Goyette wrote:
> Perhaps remove the extra % character? 
that gives me:

> dspam[25458]: Signature retrieval for 'imap' failed
> Jan 05 17:31:00 email.itwrx.org dspam[25458]: Unable to find a valid
> signature. Aborting.
> Jan 05 17:31:00 email.itwrx.org dspam[25458]: process_message returned
> error -5.  dropping message.
instead.

Re: [Dspam-user] training for non-spam not working

[Stevan B. <st...@ba...>]

So DSPAM can not find the signature in the db. Are you sure that the 
signature is inside the db?

When you run this against the DSPAM database (I assume the email address 
you use is in...@it.... If not, change it to whatever your email is):

select uid,signature from dspam_signature_data where uid=(select uid 
from dspam_virtual_uids where username='in...@it...') and signature 
like '%a441081121917356521135';


What do you get?


Do you have an user id for your email? What do you get when you run this 
here:

select uid from dspam_virtual_uids where username='in...@it...';


What do you get when you run this here:

select uid,signature,length,created_on from dspam_signature_data where 
signature like '%a441081121917356521135';


What are your user preferences? Can your run this here and post the 
output (if in...@it... is not your email address then change it to 
whatever you use):

dspam_admin list pref in...@it...



-- 
  Kind Regards from Switzerland,

  Stevan Bajić



On 06.01.2018 00:05, ITwrx.org wrote:
> On 01/05/2018 03:46 PM, Stevan Bajić via Dspam-user wrote:
>> Assuming the mail you try to reclassify is for your own account (aka:
>> in...@it...) then the following lines inside the plugin configuration:
>>
>>      antispam_dspam_binary = /usr/bin/dspam
>>      antispam_dspam_args = --user;%u;--source=error;--signature=%%s
>>      antispam_dspam_spam = --class=spam
>>      antispam_dspam_notspam = --class=innocent
>>
>>
>> and the fact that the mail is inside your spam folder and you move it
>> to the inbox folder, would result in the following command being
>> executed:
>>
>> /usr/bin/dspam --user in...@it... --source=error
>> --signature=a441081121917356521135 --class=innocent
>>
>>
>> What happens when you execute this? What entries do you get in your
>> syslog? Can you post them here?
>>
>>
>>
> when i try your example manually in the terminal i get:
>
>> Signature retrieval for 'a441081121917356521135' failed
>> Jan 05 16:59:26 email.itwrx.org dspam[25337]: Unable to find a valid
>> signature. Aborting.
>> Jan 05 16:59:26 email.itwrx.org dspam[25337]: process_message returned
>> error -5.  dropping message.
> no such message exists...
>
> ------------------------------------
>
> when i reclassify+move a real email i get:
>
>> Signature retrieval for '%s' failed
>> dspam[25001]: Unable to find a valid signature. Aborting.
>> dspam[25001]: process_message returned error -5.  dropping message.
> the signature is always shown as '%s' in the log (for all messages i
> move). so, either there is no signature being assigned or dspam is not
> being passed the signature?
>
>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> Dspam-user mailing list
> Dsp...@li...
> https://lists.sourceforge.net/lists/listinfo/dspam-user

Re: [Dspam-user] training for non-spam not working

[Paul G. <pa...@wh...>]

On Fri, 5 Jan 2018, ITwrx.org wrote:

>> Signature retrieval for '%s' failed
>> dspam[25001]: Unable to find a valid signature. Aborting.
>> dspam[25001]: process_message returned error -5.  dropping message.
>
> the signature is always shown as '%s' in the log (for all messages i
> move). so, either there is no signature being assigned or dspam is not
> being passed the signature?
>
>>     antispam_dspam_args = --user;%u;--source=error;--signature=%%s

Perhaps remove the extra % character?


+------------------+--------------------------+----------------------------+
| Paul Goyette     | PGP Key fingerprint:     | E-mail addresses:          |
| (Retired)        | FA29 0E3B 35AF E8AE 6651 | paul at whooppee dot com   |
| Kernel Developer | 0786 F758 55DE 53BA 7731 | pgoyette at netbsd dot org |
+------------------+--------------------------+----------------------------+

Re: [Dspam-user] training for non-spam not working

[ITwrx.org <in...@it...>]

On 01/05/2018 03:46 PM, Stevan Bajić via Dspam-user wrote:
> Assuming the mail you try to reclassify is for your own account (aka:
> in...@it...) then the following lines inside the plugin configuration:
>
>     antispam_dspam_binary = /usr/bin/dspam
>     antispam_dspam_args = --user;%u;--source=error;--signature=%%s
>     antispam_dspam_spam = --class=spam
>     antispam_dspam_notspam = --class=innocent
>
>
> and the fact that the mail is inside your spam folder and you move it
> to the inbox folder, would result in the following command being
> executed:
>
> /usr/bin/dspam --user in...@it... --source=error
> --signature=a441081121917356521135 --class=innocent
>
>
> What happens when you execute this? What entries do you get in your
> syslog? Can you post them here?
>
>
>
when i try your example manually in the terminal i get:

> Signature retrieval for 'a441081121917356521135' failed
> Jan 05 16:59:26 email.itwrx.org dspam[25337]: Unable to find a valid
> signature. Aborting.
> Jan 05 16:59:26 email.itwrx.org dspam[25337]: process_message returned
> error -5.  dropping message.
no such message exists...

------------------------------------

when i reclassify+move a real email i get:

> Signature retrieval for '%s' failed
> dspam[25001]: Unable to find a valid signature. Aborting.
> dspam[25001]: process_message returned error -5.  dropping message.

the signature is always shown as '%s' in the log (for all messages i
move). so, either there is no signature being assigned or dspam is not
being passed the signature?

Re: [Dspam-user] training for non-spam not working

[Stevan B. <st...@ba...>]

Assuming the mail you try to reclassify is for your own account (aka: 
in...@it...) then the following lines inside the plugin configuration:

     antispam_dspam_binary = /usr/bin/dspam
     antispam_dspam_args = --user;%u;--source=error;--signature=%%s
     antispam_dspam_spam = --class=spam
     antispam_dspam_notspam = --class=innocent


and the fact that the mail is inside your spam folder and you move it to 
the inbox folder, would result in the following command being executed:

/usr/bin/dspam --user in...@it... --source=error 
--signature=a441081121917356521135 --class=innocent


What happens when you execute this? What entries do you get in your 
syslog? Can you post them here?



-- 
  Kind Regards from Switzerland,

  Stevan Bajić



On 05.01.2018 17:52, ITwrx.org wrote:
> On 01/05/2018 02:03 AM, Stevan Bajić via Dspam-user wrote:
>> Can you please post the header of the message that you are trying to
>> retrain? Just the one beginning with "X-DSPAM".
>>
> sure, thanks.
>
>> X-DSPAM-Result: Spam
>> X-DSPAM-Processed: Wed Dec 27 15:28:33 2017
>> X-DSPAM-Confidence: 0.9899
>> X-DSPAM-Probability: 1.0000
>> X-DSPAM-Signature: 5a441081121917356521135
>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> Dspam-user mailing list
> Dsp...@li...
> https://lists.sourceforge.net/lists/listinfo/dspam-user