clisp-devel — closed list for developers and testers

clisp-cvs Digest, Vol 77, Issue 1

[<cli...@li...>]

Send clisp-cvs mailing list submissions to
	cli...@li...

To subscribe or unsubscribe via the World Wide Web, visit
	https://lists.sourceforge.net/lists/listinfo/clisp-cvs
or, via email, send a message with subject or body 'help' to
	cli...@li...

You can reach the person managing the list at
	cli...@li...

When replying, please edit your Subject line so it is more specific
than "Re: Contents of clisp-cvs digest..."


CLISP CVS commits for today

Today's Topics:

   1. clisp: Fix regeneration of src/configure after version.sh has
      ch... (cli...@li...)
   2. clisp: Added tag clisp_2_49_51-2017-04-17 for changeset
      d379b5ba... (cli...@li...)
   3. clisp: Fix MT builds with MAP_MEMORY_TABLES model
      (cli...@li...)
   4. clisp: Disable SINGLEMAP_MEMORY model in MT builds
      (cli...@li...)
   5. clisp: Add Swedish translation (work in progress).
      (cli...@li...)
   6. clisp: Merge sv.po with clisp.pot. Generate sv.gmo and
      clisplow_... (cli...@li...)
   7. clisp: Update some URLs. (cli...@li...)
   8. clisp: Small fixes in socket.d.
      (cli...@li...)
   9. clisp: Silence error messages from 'find' (regression from
      2017-... (cli...@li...)
  10. clisp: Add Swedish localization (work in progress).
      (cli...@li...)
  11. clisp: Fix race condition w.r.t. SIGWINCH signal (regression
      fro... (cli...@li...)
  12. clisp: Add back comment, lost on 2008-09-18 (merged into
      default... (cli...@li...)
  13. clisp: Fix build warning "unrecognized command line option
      ?-Wno... (cli...@li...)
  14. clisp: Silence error messages from 'find' (regression from
      2017-... (cli...@li...)


----------------------------------------------------------------------

Message: 1
Date: Mon, 17 Apr 2017 22:41:07 +0000
From: cli...@li...
To: cli...@li...
Subject: clisp: Fix regeneration of src/configure after version.sh has
	ch...
Message-ID:
	<hg....@sf...>
	
Content-Type: text/plain; charset="us-ascii"

details:   http://clisp.hg.sourceforge.net/hgweb/clisp/clisp/clisp/rev/e12d6e03b283
changeset: 15892:e12d6e03b283a45519ed6c38f55465b77ed4635f
user:      Bruno Haible <br...@cl...>
date:      2017-04-18 00:40:52 +0200
description:
Fix regeneration of src/configure after version.sh has changed.

diffstat:

 Makefile.devel |  4 +++-
 src/ChangeLog  |  7 +++++++
 src/aclocal.m4 |  2 ++
 src/configure  |  2 +-
 4 files changed, 13 insertions(+), 2 deletions(-)



------------------------------

Message: 2
Date: Tue, 18 Apr 2017 08:24:55 +0000
From: cli...@li...
To: cli...@li...
Subject: clisp: Added tag clisp_2_49_51-2017-04-17 for changeset
	d379b5ba...
Message-ID:
	<hg....@sf...>
	
Content-Type: text/plain; charset="us-ascii"

details:   http://clisp.hg.sourceforge.net/hgweb/clisp/clisp/clisp/rev/5f269cb96199
changeset: 15893:5f269cb961999095affadf8df0b3ef6eb5540f83
user:      Bruno Haible <br...@cl...>
date:      2017-04-18 10:24:02 +0200
description:
Added tag clisp_2_49_51-2017-04-17 for changeset d379b5baaba0

diffstat:

 .hgtags |  1 +
 1 files changed, 1 insertions(+), 0 deletions(-)



------------------------------

Message: 3
Date: Fri, 19 May 2017 22:59:09 +0000
From: cli...@li...
To: cli...@li...
Subject: clisp: Fix MT builds with MAP_MEMORY_TABLES model
Message-ID:
	<hg....@sf...>
	
Content-Type: text/plain; charset="us-ascii"

details:   http://clisp.hg.sourceforge.net/hgweb/clisp/clisp/clisp/rev/70b974fb8245
changeset: 15894:70b974fb8245a61b8cb72f2f1d1ce5d1da5c141e
user:      Vladimir Tzankov <vtz...@gm...>
date:      2017-05-20 01:58:55 +0300
description:
Fix MT builds with MAP_MEMORY_TABLES model

diffstat:

 src/ChangeLog |   6 ++++++
 src/spvw.d    |  13 ++++++++++---
 2 files changed, 16 insertions(+), 3 deletions(-)



------------------------------

Message: 4
Date: Sat, 20 May 2017 13:51:56 +0000
From: cli...@li...
To: cli...@li...
Subject: clisp: Disable SINGLEMAP_MEMORY model in MT builds
Message-ID:
	<hg....@sf...>
	
Content-Type: text/plain; charset="us-ascii"

details:   http://clisp.hg.sourceforge.net/hgweb/clisp/clisp/clisp/rev/dfd532cfddb5
changeset: 15895:dfd532cfddb523ad8ade0f157c5994b013c026de
user:      Vladimir Tzankov <vtz...@gm...>
date:      2017-05-20 16:51:42 +0300
description:
Disable SINGLEMAP_MEMORY model in MT builds

diffstat:

 src/ChangeLog  |  5 +++++
 src/lispbibl.d |  3 ++-
 2 files changed, 7 insertions(+), 1 deletions(-)



------------------------------

Message: 5
Date: Sun, 21 May 2017 19:27:37 +0000
From: cli...@li...
To: cli...@li...
Subject: clisp: Add Swedish translation (work in progress).
Message-ID:
	<hg....@sf...>
	
Content-Type: text/plain; charset="us-ascii"

details:   http://clisp.hg.sourceforge.net/hgweb/clisp/clisp/clisp/rev/74e7e2502254
changeset: 15896:74e7e2502254404a4ec76a3fe163586f0f042591
user:      Bruno Haible <br...@cl...>
date:      2017-05-21 21:27:11 +0200
description:
Add Swedish translation (work in progress).

diffstat:

 src/ChangeLog            |     8 +
 src/po/LINGUAS           |     2 +-
 src/po/Makefile.devel    |     4 +-
 src/po/Makefile.trans.sv |    24 +
 src/po/sv.po             |  7905 ++++++++++++++++++++++++++++++++++++++++++++++
 5 files changed, 7940 insertions(+), 3 deletions(-)



------------------------------

Message: 6
Date: Mon, 22 May 2017 16:45:13 +0000
From: cli...@li...
To: cli...@li...
Subject: clisp: Merge sv.po with clisp.pot. Generate sv.gmo and
	clisplow_...
Message-ID:
	<hg....@sf...>
	
Content-Type: text/plain; charset="us-ascii"

details:   http://clisp.hg.sourceforge.net/hgweb/clisp/clisp/clisp/rev/bdefd975ba8f
changeset: 15897:bdefd975ba8fba3ce9e071146046e3f495b0edf3
user:      Bruno Haible <br...@cl...>
date:      2017-05-22 18:35:16 +0200
description:
Merge sv.po with clisp.pot. Generate sv.gmo and clisplow_sv.*.

diffstat:

 src/po/clisplow_sv.gmo |   Bin 
 src/po/clisplow_sv.po  |   792 ++++++++++++++++++
 src/po/sv.gmo          |   Bin 
 src/po/sv.po           |  2002 ++++++++++++++++++++++++-----------------------
 4 files changed, 1802 insertions(+), 992 deletions(-)



------------------------------

Message: 7
Date: Tue, 23 May 2017 00:30:26 +0000
From: cli...@li...
To: cli...@li...
Subject: clisp: Update some URLs.
Message-ID:
	<hg....@sf...>
	
Content-Type: text/plain; charset="us-ascii"

details:   http://clisp.hg.sourceforge.net/hgweb/clisp/clisp/clisp/rev/c770c4e6b6bd
changeset: 15898:c770c4e6b6bd02303542c080cc4e1ab9dbdafcd1
user:      Bruno Haible <br...@cl...>
date:      2017-05-23 02:29:51 +0200
description:
Update some URLs.

diffstat:

 src/ChangeLog |   8 ++++++++
 unix/INSTALL  |  33 ++++++++++++++++-----------------
 2 files changed, 24 insertions(+), 17 deletions(-)



------------------------------

Message: 8
Date: Thu, 25 May 2017 14:02:00 +0000
From: cli...@li...
To: cli...@li...
Subject: clisp: Small fixes in socket.d.
Message-ID:
	<hg....@sf...>
	
Content-Type: text/plain; charset="us-ascii"

details:   http://clisp.hg.sourceforge.net/hgweb/clisp/clisp/clisp/rev/f6460ecb9186
changeset: 15899:f6460ecb9186e5477ffab1dba46192307f53c126
user:      Bruno Haible <br...@cl...>
date:      2017-05-25 15:01:35 +0200
description:
Small fixes in socket.d.

diffstat:

 src/ChangeLog  |   31 ++++++++++-
 src/lispbibl.d |   24 ++++---
 src/socket.d   |  169 ++++++++++++++++++++++++++++++++++----------------------
 src/stream.d   |    5 -
 src/win32.d    |    3 +-
 5 files changed, 146 insertions(+), 86 deletions(-)



------------------------------

Message: 9
Date: Thu, 25 May 2017 20:15:41 +0000
From: cli...@li...
To: cli...@li...
Subject: clisp: Silence error messages from 'find' (regression from
	2017-...
Message-ID:
	<hg....@sf...>
	
Content-Type: text/plain; charset="us-ascii"

details:   http://clisp.hg.sourceforge.net/hgweb/clisp/clisp/clisp/rev/1ad674af5962
changeset: 15900:1ad674af59624bb627b6f0fe708cdbcdc473cd2b
user:      Bruno Haible <br...@cl...>
date:      2017-05-25 16:31:15 +0200
description:
Silence error messages from 'find' (regression from 2017-03-21).

diffstat:

 src/ChangeLog   |  5 +++++
 src/makemake.in |  2 +-
 2 files changed, 6 insertions(+), 1 deletions(-)



------------------------------

Message: 10
Date: Thu, 25 May 2017 20:15:42 +0000
From: cli...@li...
To: cli...@li...
Subject: clisp: Add Swedish localization (work in progress).
Message-ID:
	<hg....@sf...>
	
Content-Type: text/plain; charset="us-ascii"

details:   http://clisp.hg.sourceforge.net/hgweb/clisp/clisp/clisp/rev/61f776ace0bf
changeset: 15901:61f776ace0bf59922037c4137dca94864a96cb59
user:      Bruno Haible <br...@cl...>
date:      2017-05-25 17:59:07 +0200
description:
Add Swedish localization (work in progress).

diffstat:

 src/ChangeLog       |  8 ++++++++
 src/constsym.d      |  3 ++-
 src/spvw_language.d |  9 ++++++++-
 3 files changed, 18 insertions(+), 2 deletions(-)



------------------------------

Message: 11
Date: Thu, 25 May 2017 20:15:43 +0000
From: cli...@li...
To: cli...@li...
Subject: clisp: Fix race condition w.r.t. SIGWINCH signal (regression
	fro...
Message-ID:
	<hg....@sf...>
	
Content-Type: text/plain; charset="us-ascii"

details:   http://clisp.hg.sourceforge.net/hgweb/clisp/clisp/clisp/rev/efa02d0f577f
changeset: 15902:efa02d0f577f67e7412161aade3d67008a6c72e6
user:      Bruno Haible <br...@cl...>
date:      2017-05-25 22:14:26 +0200
description:
Fix race condition w.r.t. SIGWINCH signal (regression from 2009-10-21).

diffstat:

 src/ChangeLog |   6 ++++++
 src/spvw.d    |  13 +++++++------
 2 files changed, 13 insertions(+), 6 deletions(-)



------------------------------

Message: 12
Date: Thu, 25 May 2017 20:30:41 +0000
From: cli...@li...
To: cli...@li...
Subject: clisp: Add back comment, lost on 2008-09-18 (merged into
	default...
Message-ID:
	<hg....@sf...>
	
Content-Type: text/plain; charset="us-ascii"

details:   http://clisp.hg.sourceforge.net/hgweb/clisp/clisp/clisp/rev/348fb97d6677
changeset: 15903:348fb97d667742bb3a4004db73a0d1334e02887a
user:      Bruno Haible <br...@cl...>
date:      2017-05-25 22:29:56 +0200
description:
Add back comment, lost on 2008-09-18 (merged into default branch on 2008-10-29).

diffstat:

 src/lispbibl.d |  2 ++
 1 files changed, 2 insertions(+), 0 deletions(-)



------------------------------

Message: 13
Date: Fri, 26 May 2017 01:45:47 +0000
From: cli...@li...
To: cli...@li...
Subject: clisp: Fix build warning "unrecognized command line option
	?-Wno...
Message-ID:
	<hg....@sf...>
	
Content-Type: text/plain; charset="us-ascii"

details:   http://clisp.hg.sourceforge.net/hgweb/clisp/clisp/clisp/rev/bac60ff67689
changeset: 15904:bac60ff676892b69b4cbc023efcd6355edc5c3e4
user:      Bruno Haible <br...@cl...>
date:      2017-05-26 00:50:14 +0200
description:
Fix build warning "unrecognized command line option ?-Wno-shift-negative-value?"

diffstat:

 src/ChangeLog   |  7 +++++++
 src/makemake.in |  2 +-
 2 files changed, 8 insertions(+), 1 deletions(-)



------------------------------

Message: 14
Date: Fri, 26 May 2017 01:45:49 +0000
From: cli...@li...
To: cli...@li...
Subject: clisp: Silence error messages from 'find' (regression from
	2017-...
Message-ID:
	<hg....@sf...>
	
Content-Type: text/plain; charset="us-ascii"

details:   http://clisp.hg.sourceforge.net/hgweb/clisp/clisp/clisp/rev/c03742cb1f18
changeset: 15905:c03742cb1f1854e73eea6765c751a6b5dd2cd6c5
user:      Bruno Haible <br...@cl...>
date:      2017-05-26 00:51:54 +0200
description:
Silence error messages from 'find' (regression from 2017-03-21).

diffstat:

 src/ChangeLog   |  5 +++++
 src/makemake.in |  2 +-
 2 files changed, 6 insertions(+), 1 deletions(-)



------------------------------

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot

------------------------------

Subject: Digest Footer

_______________________________________________
clisp-cvs mailing list
cli...@li...
https://lists.sourceforge.net/lists/listinfo/clisp-cvs


------------------------------

End of clisp-cvs Digest, Vol 77, Issue 1
****************************************

Re: typedef query

[Bruno H. <br...@cl...>]

Compro Prasad wrote:
> According to what I have seen, 32 bit systems have sizeof(long) as 32
> bits and on 64 bit systems it is 64 bits.

On 64-bit native Windows, 'long' is 32 bits, not 64 bits. That is,
'long' can be smaller than a 'void *'.

> So, why trust "long".

The code trusts the type whose width it has determined. The point of
the 'uint32', 'uint64' types is to use *not* make assumptions about
the width of a specific type such as 'int' or 'long'. Computer architectures
evolve.

> Why not use "int" for 32 bits and "long long" for 64 bits? If there is a
> problem then what is it?

Until recently (2015), you could not use 'long long' portably. Now,
finally, MSVC has this type too.

Bruno

Re: typedef query

[Daniel J. <dan...@gm...>]

int might also be only 16 bit wide. AFAIK both types also could be larger
than 32 respectively 64 bits.

The real solution is to use the fixed width integer types provided by the
(C99 and newer) standard (int32_t and int64_t). I started work on that in
February, but was set back by serious mysterious crashes that appeared even
without any of my changes.

I'll look whether I can polish the changes to a complete patch next week,
that I hopefully can test (assuming CLISP from the repo doesn't crash by
itself now).

Cheers, Daniel

Compro Prasad <com...@gm...> schrieb am Fr., 26. Mai 2017, 07:49:

> According to what I have seen, 32 bit systems have sizeof(long) as 32
> bits and on 64 bit systems it is 64 bits. So, why trust "long". Why
> not use "int" for 32 bits and "long long" for 64 bits? If there is a
> problem then what is it?
>
> On Thu, May 25, 2017 at 5:52 PM, Bruno Haible <br...@cl...> wrote:
> > Compro Prasad wrote:
> >> typedef unsigned long ULONGLONG;
> >> typedef ULONGLONG uint64;
> >> typedef uint64 uintP;
> >>
> >> I think uintP refers to pointer
> >
> > Yes, the comment in lispbibl.d says so. Just search for 'uintP'.
> >
> >> But clisp.h doesn't has anything like:
> >> build-MT-debug/lispbibl.c:1164:  typedef unsigned long long  ULONGLONG;
> >
> > In my (non-MT) builds, clisp.h contains
> >
> > typedef unsigned long ULONGLONG;
> > ...
> > typedef ULONGLONG uint64;
> > ...
> > typedef uint64 uintP;
> >
> > Bruno
> >
>
>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> clisp-devel mailing list
> cli...@li...
> https://lists.sourceforge.net/lists/listinfo/clisp-devel
>

Re: typedef query

[Compro P. <com...@gm...>]

According to what I have seen, 32 bit systems have sizeof(long) as 32
bits and on 64 bit systems it is 64 bits. So, why trust "long". Why
not use "int" for 32 bits and "long long" for 64 bits? If there is a
problem then what is it?

On Thu, May 25, 2017 at 5:52 PM, Bruno Haible <br...@cl...> wrote:
> Compro Prasad wrote:
>> typedef unsigned long ULONGLONG;
>> typedef ULONGLONG uint64;
>> typedef uint64 uintP;
>>
>> I think uintP refers to pointer
>
> Yes, the comment in lispbibl.d says so. Just search for 'uintP'.
>
>> But clisp.h doesn't has anything like:
>> build-MT-debug/lispbibl.c:1164:  typedef unsigned long long  ULONGLONG;
>
> In my (non-MT) builds, clisp.h contains
>
> typedef unsigned long ULONGLONG;
> ...
> typedef ULONGLONG uint64;
> ...
> typedef uint64 uintP;
>
> Bruno
>

Re: libffcall and selinux

[Bruno H. <br...@cl...>]

Don,

> Let me know how to determine whether it contains the checks you want,
> and if not, how to add them, or if you don't happen to know, any advice
> you can offer on how to find out.

I don't know. Maybe the docs about SELinux, from Red Hat, have some infos?

> Also by "how clisp behaves" you mean what part of the process?
> Just make check?  Or start over from building libsigsegv and ffcall?

Start with "make check". If that fails miserably, then reconfigure,
rebuild, and reinstall libffcall, then rebuild clisp (here, I'd guess,
reconfigure is not necessary, just "make clean && make").

Bruno

Re: libffcall and selinux

[<don...@is...>]

Bruno Haible writes:
 > > make -k check also shows
 > >  > form: (nth-prime 150)
 > > 
 > > *** - Program stack overflow. RESET
 > 
 > Now this means that the default stack size is quite small. What's
 > the result of
 > $ ulimit -a | grep stack
 > ? For me, it's:
 > stack size              (kbytes, -s) 8192

stack size              (kbytes, -s) 8515

I was surprised not to see anything about setting limit
at the end of the configure output.

 > > Let me know if I can do anything else useful with this VM before 
 > > I turn it off.
 > 
 > Yes, it would be useful to enable SELinux checks (at least those
 > that smell like related to "restricted mprotect" or like "write xor
 > execute" or similar, and see how clisp behaves with these checks
 > enabled.

So far I've left the default selinux config alone.
Let me know how to determine whether it contains the checks you want,
and if not, how to add them, or if you don't happen to know, any advice
you can offer on how to find out.

Also by "how clisp behaves" you mean what part of the process?
Just make check?  Or start over from building libsigsegv and ffcall?

Re: libffcall and selinux

[Bruno H. <br...@cl...>]

Hi Don,

> May 25 12:10:41 localhost audit: ANOM_ABEND auid=0 uid=0 gid=0 ses=3 subj=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023 pid=11356 comm="lisp.run" exe="/home/don/hg/clisp/build-dir/lisp.run" sig=11
> May 25 12:10:41 localhost kernel: lisp.run[11356]: segfault at b000000b1f1 ip 00000000004bdeb4 sp 00007ffd4d6b82f0 error 4 in lisp.run[400000+2c1000]
> May 25 12:10:42 localhost abrt-hook-ccpp: Process 11356 (lisp.run) of user 0 killed by SIGSEGV - dumping core
> 
> I'm guessing this is related to the problem you're now working on,
> but not related to selinux.

Yes, nearly everyone on Linux/x86_64 is seeing this (or a similar) crash.

> make -k check also shows
>  > form: (nth-prime 150)
> 
> *** - Program stack overflow. RESET

Now this means that the default stack size is quite small. What's the result of
$ ulimit -a | grep stack
? For me, it's:
stack size              (kbytes, -s) 8192

> Let me know if I can do anything else useful with this VM before 
> I turn it off.

Yes, it would be useful to enable SELinux checks (at least those that smell
like related to "restricted mprotect" or like "write xor execute" or similar,
and see how clisp behaves with these checks enabled.

Bruno

Re: libffcall and selinux

[<don...@is...>]

I turned off the program using port 9090 and retried make check.
It now ends with:
(STRINGP (WITH-OUTPUT-TO-STRING (S) (DESCRIBE (MAKE-ARRAY NIL :ELEMENT-TYPE NIL) S)))
EQL-OK: T
(STRINGP (WITH-OUTPUT-TO-STRING (S) (DESCRIBE NIL S)))
;; connecting to "http://clisp.org/impnotes/id-href.map"...connected...HTTP/1.1 200 OK...74,909 bytes
;; SYSTEM::GET-STRING-MAP(#<IO INPUT-BUFFERED SOCKET-STREAM CHARACTER clisp.org:80>)...Makefile:25: recipe for target 'tests' failed
make[1]: *** [tests] Segmentation fault (core dumped)
make[1]: Leaving directory '/home/don/hg/clisp/build-dir/tests'
Makefile:2167: recipe for target 'check-tests' failed
make: *** [check-tests] Error 2

system log still contains no AVC, but does contain:
May 25 12:09:22 localhost audit: ANOM_ABEND auid=0 uid=0 gid=0 ses=3 subj=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023 pid=10960 comm="systemd-tty-ask" exe="/usr/bin/systemd-tty-ask-password-agent" sig=11
May 25 12:10:41 localhost audit: ANOM_ABEND auid=0 uid=0 gid=0 ses=3 subj=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023 pid=11356 comm="lisp.run" exe="/home/don/hg/clisp/build-dir/lisp.run" sig=11
May 25 12:10:41 localhost kernel: lisp.run[11356]: segfault at b000000b1f1 ip 00000000004bdeb4 sp 00007ffd4d6b82f0 error 4 in lisp.run[400000+2c1000]
May 25 12:10:42 localhost abrt-hook-ccpp: Process 11356 (lisp.run) of user 0 killed by SIGSEGV - dumping core

I'm guessing this is related to the problem you're now working on,
but not related to selinux.

make -k check also shows
 > form: (nth-prime 150)

*** - Program stack overflow. RESET


Let me know if I can do anything else useful with this VM before 
I turn it off.

Re: crashing socket tests

[Bruno H. <br...@cl...>]

Hi Vladimir,

> Here is narrowed down reproducible stacktrace based on hg tip.
> The build is '--without-ffcall'. Really important since I was not able to
> reproduce it with FFI enabled.

I reproduce similar things also with FFI enabled.

Namely:

1) In build-porting64-gcc-portability

This is a build with

$ grep '\(SPVW_\|GENERA\)' lispbibl.h
#define NO_GENERATIONAL_GC 1
#define SPVW_MIXED 
#define SPVW_PAGES 

Here I get a crash in "make check-tests"

(TEST-FLOAT-IO-CONSISTENCY :FROM 1.0s-30 :BY 10 :TO 1.0s30 :REPEAT 100)
Makefile:25: recipe for target 'tests' failed
make[1]: *** [tests] Segmentation fault (core dumped)

and "make check-sacla-tests" works.

2) I also got a crash in "make check-sacla-tests", which doesn't use sockets.

But these crashes are hard to reproduce.

3) In build-porting64-gcc-debug_gcsafety
This is a build with

$ grep '\(SPVW_\|GENERA\)' lispbibl.h
#define SPVW_BLOCKS 
#define SPVW_PURE 

This time, here "make check-tests" and "make check-sacla-tests" both work.

Bruno

Re: typedef query

[Bruno H. <br...@cl...>]

Compro Prasad wrote:
> typedef unsigned long ULONGLONG;
> typedef ULONGLONG uint64;
> typedef uint64 uintP;
> 
> I think uintP refers to pointer

Yes, the comment in lispbibl.d says so. Just search for 'uintP'.

> But clisp.h doesn't has anything like:
> build-MT-debug/lispbibl.c:1164:  typedef unsigned long long  ULONGLONG;

In my (non-MT) builds, clisp.h contains

typedef unsigned long ULONGLONG;
...
typedef ULONGLONG uint64;
...
typedef uint64 uintP;

Bruno

typedef query

[Compro P. <com...@gm...>]

typedef unsigned long ULONGLONG;
typedef ULONGLONG uint64;
typedef uint64 uintP;

I think uintP refers to pointer as it is used in definition of
"gcv_object_t". But clisp.h doesn't has anything like:
build-MT-debug/lispbibl.c:1164:  typedef unsigned long long  ULONGLONG;

Was that overlooked? Or is it not required?

Re: crashing socket tests

[Vladimir T. <vtz...@gm...>]

Hi Bruno,

Here is narrowed down reproducible stacktrace based on hg tip.
The build is '--without-ffcall'. Really important since I was not able to
reproduce it with FFI enabled.

GNU CLISP 2.49.50+ (2017-03-30) (built 3704559062) (memory 3704559864)
Software: GNU C 4.9.2
gcc -g -O2 -W -Wswitch -Wcomment -Wpointer-arith -Wreturn-type
-Wmissing-declarations -Wimplicit -Wno-sign-compare -Wno-format-nonliteral
-Wno-shift-negative-value -O -fwrapv -fno-strict-aliasing -DENABLE_UNICODE
-DNO_TERMCAP_NCURSES -DDYNAMIC_MODULES  libgnu.a  -ldl   -lsigsegv
SAFETY=0 TYPECODES WIDE_HARD GENERATIONAL_GC SPVW_BLOCKS SPVW_PURE
SINGLEMAP_MEMORY
libsigsegv 2.10
Features:
(REGEXP WILDCARD SYSCALLS I18N LOOP COMPILER CLOS MOP CLISP ANSI-CL
COMMON-LISP LISP=CL INTERPRETER LOGICAL-PATHNAMES SOCKETS GENERIC-STREAMS
GETTEXT UNICODE BASE-CHAR=CHARACTER
 WORD-SIZE=64 PC386 UNIX)
C Modules: (clisp i18n syscalls regexp)
Installation directory: /home/vtz/clisp/s/
User language: ENGLISH
Machine: X86_64 (X86_64) debian [127.0.1.1]


And here is the GDB session:

(gdb) base
(gdb) handle SIGSEGV nostop noprint
Signal        Stop Print Pass to program Description
SIGSEGV       No No Yes Segmentation fault
(gdb) break spvw_sigsegv.d:64
Breakpoint 1 at 0x42d703: file ../src/spvw_sigsegv.d, line 64.
(gdb) r
Starting program: /home/vtz/clisp/s/base/lisp.run -B . -N locale -E 1:1 -q
-norc -M base/lispinit.mem
[1]> (describe nil)

NIL is the empty list, the symbol NIL, lies in #<PACKAGE COMMON-LISP>, is
accessible in 8 packages CLOS, COMMON-LISP, COMMON-LISP-USER, EXPORTING,
EXT, POSIX, REGEXP, SYSTEM, a
constant, value: NIL, names a type, has 2 properties SYSTEM::INSTRUCTION,
SYSTEM::TYPE-SYMBOL
;; connecting to "
http://www.ai.mit.edu/projects/iiip/doc/CommonLISP/HyperSpec/Data/Map_Sym.txt"...connected...HTTP/1.1
404 Not Found
;; "Date: Tue, 23 May 2017 22:23:10 GMT"
;; "Server: Apache/2.4.7 (Ubuntu)"
;; "Content-Length: 253"
;; "Connection: close"
;; "Content-Type: text/html; charset=iso-8859-1"
;; ""
;; "<!DOCTYPE HTML PUBLIC \"-//IETF//DTD HTML 2.0//EN\">"
;; "<html><head>"
;; "<title>404 Not Found</title>"
;; "</head><body>"
;; "<h1>Not Found</h1>"
;; "<p>The requested URL
/projects/iiip/doc/CommonLISP/HyperSpec/Data/Map_Sym.txt was not found on
this server.</p>"
;; "</body></html>"
;; connecting to "
http://www.ai.mit.edu/projects/iiip/doc/CommonLISP/HyperSpec/Data/Symbol-Table.text"...connected...HTTP/1.1
200 OK...45,322 bytes
;; SYSTEM::GET-CLHS-MAP(#<IO INPUT-BUFFERED SOCKET-STREAM CHARACTER
www.ai.mit.edu:80>)...978/978 symbols
.
ANSI-CL Documentation is at
"
http://www.ai.mit.edu/projects/iiip/doc/CommonLISP/HyperSpec/Body/any_nil.html
"
;; connecting to "http://clisp.org/impnotes/id-href.map"...connected...HTTP/1.1
200 OK...74,909 bytes
;; SYSTEM::GET-STRING-MAP(#<IO INPUT-BUFFERED SOCKET-STREAM CHARACTER
clisp.org:80>)...
*** - handle_fault error2 ! address = 0xc000001a3b8 not in
[0xc0000000000,0xc0000018ac8) !
Breakpoint 1, sigsegv_handler_failed (address=address@entry=0xc000001a3b8)
at ../src/spvw_sigsegv.d:64
64  fputc('\n',stderr);
(gdb) where 10
#0  sigsegv_handler_failed (address=address@entry=0xc000001a3b8) at
../src/spvw_sigsegv.d:64
#1  0x000000000042da0d in sigsegv_handler (fault_address=0xc000001a3b8,
serious=<optimized out>) at ../src/spvw_sigsegv.d:80
#2  0x00007ffff749ceaf in ?? () from
/usr/lib/x86_64-linux-gnu/libsigsegv.so.2
#3  <signal handler called>
#4  0x0000000000471991 in rd_ch_buffered (stream_=0x30000000360) at
../src/stream.d:6654
#5  0x000000000047fd42 in read_line (stream_=0x30000000360,
buffer_=buffer_@entry=0x30000000350) at ../src/stream.d:16328
#6  0x000000000047fd2b in read_line_twoway (buffer_=0x30000000350,
stream=0xb00000019d8) at ../src/stream.d:2168
#7  read_line (stream_=stream_@entry=0x30000000330, buffer_=0x30000000350)
at ../src/stream.d:16322
#8  0x0000000000490661 in C_read_line () at ../src/io.d:4500
#9  0x0000000000448b5a in interpret_bytecode_ (closure=0x90000048560,
codeptr=0x13000003e538,
    byteptr=0x13000003e5c2
"j\002j\002\222\001\377\256k\001\344\260-\003\004\026\003\025\031\002\341ݯ\257-\004\b")
at ../src/eval.d:7653
(More stack frames follow...)
(gdb) frame 4
#4  0x0000000000471991 in rd_ch_buffered (stream_=0x30000000360) at
../src/stream.d:6654
6654    Encoding_mbstowcs(encoding)
(gdb) p encoding
$1 = (object) 0xc000001a380
(gdb) p bufferptr
$2 = (uintB *) 0x13000004cb8f <error: Cannot access memory at address
0x13000004cb8f>

There was no GC run since the startup (double checked it) so it should not
be GC safety issue.


On Tue, May 23, 2017 at 11:36 AM, Bruno Haible <br...@cl...> wrote:

> Hi Vladimir,
>
> > Besides this I observe weird behaviour with amd64 builds on linux - both
> > single and multithreaded: without libffcall there is consistent segfault
> on
> > sockets tests while with libffcall enabled everything works fine. Will
> > investigate this further but any clue will be helpful.
>
> I also observed segfaults on or soon after socket tests in various
> configurations in February 2017. It seemed to depend on alignment options,
> but tracking down this route it behaved like a Heisenbug.
>
> A build with GC debugging enabled did not help.
>
> I think to resolve this we need one of the following approaches:
>   - Comment out some tests (the socket tests especially) and see if the
>     testsuite still crashes occasionally.
>   - Review the code of socket.d for ANY kind of mistake (usual GC-safety
>     mistakes are not likely - see testing I mentioned above).
>   - New kinds of debugging tools, in the spirit of GCC's "sanitizers" or
>     valgrind.
>
> Bruno
>
>

New Swedish PO file for 'clisp' (version 2.48-pre1)

[Translation P. R. <ro...@tr...>]

Hello, gentle maintainer.

This is a message from the Translation Project robot.

A revised PO file for textual domain 'clisp' has been submitted
by the Swedish team of translators.  The file is available at:

    http://translationproject.org/latest/clisp/sv.po

(We can arrange things so that in the future such files are automatically
e-mailed to you when they arrive.  Ask at the address below if you want this.)

All other PO files for your package are available in:

    http://translationproject.org/latest/clisp/

Please consider including all of these in your next release, whether
official or a pretest.

Whenever you have a new distribution with a new version number ready,
containing a newer POT file, please send the URL of that distribution
tarball to the address below.  The tarball may be just a pretest or a
snapshot, it does not even have to compile.  It is just used by the
translators when they need some extra translation context.

The following HTML page has been updated:

    http://translationproject.org/domain/clisp.html

If any question arises, please contact the translation coordinator.

Thank you for all your work,

                                The Translation Project robot, in the
                                name of your translation coordinator.
                                <coo...@tr...>

Re: libffcall and selinux

[<don...@is...>]

  mkdir locale
  (cd po && make && make install datarootdir=.. localedir='$(datarootdir)/locale' INSTALL_DATA='ln') || (rm -rf locale ; exit 1)
  make[1]: Entering directory '/home/don/hg/clisp/build-dir/po'
  make[1]: *** No rule to make target 'sv.gmo', needed by 'all-yes'.  Stop.
  make[1]: Leaving directory '/home/don/hg/clisp/build-dir/po'
  Makefile:1382: recipe for target 'locale' failed
  make: *** [locale] Error 1
  [don@localhost build-dir]$ 

I don't understand why this build is different from the one on the
host machine, where make reports nothing to be done.
But since that's not the main point of this exercise, I just copy 
sc.gmo and then clisplow_sv.gmo from the host to the VM and then 
make seems to finish ok.
Then make check ends with:

EQL-OK: NIL
(PROGN (SETQ *SERVER* (SHOW (SOCKET-SERVER 9090)) *SOCKET-1* (SHOW (SOCKET-CONNECT 9090 "localhost" :TIMEOUT 0 :BUFFERED NIL)) *SOCKET-2* (SHOW (SOCKET-ACCEPT *SERVER* :BUFFERED NIL))) (WRITE-CHAR #\a *SOCKET-1*))

[../src/stream.d:14062] [OS-ERROR]: OS-ERROR(98): Address already in use
ERROR!! ERROR should be #\a !
(LISTP (SHOW (LIST (MULTIPLE-VALUE-LIST (SOCKET-STREAM-LOCAL *SOCKET-1*)) (MULTIPLE-VALUE-LIST (SOCKET-STREAM-PEER *SOCKET-1*)) (MULTIPLE-VALUE-LIST (SOCKET-STREAM-LOCAL *SOCKET-2*)) (MULTIPLE-VALUE-LIST (SOCKET-STREAM-PEER *SOCKET-2*))) :PRETTY T))
[SIMPLE-TYPE-ERROR]: SOCKET-STREAM-LOCAL: argument #1=#<CLOSED INPUT BUFFERED SOCKET-STREAM CHARACTER localhost:46709> is not an open SOCKET-STREAM

ERROR!! ERROR should be T !
(SEARCH " (" (SOCKET-STREAM-LOCAL *SOCKET-1* T))
[SIMPLE-TYPE-ERROR]: SOCKET-STREAM-LOCAL: argument #1=#<CLOSED INPUT BUFFERED SOCKET-STREAM CHARACTER localhost:46709> is not an open SOCKET-STREAM

ERROR!! ERROR should be NIL !
(SEARCH " (" (SOCKET-STREAM-PEER *SOCKET-1* T))
[SIMPLE-TYPE-ERROR]: SOCKET-STREAM-PEER: argument #1=#<CLOSED INPUT BUFFERED SOCKET-STREAM CHARACTER localhost:46709> is not an open SOCKET-STREAM

ERROR!! ERROR should be NIL !
(SOCKET-STATUS (CONS *SOCKET-2* :INPUT) 0)
[SIMPLE-TYPE-ERROR]: SOCKET-STATUS: argument #1=#<CLOSED IO INPUT-BUFFERED SOCKET-STREAM CHARACTER 0.0.0.0:46709> is not an open stream

Makefile:25: recipe for target 'tests' failed
make[1]: *** [tests] Segmentation fault (core dumped)
make[1]: Leaving directory '/home/don/hg/clisp/build-dir/tests'
Makefile:2167: recipe for target 'check-tests' failed
make: *** [check-tests] Error 2
[don@localhost build-dir]$ 


same thing happens if I make check as root
netstat --inet -l -n -p
doesn't show any 9090 in use...

Aha - we seem to be using inet6 by default now!
netstat  -l -n -p
shows:
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      2999/sshd
tcp6       0      0 :::9090                 :::*                    LISTEN      1/systemd
 ...

Re: libffcall and selinux

[<don...@is...>]

 > > Not sure why, but this seems to be my traditional configure:
 > > ./configure CC='gcc -m64' --with-libsigsegv-prefix=/usr/local
 > >   --disable-maintainer-mode --with-debug --with-module=rawsock build-dir
 > 
 > Ouch. Don't install libraries in /usr/local *EVER*. You'll invariably
 > get trapped by a decades-old GCC bug if you do so. /usr/local is ONLY good
 > for executables. Any other --prefix value is OK; only /usr/local is so bad.

And yet that's where the library ends up when I do plain make install
as the directions say.

However, after hg pull retrieves a few new changes I try without
that and it still finds libsigsegv, and now also finds readline too.

But then make still ends with this:

gcc -m64 -I/home/don/hg/clisp/src -I/home/don/hg/clisp/build-dir/gllib -I/home/don/hg/clisp/src/gllib -g -O2 -W -Wswitch -Wcomment -Wpointer-arith -Wreturn-type -Wmissing-declarations -Wimplicit -Wno-sign-compare -Wno-format-nonliteral -Wno-shift-negative-value -fwrapv -fno-strict-aliasing -ggdb -O0 -DDEBUG_OS_ERROR -DDEBUG_SPVW -DDEBUG_BYTECODE -DSAFETY=3 -DENABLE_UNICODE -DDYNAMIC_FFI -DDYNAMIC_MODULES -I. -I. -c ../src/modules.c
if test -d locale; then rm -rf locale; fi
mkdir locale
(cd po && make && make install datarootdir=.. localedir='$(datarootdir)/locale' INSTALL_DATA='ln') || (rm -rf locale ; exit 1)
make[1]: Entering directory '/home/don/hg/clisp/build-dir/po'
make[1]: *** No rule to make target 'sv.gmo', needed by 'all-yes'.  Stop.
make[1]: Leaving directory '/home/don/hg/clisp/build-dir/po'
Makefile:1382: recipe for target 'locale' failed
make: *** [locale] Error 1
[don@localhost build-dir]$ 

Re: MT & SINGELMAP_MEMORY model

[Vladimir T. <vtz...@gm...>]

I already tried disabling only SINGLEMAP_MEMORY_STACK and got immediate
segfault (single threaded build as well) on startup in init_object_tab()
. Didn't investigate much but seems STACK is bogus.

It looks to me there are two ways to enable MT with SINGLEMAP_MEMORY:
* disable SINGLEMAP_MEMORY_STACK and fix the above problem.
* allocate new threads stacks in designated memory region instead of
malloc-ing. In this way make_framepointer/topofframe/uTheFramepointer will
behave as expected in the context of new threads.

I tend towards the latter.




On Tue, May 23, 2017 at 11:35 AM, Bruno Haible <br...@cl...> wrote:

> Hi Vladimir,
>
> > I disabled SINGLEMAP_MEMORY model in MT builds. The problem is that this
> > model assumes single fixed stack address range while every thread
> requires
> > it's own stack which is currently malloc-ed. What is the good way to
> > workaround this? Allocate new threads stacks in the above range?
>
> You mean, the only problem with MT and SINGLEMAP_MEMORY was that in spvw.d
> lines 3230..3245 we allocate one STACK range only, not multiple ones?
> If yes, I would try to keep SINGLEMAP_MEMORY turned on and disable only
> SINGLEMAP_MEMORY_STACK.
>
> Bruno
>
>

Re: crashing socket tests

[Bruno H. <br...@cl...>]

Hi Vladimir,

> Besides this I observe weird behaviour with amd64 builds on linux - both
> single and multithreaded: without libffcall there is consistent segfault on
> sockets tests while with libffcall enabled everything works fine. Will
> investigate this further but any clue will be helpful.

I also observed segfaults on or soon after socket tests in various
configurations in February 2017. It seemed to depend on alignment options,
but tracking down this route it behaved like a Heisenbug.

A build with GC debugging enabled did not help.

I think to resolve this we need one of the following approaches:
  - Comment out some tests (the socket tests especially) and see if the
    testsuite still crashes occasionally.
  - Review the code of socket.d for ANY kind of mistake (usual GC-safety
    mistakes are not likely - see testing I mentioned above).
  - New kinds of debugging tools, in the spirit of GCC's "sanitizers" or
    valgrind.

Bruno

Re: MT & SINGELMAP_MEMORY model

[Bruno H. <br...@cl...>]

Hi Vladimir,

> I disabled SINGLEMAP_MEMORY model in MT builds. The problem is that this
> model assumes single fixed stack address range while every thread requires
> it's own stack which is currently malloc-ed. What is the good way to
> workaround this? Allocate new threads stacks in the above range?

You mean, the only problem with MT and SINGLEMAP_MEMORY was that in spvw.d
lines 3230..3245 we allocate one STACK range only, not multiple ones?
If yes, I would try to keep SINGLEMAP_MEMORY turned on and disable only
SINGLEMAP_MEMORY_STACK.

Bruno

Re: libffcall and selinux

[Bruno H. <br...@cl...>]

Hi Don,

> Now gunzip,tar, read instructions and do mkdir, cd, ../configure
> 
> At this point I see a new AVC in audit.log:
> 
> type=AVC msg=audit(1495493082.183:494): avc:  denied  { execheap } for  pid=3540 comm="conftest" scontext=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023 tcontext=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023 tclass=process permissive=0
> 
> The end of the configure shows:
>   checking for working shared memory... (cached) yes
>   checking for sys/sysmacros.h... (cached) yes
>   checking whether code in malloc()ed memory is executable... (cached) no
>   checking whether mprotect can make malloc()ed memory executable... (cached) no
>   checking whether mprotect can make mmap()ed memory executable... (cached) yes
>   configure: creating ./config.status
>   config.status: creating Makefile
>   config.status: creating config.h
>   config.status: creating trampoline_r.h
>   config.status: executing libtool commands
>   [root@localhost builddir]# 
> 
> This is probably what you expect.
> I now try make - no new AVC.
> then make check - still no new AVC -- which surprises me. 

Good. This means that the workaround for Linux+PaX or SELinux kernels and for
HardenedBSD, that I added to libffcall on 2017-01-29, is working fine.

1 log message during configuration is acceptable, I think.

> (maybe you should update unix/INSTALL ?)

Done.

> Not sure why, but this seems to be my traditional configure:
> ./configure CC='gcc -m64' --with-libsigsegv-prefix=/usr/local
>   --disable-maintainer-mode --with-debug --with-module=rawsock build-dir

Ouch. Don't install libraries in /usr/local *EVER*. You'll invariably
get trapped by a decades-old GCC bug if you do so. /usr/local is ONLY good
for executables. Any other --prefix value is OK; only /usr/local is so bad.

Bruno

Re: libffcall and selinux

[<don...@is...>]

Bruno Haible writes:
 > Hi Don,
 > 
 > > I attempted to make various things work with selinux before giving up,
 > 
 > I would be interested to hear more about problems between libffcall
 > and various security features of Linux distros.
 > 
 > If you have a "How to reproduce" of libffcall running into trouble
 > (with or without clisp), please report it to libffcall's mailing list:
 > Distro, customizations/settings of the distro, compilation flags, etc.
 > 
 > By "trouble" I mean something more serious than just a line in a log file.
 > 
 > I'm asking because I tried to reproduce something but couldn't.
 > 
 > Bruno
 > 

Here's my procedure:
dowloaded from https://getfedora.org/en/server/download/
Fedora-Server-dvd-x86_64-25-1.3.iso (2GB)
start a virtual machine (using virtual machine manager in linux,
but this shouldn't matter), install above (create user don to
do builds)
login as root at console to find ip addr, then ssh to it as root.

 yum update

[now that I think of it, this probably just makes things less repeatable
it also takes a long time, so probably should have skipped it]

 yum install emacs emacs-el gcc ncurses ncurses-devel ncurses-term
 ncurses-libs readline readline-devel

I think all the ncurses stuff us needed for readline,
gcc needed for building stuff below, 
emacs needed just to live, also good for collecting transcripts

Now I run emacs, start a shell buffer with the intent (frustrated
in part as you see below) of using that buffer as a transcript
for the rest.

I thought I'd save a little time (not clear I did) by scp'ing my
hg directory to the vm.

Interestingly at this point I already see a bunch of AVC denied messages
in /var/log/audit/audit.log

But at least I can see clisp/unix/INSTALL which says to get ligsigsegv from 
http://sourceforge.net/projects/libsigsegv 
but that says it's moved to http://savannah.gnu.org/projects/libsigsegv/
(maybe you should update unix/INSTALL ?)

I use the browser of the host machine to get 
http://ftp.gnu.org/gnu/libsigsegv/libsigsegv-2.11.tar.gz
and scp that to the VM (in /root)

gunzip, tar, cd, ./configure, make, make check, make install all
seem to go smoothly, audit.log shows no additional avc's.

unix install then says https://www.gnu.org/software/libffcall/
and that points me to
 https://haible.de/bruno/gnu/libffcall-1.13-20170225.tar.gz
which I again scp to the vm

Now gunzip,tar, read instructions and do mkdir, cd, ../configure

At this point I see a new AVC in audit.log:

type=AVC msg=audit(1495493082.183:494): avc:  denied  { execheap } for  pid=3540 comm="conftest" scontext=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023 tcontext=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023 tclass=process permissive=0

The end of the configure shows:
  checking for working shared memory... (cached) yes
  checking for sys/sysmacros.h... (cached) yes
  checking whether code in malloc()ed memory is executable... (cached) no
  checking whether mprotect can make malloc()ed memory executable... (cached) no
  checking whether mprotect can make mmap()ed memory executable... (cached) yes
  configure: creating ./config.status
  config.status: creating Makefile
  config.status: creating config.h
  config.status: creating trampoline_r.h
  config.status: executing libtool commands
  [root@localhost builddir]# 

This is probably what you expect.
I now try make - no new AVC.
then make check - still no new AVC -- which surprises me. 
I thought the last time I tried make check it did result in AVC's.
then make install, still no avc

So now I try to build clisp:
su don, cd to hg/clisp, hg pull - hg not yet installed, back out, install,
su don, cd to hg/clisp, hg pull
(1 changeset, 4 changes to 4 files, which I hope fixed swedish problem
that prevented last night's build)

Not sure why, but this seems to be my traditional configure:
./configure CC='gcc -m64' --with-libsigsegv-prefix=/usr/local --disable-maintainer-mode --with-debug --with-module=rawsock build-dir

no new avc's
configure says FFI yes, libsigsegv yes, readline no - so I guess I had
to install something else to get that (any suggestions?)
But this was not meant as a test of readline so I continue with make

It ends up with this - looks like a problem remaining from recent
addition of swedish

gcc -m64 -I/home/don/hg/clisp/src -I/home/don/hg/clisp/build-dir/gllib -I/home/don/hg/clisp/src/gllib -g -O2 -W -Wswitch -Wcomment -Wpointer-arith -Wreturn-type -Wmissing-declarations -Wimplicit -Wno-sign-compare -Wno-format-nonliteral -Wno-shift-negative-value -fwrapv -fno-strict-aliasing -ggdb -O0 -DDEBUG_OS_ERROR -DDEBUG_SPVW -DDEBUG_BYTECODE -DSAFETY=3 -DENABLE_UNICODE -DNO_TERMCAP_NCURSES -DDYNAMIC_FFI -DDYNAMIC_MODULES -I. -I. -c ../src/modules.c
if test -d locale; then rm -rf locale; fi
mkdir locale
(cd po && make && make install datarootdir=.. localedir='$(datarootdir)/locale' INSTALL_DATA='ln') || (rm -rf locale ; exit 1)
make[1]: Entering directory '/home/don/hg/clisp/build-dir/po'
make[1]: *** No rule to make target 'sv.gmo', needed by 'all-yes'.  Stop.
make[1]: Leaving directory '/home/don/hg/clisp/build-dir/po'
Makefile:1382: recipe for target 'locale' failed
make: *** [locale] Error 1
[don@localhost build-dir]$ 

I'll leave this vm running (but idle) in hope of an update that will
allow the build to continue.

Re: Queries

[Bruno H. <br...@cl...>]

Compro Prasad wrote:
> What do the following file naming conventions refer to:
> + spvw*
> + clos*
> + ari*

http://clisp.org/impnotes/src-files.html

> + *.d (why not the default *.c)

http://clisp.org/impnotes/src-file-types.html
After some lightweight preprocessing, it's C code.

> Can you explain the following line. I was too stuck here but couldn't
> understand the syntax from "object" to "=". It would be better if you
> can tell me the fine details of why and how do you estimate it lies in
> that specific location in memory:
> #define S_help_(name)
> (((object){.one_o=((oint)((UBYTE*)((&symbol_tab_data.name))+((oint)(tint)((
> (1UL<<(2)) ))<<48)))}))

It uses the so-called "designated initializer" syntax of C:
  (struct_type){.member=value}
See https://gcc.gnu.org/onlinedocs/gcc/Designated-Inits.html
and ISO C11 section 6.7.9.

This macro S_help_ relies on how the symbol_tab gets initialized (in spvw.d).

Bruno

Re: Queries

[Vladimir T. <vtz...@gm...>]

Compro, please go over implementation notes, there is good introduction to
the internals:
http://www.clisp.org/impnotes/internals.html

And for debugging with gdb:
http://www.clisp.org/impnotes/faq.html#faq-debug


On Mon, May 22, 2017 at 5:57 PM, Compro Prasad <com...@gm...>
wrote:

> What do the following file naming conventions refer to:
> + spvw*

+ clos*
> + ari*
> + *.d (why not the default *.c)

Should I look into gen* or the generated files?
> Can you explain the following line. I was too stuck here but couldn't
> understand the syntax from "object" to "=". It would be better if you
> can tell me the fine details of why and how do you estimate it lies in
> that specific location in memory:
> #define S_help_(name)
> (((object){.one_o=((oint)((UBYTE*)((&symbol_tab_data.name))+
> ((oint)(tint)((
> (1UL<<(2)) ))<<48)))}))
>

http://www.clisp.org/impnotes/faq.html#faq-debug

Re: Makefile error

[Vladimir T. <vtz...@gm...>]

Please do a clean repo checkout and try to build everything as is without
modifying Makefiles or anything else. It should build and pass tests fine.

Something that I use frequently to put the builds from same source into
distinct directories, e.g.:

./configure s
./configure --with-threads=POSIX_THREADS m
./configure --with-threads=POSIX_THREADS --with-debug md
..

And then work inside 's', 'm' or 'md' folders.


On Mon, May 22, 2017 at 5:20 PM, Compro Prasad <com...@gm...>
wrote:

> I updated the source and ran "../configure --without-ffcall
> --without-dynamic-modules --with-threads=POSIX_THREADS --with-debug"
> (and without "--with-debug" too) then removed -O2 from Makefile and
> ran "make" but it had this following error.
> gcc -I/mnt/eb7b593c-d20e-4393-be34-3b108921f50e/home/compro/Drop
> box/programs/hg/clisp/src
> -I/mnt/eb7b593c-d20e-4393-be34-3b108921f50e/home/compro/Drop
> box/programs/hg/clisp/build/gllib
> -I/mnt/eb7b593c-d20e-4393-be34-3b108921f50e/home/compro/Drop
> box/programs/hg/clisp/src/gllib
> -g -W -Wswitch -Wcomment -Wpointer-arith -Wreturn-type
> -Wmissing-declarations -Wimplicit -Wno-sign-compare
> -Wno-format-nonliteral -Wno-shift-negative-value -fwrapv -pthread
> -fno-strict-aliasing -ggdb -O0 -DDEBUG_OS_ERROR -DDEBUG_SPVW
> -DDEBUG_BYTECODE -DSAFETY=3 -DENABLE_UNICODE -DMULTITHREAD
> -DPOSIX_THREADS -I. -I. -c ../src/modules.c
> if test -d locale; then rm -rf locale; fi
> mkdir locale
> (cd po && /usr/bin/make && /usr/bin/make install datarootdir=..
> localedir='$(datarootdir)/locale' INSTALL_DATA='ln') || (rm -rf locale
> ; exit 1)
> make[1]: Entering directory
> '/mnt/eb7b593c-d20e-4393-be34-3b108921f50e/home/compro/Dropb
> ox/programs/hg/clisp/build/po'
> make[1]: *** No rule to make target 'sv.gmo', needed by 'all-yes'.  Stop.
> make[1]: Leaving directory
> '/mnt/eb7b593c-d20e-4393-be34-3b108921f50e/home/compro/Dropb
> ox/programs/hg/clisp/build/po'
> make: *** [Makefile:1374: locale] Error 1
>
> How to not build the locale directory? I think it is not necessary.
>
> > 'hg pull' and check that MT build is good now - tested on osx and
> > linux-amd64. No need for --enable-portability. There was a problem with
> > initialization of special variables bindings.
>

Re: Queries

[Sam S. <sd...@gn...>]

> * Compro Prasad <pbzcebcenfnq@tznvy.pbz> [2017-05-22 20:27:22 +0500]:
>
> What do the following file naming conventions refer to:
> + spvw*

the second line of spvw.d says:

 * (SPVW = Speicherverwaltung): Memory Management for CLISP

> + clos*

the first line of clos.lisp says:

;;;; Common Lisp Object System for CLISP

https://en.wikipedia.org/wiki/Common_Lisp_Object_System

> + ari*

search for NO_ARI_ASM in lispbibl.d:

       Hand-written assembler code for arithmetic, especially multi-precision
       arithmetic:
         NO_ARI_ASM

> + *.d (why not the default *.c)

CLISP pre-processes those into normal C
https://sourceforge.net/p/clisp/mailman/message/35596028/

there are 3 preprocessors:

1. comment5: replaces "# " shell-style comments with /**/ C comments
   --- should be removed

2. varbrace: surrounds "var int foo" declarations with braces.
   --- should be removed

3. gctrigger: instruments "maygc" function so catch GC-safety bugs at
   run time (http://clisp.org/impnotes/gc-safety.html#gc-alloccount)
   --- must be kept!

You can search ML archives
(https://sourceforge.net/p/clisp/mailman/search/?q=preprocessing&sort=posted_date+desc&limit=250)
for more information.

Basically, we need to remove varbrace & comment5 and replace *.d with
*.c and gctrigger should write *.m.c and gcc should compile them to *.o.

http://www.cygwin.com/acronyms/#PTC


-- 
Sam Steingold (http://sds.podval.org/) on darwin Ns 10.3.1504
http://steingoldpsychology.com http://www.childpsy.net
http://iris.org.il http://islamexposedonline.com http://www.dhimmitude.org
Do not tell me what to do and I will not tell you where to go.

Re: Makefile error

[Bruno H. <br...@cl...>]

Compro Prasad wrote:
> make[1]: Entering directory
> '/mnt/eb7b593c-d20e-4393-be34-3b108921f50e/home/compro/Dropbox/programs/hg/clisp/build/po'
> make[1]: *** No rule to make target 'sv.gmo', needed by 'all-yes'.  Stop.

Oops. It was my mistake, when I added the Swedish translation.
It's corrected now. Please "hg pull --update" and retry.

Bruno