Steel Bank Common Lisp

Following Juho Snellman's nicely commented example on
http://paste.lisp.org/display/27891 I tried to write out/mmap in
arrays on both 32 and 64 bit sbcl (both on Linux). It went
smoothly on x86, but on x86_64 I get the following:

(require 'sb-posix)

(defvar *a*)

(defun create-lisp-mem-from-array (array file)
  (declare (optimize (speed 1)))
  (with-open-file (map-file file
                            :direction :output
                            :if-exists :supersede
                            :element-type '(unsigned-byte 64))
    ;; Header
    (write-byte sb-vm::simple-array-unsigned-byte-60-widetag map-file)
    ;; Array size placeholder
    (write-byte 8 map-file)
    (loop for in across array
          with count = 0
          do
          (let ((data (ash in sb-vm::n-fixnum-tag-bits)))
            (incf count)
            (write-byte data map-file))
          finally
          (file-position map-file 1)
          (write-byte (ash count sb-vm:n-fixnum-tag-bits)
                      map-file))))


(defun load-lisp-mem (map-file variable)
  (with-open-file (file map-file)
    (let* ((sap (sb-posix:mmap nil
                               (file-length file)
                               sb-posix:prot-read
                               sb-posix:map-private
                               (sb-impl::fd-stream-fd file)
                               0))
           (addr (logior (sb-sys:sap-int sap)
                         sb-vm:other-pointer-lowtag)))
      (setf (symbol-value variable) (sb-kernel:make-lisp-obj addr))
            (values))))


CL-USER> (create-lisp-mem-from-array #(9 8 7 6) "map")
NIL
CL-USER> (load-lisp-mem "map" '*a*)
; No value
CL-USER> (typep *a* 'array)
NIL

and the value of *a* is garbage.

$ od map 
0000000 000000 000000 000000 133000 000000 000000 000000 020000
0000020 000000 000000 000000 044000 000000 000000 000000 040000
0000040 000000 000000 000000 034000 000000 000000 000000 030000
0000060

(sbcl is 0.9.17 binary downloaded from sf.)

What am I missing?

Andras

This time I'm trying to compile sbcl on an AMD64 machine:

$ uname -a
Linux omnibus 2.6.16.18 #1 SMP PREEMPT Sun May 28 19:34:53 CEST 2006
x86_64 GNU/Linux

with an sbcl binary compiled for x86. 

[building initial core file in "output/cold-sbcl.core":
writing 4096 bytes [1 page] from #<SB!FASL::GSPACE :READ-ONLY>
writing 4096 bytes [1 page] from #<SB!FASL::GSPACE :STATIC>
writing 39096320 bytes [9545 pages] from #<SB!FASL::GSPACE :DYNAMIC>
/(DESCRIPTOR-BITS INITIAL-FUN)=#X10021EE1A9
done]
* //testing for consistency of first and second GENESIS passes
//header files match between first and second GENESIS -- good

real    6m16.077s
user    5m47.670s
sys     0m8.987s
//entering make-target-2.sh
//doing warm init
This is SBCL 0.9.17.10, an implementation of ANSI Common Lisp.
More information about SBCL is available at <http://www.sbcl.org/>.

SBCL is free software, provided as is, with absolutely no warranty.
It is mostly in the public domain; some portions are provided under
BSD-style licenses.  See the CREDITS and COPYING files in the
distribution for more information.
fatal error encountered in SBCL pid 32580(tid 47115703515040):
%PRIMITIVE HALT called; the party is over.

LDB monitor
ldb> back
Backtrace:
   0: Foreign function (null), fp = 0x2ad9fae56e60, ra = 0x410348
   1: Foreign function ldb_monitor, fp = 0x2ad9fae56f70, ra = 0x40ff1e
   2: Foreign function lose, fp = 0x2ad9fae57060, ra = 0x40d0e6
   3: Foreign function (null), fp = 0x2ad9fae570a0, ra = 0x417496
   4: Foreign function (null), fp = 0x2ad9fae57558, ra =
0x2ad9fa78a0e0
   5: (SB!C::TL-XEP SB!IMPL::INFINITE-ERROR-PROTECTOR)
   6: (SB!C::TL-XEP COMMON-LISP::ERROR)
   7: (SB!C::TL-XEP SB!KERNEL::MEMORY-FAULT-ERROR)
   8: Foreign function call_into_lisp, fp = 0x2ad9fae57648, ra =
0x41c873
   9: Foreign function post_signal_tramp, fp = 0x2ad9fae576d0, ra =
0x41c910
  10: (SB!C::TL-XEP SB!KERNEL::VALUES-SPECIFIER-TYPE)
  11: (SB!C::TL-XEP SB!KERNEL::SPECIFIER-TYPE)
  12: (SB!C::TL-XEP SB!KERNEL::%TYPEP)
  13: (SB!C::TL-XEP SB!VM::INTERNAL-ERROR-ARGS)
  14: (SB!C::TL-XEP SB!KERNEL::INTERNAL-ERROR)
  15: Foreign function call_into_lisp, fp = 0x2ad9fae578d0, ra =
0x41c873
  16: Foreign function funcall2, fp = 0x2ad9fae578f0, ra = 0x4177be
  17: Foreign function interrupt_internal_error, fp = 0x2ad9fae57920,
ra = 0x40e354  
  18: Foreign function (null), fp = 0x2ad9fae57db0, ra =
0x2ad9fa78a0e0
  19: (SB!C::TL-XEP SB!KERNEL::SUB-GC)
  20: (SB!C::TL-XEP SB!KERNEL::!COLD-INIT)
  21: Foreign fp = 0x2ad9fae57fc8, ra = 0x10025490b7

ldb>

I also tried 

src/runtime/sbcl --core output/cold-sbcl.core --no-userinit

as Juho suggested last time I had compilation problems, with the
following result:

This is SBCL 0.9.17.10, an implementation of ANSI Common Lisp.
More information about SBCL is available at <http://www.sbcl.org/>.

SBCL is free software, provided as is, with absolutely no warranty.
It is mostly in the public domain; some portions are provided under
BSD-style licenses.  See the CREDITS and COPYING files in the
distribution for more information.
Argh! corrupted error depth, halting
fatal error encountered in SBCL pid 4216(tid 47072223512480):
%PRIMITIVE HALT called; the party is over.

LDB monitor
ldb> back
Backtrace:
   0: Foreign function (null), fp = 0x2acfdb72e460, ra = 0x410348
   1: Foreign function ldb_monitor, fp = 0x2acfdb72e570, ra = 0x40ff1e
   2: Foreign function lose, fp = 0x2acfdb72e660, ra = 0x40d0e6
   3: Foreign function (null), fp = 0x2acfdb72e6a0, ra = 0x417496
   4: Foreign function (null), fp = 0x2acfdb72eb30, ra =
0x2acfdadc70e0
   5: (SB!C::TL-XEP COMMON-LISP::ERROR)
   6: (SB!C::TL-XEP SB!KERNEL::TWO-ARG-+)
   7: (COMMON-LISP::FLET WITHOUT-INTERRUPTS-BODY-79)
   8: (SB!C::TL-XEP SB!KERNEL::SUB-GC)
   9: (SB!C::TL-XEP SB!KERNEL::!COLD-INIT)
  10: Foreign fp = 0x2acfdb72efc8, ra = 0x1002549077
ldb>

Andras

Hello,

I have a file with German "Umlaute".  When I try to load it I get

debugger invoked on a SB-INT:STREAM-DECODING-ERROR in thread
#<THREAD "initial thread" {1002270781}>:
  decoding error on stream
    #<SB-SYS:FD-STREAM for "file
    /home/neuss/Programming/lisp/stundenplan.lisp" {100306FB41}>
      (:EXTERNAL-FORMAT :UTF-8):
          the octet sequence (246 114 115 97) cannot be decoded.

I guess that I have to switch SBCL to ISO-8859-1.  How is this done?
(Is this somewhere in the manual?  I didn't find it.)

Thanks, Nicolas

Hello,
I am trying to compile cl-http in sbcl.
The biggest problem I currently have is that cl-http is full of code like

(defun foo (bar)
     (declare (values bar))
    ...)

Since the declare values seem to be lispm-specific, I added a
(declaim (declaration values)) to the code and in other lisps I have 
no problem (some package lock errors, but this is not blocking).

However in sbcl, even after confirming the package-unlock, code like 
the above will compile with a warning that the type bar is not defined
and at runtime I get a unknown type error.

There are hundreds of (declare (values ..)) in the codebase and I 
cannot change them all.

Any ideas on how to proceed? Shadow-import another values?

salu2

Karsten

PS: attached session with the problem
* (declaim (declaration values))

debugger invoked on a SYMBOL-PACKAGE-LOCKED-ERROR:
   Lock on package COMMON-LISP violated when globally declaring VALUES as a
   declaration proclamation.
See also:
   The SBCL Manual, Node "Package Locks"
   The ANSI Standard, Section 11.1.2.1.2

Type HELP for debugger help, or (SB-EXT:QUIT) to exit from SBCL.

restarts (invokable by number or by possibly-abbreviated name):
   0: [CONTINUE      ] Ignore the package lock.
   1: [IGNORE-ALL    ] Ignore all package locks in the context of 
this operation.

   2: [UNLOCK-PACKAGE] Unlock the package.
   3: [ABORT         ] Exit debugger, returning to top level.

(PACKAGE-LOCK-VIOLATION #<PACKAGE "COMMON-LISP">)
0] 1

* (defun test (n)(declare (values n)) n)
; in: LAMBDA NIL
;     (SB-INT:NAMED-LAMBDA TEST (N) (DECLARE (VALUES N)) (BLOCK TEST N))
; --> FUNCTION THE MULTIPLE-VALUE-BIND LET UNLESS COND IF NOT IF TYPEP
; ==>
;   (SB-KERNEL:%TYPEP #:G3 'N)
;
; caught STYLE-WARNING:
;   undefined type: N

; --> FUNCTION THE MULTIPLE-VALUE-BIND LET UNLESS COND IF NOT IF
; ==>
;   (TYPEP #:G3 'N)
;
; caught STYLE-WARNING:
;   undefined type: N

; ==>
;   #'(SB-INT:NAMED-LAMBDA TEST (N) (DECLARE (VALUES N)) (BLOCK TEST N))
;
; caught STYLE-WARNING:
;   undefined type: N

;
; caught STYLE-WARNING:
;   1 more use of undefined type N
; caught STYLE-WARNING:
;   1 more use of undefined type N

;
; caught STYLE-WARNING:
;   This type is undefined:
;     N
;
; compilation unit finished
;   caught 5 STYLE-WARNING conditions

TEST
* (test 1)

debugger invoked on a SIMPLE-ERROR: unknown type specifier: N

Type HELP for debugger help, or (SB-EXT:QUIT) to exit from SBCL.

restarts (invokable by number or by possibly-abbreviated name):
   0: [ABORT] Exit debugger, returning to top level.

(SB-KERNEL::%%TYPEP 1 #<SB-KERNEL:UNKNOWN-TYPE N>)
0] 0


-- 
No virus found in this outgoing message.
Checked by AVG Free Edition.
Version: 7.1.408 / Virus Database: 268.13.9/490 - Release Date: 20/10/2006

algenib offer
Up On the News - GITH Up (+12.50% with 8X Average Volume) already on Friday's closing-market News Release. narrate.

Get GITH Quote Here. callous.
http://money.cnn.com/quote/quote.html?symb=GITH

Friday's Closing-Market News On GITH binocular.
Oracle, SQL Server and Sybase Can't All Be Wrong.  Staffing companies are the #1 employer in the USA today, and IT staffing with GITH is leading the revolution. boric.

NEW YORK, Oct. 20, 2006 (PRIMEZONE) -- GITH -- A recent report based on a survey of fourteen hundred Chief Information Officers predicts steady growth in Q4 for technology IT hiring. Thirty-four percent of CIOs surveyed plan to add IT staff and none anticipated cutbacks in personnel. debility.

GITH sources personnel for companies and offers custom software solutions related to Oracle, SQL Server and Sybase and software such as SAP, JD Edwards, and PeopleSoft. The report done on behalf of Robert Half Technology specifically mentions that 71% of CIOs anticipated needing personnel having skill sets related to Oracle, SQL Server, and DB2. frantic.

Read the entire news release from Friday Closing-Market nj.
http://biz.yahoo.com/pz/061020/107201.html

GITH has been releasing steady news worldwide, from Yahoo Finance & Bloomberg to MSN & CNN Money, even the NASDAQ. Exposure for GITH is expansive.  The increased frequency of news leads us to believe that something big is coming for GITH. debauch.

Oct. 17, 2006 (PRIMEZONE) -- Executive Job Market Report Forecasting 'War For Talent' Bolsters Comments by GITH President… apology.
http://news.moneycentral.msn.com/ticker/article.asp?Symbol=US:GITH&Feed=PZ&Date=20061017&ID=6111313

Oct. 14, 2006 (PRIMEZONE) -- GITH  Foresees Growth in Fourth Quarter... posts increase in sales revenue... chadwick.
http://www.bloomberg.com/apps/news?pid=conewsstory&refer=conews&tkr=GITH:US&sid=aMMgvBh5UWMA

Sept. 25, 2006 (PRIMEZONE) -- Market forces combining over the next few years to drive up demand for a decreasing supply of specialized IT personnel.  GITH is leading the 21st Century revolution... plaque.
http://www.nasdaq.com/aspxcontent/NewsStory.aspx?cpath=20060925\ACQPMZ200609251523PRIMZONEFULLFEED105738.htm&symbol=gith&symbol=&symbol=&symbol=&symbol=&symbol=&symbol=&symbol=&symbol=&symbol=&selected=GITH&selecteddisplaysymbol=GITH&coname=GLOBAL%20IT&lo

mournful an tenth

Hi,

I am having a strange problem with using random states and the format
function. 

Basically what I want to do is to be able to regenerate twice the same
data by using a random state.

When using format with the control-string "~10e", it doesn't work,
although it works as expected if I use "~a" as control-string.

I reproduced a minimal example below:


* (let ((snapshot-state (make-random-state *random-state*)))
  (list (with-output-to-string (out)
          (loop for i to 3 do (format out "~10e "(random 1000))))
        (let ((*random-state* (make-random-state snapshot-state)))
          (with-output-to-string (out)
            (loop for i to 3 do (format out "~10e "(random 1000)))))))

("   2.61e+2    8.66e+2     9.2e+2    2.89e+2 "
 "   2.61e+2     6.2e+1    8.66e+2     9.2e+2 ")

* (let ((snapshot-state (make-random-state *random-state*)))
  (list (with-output-to-string (out)
          (loop for i to 3 do (format out "~a "(random 1000))))
        (let ((*random-state* (make-random-state snapshot-state)))
          (with-output-to-string (out)
            (loop for i to 3 do (format out "~a "(random 1000)))))))

("120 754 703 353 " "120 754 703 353 ")
*


Oh, and my version of SBCL is 0.9.8 on Linux X86.

Thanks,

Evan

This turned out to be a problem with our hack for implementing a "setenv" function 
and nothing fundamental with sbcl. The problem occurred when an environment 
variable was not set and the getenv of it returned NIL and then this was later 
called as an argument to setenv which was expecting a string. Most of our scripts 
and environments set this environment variable, so that is why it was only a 
problem in particular cases.

Sorry for the false alarm.

Stephen Westfold

Stephen Westfold wrote:
> Nikodemus Siivola wrote:
> 
>>Stephen Westfold <westfold@...> writes:
>>
>>  
>>
>>>I am trying to get my (large) application running on different platforms 
>>>with SBCL. It is working very well on Linux and is looking close on 
>>>Windows (!), but although it works on Mac OS X if I don't save a core 
>>>image, I get a GC invariant lost error soon after restarting a saved 
>>>core image. The transcript is below. Is there any other information that 
>>>would be useful in tracking this down?
>>>
>>>Stephen Westfold
>>>
>>>
>>>This is SBCL 0.9.16, an implementation of ANSI Common Lisp.
>>>More information about SBCL is available at <http://www.sbcl.org/>.
>>>
>>>SBCL is free software, provided as is, with absolutely no warranty.
>>>It is mostly in the public domain; some portions are provided under
>>>BSD-style licenses.  See the CREDITS and COPYING files in the
>>>distribution for more information.
>>>
>>>...
>>>;;;  <Initialization print-out from my application>
>>>...
>>>
>>>fatal error encountered in SBCL pid 18163:
>>>GC invariant lost, file "gc-common.c", line 137
>>>
>>>LDB monitor
>>>ldb>
>>>    
>>
>>Does purify affect this?
>>
>>  (save-lisp-and-die "pure.core" :purify t)
>>  (save-lisp-and-die "impure.core" :purify nil)
>>
>>That is, do both cores hit the GC invariant?
>>
>>If they do, what does
>>
>>  (save-lisp-end-die "test.core" :toplevel (lambda () (gc :full t) (your-toplevel)))
>>
>>do? 
>>
>>The LDB backtrace (hit "b") would not hurt either, but I'm not optimistic in
>>its ability solve this. 
>>
>>If you cannot send us the source (or even send it to eg. me
>>confidentially), then your best bet may be doing a binary section:
>>take an older released SBCL, eg. 0.9.0, and try with it, then
>>(assuming it works) with 0.9.8, and so forth, till you narrow it down
>>to a single release where the failure appears, and finally
>>(optionally) continuing to narrow it down into a single commit causing
>>the failure. ...but just knowing if that this used to work with 0.9.X
>>and stopped working with 0.9.X+1 would be quite helpfull.
>>
>>Cheers,
>>
>>  -- Nikodemus              Schemer: "Buddha is small, clean, and serious."
>>                   Lispnik: "Buddha is big, has hairy armpits, and laughs."
>>
>>  
> 
> Thanks for the suggestions.
> Purify has no effect, neither does inserting a full gc. When I type b to 
> LDB it says
> Backtrace:
> fatal error encountered in SBCL pid 26773:
> GC invariant lost, file "gencgc.c", line 652
> 
> I removed our automatic initialization on start-up, so I can interact 
> with the system. Everything works fine until I call the initialization 
> routine. I have narrowed it down to an individual function where the 
> error occurs, and I am currently trying to narrow it down further.
> 
> I forgot to mention in my initial report that this is not a new problem. 
> In fact I have never got it working. I am not sure which versions I have 
> tried it on, but several in the last six months, although only recently 
> was I motivated to push it. Do you think it is worth my while trying to 
> find a version where it worked, or continue narrowing down where the 
> error occurs. Sending you the source may be possible, although it would 
> require some effort to extract the relevant files.
> 
> Cheers,
> stephen
> 
> 
> -------------------------------------------------------------------------
> Using Tomcat but need to do more? Need to support web services, security?
> Get stuff done quickly with pre-integrated technology to make your job easier
> Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
> _______________________________________________
> Sbcl-help mailing list
> Sbcl-help@...
> https://lists.sourceforge.net/lists/listinfo/sbcl-help

Hi,

VkAGRA for LESS http://www.catasideen.com

=20
identities. All I want to know is their musical abilities, and will
destroying nature.

Yaroslav Kavenchuk <kavenchuk@...> writes:

> sbcl 0.9.17.10
>
> build log:
>
> gcc -g -Wall -O3 -mno-cygwin -I.  -c -o x86-assem.o x86-assem.S
> x86-assem.S:1089:9: warning: no newline at end of file
> x86-assem.S: Assembler messages:
> x86-assem.S:368: Warning: .type pseudo-op used outside of .def/.endef 
> ignored.
[...]

Looks like you've got newline issues. Make sure the file and your
newline settings in cygwin match up.


-- 
Rahul Jain
rjain@...
Professional Software Developer, Amateur Quantum Mechanicist

I added a Windows installer to the 0.9.17 release files:

 http://prdownloads.sourceforge.net/sbcl/sbcl-0.9.17-x86-windows-binary.msi?download

Built using the make-windows-installer.sh, except I removed the Program Menu
shortcut from the installer, as it needs to be manually tweaked in order to
work: 

 If you make shortcuts to the 0.9.17 binary and core, you need to manually
 disable the "Advanced Text Services" for the shortcut from the properties /
 compatibility tab.

Cheers,

  -- Nikodemus              Schemer: "Buddha is small, clean, and serious."
                   Lispnik: "Buddha is big, has hairy armpits, and laughs."

Juho Snellman <jsnell@...> writes:

> Andras Simon <asimon@...> writes:
> > (Meanwhile, I've downloaded the 0.9.17 binary from sf and it seems to
> > run fine. Should I try to compile sbcl with it?)
> 
> I wouldn't expect that to make any difference. But can you run the

Compiling with sbcl worked, so I thought it did make a difference. 
But then...

> following tests, and report which ones work?
> 
>   src/runtime/sbcl --core output/cold-sbcl.core --no-userinit
> 
>   (defun sb!impl::profile-deinit ())
>   (save-lisp-and-die "foo.core")
> 
> And:
> 
>   src/runtime/sbcl --core foo.core --no-userinit
> 
> And:
> 
>   src/runtime/sbcl --core output/sbcl.core --no-userinit

...I recompiled with cmucl to be able to run these tests, and this
time it went without a hitch. (I didn't update the sources in the
meantime.) I'll try it again, and will run the tests if there is a
problem. 

Andras