scriptonite-dev

[Scriptonite-dev] Scriptonite project deletion

[Etienne G. <eti...@uq...>]

Hi!

I am planning to let SourceForge remove this project, as I do not plan
to get back to work on it before a while (maybe a year or so). I am devoting
my energy on improving SableCC in areas that will eventually simplify much
the implementation of a full-fledged ecmascript interpreter using SableCC.

When it eventually comes to it, we could host the scriptonite project as
a subproject of SableCC, instead of hosting it independently.

Are there any objections?

Etienne

-- 
Etienne M. Gagnon, Ph.D.             http://www.info.uqam.ca/~egagnon/
SableVM:                                       http://www.sablevm.org/
SableCC:                                       http://www.sablecc.org/

[Scriptonite-dev] Collaboration with Mozilla.

[Raif S. N. <ra...@fl...>]

Clayton and Norris,

First of all, sorry for the delay in getting back to you. I was hoping to 
get some feedback from the team, alas everybody seems to be very busy.

We are flattered to receive your offer of collaboration with you in the 
Mozilla project, but there are few points that i would like to clarify:

1. Scriptonite.org is incepted with the goal of "providing a grammar and 
interpreter for the ECMAScript language written in java using SableCC. " 
SableCC is an open-source (GNU LGPL), full java implementation of a 
Compiler Compiler recognising LALR(1) grammars. It offers the following 2 
main advantages:

         (a) Automatic generation of strictly-typed abstract syntax trees, and
         (b) Automatic generation of tree-walker classes.

(More can be found about SableCC at its home page: 
<http://www.sable.mcgill.ca/sablecc/>).

The implication of using SableCC, compared to for example JavaCC (which i 
have used), is best described as a clean, easy-to-use and easy-to-maintain 
source code base of java classes generated from an input grammar. I.e. once 
the grammar is stable, the programmer can work with the generated AST 
classes without needing to embed within the grammar input file any semantic 
actions or code. The result is a better separation between the grammar and 
the semantic actions.

2. My personal reason for joining the scriptonite.org team is to learn how 
to use SableCC. I am planning on using SableCC. instead of JavaCC in 
another project that I am managing, which is an (open-source project too) 
ASN.1 Developers' Kit at Cryptix (see: 
<http://www.cryptix.org/products/asn1/index.html>).

The fact that the author of SableCC, Mr. Etienne Gagnon, is actively 
participating in the Scriptonite team, makes achieving this personal goal 
both easy and pleasurable.


Given the above, i think a way of collaboration would be for 
scriptonite.org to provide Mozilla with, at least, the ECMAScript grammar 
and the supporting lexer, parser and AST walker classes. You may of course 
have some other ideas. In such case, we would be happy to hear them.


Look forward to hearing from you soon + cheers;
rsn

Cc: scriptonite.org developers.

PS. You mentioned in your letter that you are working on versions beyond 3; 
eg. 4 and 5. Are there documents about the features of such versions? If 
yes, how can one have access to them?  TIA.



>>X-From_: cl...@ne... Thu Apr  6 04:37:09 2000
>>Delivered-To: ra...@fl...
>>Date: Wed, 05 Apr 2000 11:35:57 -0700
>>From: cl...@ne... (Clayton Lewis)
>>Organization: Netscape Communications Corporation
>>X-Mailer: Mozilla 4.72 [en] (WinNT; U)
>>X-Accept-Language: en
>>To: ra...@fl...
>>Cc: no...@ne...
>>Subject: Re: FW: For information (Seeking permission to include ECM-262.pdf
>>  insoftware distributions)
>>
>>Raif,
>>
>>I'm happy to hear that JavaScript is getting another implementation 
>>team.  Until just last week I was the manager of Netscape's JavaScript 
>>team, am now doing a different job here at Netscape.  But that's a 
>>different story.  Did you guys know that the Mozilla open sources contain 
>>two Edition 3 conforming engines?  One written in Java and the other in 
>>C.  They're governed by Mozilla Public License or under GPL, both are 
>>dual licensed.
>>
>>The team here, together with contributions throughout the Mozilla 
>>community is working on JavaScript 2.0 which will conform to the next 
>>ECMA Edition (4) and we're working well beyond that, foreseeing Edition 5 
>>as well.  Again, all in open source.  If our work aligns with your plans 
>>and needs we would love to work together with you in Mozilla.
>>
>>I'm cc'ing Norris Boyd who is now managing the JavaScript team 
>>here.  Norris is very technically inclined and an excellent manager.  You 
>>might want to discuss cooperation with him directly (though he's on 
>>vacation until Monday of next week.)
>>
>>Best,
>>= Clayton =

[Scriptonite-dev] UTF-16 is supported under jdk 1.3

[Raif S. N. <ra...@fl...>]

i just had a look at the rt.jar included in jdk1.3rc2 and noticed the 
following classes:

sun.io.ByteToCharUTF16.class
sun.io.ByteToCharUTF8.class
sun.io.CharToByteUTF16.class
sun.io.CharToByteUTF8.class

furthermore, the similarpage i pointed to earlier (in the jdk 1.2.2 
documentation), in jdk 1.3 
(<file:///C|/jdk1.3/docs/guide/intl/encoding.doc.html>) now lists UTF-16 as 
an encoding handled by the Java platform.


i guess now my previous question is now answered, provided:

a. the lexer class can be made to specifically use the utf-16 encoding 
(canonical name "UTF-16"), and
b. java jdk 1.3 is used.


does this make sense?


cheers;
rsn

[Scriptonite-dev] ECMAScript-related UNICODE article

[Raif S. N. <ra...@fl...>]

FYI,

<http://www-4.ibm.com/software/developer/library/internationalization-support.html>


cheers;
rsn

[Scriptonite-dev] a good article about utf encodings

[Raif S. N. <ra...@fl...>]

FYI,

<http://www-4.ibm.com/software/developer/library/utfencodingforms/index.html>

cheers;
rsn

[Scriptonite-dev] Collaboration with Mozilla.

[Raif S. N. <ra...@fl...>]

At 07:22 AM 4/6/00 +1000, i wrote:

>hi guys,
>
>just received this email!
>
>what do you think?


here is what i think about this offer; it's phrased as a proposed reply to 
the author.  if i don't hear from anyone by 18:00 OZ time i will send it as is:

Clayton and Norris,

We are flattered to receive your offer of collaboration with you in the 
Mozilla project, but there are few points that i would like to clarify:

1. Scriptonite.org is incepted with the goal of "providing a grammar and 
interpreter for the ECMAScript language written in java using SableCC. " 
SableCC is an open-source (GNU LGPL), full java implementation of a 
Compiler Compiler recognising LALR(1) grammars. It offers the following 2 
main advantages:

         (a) Automatic generation of strictly-typed abstract syntax trees, and
         (b) Automatic generation of tree-walker classes.

(More can be found about SableCC at its home page: 
<http://www.sable.mcgill.ca/sablecc/>).

The implication of using SableCC, compared to for example JavaCC (which i 
have used), is best described as a clean, easy-to-use and easy-to-maintain 
source code base of java classes generated from an input grammar. I.e. once 
the grammar is stable, the programmer can work with the generated AST 
classes without needing to embed within the grammar input file any semantic 
actions or code. The result is a better separation between the grammar and 
the semantic actions.

2. My personal reason for joining the scriptonite.org team is to learn how 
to use SableCC. I am planning on using SableCC. instead of JavaCC in 
another project that I am managing, which is an (open-source project too) 
ASN.1 Developers' Kit at Cryptix (see: 
<http://www.cryptix.org/products/asn1/index.html>).

The fact that the author of SableCC, Mr. Etienne Gagnon, is actively 
participating in the Scriptonite team, makes achieving this personal goal 
both easy and pleasurable.


Given the above, i think a way of collaboration would be for 
scriptonite.org to provide Mozilla with, at least, the ECMAScript grammar 
and the supporting lexer, parser and AST walker classes.


Look forward to hearing from you soon + cheers;
rsn

Cc:     Norris Boyd - Netscape,
         scriptonite.org developers.



>cheers;
>rsn
>
>
>>X-From_: cl...@ne... Thu Apr  6 04:37:09 2000
>>Delivered-To: ra...@fl...
>>Date: Wed, 05 Apr 2000 11:35:57 -0700
>>From: cl...@ne... (Clayton Lewis)
>>Organization: Netscape Communications Corporation
>>X-Mailer: Mozilla 4.72 [en] (WinNT; U)
>>X-Accept-Language: en
>>To: ra...@fl...
>>Cc: no...@ne...
>>Subject: Re: FW: For information (Seeking permission to include ECM-262.pdf
>>  insoftware distributions)
>>
>>Raif,
>>
>>I'm happy to hear that JavaScript is getting another implementation 
>>team.  Until just last week I was the manager of Netscape's JavaScript 
>>team, am now doing a different job here at Netscape.  But that's a 
>>different story.  Did you guys know that the Mozilla open sources contain 
>>two Edition 3 conforming engines?  One written in Java and the other in 
>>C.  They're governed by Mozilla Public License or under GPL, both are 
>>dual licensed.
>>
>>The team here, together with contributions throughout the Mozilla 
>>community is working on JavaScript 2.0 which will conform to the next 
>>ECMA Edition (4) and we're working well beyond that, foreseeing Edition 5 
>>as well.  Again, all in open source.  If our work aligns with your plans 
>>and needs we would love to work together with you in Mozilla.
>>
>>I'm cc'ing Norris Boyd who is now managing the JavaScript team 
>>here.  Norris is very technically inclined and an excellent manager.  You 
>>might want to discuss cooperation with him directly (though he's on 
>>vacation until Monday of next week.)
>>
>>Best,
>>= Clayton =

[Scriptonite-dev] new update to the cvs.

[Raif S. N. <ra...@fl...>]

hi guys,

just in case you haven't checked your scriptonite cvs lately, i updated the 
grammar and added few files including a customised lexer to handle the 
special cases of (a) keywords that should not be followed by blanks with 
line-terminators (ie. continue, return break, and throw) and (b) blanks 
with[out] line-terminators before the increment and decrement operators.

there is still the case of (line 266) '0' // TODO: [lookahead not a 
DecimalDigit] in escape-sequence, but i will not do that before getting 
some feedback about what has already been committed to the cvs.


cheers;
rsn

[Scriptonite-dev] Fwd: Re: FW: For information (Seeking permission to include ECM-262.pdf insoftware distributions)

[Raif S. N. <ra...@fl...>]

hi guys,

just received this email!

what do you think?


cheers;
rsn


>X-From_: cl...@ne... Thu Apr  6 04:37:09 2000
>Delivered-To: ra...@fl...
>Date: Wed, 05 Apr 2000 11:35:57 -0700
>From: cl...@ne... (Clayton Lewis)
>Organization: Netscape Communications Corporation
>X-Mailer: Mozilla 4.72 [en] (WinNT; U)
>X-Accept-Language: en
>To: ra...@fl...
>Cc: no...@ne...
>Subject: Re: FW: For information (Seeking permission to include ECM-262.pdf
>  insoftware distributions)
>
>Raif,
>
>I'm happy to hear that JavaScript is getting another implementation=20
>team.  Until just last week I was the manager of Netscape's JavaScript=20
>team, am now doing a different job here at Netscape.  But that's a=20
>different story.  Did you guys know that the Mozilla open sources contain=
=20
>two Edition 3 conforming engines?  One written in Java and the other in=20
>C.  They're governed by Mozilla Public License or under GPL, both are dual=
=20
>licensed.
>
>The team here, together with contributions throughout the Mozilla=20
>community is working on JavaScript 2.0 which will conform to the next ECMA=
=20
>Edition (4) and we're working well beyond that, foreseeing Edition 5 as=20
>well.  Again, all in open source.  If our work aligns with your plans and=
=20
>needs we would love to work together with you in Mozilla.
>
>I'm cc'ing Norris Boyd who is now managing the JavaScript team=20
>here.  Norris is very technically inclined and an excellent manager.  You=
=20
>might want to discuss cooperation with him directly (though he's on=20
>vacation until Monday of next week.)
>
>Best,
>=3D Clayton =3D
>
>
>Michele Bonvin wrote:
>
> > > ----------
> > > From:         van den Beld Jan
> > > Sent:         mercredi, 5. avril 2000 01:07
> > > To:   Michele Bonvin
> > > Subject:      RE: Seeking permission to include ECM-262.pdf in=
 software
> > > distributions
> > >
> > >
> > > Dear Mr. Naffah,
> > > Indeed, it is perfectly acceptable to include ECMA-262 in your=
 software
> > > distribution, the standard being completely free of charge and free of
> > > copyright. We appreciate the efforts by the Scriptonite Team to=
 promote
> > > the use of ECMA-262.
> > > We recommend you to check whether you are using the latest version of=
 the
> > > Standard: the fourth edition may be published at the end of the year=
=20
> 2000.
> > > Approvals of new (editions of) ECMA Standards take place at the end=20
> of the
> > > months June and December.
> > > We wish you success in your efforts.
> > > Yours faithfully.
> > >     Jan van den Beld
> > > Jan W. van den Beld   ---   ECMA Secretary General
> > > Email:         ja...@ec...        URL:        http://www.ecma.ch
> > > Tel./Fax:    + 41 22 849 6012 / 6001  ---   Mobile:   +41 79 203 5256
> > > 114, Rue du Rh=F4ne   ---   CH-1204 GENEVA    ---   Switzerland
> > > ECMA -  An  International  Europe-based  Industry  Association  for
> > >              Standardizing  Information  and  Communication  Systems
> > >
> > >
> > >
> > >
> > >
> > > ----------
> > > From:         Raif S. Naffah[SMTP:ra...@fl...]
> > > Sent:         dimanche, 2. avril 2000 08:53
> > > To:   Michele Bonvin
> > > Cc:   scriptonite-dev
> > > Subject:      Seeking permission to include ECM-262.pdf in software
> > > distributions
> > >
> > > Ladies/Gentlemen,
> > >
> > > I am writing to you on behalf of the "scriptonite" team to seek=20
> permission
> > >
> > > to include the ECMA-262 (PDF version) in our software distributions.
> > >
> > > The Scriptonite team is an international volunteer effort, by=
 programmers
> > > across the Internet, to provide an open-source, freely available and
> > > faithful implementation of the ECMAScript language as documented in=
 the
> > > ECMA-262, 3rd edition standard. The team is new, and has recently
> > > registered the "scriptonite.org" domain (<www.scriptonite.org">) to=
 allow
> > > interested persons and entities, the follow-up on the team's=
 programming
> > > activities with regard to achieving its objective.
> > >
> > > If such permission is required and yourselves cannot give it, I would
> > > appreciate it if you can direct us to the appropriate authority,=
 within
> > > ECMA, which can issue such permission.
> > >
> > > In the meantime, I am at your disposal for any additional information=
 you
> > > may require.
> > >
> > > Sincerely,
> > > Raif S. Naffah - INSA (Lyon) eng.
> > >
> > >
> > > Cc: The Scriptonite developers group
> > > <scr...@li...>
> > >
> > >
> > >
>

[Scriptonite-dev] RE: Seeking permission to include ECM-262.pdf in software distrib utions

[Raif S. N. <ra...@fl...>]

(to the attention of Mr. Jan W. van den Beld   ---   ECMA Secretary General)

Dear Mr. van den Beld,

Thank you for your prompt reply and your positive response.

With regard to the 4th Edition of the Standard, it will depend on how 
advanced we are, in our development effort, when that document is made public.

Thanks again for your kind words.


Sincerely,
Raif S. Naffah - INSA (Lyon) eng.


At 09:27 AM 4/5/00 +0200, Michele Bonvin wrote:

>Dear Mr. Naffah,
>Indeed, it is perfectly acceptable to include ECMA-262 in your software
>distribution, the standard being completely free of charge and free of
>copyright. We appreciate the efforts by the Scriptonite Team to promote the
>use of ECMA-262.
>We recommend you to check whether you are using the latest version of the
>Standard: the fourth edition may be published at the end of the year 2000.
>Approvals of new (editions of) ECMA Standards take place at the end of the
>months June and December.
>We wish you success in your efforts.
>Yours faithfully.
>     Jan van den Beld
>Jan W. van den Beld   ---   ECMA Secretary General
>Email:         ja...@ec...        URL:        http://www.ecma.ch
>Tel./Fax:    + 41 22 849 6012 / 6001  ---   Mobile:   +41 79 203 5256
>114, Rue du Rhône   ---   CH-1204 GENEVA    ---   Switzerland
>ECMA -  An  International  Europe-based  Industry  Association  for
>              Standardizing  Information  and  Communication  Systems
>
>
> > ----------
> > From:         Raif S. Naffah[SMTP:ra...@fl...]
> > Sent:         dimanche, 2. avril 2000 08:53
> > To:   Michele Bonvin
> > Cc:   scriptonite-dev
> > Subject:      Seeking permission to include ECM-262.pdf in software
> > distributions
> >
> > Ladies/Gentlemen,
> >
> > I am writing to you on behalf of the "scriptonite" team to seek permission
> >
> > to include the ECMA-262 (PDF version) in our software distributions.
> >
> > The Scriptonite team is an international volunteer effort, by programmers
> > across the Internet, to provide an open-source, freely available and
> > faithful implementation of the ECMAScript language as documented in the
> > ECMA-262, 3rd edition standard. The team is new, and has recently
> > registered the "scriptonite.org" domain (<www.scriptonite.org">) to allow
> > interested persons and entities, the follow-up on the team's programming
> > activities with regard to achieving its objective.
> >
> > If such permission is required and yourselves cannot give it, I would
> > appreciate it if you can direct us to the appropriate authority, within
> > ECMA, which can issue such permission.
> >
> > In the meantime, I am at your disposal for any additional information you
> > may require.
> >
> > Sincerely,
> > Raif S. Naffah - INSA (Lyon) eng.
> >
> >
> > Cc: The Scriptonite developers group
> > <scr...@li...>
> >

[Scriptonite-dev] Fwd: RE: Seeking permission to include ECM-262.pdf in software distrib utions

[Raif S. N. <ra...@fl...>]

FYI,

cheers;
rsn


>X-From_: mi...@ec... Wed Apr  5 17:28:23 2000
>Delivered-To: ra...@fl...
>From: Michele Bonvin <mi...@ec...>
>To: "'Raif S. Naffah'" <ra...@fl...>
>Subject: RE: Seeking permission to include ECM-262.pdf in software distrib
>         utions
>Date: Wed, 5 Apr 2000 09:27:28 +0200
>X-Mailer: Internet Mail Service (5.5.2232.9)
>
>
>Dear Mr. Naffah,
>Indeed, it is perfectly acceptable to include ECMA-262 in your software
>distribution, the standard being completely free of charge and free of
>copyright. We appreciate the efforts by the Scriptonite Team to promote the
>use of ECMA-262.
>We recommend you to check whether you are using the latest version of the
>Standard: the fourth edition may be published at the end of the year 2000.
>Approvals of new (editions of) ECMA Standards take place at the end of the
>months June and December.
>We wish you success in your efforts.
>Yours faithfully.
>     Jan van den Beld
>Jan W. van den Beld   ---   ECMA Secretary General
>Email:         ja...@ec...        URL:        http://www.ecma.ch
>Tel./Fax:    + 41 22 849 6012 / 6001  ---   Mobile:   +41 79 203 5256
>114, Rue du Rhône   ---   CH-1204 GENEVA    ---   Switzerland
>ECMA -  An  International  Europe-based  Industry  Association  for
>              Standardizing  Information  and  Communication  Systems
>
>
> > ----------
> > From:         Raif S. Naffah[SMTP:ra...@fl...]
> > Sent:         dimanche, 2. avril 2000 08:53
> > To:   Michele Bonvin
> > Cc:   scriptonite-dev
> > Subject:      Seeking permission to include ECM-262.pdf in software
> > distributions
> >
> > Ladies/Gentlemen,
> >
> > I am writing to you on behalf of the "scriptonite" team to seek permission
> >
> > to include the ECMA-262 (PDF version) in our software distributions.
> >
> > The Scriptonite team is an international volunteer effort, by programmers
> > across the Internet, to provide an open-source, freely available and
> > faithful implementation of the ECMAScript language as documented in the
> > ECMA-262, 3rd edition standard. The team is new, and has recently
> > registered the "scriptonite.org" domain (<www.scriptonite.org">) to allow
> > interested persons and entities, the follow-up on the team's programming
> > activities with regard to achieving its objective.
> >
> > If such permission is required and yourselves cannot give it, I would
> > appreciate it if you can direct us to the appropriate authority, within
> > ECMA, which can issue such permission.
> >
> > In the meantime, I am at your disposal for any additional information you
> > may require.
> >
> > Sincerely,
> > Raif S. Naffah - INSA (Lyon) eng.
> >
> >
> > Cc: The Scriptonite developers group
> > <scr...@li...>
> >

[Scriptonite-dev] Seeking permission to include ECM-262.pdf in software distributions

[Raif S. N. <ra...@fl...>]

Ladies/Gentlemen,

I am writing to you on behalf of the "scriptonite" team to seek permission 
to include the ECMA-262 (PDF version) in our software distributions.

The Scriptonite team is an international volunteer effort, by programmers 
across the Internet, to provide an open-source, freely available and 
faithful implementation of the ECMAScript language as documented in the 
ECMA-262, 3rd edition standard. The team is new, and has recently 
registered the "scriptonite.org" domain (<www.scriptonite.org">) to allow 
interested persons and entities, the follow-up on the team's programming 
activities with regard to achieving its objective.

If such permission is required and yourselves cannot give it, I would 
appreciate it if you can direct us to the appropriate authority, within 
ECMA, which can issue such permission.

In the meantime, I am at your disposal for any additional information you 
may require.

Sincerely,
Raif S. Naffah - INSA (Lyon) eng.


Cc: The Scriptonite developers group <scr...@li...>

Re: [Scriptonite-dev] adding binary files

[Raif S. N. <ra...@fl...>]

At 11:10 PM 4/1/00 -0500, Etienne M. Gagnon wrote:
>Hi guys...
>
>Just a question...  Do we have the right to redistribute the
>specification document?  This document is Copyright ECMA. ...

 From their site (<http://www.ecma.ch/>):

"This web site presents all aspects of ECMA and makes available the results 
of the ECMA standardization work to all interested persons and
    organizations, free of charge and copyright."


>  ...They have the
>right to distribute it on their web page, but this does not give us the
>right to do so.  We need a license for this...

..but you're absolutely right. there's no explicit permission to bundle the 
(any) document. to solve this question, i took the liberty of explicitly 
seeking their permission about this matter. see next message.


cheers;
rsn


>"Raif S. Naffah" wrote:
> > a. is it a good idea to add a copy of the standard we're working towards
> > implementing into the project and its distribution(s)?
> > b. if yes how much trouble would that cause the group members?
>
>--
>----------------------------------------------------------------------
>Etienne M. Gagnon, M.Sc.                     e-mail: eg...@j-...
>Author of SableCC:                 http://www.sable.mcgill.ca/sablecc/
>----------------------------------------------------------------------
>
>_______________________________________________
>Scriptonite-dev mailing list
>Scr...@li...
>http://lists.sourceforge.net/mailman/listinfo/scriptonite-dev

Re: [Scriptonite-dev] adding binary files

[Etienne M. G. <eg...@j-...>]

Hi guys...

Just a question...  Do we have the right to redistribute the
specification document?  This document is Copyright ECMA.  They have the
right to distribute it on their web page, but this does not give us the
right to do so.  We need a license for this.  I did not search their
site, so I do not know if we do have the right to redistribute or not. 
It might be a good idea to check this.

Etienne

"Raif S. Naffah" wrote:
> a. is it a good idea to add a copy of the standard we're working towards
> implementing into the project and its distribution(s)?
> b. if yes how much trouble would that cause the group members?

-- 
----------------------------------------------------------------------
Etienne M. Gagnon, M.Sc.                     e-mail: eg...@j-...
Author of SableCC:                 http://www.sable.mcgill.ca/sablecc/
----------------------------------------------------------------------

[Scriptonite-dev] adding binary files

[Raif S. N. <ra...@fl...>]

hi guys,

i'd like to add the ECMA-262 pdf file into the project (under its own 
directory: /docs/). but to do that it has to be added as a binary file, 
which, Etienne in an earlier message to the group (dated 26 feb) warned 
against.

a. is it a good idea to add a copy of the standard we're working towards 
implementing into the project and its distribution(s)?
b. if yes how much trouble would that cause the group members?


cheers;
rsn

[Scriptonite-dev] new version of ecmascript.grammar

[Raif S. N. <ra...@fl...>]

hi guys,

i just checked in (finally!!!) the above.

beware, it takes a very long time to compile (most probably because there's 
an error which i cannot see). i'd appreciate it if Etienne, or a 
grmmar/SableCC expert can look into it and set me on the right track.


have a nice weekend guys + cheers;
rsn

ps. thanks to Etienned for his help re. access to the CVS.

Re: [Scriptonite-dev] CVS access rights

[Etienne M. G. <eg...@j-...>]

Apparently, one of the easiest way to go around the WinXX cvs/ssh
problems is to cheat;-)

You use ssh to login into your shell1.sourceforge.net.

There, you simply checkout using cvs/ssh (as described in the UNIX
documentation).  You must only be careful using @cvs1  instead of
cvs.scriptonite.sourcefoge.net as you are inside their firewall.  

Here's a sample session (from my own Linux station).

$ ssh -P -l egagnon shell1.sourceforge.net

********************************************************************
*  Welcome to SourceForge Shell Services (orbital.sourceforge.net) *
********************************************************************
Project Websites are located in /home/groups and can be seen
by visiting http://<project name>.sourceforge.net

Project FTP Sites are located in /home/groups/ftp/pub/<project name>
and can be seen by visiting ftp://<project name>.sourceforge.net/pub

/home/users   : User Based Quota 2MB Soft 4MB Hard
/home/groups  : Group Based Quota 100MB Soft 125MB Hard
********************************************************************
PLEASE READ THIS:
        Move to the new webserver failed, bad SCSI disk.  I will
        replace the disk ASAP and get the move underway.  We'll
        shoot for another move Monday.

        The directories in /home/groups will be changing to all
        lowercase.  This will happen with the move to the new
        server. Please be ready to update your scripts.
********************************************************************
No mail.
[egagnon@orbital egagnon]$ export CVS_RSH=ssh
[egagnon@orbital egagnon]$ cvs -z3 -degagnon@cvs1:/cvsroot/scriptonite
co scriptonite
egagnon@cvs1's password: 
cvs server: Updating scriptonite
U scriptonite/AUTHORS
U scriptonite/COPYING.LIB
U scriptonite/ChangeLog
U scriptonite/Scriptonite-LICENSE
U scriptonite/THANKS
cvs server: Updating scriptonite/scriptonite
cvs server: Updating scriptonite/scriptonite/src
cvs server: Updating scriptonite/src
U scriptonite/src/ecmascript.grammar
U scriptonite/src/scriptonite-ast.grammar
[egagnon@orbital egagnon]$ 

Now, I can simply go and replace scriptonite/src/* by new versions and
check-in the result;-)

You can use "scp" to copy files over.

I hope this solves your problem

Etienne

Re: [Scriptonite-dev] CVS access rights

[Raif S. N. <ra...@fl...>]

At 08:20 AM 3/30/00 -0500, Etienne M. Gagnon wrote:
>"Raif S. Naffah" wrote:
> > is ther a special incantation to gain access rights to the CVS tree?
>
>Are you using cvs/ssh?

i usually use wincvs; but i also tried the (command-line version of) cvs 
and it still does not work.


>If not, look at
>http://www.geocrawler.com/archives/3/2058/2000/2/0/3359977/

already did that.

btw, the directions on setting up wincvs to work with sourceforge, are 
incomplete compared to <http://www.cryptix.org/docs/devcvs.html> which i 
pointed to in an earlier messsage (see 
http://www.geocrawler.com/archives/3/2058/2000/2/0/3368026/).


cheers;
rsn

Re: [Scriptonite-dev] CVS access rights

[Etienne M. G. <eg...@j-...>]

"Raif S. Naffah" wrote:
> is ther a special incantation to gain access rights to the CVS tree?

Are you using cvs/ssh?

If not, look at
http://www.geocrawler.com/archives/3/2058/2000/2/0/3359977/

Etienne

[Scriptonite-dev] CVS access rights

[Raif S. N. <ra...@fl...>]

is ther a special incantation to gain access rights to the CVS tree?

i'm trying to commit the grammar but keep getting:

cvs -z3 commit -m "+ updated Lexer sections based on ECMA-262.\n" 
ecmascript.grammar (in directory X:\sourceforge\scriptonite\src\)
cvs [server aborted]: "commit" requires write access to the repository

*****CVS exited normally with code 1*****

cheers;
rsn

ps. BTW, i'm checking in this file because i need some help to go forward.

Re: [Scriptonite-dev] some questions (long)

[Raif S. N. <ra...@fl...>]

At 04:31 PM 3/27/00 -0500, Etienne M. Gagnon wrote:
>"Raif S. Naffah" wrote:
> >
> > 1.  UTF-16 / UTF-8
> >
> > In "2. Conformance," the ECMA-262 standard states:
> >
> > "A conforming implementation of this International standard shall interpret
> > characters in conformance with the
> > Unicode Standard, Version 2.1 or later, and ISO/IEC 10646-1 with either
> > UCS-2 or UTF-16 as..."
> >
> > Java understands UTF-8, ie. if we use Reader (or any of its subclasses) we
> > would get UTF-8 chars.
>
>Wrong.  UTF-8 is an encoding scheme.  Java characters are simply "char"s.

???

java chars are 16-bit allright and utf-8 is of course an encoding.

i was referring to java Reader classes reading byte sequences and 
translating them into chars. (from the InputStreamReader javadoc:

         "An InputStreamReader is a bridge from byte streams to character 
streams:
         It reads bytes and translates them into characters according to a 
specified
         character encoding. The encoding that it uses may be specified by 
name,
         or the platform's default encoding may be accepted. "

Lexers generated by SableCC use a Reader to parse the input stream into the 
language tokens. hence, if we know the encoding of the input stream, say 
ISO 2022 CN, Chinese, we would then instantiate a (subclass of the) Reader 
using the encoding name "ISO2022CN," eg.

         isr = InputStreamReader(in, "ISO2022CN");

for the complete list of Java 2 supported encodings, see 
<file:///${your-jdk-home}/docs/guide/internat/encoding.doc.html>.

so for me the question remains: do we need to write a ByteToChar converter 
for UTF-16?


>But: Not all "char"s are valid "java_letter_or_number" (or something like 
>that).  Only
>this subset can be used to construct valid identifier.  This is why there 
>is a long subset
>definition in the Java grammar.
>
>What we need to know is:
>1- Can we represent "Unicode Standard, Version 2.1" characters using 
>"char" (i.e.: is 16
>bits enough?)

yes.

>2- Are there special subset we need to care about (like: valid for 
>identifiers, ...)?.

yes.

>If the answer to (1) is false, AND the answer to (2) is true, then this 
>complicates the
>matter a little.  The solution is then to define chars as follows:
>
>(example)
>
>Helpers
>...
>   some_multichar_unicode = 0xff34 0x394d;  // a 64 bit unicode char
>...
>Tokens
>...
>... = ... some_multichar_unicode ...;
>...
>
>
>Mainly, you simply maintain explicit UTF-16 encoding in the grammar.  You 
>do not build
>real 64 (or whatever) bit chars.
>
> >
> > Since i dont know if we need to convert UTF-8 to UTF-16 (in case it is not
> > a subset of the latter), how can we implement the above requirement? of
> > course if UTF-8 is a subset of UTF-16 then we need to do nothing, but i
> > need a confirmation on that, or a pointer to a document that clearly 
> states it.
> >
> > 2. lookahead in lexer.
> >
> > On page 19, the standard states:
> >
> > "EscapeSequence ::
> >          CharacterEscapeSequence
> >          0 [lookahead not included in DecimalDigit]
> >          HexEscapeSequence
> >          UnicodeEscapeSequence"
> >
> > how can we enforce this requirement?
>
>Lexer states + custom lexer.
>
>e.g.: You define a bogus token that matches the exception, in the custom 
>lexer, when this
>token is matched, you pushback the text into the reader.  (then set 
>token=null)
>
>...
>{normal->not_escape_sequence}
>    bogus_escape_sequence = 0 decimal_digit;
>
>{normal}
>    escape_sequence = ...;
>
>Obviously, token "escape_sequence" is not defined in state 
>"not_escape_sequence".

ok.

> >
> > 3. Reduction of multiple line_terminators:
> >
> > On page 6, the standard states:
> >
> > "A MultiLineComment (that is, a comment of the form /*?*/ regardless of
> > whether it spans more than one line) is likewise simply discarded if it
> > contains no line terminator; but if a MultiLineComment contains one or more
> > line terminators, then it is replaced by a single line terminator, which
> > becomes part of the stream of input
> > elements for the syntactic grammar."
> >
> > given that the grammar now looks like the following (lines 53-61)
> >
> >     /**
> >      *  7.3. Line Terminators. [ECMA-262] p. 12.
> >      */
> >     lf = 0x000A; // Line Feed
> >     cr = 0x000D; // Carriage Return
> >     ls = 0x2028; // Line separator
> >     ps = 0x2029; // Paragraph separator
> >
> >     line_terminator = [lf + [cr + [ls + ps]]];
> >
> > should the above statement be interpreted as:
> >
> > a. when appropriate, remove all occurences of consecutive line_terminator
> > chars and replace with one "canonical line terminator" char? or
> > b. when appropriate, remove all occurences of consecutive line_terminator
> > chars and replace with the first line_terminator char whatever it is?
> >
> > if (a) what should be considered as the "canonical" lt char? a
> > scriptonite-specific line_terminator char (chosen among the above list) or
> > the Java platform-dependant "line.separator" string?
>
>I would instead define:
>
>line_terminator = (... | multiline_comment)+;
>
>blank = (... | single_line_comment)+;
>
>(Or something like that)

agree. re-reading the standard, i noted this paragraph (near bottom of p. 12):

         "Comments behave like white space and are discarded except that, if a
         MultiLineComment contains a line terminator character, then the entire
         comment is considered to be a LineTerminator for purposes of parsing
         by the syntactic grammar."


> >
> > (SableCC-related; ie. for Etienne)
> >
> > 4. lookahead operator
> > SableCC 2.13 does not support the "/" lookahead opertor. any ideas if/when
> > it will be supported?
>
>Not quite soon.  (Ph.D. thesis has precedence;-)
>
> > ...
> >
> > 6. unicode.txt and UnicodeLexer.java
> > in sablecc distribution, in the Java1.02 and Java1.1 examples, references
> > are made to a 0x001A (Unicode "SUBSTITUTE") character.
> >
> > where can i get more information about this character and why it [might]
> > appear/s in the input?


any pointers?

> >
> > cheers;
> > rsn
> >
> > _______________________________________________
> > Scriptonite-dev mailing list
> > Scr...@li...
> > http://lists.sourceforge.net/mailman/listinfo/scriptonite-dev
>
>--
>----------------------------------------------------------------------
>Etienne M. Gagnon, M.Sc.                     e-mail: eg...@j-...
>Author of SableCC:                 http://www.sable.mcgill.ca/sablecc/
>----------------------------------------------------------------------

Re: [Scriptonite-dev] some questions (long)

[Etienne M. G. <eg...@j-...>]

"Raif S. Naffah" wrote:
> 
> 1.  UTF-16 / UTF-8
> 
> In "2. Conformance," the ECMA-262 standard states:
> 
> "A conforming implementation of this International standard shall interpret
> characters in conformance with the
> Unicode Standard, Version 2.1 or later, and ISO/IEC 10646-1 with either
> UCS-2 or UTF-16 as..."
> 
> Java understands UTF-8, ie. if we use Reader (or any of its subclasses) we
> would get UTF-8 chars.

Wrong.  UTF-8 is an encoding scheme.  Java characters are simply "char"s.

But: Not all "char"s are valid "java_letter_or_number" (or something like that).  Only
this subset can be used to construct valid identifier.  This is why there is a long subset
definition in the Java grammar.

What we need to know is:
1- Can we represent "Unicode Standard, Version 2.1" characters using "char" (i.e.: is 16
bits enough?)
2- Are there special subset we need to care about (like: valid for identifiers, ...)?.

If the answer to (1) is false, AND the answer to (2) is true, then this complicates the
matter a little.  The solution is then to define chars as follows:

(example)

Helpers
...
  some_multichar_unicode = 0xff34 0x394d;  // a 64 bit unicode char
...
Tokens
...
... = ... some_multichar_unicode ...;
...


Mainly, you simply maintain explicit UTF-16 encoding in the grammar.  You do not build
real 64 (or whatever) bit chars. 

> 
> Since i dont know if we need to convert UTF-8 to UTF-16 (in case it is not
> a subset of the latter), how can we implement the above requirement? of
> course if UTF-8 is a subset of UTF-16 then we need to do nothing, but i
> need a confirmation on that, or a pointer to a document that clearly states it.
> 
> 2. lookahead in lexer.
> 
> On page 19, the standard states:
> 
> "EscapeSequence ::
>          CharacterEscapeSequence
>          0 [lookahead not included in DecimalDigit]
>          HexEscapeSequence
>          UnicodeEscapeSequence"
> 
> how can we enforce this requirement?

Lexer states + custom lexer.

e.g.: You define a bogus token that matches the exception, in the custom lexer, when this
token is matched, you pushback the text into the reader.  (then set token=null)

...
{normal->not_escape_sequence}
   bogus_escape_sequence = 0 decimal_digit;

{normal}
   escape_sequence = ...;

Obviously, token "escape_sequence" is not defined in state "not_escape_sequence".

> 
> 3. Reduction of multiple line_terminators:
> 
> On page 6, the standard states:
> 
> "A MultiLineComment (that is, a comment of the form /*?*/ regardless of
> whether it spans more than one line) is likewise simply discarded if it
> contains no line terminator; but if a MultiLineComment contains one or more
> line terminators, then it is replaced by a single line terminator, which
> becomes part of the stream of input
> elements for the syntactic grammar."
> 
> given that the grammar now looks like the following (lines 53-61)
> 
>     /**
>      *  7.3. Line Terminators. [ECMA-262] p. 12.
>      */
>     lf = 0x000A; // Line Feed
>     cr = 0x000D; // Carriage Return
>     ls = 0x2028; // Line separator
>     ps = 0x2029; // Paragraph separator
> 
>     line_terminator = [lf + [cr + [ls + ps]]];
> 
> should the above statement be interpreted as:
> 
> a. when appropriate, remove all occurences of consecutive line_terminator
> chars and replace with one "canonical line terminator" char? or
> b. when appropriate, remove all occurences of consecutive line_terminator
> chars and replace with the first line_terminator char whatever it is?
> 
> if (a) what should be considered as the "canonical" lt char? a
> scriptonite-specific line_terminator char (chosen among the above list) or
> the Java platform-dependant "line.separator" string?

I would instead define:

line_terminator = (... | multiline_comment)+;

blank = (... | single_line_comment)+;

(Or something like that)

> 
> (SableCC-related; ie. for Etienne)
> 
> 4. lookahead operator
> SableCC 2.13 does not support the "/" lookahead opertor. any ideas if/when
> it will be supported?

Not quite soon.  (Ph.D. thesis has precedence;-)

> 
> 5. Lexer is not generated
> to test the new grammar i commented out the current productions and added
> the following:
> 
>     script = script_token*;
> 
>     script_token =
>          {res} reserved_word
>        | {id}  identifier
>        | {op}  punctuator
>        | {num} numeric_literal
>        | {str} string_literal
>        ;
> 
> with the appropriate supporting productions.
> 
> no Lexer (classes) get generated; why?
> 
> 6. unicode.txt and UnicodeLexer.java
> in sablecc distribution, in the Java1.02 and Java1.1 examples, references
> are made to a 0x001A (Unicode "SUBSTITUTE") character.
> 
> where can i get more information about this character and why it [might]
> appear/s in the input?
> 
> cheers;
> rsn
> 
> _______________________________________________
> Scriptonite-dev mailing list
> Scr...@li...
> http://lists.sourceforge.net/mailman/listinfo/scriptonite-dev

-- 
----------------------------------------------------------------------
Etienne M. Gagnon, M.Sc.                     e-mail: eg...@j-...
Author of SableCC:                 http://www.sable.mcgill.ca/sablecc/
----------------------------------------------------------------------

Re: [Scriptonite-dev] some questions (long)

[Raif S. N. <ra...@fl...>]

At 06:05 AM 3/28/00 +1000, Raif S. Naffah wrote:
>...
>5. Lexer is not generated
>to test the new grammar i commented out the current productions and added 
>the following:
>
>    script = script_token*;
>
>    script_token =
>         {res} reserved_word
>       | {id}  identifier
>       | {op}  punctuator
>       | {num} numeric_literal
>       | {str} string_literal
>       ;
>
>with the appropriate supporting productions.
>
>no Lexer (classes) get generated; why?


pls diregard this point.


cheers;
rsn

[Scriptonite-dev] some questions (long)

[Raif S. N. <ra...@fl...>]

1.  UTF-16 / UTF-8

In "2. Conformance," the ECMA-262 standard states:

"A conforming implementation of this International standard shall interpret 
characters in conformance with the
Unicode Standard, Version 2.1 or later, and ISO/IEC 10646-1 with either 
UCS-2 or UTF-16 as..."

Java understands UTF-8, ie. if we use Reader (or any of its subclasses) we 
would get UTF-8 chars.

Since i dont know if we need to convert UTF-8 to UTF-16 (in case it is not 
a subset of the latter), how can we implement the above requirement? of 
course if UTF-8 is a subset of UTF-16 then we need to do nothing, but i 
need a confirmation on that, or a pointer to a document that clearly states it.


2. lookahead in lexer.

On page 19, the standard states:

"EscapeSequence ::
         CharacterEscapeSequence
         0 [lookahead not included in DecimalDigit]
         HexEscapeSequence
         UnicodeEscapeSequence"

how can we enforce this requirement?


3. Reduction of multiple line_terminators:

On page 6, the standard states:

"A MultiLineComment (that is, a comment of the form /*…*/ regardless of 
whether it spans more than one line) is likewise simply discarded if it 
contains no line terminator; but if a MultiLineComment contains one or more 
line terminators, then it is replaced by a single line terminator, which 
becomes part of the stream of input
elements for the syntactic grammar."

given that the grammar now looks like the following (lines 53-61)

    /**
     *  7.3. Line Terminators. [ECMA-262] p. 12.
     */
    lf = 0x000A; // Line Feed
    cr = 0x000D; // Carriage Return
    ls = 0x2028; // Line separator
    ps = 0x2029; // Paragraph separator

    line_terminator = [lf + [cr + [ls + ps]]];

should the above statement be interpreted as:

a. when appropriate, remove all occurences of consecutive line_terminator 
chars and replace with one "canonical line terminator" char? or
b. when appropriate, remove all occurences of consecutive line_terminator 
chars and replace with the first line_terminator char whatever it is?

if (a) what should be considered as the "canonical" lt char? a 
scriptonite-specific line_terminator char (chosen among the above list) or 
the Java platform-dependant "line.separator" string?


(SableCC-related; ie. for Etienne)

4. lookahead operator
SableCC 2.13 does not support the "/" lookahead opertor. any ideas if/when 
it will be supported?


5. Lexer is not generated
to test the new grammar i commented out the current productions and added 
the following:

    script = script_token*;

    script_token =
         {res} reserved_word
       | {id}  identifier
       | {op}  punctuator
       | {num} numeric_literal
       | {str} string_literal
       ;

with the appropriate supporting productions.

no Lexer (classes) get generated; why?


6. unicode.txt and UnicodeLexer.java
in sablecc distribution, in the Java1.02 and Java1.1 examples, references 
are made to a 0x001A (Unicode "SUBSTITUTE") character.

where can i get more information about this character and why it [might] 
appear/s in the input?


cheers;
rsn

[Scriptonite-dev] NEWS: www.scriptonite.org is up!

[Etienne M. G. <eg...@j-...>]

[Scriptonite-dev] UNICODE references. was: questions about helper definitions

[Raif S. N. <ra...@fl...>]

At 01:30 PM 3/22/00 -0500, Etienne M. Gagnon wrote:
>"Raif S. Naffah" wrote:
> > i downloaded the UNICODE 3.0 character chart and will proceed to implement
> > the ECMA specs for the lexer.
>
>If you could tell us about all the URLs to related specifications that you 
>find, we could add them
>to the web page.  I personally am interested in knowing the UNICODE 3.0 URL...


* the UNICODE main page is at: <http://www.unicode.org/>
* the UNICODE Data page is at: 
<http://www.unicode.org/unicode/onlinedat/online.html>
* the character chart i'm using is at: 
<ftp://ftp.unicode.org/Public/UNIDATA/UnicodeData-Latest.txt>

cheers;
rsn