[pure-lang-svn] SF.net SVN: pure-lang:[636] pure/trunk

[<ag...@us...>]

Revision: 636
          http://pure-lang.svn.sourceforge.net/pure-lang/?rev=636&view=rev
Author:   agraef
Date:     2008-08-27 19:02:39 +0000 (Wed, 27 Aug 2008)

Log Message:
-----------
Added limited support for unicode symbols.

Modified Paths:
--------------
    pure/trunk/ChangeLog
    pure/trunk/lexer.ll

Modified: pure/trunk/ChangeLog
===================================================================
--- pure/trunk/ChangeLog	2008-08-27 18:35:59 UTC (rev 635)
+++ pure/trunk/ChangeLog	2008-08-27 19:02:39 UTC (rev 636)
@@ -1,5 +1,8 @@
 2008-08-27  Albert Graef  <Dr....@t-...>
 
+	* lexer.ll: Added limited support for unicode symbols. These can
+	now be declared as operator or nullary symbols.
+
 	* parser.yy, etc.: Symbols can now be declared 'private'. These
 	aren't visible anywhere except in the module that declares them.
 

Modified: pure/trunk/lexer.ll
===================================================================
--- pure/trunk/lexer.ll	2008-08-27 18:35:59 UTC (rev 635)
+++ pure/trunk/lexer.ll	2008-08-27 19:02:39 UTC (rev 636)
@@ -929,7 +929,7 @@
 }
 [@=|;()\[\]\\] return yy::parser::token_type(yytext[0]);
 "->"       return token::MAPSTO;
-[[:punct:]]+  {
+([[:punct:]]|[\200-\377])+  {
   if (yytext[0] == '/' && yytext[1] == '*') REJECT; // comment starter
   while (yyleng > 1 && yytext[yyleng-1] == ';') yyless(yyleng-1);
   if (interp.declare_op) {


This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.