[CEDET-devel] python parser now generates valid semantic tokens

[<ry...@ds...>]

Hi everyone,

I just checked in new wisent-python.el and wisent-python.wy.

The grammar now generates proper semanatic tokens for many
of the non-terminals.  Further work is required though.

I would like to ask one question before I proceed further.

What name should be given to expressions that do not define any names?

Unlike java, python's top-level forms can be virtually any expression
that do not define any names.
For example, a simple python code is shown below:

    s and t
    q | r
    o ^ p

This results in the following semantic tokens:

   ("s and t" expr nil nil nil #<overlay from 467 to 474 in test.py>)
   ("q | r" expr nil nil nil #<overlay from 475 to 480 in test.py>)
   ("o ^ p" expr nil nil nil #<overlay from 481 to 486 in test.py>)

All three lines match the "expr" non-terminal.

What name (i.e., the first element of the semantic tokens) should
be given to such forms?

To see further examples, you could try "M-x bovinate" on test.py
file.

Thanks for your help.