Re: [Pyparsing] Word and Regex matching more than they should

[Stuart L. <st...@vr...>]

On 19/01/18 16:16, Stuart Longland wrote:
> I'm finding if I pass one in, it does:
>> stuartl@vk4msl-ws ~/vrt/projects/widesky/sdk/hszinc $ ipython2 
>> Python 2.7.14 (default, Jan 17 2018, 17:36:45) 
>> Type "copyright", "credits" or "license" for more information.
>>
>> IPython 5.4.1 -- An enhanced Interactive Python.
>> ?         -> Introduction and overview of IPython's features.
>> %quickref -> Quick reference.
>> help      -> Python's own help system.
>> object?   -> Details about 'object', use 'object??' for extra details.
>>
>> In [1]: from hszinc import grammar
>>
>> In [2]: grammar.hs_quantity.parseString('123.45 notpartofquantity')
>> Out[2]: ([BasicQuantity(123.45, 'notpartofquantity')], {})

Okay, something is *definitely* buggy:
> stuartl@vk4msl-ws ~/vrt/projects/widesky/sdk/hszinc $ ipython2
> Python 2.7.14 (default, Jan 17 2018, 17:36:45) 
> Type "copyright", "credits" or "license" for more information.
> 
> IPython 5.4.1 -- An enhanced Interactive Python.
> ?         -> Introduction and overview of IPython's features.
> %quickref -> Quick reference.
> help      -> Python's own help system.
> object?   -> Details about 'object', use 'object??' for extra details.
> 
> In [1]: import pyparsing as pp
> 
> In [2]: class Quantity(object):
>    ...:     def __init__(self, value, unit):
>    ...:         self.value = value
>    ...:         self.unit = unit
>    ...:     def __repr__(self):
>    ...:         return 'Q(%r, %r)' % (self.value, self.unit)
>    ...: 
> 
> In [3]: hs_unit         = pp.Regex(ur"[a-zA-Z%_/$\x80-\xffffffff]+")
>    ...: hs_decimal      = pp.Regex(r"-?[\d_]+(\.[\d_]+)?([eE][+\-]?[\d_]+)?").setParseAction(
>    ...:                 lambda toks : [float(toks[0].replace('_',''))])
>    ...: hs_quantity     = (hs_decimal + hs_unit).setParseAction(
>    ...:         lambda toks : [Quantity(toks[0], unit=toks[1])])
>    ...: 
> 
> In [4]: hs_quantity.parseString('123.123 abc')
> Out[4]: ([Q(123.123, 'abc')], {})
> 
> In [5]: hs_quantity.parseString('123.123 abc', parseAll=True)
> Out[5]: ([Q(123.123, 'abc')], {})

*Nowhere*, in those patterns, is a space allowed.  Yet, it passes it
through.
-- 
     _ ___             Stuart Longland - Systems Engineer
\  /|_) |                           T: +61 7 3535 9619
 \/ | \ |     38b Douglas Street    F: +61 7 3535 9699
   SYSTEMS    Milton QLD 4064       http://www.vrt.com.au