Menu
▾
▴
xmltk-devs — mailing list for xmltk developers
You can subscribe to this list here.
| 2002 |
Jan
|
Feb
|
Mar
|
Apr
|
May
(1) |
Jun
|
Jul
|
Aug
|
Sep
(4) |
Oct
(6) |
Nov
(1) |
Dec
(1) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2003 |
Jan
(1) |
Feb
(11) |
Mar
(1) |
Apr
|
May
|
Jun
(4) |
Jul
|
Aug
|
Sep
|
Oct
(2) |
Nov
|
Dec
(2) |
| 2005 |
Jan
|
Feb
(2) |
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
| 2006 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
(9) |
Dec
|
| 2007 |
Jan
(6) |
Feb
(1) |
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
|
From: Makoto O. <on...@ac...> - 2007-02-18 09:17:39
|
Dinesh, I fixed the xsort bug and modified filestream.cpp so that xsort detects errors of the file system such as "no space left on devices in /tmp". The latest release is xmlltk1.11. URL http://sourceforge.net/projects/xmltk makoto From: "Venkataramanaidu, Dinesh (Dinesh)** CTR **" <vd...@al...> Subject: RE: [Xmltk-devs] Sorting a huge XML file Date: Wed, 24 Jan 2007 18:13:51 +0530 Message-ID: <3BE...@ii...> >Hello Makoto, > >It's wonderful that you could run series of tests and able to simulate the >problem. > >We are actually working on a prototype which is purely based on >XML streams. XML sorting is an important step in the prototype. We are >looking at using >xsort utility to perform this stream based XML sorting, provided it can >perform >sorting using reasonable memory. > >Based on your solution we ran few more tests to study the behavior of xsort >utility further. Attached please find the details of our test results. In >summary >we found that the amount of memory size to be allocated is roughly >equivalent >to the size of the blocks we are sorting. For example to sort blocks of 1GB >we need to have ~900MB of RAM pre-allocated. > >Hope you will agree with me that Pre allocating such a huge memory in >advance >for sorting streams is not very nice. Can we do something in >disk-sort-merge >algorithm to alleviate this problem?. Is this something very difficult bug >to fix? > >I once again truly appreciate your help in this regards. > >Thanks, >Dinesh.V > > >-----Original Message----- >From: Makoto ONIZUKA [mailto:oni...@la...] >Sent: Sunday, January 21, 2007 11:16 AM >To: vd...@al... >Cc: xml...@li... >Subject: Re: [Xmltk-devs] Sorting a huge XML file > > >Dinesh, > >I hit the same problem. As far as I know/guess: >- the initial memory size of xsort is fixed at 38MB. >- xsort with default memory setting works if the output > size doesn't exceed around 100MB. >- so, there are some bugs in disk-sort-merge algorithm > in xsort. I can't fix it soon. > >A easiest solution is to set the memory size. >xsort -m {memory size MB} -c "top" -e "*" -k ...; > >makoto > > >From: Makoto ONIZUKA <oni...@la...> >Subject: Re: [Xmltk-devs] Sorting a huge XML file >Date: Sat, 20 Jan 2007 15:48:58 +0900 (JST) >Message-ID: <200...@la...> > >>Dinesh, >> >>I have tested the xsort using a synthetic XML data >>that satisfies your condition; the total size of >>BLOCK1 and BLOCK2 exceeds 100MB. >> >>Two exapmles below work correctly. >> xsort -c "top" -e "*" -k ... >> xsort -c "top/*" -e "*" -k ... >> >>So, can you give me more details of your example? >> >>makoto >> >> >>From: "Venkataramanaidu, Dinesh (Dinesh)** CTR **" ><vd...@al...> >>Subject: [Xmltk-devs] Sorting a huge XML file >>Date: Wed, 10 Jan 2007 15:37:22 +0530 >>Message-ID: ><3BE...@ii...> >> >>>Hello XML Toolkit developers, >>> >>>While looking for a tool to sort XML tags i hit upon >>>xsort utility in sourceforge. This tool impressed me very much after >>>my initial testing of this tool with sample XML files. >>>Now i am trying to use xsort utility against bigger XML files, >>>and encountering a problem. >>> >>>In the below XML template, if the total size of descendents of BLOCK1(or >>>BLOCK2) >>>exceeds ~100MB then running xsort on this XML file simply returns <TOP/>, >>>while the same thing works perfectly fine when the descendents >>>size less than 100MB.(For my testing, I am just embedding XML files of >>>certain >>>size as the descendents for each of the BLOCK.) >>> >>> >>><TOP> >>> <BLOCK1 id="1"> >>> ...... >>> </BLOCK1> >>> <BLOCK2 id="2"> >>> ...... >>> </BLOCK2> >>></TOP> >>> >>>Inputs from your side regarding this issue will be of great help to me to. >>>My advance thank for your inputs. >>> >>>Thanks, >>>Dinesh.V >>> >>>------------------------------------------------------------------------- >>>Take Surveys. Earn Cash. Influence the Future of IT >>>Join SourceForge.net's Techsay panel and you'll get the chance to share >your >>>opinions on IT & business topics through brief surveys - and earn cash >>>http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV >>>_______________________________________________ >>>Xmltk-devs mailing list >>>Xml...@li... >>>https://lists.sourceforge.net/lists/listinfo/xmltk-devs |
|
From: Venkataramanaidu, D. (Dinesh)** C. ** <vd...@al...> - 2007-01-24 12:44:48
|
Hello Makoto,
It's wonderful that you could run series of tests and able to simulate the
problem.
We are actually working on a prototype which is purely based on
XML streams. XML sorting is an important step in the prototype. We are
looking at using
xsort utility to perform this stream based XML sorting, provided it can
perform
sorting using reasonable memory.
Based on your solution we ran few more tests to study the behavior of xsort
utility further. Attached please find the details of our test results. In
summary
we found that the amount of memory size to be allocated is roughly
equivalent
to the size of the blocks we are sorting. For example to sort blocks of 1GB
we need to have ~900MB of RAM pre-allocated.
Hope you will agree with me that Pre allocating such a huge memory in
advance
for sorting streams is not very nice. Can we do something in
disk-sort-merge
algorithm to alleviate this problem?. Is this something very difficult bug
to fix?
I once again truly appreciate your help in this regards.
Thanks,
Dinesh.V
-----Original Message-----
From: Makoto ONIZUKA [mailto:oni...@la...]
Sent: Sunday, January 21, 2007 11:16 AM
To: vd...@al...
Cc: xml...@li...
Subject: Re: [Xmltk-devs] Sorting a huge XML file
Dinesh,
I hit the same problem. As far as I know/guess:
- the initial memory size of xsort is fixed at 38MB.
- xsort with default memory setting works if the output
size doesn't exceed around 100MB.
- so, there are some bugs in disk-sort-merge algorithm
in xsort. I can't fix it soon.
A easiest solution is to set the memory size.
xsort -m {memory size MB} -c "top" -e "*" -k ...;
makoto
From: Makoto ONIZUKA <oni...@la...>
Subject: Re: [Xmltk-devs] Sorting a huge XML file
Date: Sat, 20 Jan 2007 15:48:58 +0900 (JST)
Message-ID: <200...@la...>
>Dinesh,
>
>I have tested the xsort using a synthetic XML data
>that satisfies your condition; the total size of
>BLOCK1 and BLOCK2 exceeds 100MB.
>
>Two exapmles below work correctly.
> xsort -c "top" -e "*" -k ...
> xsort -c "top/*" -e "*" -k ...
>
>So, can you give me more details of your example?
>
>makoto
>
>
>From: "Venkataramanaidu, Dinesh (Dinesh)** CTR **"
<vd...@al...>
>Subject: [Xmltk-devs] Sorting a huge XML file
>Date: Wed, 10 Jan 2007 15:37:22 +0530
>Message-ID:
<3BE...@ii...>
>
>>Hello XML Toolkit developers,
>>
>>While looking for a tool to sort XML tags i hit upon
>>xsort utility in sourceforge. This tool impressed me very much after
>>my initial testing of this tool with sample XML files.
>>Now i am trying to use xsort utility against bigger XML files,
>>and encountering a problem.
>>
>>In the below XML template, if the total size of descendents of BLOCK1(or
>>BLOCK2)
>>exceeds ~100MB then running xsort on this XML file simply returns <TOP/>,
>>while the same thing works perfectly fine when the descendents
>>size less than 100MB.(For my testing, I am just embedding XML files of
>>certain
>>size as the descendents for each of the BLOCK.)
>>
>>
>><TOP>
>> <BLOCK1 id="1">
>> ......
>> </BLOCK1>
>> <BLOCK2 id="2">
>> ......
>> </BLOCK2>
>></TOP>
>>
>>Inputs from your side regarding this issue will be of great help to me to.
>>My advance thank for your inputs.
>>
>>Thanks,
>>Dinesh.V
>>
>>-------------------------------------------------------------------------
>>Take Surveys. Earn Cash. Influence the Future of IT
>>Join SourceForge.net's Techsay panel and you'll get the chance to share
your
>>opinions on IT & business topics through brief surveys - and earn cash
>>http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
>>_______________________________________________
>>Xmltk-devs mailing list
>>Xml...@li...
>>https://lists.sourceforge.net/lists/listinfo/xmltk-devs
>>
|
|
From: Makoto O. <oni...@la...> - 2007-01-21 05:46:17
|
Dinesh,
I hit the same problem. As far as I know/guess:
- the initial memory size of xsort is fixed at 38MB.
- xsort with default memory setting works if the output
size doesn't exceed around 100MB.
- so, there are some bugs in disk-sort-merge algorithm
in xsort. I can't fix it soon.
A easiest solution is to set the memory size.
xsort -m {memory size MB} -c "top" -e "*" -k ...;
makoto
From: Makoto ONIZUKA <oni...@la...>
Subject: Re: [Xmltk-devs] Sorting a huge XML file
Date: Sat, 20 Jan 2007 15:48:58 +0900 (JST)
Message-ID: <200...@la...>
>Dinesh,
>
>I have tested the xsort using a synthetic XML data
>that satisfies your condition; the total size of
>BLOCK1 and BLOCK2 exceeds 100MB.
>
>Two exapmles below work correctly.
> xsort -c "top" -e "*" -k ...
> xsort -c "top/*" -e "*" -k ...
>
>So, can you give me more details of your example?
>
>makoto
>
>
>From: "Venkataramanaidu, Dinesh (Dinesh)** CTR **" <vd...@al...>
>Subject: [Xmltk-devs] Sorting a huge XML file
>Date: Wed, 10 Jan 2007 15:37:22 +0530
>Message-ID: <3BE...@ii...>
>
>>Hello XML Toolkit developers,
>>
>>While looking for a tool to sort XML tags i hit upon
>>xsort utility in sourceforge. This tool impressed me very much after
>>my initial testing of this tool with sample XML files.
>>Now i am trying to use xsort utility against bigger XML files,
>>and encountering a problem.
>>
>>In the below XML template, if the total size of descendents of BLOCK1(or
>>BLOCK2)
>>exceeds ~100MB then running xsort on this XML file simply returns <TOP/>,
>>while the same thing works perfectly fine when the descendents
>>size less than 100MB.(For my testing, I am just embedding XML files of
>>certain
>>size as the descendents for each of the BLOCK.)
>>
>>
>><TOP>
>> <BLOCK1 id="1">
>> ......
>> </BLOCK1>
>> <BLOCK2 id="2">
>> ......
>> </BLOCK2>
>></TOP>
>>
>>Inputs from your side regarding this issue will be of great help to me to.
>>My advance thank for your inputs.
>>
>>Thanks,
>>Dinesh.V
>>
>>-------------------------------------------------------------------------
>>Take Surveys. Earn Cash. Influence the Future of IT
>>Join SourceForge.net's Techsay panel and you'll get the chance to share your
>>opinions on IT & business topics through brief surveys - and earn cash
>>http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
>>_______________________________________________
>>Xmltk-devs mailing list
>>Xml...@li...
>>https://lists.sourceforge.net/lists/listinfo/xmltk-devs
>>
|
|
From: Makoto O. <oni...@la...> - 2007-01-20 06:49:11
|
Dinesh, I have tested the xsort using a synthetic XML data that satisfies your condition; the total size of BLOCK1 and BLOCK2 exceeds 100MB. Two exapmles below work correctly. xsort -c "top" -e "*" -k ... xsort -c "top/*" -e "*" -k ... So, can you give me more details of your example? makoto From: "Venkataramanaidu, Dinesh (Dinesh)** CTR **" <vd...@al...> Subject: [Xmltk-devs] Sorting a huge XML file Date: Wed, 10 Jan 2007 15:37:22 +0530 Message-ID: <3BE...@ii...> >Hello XML Toolkit developers, > >While looking for a tool to sort XML tags i hit upon >xsort utility in sourceforge. This tool impressed me very much after >my initial testing of this tool with sample XML files. >Now i am trying to use xsort utility against bigger XML files, >and encountering a problem. > >In the below XML template, if the total size of descendents of BLOCK1(or >BLOCK2) >exceeds ~100MB then running xsort on this XML file simply returns <TOP/>, >while the same thing works perfectly fine when the descendents >size less than 100MB.(For my testing, I am just embedding XML files of >certain >size as the descendents for each of the BLOCK.) > > ><TOP> > <BLOCK1 id="1"> > ...... > </BLOCK1> > <BLOCK2 id="2"> > ...... > </BLOCK2> ></TOP> > >Inputs from your side regarding this issue will be of great help to me to. >My advance thank for your inputs. > >Thanks, >Dinesh.V > >------------------------------------------------------------------------- >Take Surveys. Earn Cash. Influence the Future of IT >Join SourceForge.net's Techsay panel and you'll get the chance to share your >opinions on IT & business topics through brief surveys - and earn cash >http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV >_______________________________________________ >Xmltk-devs mailing list >Xml...@li... >https://lists.sourceforge.net/lists/listinfo/xmltk-devs > |
|
From: Makoto O. <oni...@la...> - 2007-01-20 06:04:01
|
Hello Luis Alberto, If you want to sort elements by key values as integer type, = you need to specify -t option. = In your example, probably what you want to do is done by = xsort -t "/inicio/*/area:%i" -c /inicio -e "*" -k "area" your.xml; The text data of area is treated as integer, so the result becomes = as follows. I tested it by xmltk1.1 which is the latest version I = maintain. <inicio> <sortD> <nombre>ff</nombre> <area>2</area> </sortD> <sortD a=3D"2"> <nombre>aa</nombre> <area>4</area> </sortD> <sortD> <nombre>ww</nombre> <area>4</area> </sortD> <sortD> <nombre>bb</nombre> <area>6</area> </sortD> <sortD> <nombre>cc</nombre> <area>24</area> </sortD> </inicio> makoto From: "Luis Alberto Ramirez Albino" <soa...@ho...> Subject: [Xmltk-devs] Xsort problems with XML attributes Date: Fri, 19 Jan 2007 19:48:41 +0000 Message-ID: <BAY...@ph...l> >Hello, good day My name is Luis Alberto Ram=EDrez, I'm from Mexico an= d I'm = >trying to use >the xsort util from the xmltk package, but I found an error, I explain= here = >the details : > > I try to sort a simple document like this > > <?xml version=3D"1.0"?> > <inicio> > <sortD a=3D"2" > > <nombre>aa</nombre> > <area>4</area> > </sortD> > <sortD> > <nombre>ff</nombre> > <area>2</area> > </sortD> > <sortD> > <nombre>bb</nombre> > <area>6</area> > </sortD> > <sortD> > <nombre>ww</nombre> > <area>4</area> > </sortD> > <sortD> > <nombre>cc</nombre> > <area>24</area> > </sortD> > </inicio> > > > with the next command : xsort -c "/inicio" -e "*" -k "area/text()= " = >midocument.xml > and I get the output : <inicio> , and iterates indefinitely > > Like I can realize, this output just iterates when my document contai= ns = >attributes, > because I've typed the same command with my document w= ithout = >attributes and > the output was: > > <inicio> > <sortD> > <nombre>cc</nombre> > <area>24</area> > </sortD> > <sortD> > <nombre>ff</nombre> > <area>2</area> > </sortD> > <sortD> > <nombre>ww</nombre> > <area>4</area> > </sortD> > <sortD> > <nombre>aa</nombre> > <area>4</area> > </sortD> > <sortD> > <nombre>bb</nombre> > <area>6</area> > </sortD> > </inicio> > > I've read the xsort documentation and it has not commentaries about t= he = >attributes, > So, I'll like to know if is there a way or a command which I can use = to = >sort the > document, I use fedora Core 6,with the xmltk 2.0 , gcc 4.1.1 and I = >downloaded the > document from = >http://www.cs.washington.edu/homes/suciu/XMLTK/xmltk-v2.0.zip. > > > I'll thank you for your help, and thanks for your time. > >_________________________________________________________________ >Personnalisez votre Messenger avec Live.com = >http://www.windowslive.fr/livecom/ > > >----------------------------------------------------------------------= --- >Take Surveys. Earn Cash. Influence the Future of IT >Join SourceForge.net's Techsay panel and you'll get the chance to shar= e your >opinions on IT & business topics through brief surveys - and earn cash= >http://www.techsay.com/default.php?page=3Djoin.php&p=3Dsourceforge&CID= =3DDEVDEV >_______________________________________________ >Xmltk-devs mailing list >Xml...@li... >https://lists.sourceforge.net/lists/listinfo/xmltk-devs > |
|
From: Luis A. R. A. <soa...@ho...> - 2007-01-19 19:48:54
|
Hello, good day My name is Luis Alberto Ramírez, I'm from Mexico and I'm
trying to use
the xsort util from the xmltk package, but I found an error, I explain here
the details :
I try to sort a simple document like this
<?xml version="1.0"?>
<inicio>
<sortD a="2" >
<nombre>aa</nombre>
<area>4</area>
</sortD>
<sortD>
<nombre>ff</nombre>
<area>2</area>
</sortD>
<sortD>
<nombre>bb</nombre>
<area>6</area>
</sortD>
<sortD>
<nombre>ww</nombre>
<area>4</area>
</sortD>
<sortD>
<nombre>cc</nombre>
<area>24</area>
</sortD>
</inicio>
with the next command : xsort -c "/inicio" -e "*" -k "area/text()"
midocument.xml
and I get the output : <inicio> , and iterates indefinitely
Like I can realize, this output just iterates when my document contains
attributes,
because I've typed the same command with my document without
attributes and
the output was:
<inicio>
<sortD>
<nombre>cc</nombre>
<area>24</area>
</sortD>
<sortD>
<nombre>ff</nombre>
<area>2</area>
</sortD>
<sortD>
<nombre>ww</nombre>
<area>4</area>
</sortD>
<sortD>
<nombre>aa</nombre>
<area>4</area>
</sortD>
<sortD>
<nombre>bb</nombre>
<area>6</area>
</sortD>
</inicio>
I've read the xsort documentation and it has not commentaries about the
attributes,
So, I'll like to know if is there a way or a command which I can use to
sort the
document, I use fedora Core 6,with the xmltk 2.0 , gcc 4.1.1 and I
downloaded the
document from
http://www.cs.washington.edu/homes/suciu/XMLTK/xmltk-v2.0.zip.
I'll thank you for your help, and thanks for your time.
_________________________________________________________________
Personnalisez votre Messenger avec Live.com
http://www.windowslive.fr/livecom/
|
|
From: Venkataramanaidu, D. (Dinesh)** C. ** <vd...@al...> - 2007-01-10 10:07:30
|
Hello XML Toolkit developers,
While looking for a tool to sort XML tags i hit upon
xsort utility in sourceforge. This tool impressed me very much after
my initial testing of this tool with sample XML files.
Now i am trying to use xsort utility against bigger XML files,
and encountering a problem.
In the below XML template, if the total size of descendents of BLOCK1(or
BLOCK2)
exceeds ~100MB then running xsort on this XML file simply returns <TOP/>,
while the same thing works perfectly fine when the descendents
size less than 100MB.(For my testing, I am just embedding XML files of
certain
size as the descendents for each of the BLOCK.)
<TOP>
<BLOCK1 id="1">
......
</BLOCK1>
<BLOCK2 id="2">
......
</BLOCK2>
</TOP>
Inputs from your side regarding this issue will be of great help to me to.
My advance thank for your inputs.
Thanks,
Dinesh.V
|
|
From: Makoto O. <oni...@la...> - 2006-11-17 02:40:47
|
Hi folks,
Accompanied with fixing the unnecessary endContext() bug,
I have fixed other existing bugs and modified xmltk.
I have released xmltk1.1.
Here is the xmltk project news.
I clarify the limited usage of predicates and include the
change log.
XMLTK process multiple XPath expressions in XP{//,*} optionally
with limited predicates. Predicate expressions must follow the
following conditions simultaneously.
1. The last location step does not have any predicates. Location
steps except the last one can have predicates.
2. The last location step does not specify the same attribute
used in predicates.
3. // and predicate are not used in a same XPath expression when
the XML stream has nested with same elements.
4. A predicate follows the form of [attribute operator constant value]
or [position]. A position predicate comes before any attribute
predicates in the same location step.
5. When a location step has multiple predicates on attributes,
the order of attributes must be the same with the occurrences
of attributes in the XML stream.
For example, in DBLP example,
//inproceedings[1][contains(@key,'Onizuka')]/title
works correctly, because the DBLP XML stream is not nested with inproceedings.
ChangeLog
2006-11-16 Makoto Onizuka <on...@ac...>
* fixed xagg bug by which xagg didn't properly process the multiple
aggregation functions, which was discussed in the post to bug
tracker at 2002-10-22 04:57
http://sourceforge.net/tracker/index.php?func=detail&aid=626830&group_id=51270&atid=462691
* fixed the bug in dfafiler.cxx by which Lazy DFA invoked startContext(/)
before startDocument().
* added a xmltoolkit command, xdetector. xdetector inputs two files:
a query file (containing multiple queries) and an XML document.
xdetector invokes printAutomata(const char * filename) method in
IDfaFilter interface and serializes the NFAs and DFA to (current)/xpathQuery.xml.
Examples are included in sample/dblp directory (Read README in that directory).
2006-11-15 Makoto Onizuka <on...@ac...>
* fixed the GCC 3.3 static_cast compile errors in xnest, xpair, xtail
discussed in the post to bug tracker at 2003-10-18 23:13
https://sourceforge.net/tracker/index.php?func=detail&aid=825978&group_id=51270&atid=462691
* modified xrun to input XML stream from stdin discussed in the
post to xmltk-devs at 2003-02-10 11:00
https://sourceforge.net/mailarchive/forum.php?thread_id=1634460&forum_id=9098
* fixed the bug in Automata::isTerminal() discussed in the post to xmltk-devs
at 2006-11-11 14:34.
https://sourceforge.net/mailarchive/forum.php?forum_id=9098&max_rows=25&style=flat&viewmonth=200611&viewday=10
The bug caused unnecessary endContext() events.
* modified PString::buf which stores the cached value converted from XTOKEN.
* added printAutomata(const char * filename) method in IDfaFilter interface.
It serializes the NFAs and DFA to the specified file.
* added the document IMPLEMENTATION that describes the complicated part of
the Lazy DFA implementation.
makoto
|
|
From: Makoto O. <oni...@la...> - 2006-11-14 07:33:25
|
Steffi,
Now, I finished fixing the bug. Again, please replace the
Automata.h with the attached one.
makoto
From: Makoto ONIZUKA <oni...@la...>
Subject: Re: [Xmltk-devs] bug in calling end-Context?
Date: Mon, 13 Nov 2006 23:37:28 +0900 (JST)
Message-ID: <200...@la...>
>Steffi,
>
>I attached Automata.h. Please replace it with yours.
>I modified State * State::createEdge(LocationStep * sp) in Automata.h.
>
> switch(sp->getType()){
> case LocationStep::Attribute:
> // add @* edge to all states
> edges->push_back(Edge(this, this, Edge::T_AnyAttribute));
> // continue;
> case LocationStep::Element:
> case LocationStep::Text:
> case LocationStep::AnyElement:
> edges->push_back(Edge(this, next, sp));
> break;
>
>I noticed this problem somewhat before, but I didn't consider
>this mattered much.
>
>makoto
>
>
>From: Makoto ONIZUKA <oni...@la...>
>Subject: Re: [Xmltk-devs] bug in calling end-Context?
>Date: Mon, 13 Nov 2006 18:31:12 +0900 (JST)
>Message-ID: <200...@la...>
>
>>Steffi,
>>
>>I will send you the fixed version of XMLTK in
>>a different e-mail.
>>
>>makoto
>>
>>From: Makoto ONIZUKA <oni...@la...>
>>Subject: Re: [Xmltk-devs] bug in calling end-Context?
>>Date: Mon, 13 Nov 2006 12:17:03 +0900 (JST)
>>Message-ID: <200...@la...>
>>
>>>Steffi,
>>>
>>>Sorry to inform you I have the same problem with xmltk1.0.1
>>>that I modified minorly so that it can be compiled on gcc 3.4.2
>>>in linux.
>>>
>>>I will check to see the xmltk1.0.1.
>>>
>>>makoto
>>>
>>>
>>>From: "Stefanie Scherzinger" <ste...@gm...>
>>>Subject: Re: [Xmltk-devs] bug in calling end-Context?
>>>Date: Sun, 12 Nov 2006 21:15:32 -0500
>>>Message-ID: <de4...@ma...>
>>>
>>>>Hi Makoto,
>>>>
>>>>thanks for your reply!
>>>>
>>>>> I run xrun over your XML document and obtained the following
>>>>> result:
>>>>>>...
>>>>>
>>>>> This is somewhat different from your result. Did you use
>>>>> a different XPath expression?
>>>>
>>>>I guess there is something wrong with my code then. I had to do many
>>>>changes to make it compile for gcc 3.4.6 on RedHat Linux. Maybe I
>>>>introduced a bug in doing so.
>>>>
>>>>Is there a Linux binary available for xrun?
>>>>
>>>>Steffi
|
|
From: Stefanie S. <ste...@gm...> - 2006-11-13 18:40:43
|
Hi Maktoto, thank you so much for your help! Steffi |
|
From: Makoto O. <oni...@la...> - 2006-11-13 14:37:44
|
Steffi,
I attached Automata.h. Please replace it with yours.
I modified State * State::createEdge(LocationStep * sp) in Automata.h.
switch(sp->getType()){
case LocationStep::Attribute:
// add @* edge to all states
edges->push_back(Edge(this, this, Edge::T_AnyAttribute));
// continue;
case LocationStep::Element:
case LocationStep::Text:
case LocationStep::AnyElement:
edges->push_back(Edge(this, next, sp));
break;
I noticed this problem somewhat before, but I didn't consider
this mattered much.
makoto
From: Makoto ONIZUKA <oni...@la...>
Subject: Re: [Xmltk-devs] bug in calling end-Context?
Date: Mon, 13 Nov 2006 18:31:12 +0900 (JST)
Message-ID: <200...@la...>
>Steffi,
>
>I will send you the fixed version of XMLTK in
>a different e-mail.
>
>makoto
>
>From: Makoto ONIZUKA <oni...@la...>
>Subject: Re: [Xmltk-devs] bug in calling end-Context?
>Date: Mon, 13 Nov 2006 12:17:03 +0900 (JST)
>Message-ID: <200...@la...>
>
>>Steffi,
>>
>>Sorry to inform you I have the same problem with xmltk1.0.1
>>that I modified minorly so that it can be compiled on gcc 3.4.2
>>in linux.
>>
>>I will check to see the xmltk1.0.1.
>>
>>makoto
>>
>>
>>From: "Stefanie Scherzinger" <ste...@gm...>
>>Subject: Re: [Xmltk-devs] bug in calling end-Context?
>>Date: Sun, 12 Nov 2006 21:15:32 -0500
>>Message-ID: <de4...@ma...>
>>
>>>Hi Makoto,
>>>
>>>thanks for your reply!
>>>
>>>> I run xrun over your XML document and obtained the following
>>>> result:
>>>>>...
>>>>
>>>> This is somewhat different from your result. Did you use
>>>> a different XPath expression?
>>>
>>>I guess there is something wrong with my code then. I had to do many
>>>changes to make it compile for gcc 3.4.6 on RedHat Linux. Maybe I
>>>introduced a bug in doing so.
>>>
>>>Is there a Linux binary available for xrun?
>>>
>>>Steffi
>>>
>>>
|
|
From: Makoto O. <oni...@la...> - 2006-11-13 09:31:29
|
Steffi, I will send you the fixed version of XMLTK in a different e-mail. makoto From: Makoto ONIZUKA <oni...@la...> Subject: Re: [Xmltk-devs] bug in calling end-Context? Date: Mon, 13 Nov 2006 12:17:03 +0900 (JST) Message-ID: <200...@la...> >Steffi, > >Sorry to inform you I have the same problem with xmltk1.0.1 >that I modified minorly so that it can be compiled on gcc 3.4.2 >in linux. > >I will check to see the xmltk1.0.1. > >makoto > > >From: "Stefanie Scherzinger" <ste...@gm...> >Subject: Re: [Xmltk-devs] bug in calling end-Context? >Date: Sun, 12 Nov 2006 21:15:32 -0500 >Message-ID: <de4...@ma...> > >>Hi Makoto, >> >>thanks for your reply! >> >>> I run xrun over your XML document and obtained the following >>> result: >>>>... >>> >>> This is somewhat different from your result. Did you use >>> a different XPath expression? >> >>I guess there is something wrong with my code then. I had to do many >>changes to make it compile for gcc 3.4.6 on RedHat Linux. Maybe I >>introduced a bug in doing so. >> >>Is there a Linux binary available for xrun? >> >>Steffi >> >> |
|
From: Makoto O. <oni...@la...> - 2006-11-13 03:17:14
|
Steffi, Sorry to inform you I have the same problem with xmltk1.0.1 that I modified minorly so that it can be compiled on gcc 3.4.2 in linux. I will check to see the xmltk1.0.1. makoto From: "Stefanie Scherzinger" <ste...@gm...> Subject: Re: [Xmltk-devs] bug in calling end-Context? Date: Sun, 12 Nov 2006 21:15:32 -0500 Message-ID: <de4...@ma...> >Hi Makoto, > >thanks for your reply! > >> I run xrun over your XML document and obtained the following >> result: >>>... >> >> This is somewhat different from your result. Did you use >> a different XPath expression? > >I guess there is something wrong with my code then. I had to do many >changes to make it compile for gcc 3.4.6 on RedHat Linux. Maybe I >introduced a bug in doing so. > >Is there a Linux binary available for xrun? > >Steffi > > |
|
From: Stefanie S. <ste...@gm...> - 2006-11-13 02:15:46
|
Hi Makoto, thanks for your reply! > I run xrun over your XML document and obtained the following > result: >>... > > This is somewhat different from your result. Did you use > a different XPath expression? I guess there is something wrong with my code then. I had to do many changes to make it compile for gcc 3.4.6 on RedHat Linux. Maybe I introduced a bug in doing so. Is there a Linux binary available for xrun? Steffi |
|
From: Makoto O. <oni...@la...> - 2006-11-13 02:09:18
|
Hi Steffi, nice to see you. I run xrun over your XML document and obtained the following result: makoto@clos1:/cygdrive/c/home/makoto:[2]> xrun //person ttt.xml <person id="person1"> <name>Vidar Reinsch</name> <profile income="91891.75"> <age/> </profile> <watches/> </person><person id="person2"> <name>Rens Rifaut</name> </person>makoto@clos1:/cygdrive/c/home/makoto:[3]> This is somewhat different from your result. Did you use a different XPath expression? Only endContext(person) must be emitted if you specify //person. makoto --------------------------------------------------------------- Makoto Onizuka E-mail oni...@la... Open source software computing project, NTT Cyber Space Laboratories From: "Stefanie Scherzinger" <ste...@gm...> Subject: [Xmltk-devs] bug in calling end-Context? Date: Sat, 11 Nov 2006 00:34:20 -0500 Message-ID: <de4...@ma...> >Hi, > >I evaluated the query //person on the input file > > <a> > <person id="person1"> > <name>Vidar Reinsch</name> > <profile income="91891.75"> > <age/> > </profile> > <watches/> > </person> > > <person id="person2"> > <name>Rens Rifaut</name> > </person> ></a> > >but as a result I get > ><person id="person1"> ><name>Vidar Reinsch</name> ><profile income="91891.75"> ><age/> ></profile> ></person><person/> > >The result is correct if either the attribute in "profile" or the >"age" token are missing. It seems that the end-context for the XPath >expression is invoked at both </profile> and </person>. However, I >could not find out the reason beyond that. > >Did anybody else observe this behavior? And if so, how can I fix it? > >Thanks, >Steffi > >------------------------------------------------------------------------- >Using Tomcat but need to do more? Need to support web services, security? >Get stuff done quickly with pre-integrated technology to make your job easier >Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo >http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 >_______________________________________________ >Xmltk-devs mailing list >Xml...@li... >https://lists.sourceforge.net/lists/listinfo/xmltk-devs > > |
|
From: Stefanie S. <ste...@gm...> - 2006-11-11 05:34:27
|
Hi,
I evaluated the query //person on the input file
<a>
<person id="person1">
<name>Vidar Reinsch</name>
<profile income="91891.75">
<age/>
</profile>
<watches/>
</person>
<person id="person2">
<name>Rens Rifaut</name>
</person>
</a>
but as a result I get
<person id="person1">
<name>Vidar Reinsch</name>
<profile income="91891.75">
<age/>
</profile>
</person><person/>
The result is correct if either the attribute in "profile" or the
"age" token are missing. It seems that the end-context for the XPath
expression is invoked at both </profile> and </person>. However, I
could not find out the reason beyond that.
Did anybody else observe this behavior? And if so, how can I fix it?
Thanks,
Steffi
|
|
From: Makoto O. <oni...@la...> - 2005-02-23 04:05:51
|
The error messages below indicate you failed to compile libtsax and libxmltkdfa. Can you post or send me the whole error message of make? makoto From: Uday Krishnan <od...@ya...> Subject: [Xmltk-devs] installing xmltk... Date: Tue, 22 Feb 2005 19:20:45 -0800 (PST) Message-ID: <200...@we...> odin147> Hello folks, odin147> odin147> I tried to run make all in the makefile in the $XMLTKROOT directory ie (~uday/xmlRouter/xmltk/makefile) I get these error messages upon entering the xagg, xsort, ... directories(ie the command line directories)which make no sense. odin147> odin147> ld: fatal: library -ltsax: not found odin147> ld: fatal: library -lxmltkdfa: not found, odin147> Iam trying to run the set of command line applications on a sunOS 5.9. odin147> odin147> I set the PATH as odin147> export PATH=$PATH:/home/users/u/uday/xmlRouter/xmltk/: odin147> and the XMLTKROOT is also set as odin147> export XMLTKROOT=/home/users/u/uday/xmlRouter/xmltk, which means that the libraries tsax and xmltkdfa should be found by the linker. odin147> odin147> do you folks know what's going on?. odin147> odin147> u.k. odin147> odin147> odin147> odin147> odin147> --------------------------------- odin147> Do you Yahoo!? odin147> Yahoo! Sports - Sign up for Fantasy Baseball. |
|
From: Uday K. <od...@ya...> - 2005-02-23 03:20:53
|
Hello folks,
I tried to run make all in the makefile in the $XMLTKROOT directory ie (~uday/xmlRouter/xmltk/makefile) I get these error messages upon entering the xagg, xsort, ... directories(ie the command line directories)which make no sense.
ld: fatal: library -ltsax: not found
ld: fatal: library -lxmltkdfa: not found,
Iam trying to run the set of command line applications on a sunOS 5.9.
I set the PATH as
export PATH=$PATH:/home/users/u/uday/xmlRouter/xmltk/:
and the XMLTKROOT is also set as
export XMLTKROOT=/home/users/u/uday/xmlRouter/xmltk, which means that the libraries tsax and xmltkdfa should be found by the linker.
do you folks know what's going on?.
u.k.
---------------------------------
Do you Yahoo!?
Yahoo! Sports - Sign up for Fantasy Baseball. |
|
From: Makoto O. <oni...@la...> - 2003-12-03 09:41:41
|
From: "Anthony J. Starks" <ajs...@co...> Subject: [Xmltk-devs] Building xmltk on Mac OS X Date: Tue, 2 Dec 2003 19:32:11 -0500 Message-ID: <229...@co...> >Using a version pulled from CVS on 2003-12-02, under Mac OS X (10.3.1), >gcc version 3.3: I removed #include <sys/sysinfo.h>, to get most things >to build, It doesn't matter a lot. >however some things are still broken -- xsort, xpair, xnest: > >g++ -I. -I../include -I../xpathDFA -I../streamIndex -c -g -O2 -Wall >-Wno-ctor-dtor-privacy -Wno-sign-compare -Wno-deprecated >-D__gnu_cxx=std main.cpp >main.cpp: In member function `void CTailHandler::_OnCloseContext()': >main.cpp:264: error: non-lvalue in unary `&' >main.cpp: In member function `void CTailHandler::_OnCloseElement()': >main.cpp:278: error: non-lvalue in unary `&' >make[1]: *** [main.o] Error 1 I like to confirm that the line _Assign(&static_cast<IUnknownCL*>(m_pchOut), m_pchCur); occurs above errors, right? I compiled the XMLTK with some modifications using gcc 3.3.1 (cygwing special) and it works fine at least. makoto |
|
From: Anthony J. S. <ajs...@co...> - 2003-12-03 00:32:18
|
Using a version pulled from CVS on 2003-12-02, under Mac OS X (10.3.1), gcc version 3.3: I removed #include <sys/sysinfo.h>, to get most things to build, however some things are still broken -- xsort, xpair, xnest: g++ -I. -I../include -I../xpathDFA -I../streamIndex -c -g -O2 -Wall -Wno-ctor-dtor-privacy -Wno-sign-compare -Wno-deprecated -D__gnu_cxx=std main.cpp main.cpp: In member function `void CTailHandler::_OnCloseContext()': main.cpp:264: error: non-lvalue in unary `&' main.cpp: In member function `void CTailHandler::_OnCloseElement()': main.cpp:278: error: non-lvalue in unary `&' make[1]: *** [main.o] Error 1 g++ -I. -I/Users/ajstarks/Code/xmltk/include -I/Users/ajstarks/Code/xmltk/xpathDFA -I/Users/ajstarks/Code/xmltk/streamIndex -c -g -O2 -Wall -Wno-ctor-dtor-privacy -Wno-sign-compare -Wno-deprecated -D__gnu_cxx=std xpair.cpp xpair.cpp: In member function `void CPairHandler::_OnCloseElement(Variable*)': xpair.cpp:158: error: non-lvalue in unary `&' make[1]: *** [xpair.o] Error 1 g++ -I. -I/Users/ajstarks/Code/xmltk/include -I/Users/ajstarks/Code/xmltk/xpathDFA -I/Users/ajstarks/Code/xmltk/streamIndex -c -g -O2 -Wall -Wno-ctor-dtor-privacy -Wno-sign-compare -Wno-deprecated -D__gnu_cxx=std xnest.cpp xnest.cpp: In member function `void CNestHandler::_OnCloseElement(Variable*)': xnest.cpp:313: error: non-lvalue in unary `&' make[1]: *** [xnest.o] Error 1 |
|
From: Makoto O. <on...@ac...> - 2003-10-10 09:56:13
|
Is the error occured by a scandir()? Then, probablly, need to modify that part, because the scandir() is operating system depended function. There is no such function in Solaris, and in your environment, it seems to me that the signature of the scandir() is different from that in Linux. Unfortunately, I don't know much about Tru64 OSF5.1. makoto From: Michael Mader <m....@gs...> Subject: [Xmltk-devs] compilation on Tru64 OSF5.1/g++ 3.3.1 Date: Wed, 08 Oct 2003 09:59:58 +0200 Message-ID: <3F8...@gs...> >Hi everybody > >I'm struggling with an compilation error: > >g++ -c xtraverse.cxx >xtraverse.cxx: In function `void traverse(char*)': >xtraverse.cxx:183: error: invalid conversion from `int (*)(const void*, >const > void*)' to `int (*)(dirent**, dirent**)' > >Did anybody observe that in before? >Any work-around? > >Regards > >Michael >-- >Michael T. Mader >Institute for Bioinformatics/MIPS, GSF >Ingolstaedter Landstrasse 1 >D-80937 Neuherberg >0049-89-3187-3576 > >XML can be a simplifying choice or a complicating one. There is a lot of >hype surrounding it, but don't become a fashion victim by either >adopting or rejecting it uncritically. Choose carefully and bear the >KISS principle in mind. > Eric Steven Raymond: The Art of Unix Programming, 2003 > > >------------------------------------------------------- >This sf.net email is sponsored by:ThinkGeek >Welcome to geek heaven. >http://thinkgeek.com/sf >_______________________________________________ >Xmltk-devs mailing list >Xml...@li... >https://lists.sourceforge.net/lists/listinfo/xmltk-devs > |
|
From: Michael M. <m....@gs...> - 2003-10-08 08:00:52
|
Hi everybody I'm struggling with an compilation error: g++ -c xtraverse.cxx xtraverse.cxx: In function `void traverse(char*)': xtraverse.cxx:183: error: invalid conversion from `int (*)(const void*, const void*)' to `int (*)(dirent**, dirent**)' Did anybody observe that in before? Any work-around? Regards Michael -- Michael T. Mader Institute for Bioinformatics/MIPS, GSF Ingolstaedter Landstrasse 1 D-80937 Neuherberg 0049-89-3187-3576 XML can be a simplifying choice or a complicating one. There is a lot of hype surrounding it, but don't become a fashion victim by either adopting or rejecting it uncritically. Choose carefully and bear the KISS principle in mind. Eric Steven Raymond: The Art of Unix Programming, 2003 |
|
From: Makoto O. <on...@ac...> - 2003-06-24 03:32:21
|
TJ, are you there? It seems to me that the PLANX paper describes the wrong xsort example. Is that right? It should be file2xml -s. | xsort -b -t "size/text():%i" -c /directory = -e //file -k "size/text()" | xhead -c /directory -e file But, there are two issues on the above example. 1. The binary option (-b) doesn't work fine. The xcat has the same problem. But nothing major = modification has been made on the xmltk lib. 2. xsort doesn't sort entries with integer. makoto From: Wol...@at... Subject: [Xmltk-devs] shell quoting Date: Mon, 23 Jun 2003 14:00:25 +0200 Message-ID: <OF5...@bs...> >Thanx for you quick answers! > >Quoting did not do the trick! > >yacc(lazyDFA) error (line 1): parse error at ":" in "size/text():%i" > Root::parse(), line =3D 861 Root::parse(), line =3D 922 >Query::parse(), line =3D 39 > > >Do I have an old version os xpathDFA? > >sorry to bother you again > >mit freundlichen Gr=FC=DFen/best regards > >Wolfgang Schrecker > >"Organic models define people in terms of their uniqueness, that is, t= heir >sameness plus their differences." >Gerald M. Weinberg, 'Becoming a Technical Leader' S. 10 > > > >This e-mail is destined for the above mentioned recipient. In case you= received this e-mail by accident, we would appreciate it if you could = contact the sender and delete all copies stored on your computer. >Please be aware that the security and confidentiality of electronic da= ta transmitted by e-mail is not completely guaranteed and that data may= be seen, copied, downloaded or changed by third persons during transmi= ssion. >Atos Origin accepts no liability for the security and confidentiality = of data and documents sent by e-mail. Please make sure that all importa= nt messages will be confirmed in writing by means of a telefax or a let= ter. = > > > >------------------------------------------------------- >This SF.Net email is sponsored by: INetU >Attention Web Developers & Consultants: Become An INetU Hosting Partne= r. >Refer Dedicated Servers. We Manage Them. You Get 10% Monthly Commissio= n! >INetU Dedicated Managed Hosting http://www.inetu.net/partner/index.php= >_______________________________________________ >Xmltk-devs mailing list >Xml...@li... >https://lists.sourceforge.net/lists/listinfo/xmltk-devs |
|
From: <Wol...@at...> - 2003-06-23 12:00:41
|
Thanx for you quick answers!
Quoting did not do the trick!
yacc(lazyDFA) error (line 1): parse error at ":" in "size/text():%i"
Root::parse(), line =3D 861 Root::parse(), line =3D 922
Query::parse(), line =3D 39
Do I have an old version os xpathDFA?
sorry to bother you again
mit freundlichen Gr=FC=DFen/best regards
Wolfgang Schrecker
"Organic models define people in terms of their uniqueness, that is, their
sameness plus their differences."
Gerald M. Weinberg, 'Becoming a Technical Leader' S. 10
This e-mail is destined for the above mentioned recipient. In case you recei=
ved this e-mail by accident, we would appreciate it if you could contact the=
sender and delete all copies stored on your computer.
Please be aware that the security and confidentiality of electronic data tra=
nsmitted by e-mail is not completely guaranteed and that data may be seen, c=
opied, downloaded or changed by third persons during transmission.
Atos Origin accepts no liability for the security and confidentiality of dat=
a and documents sent by e-mail. Please make sure that all important messages=
will be confirmed in writing by means of a telefax or a letter.
|
|
From: Makoto O. <oni...@la...> - 2003-06-18 01:13:57
|
Hi Wolfgang, From: Wol...@at... Subject: [Xmltk-devs] questions Date: Tue, 17 Jun 2003 14:10:47 +0200 Message-ID: <OFF...@bs...> >I stumbled upon your paper "XMLTK: An XML Toolkit for Scalable XML Stream >Processing" >(it dropped out of the printer) and liked it a lot. > >But xhead is not in the distribution (xtail ?) There is a "makefile.xhead" in the xtail directory. Try to use it to compile the xhead. e.g. make -f makefile.xhead; >and the example > >"file2xml -s. | xsort -b -c /directory -e //file -k size/text():%i | xhead >-c /directory -e file" > >does not parse the ':%i' Probably, you need to make the command escape from a shell interpretation. e.g. file2xml -s. | xsort -b -c /directory -e //file -k "size/text():%i" | xhead If you still have a problem, please show us an error message. >plus, the following line(s) did NOT compile on my SUSE8.2 (gcc 3.3) > >//_Assign(&static_cast<IUnknownCL*>(m_pchCur), m_pchOut); > >but those did: > > IUnknownCL* _Ass = static_cast<IUnknownCL*>(m_pchCur); > _Assign(&_Ass , m_pchOut); Thanks for your feedback. I have never tried to compile XMLTK with gcc 3.3 yet. makoto |
