[Introspector-developers] Example SQL and XML of DOTGNU/CSCC/csnodes.c
Status: Beta
Brought to you by:
mdupont
Menu
▾
▴
[Introspector-developers] Example SQL and XML of DOTGNU/CSCC/csnodes.c
|
From: James M. D. <mdu...@ya...> - 2002-04-18 22:24:39
|
Dear Fellow DotGNUers, I have done the first step in actually *Doing* something for DotGNU and towards a bridge between the gcc and pnet and not just thinking and talking about what I want to do all the time. Taking the csnodes.c and running it through the introspector for one. Tweaking and *SIMPLIFING* the database model so that you can probably run in on *ANY* sql database server. Putting it all on a server that you can download and play with. Sorry that the last release from me did not have any documentation or tips on how to use it. One has to be carefull, the asts are very BIG and hard to use. But we will get there :=) I have reduced the database mode down to 3 tables *node_base contains the ID and the type of the node *node_attr contains the ID of the node, type and value of the attribute. *node_usage contains the fromid, toid , types of nodes and type of relationship With these three tables you have a full graph of the parse tree of the c# compilers node structure. The SQL for the tables is located on http://introspector.sourceforge.net/dotgnu/simple.sql The data for inserting into the database you will find in a gz sql file here : http://introspector.sourceforge.net/dotgnu/____global.xml.sql.gz The XML that was dumped you will find here : http://introspector.sourceforge.net/dotgnu/____global.xml.gz (If you are interested in parsing the XML yourself ) The XML has the following structure: <xmlroot> # the root of the document # tells you what file that was compiled to get these nodes <xml_cfile name= NAME OF SOURCE FILE/> # each tree node in the parse tree produces such a xml entry <node idx=NUMBER OF NODE node_name=TYPE OF NODE > # RELATIONSHIPS - each relation to a different node is contained inside of the NODE element < # EACH RELATION is an entity of one of the following types name | type | unql | size | min | max | args | prms | scpe | flds | body | chan | valu | op_0 | op_2 | val | purp | next idx="THE ID OF THE OTHER NODE" ref_node_name="THE TYPE OF OTHER NODE TYPE" /> # ATTRIBUTES SOME of the following attributes might be set : <strg>THE VALUE OF A STRING</strg> <srcl>SOURCE LINE</srcl> <srcp>SOURCE FILE</srcp> <prec>PRECISION</prec> <algn>ALIGNMENT</algn> <built_in>ALIGNMENT</built_in> <low>LOW BYTE of a Constant</low> <high>LOW BYTE of a Constant</high> <lngth>Length of a string</lngth> <qualconst>is const</qualconst> <qualrest>?forgot for now :(</qualrest> <qualvol>is volitile</qualcol> <str>SOME TYPE OF PARAMETER FOR THE NODE (extern for functions, struct for records)</str> </node> # MANY OTHER NODEs may follow </xmlroot> I am also testing a simple query language for accessing the nodes. more about that next time. The files are located here : http://introspector.sourceforge.net/dotgnu/ I hope that you can use these files and find them helpfull. Next step is to create a cross reference table between the GCC and the CSCC cores. Following are two example queries that show you the power of the database. Mike First is a list of all the identifiers of record_types who name begin with IL introspector_simple=# select distinct value from node_usage u, node_attr a , node_base b where a.attr_type = 'strg' and a.value like '"IL%' and a.id=b.id and u.to_id = b.id and u.usage = 'name' and u.from_type = 'record_type'; value ---------------------------------------- "ILNode_AddressOf__" "ILNode_AddressOf_vtable__" "ILNode_ArrayAccess__" "ILNode_ArrayAccess_vtable__" "ILNode_ArrayInit__" "ILNode_ArrayInit_vtable__" "ILNode_AsIs__" "ILNode_AsIs_vtable__" "ILNode_Assign__" "ILNode_Assign_vtable__" "ILNode_AttrArgs__" "ILNode_BaseAccess__" "ILNode_BaseAccess_vtable__" "ILNode_BaseElement__" "ILNode_BaseElement_vtable__" "ILNode_BinaryArith__" "ILNode_BinaryArith_vtable__" "ILNode_BinaryBitwise__" "ILNode_BinaryBitwise_vtable__" "ILNode_BinaryExpression_vtable__" "ILNode_BinaryShift__" "ILNode_BinaryShift_vtable__" "ILNode_CastSimple__" "ILNode_CastSimple_vtable__" "ILNode_CastType__" "ILNode_CastType_vtable__" "ILNode_Concat__" "ILNode_Concat_vtable__" "ILNode_Constant__" "ILNode_Constant_vtable__" "ILNode_DecimalType__" "ILNode_DerefField__" "ILNode_DerefField_vtable__" "ILNode_Deref__" "ILNode_Deref_vtable__" "ILNode_DocComment__" "ILNode_DocComment_vtable__" "ILNode_DummyBinaryExpr__" "ILNode_DummyBinaryExpr_vtable__" "ILNode_DummySem_vtable__" "ILNode_DummyUnaryExpr__" "ILNode_DummyUnaryExpr_vtable__" "ILNode_Dummy_vtable__" "ILNode_Expression_vtable__" "ILNode_FixAddress__" "ILNode_FixAddress_vtable__" "ILNode_FixExpr__" "ILNode_FixExpr_vtable__" "ILNode_FixedDeclList_vtable__" "ILNode_Identifier__" "ILNode_Identifier_vtable__" "ILNode_IndexerAccess__" "ILNode_IndexerAccess_vtable__" "ILNode_IsNonNull__" "ILNode_IsNonNull_vtable__" "ILNode_IsNull__" "ILNode_IsNull_vtable__" "ILNode_LValueBinaryExpr_vtable__" "ILNode_LValueNoRefUnaryExpr__" "ILNode_LValueNoRefUnaryExpr_vtable__" "ILNode_LValueNoRef_vtable__" "ILNode_LValueUnaryExpr_vtable__" "ILNode_LValue__" "ILNode_LValue_vtable__" "ILNode_List_vtable__" "ILNode_LocalVariableType__" "ILNode_LocalVariableType_vtable__" "ILNode_LogicalAnd__" "ILNode_LogicalAnd_vtable__" "ILNode_LogicalNot__" "ILNode_LogicalNot_vtable__" "ILNode_LogicalOr__" "ILNode_LogicalOr_vtable__" "ILNode_MemberAccess__" "ILNode_MemberAccess_vtable__" "ILNode_MemberField__" "ILNode_MemberField_vtable__" "ILNode_MemberProperty__" "ILNode_MemberProperty_vtable__" "ILNode_NamedArg__" "ILNode_NamedArg_vtable__" "ILNode_Namespace__" "ILNode_Namespace_vtable__" "ILNode_Neg__" "ILNode_Neg_vtable__" "ILNode_NoOverflow__" "ILNode_NoOverflow_vtable__" "ILNode_NoPedantic__" "ILNode_NoPedantic_vtable__" "ILNode_Overflow__" "ILNode_Overflow_vtable__" "ILNode_Pedantic__" "ILNode_Pedantic_vtable__" "ILNode_PostDec__" "ILNode_PostDec_vtable__" "ILNode_PostInc__" "ILNode_PostInc_vtable__" "ILNode_PreDec__" "ILNode_PreDec_vtable__" "ILNode_PreInc__" "ILNode_PreInc_vtable__" "ILNode_QualIdent__" "ILNode_QualIdent_vtable__" "ILNode_Relational__" "ILNode_Relational_vtable__" "ILNode_Statement__" "ILNode_Statement_vtable__" "ILNode_StaticField__" "ILNode_StaticProperty__" "ILNode_StaticProperty_vtable__" "ILNode_ToBool__" "ILNode_ToBool_vtable__" "ILNode_ToConst__" "ILNode_ToConst_vtable__" "ILNode_TypeSuffix__" "ILNode_TypeSuffix_vtable__" "ILNode_UnaryExpression_vtable__" "ILNode_Unsafe__" "ILNode_Unsafe_vtable__" "ILNode_UserBinaryOp__" "ILNode_UserBinaryOp_vtable__" "ILNode_UserConversion__" "ILNode_UserConversion_vtable__" "ILNode_UserIncOrDec__" "ILNode_UserIncOrDec_vtable__" "ILNode_UserLogical__" "ILNode_UserLogical_vtable__" "ILNode_UserPostDec__" "ILNode_UserPostDec_vtable__" "ILNode_UserPostInc__" "ILNode_UserPostInc_vtable__" "ILNode_UserPreDec__" "ILNode_UserPreDec_vtable__" "ILNode_UserPreInc__" "ILNode_UserPreInc_vtable__" "ILNode_UserUnaryOp__" "ILNode_UsingAlias__" "ILNode_UsingAlias_vtable__" "ILNode_UsingNamespace__" "ILNode_UsingNamespace_vtable__" "ILNode__" "ILNode_vtable__" Following is an example query that shows you what type of nodes point to what other types of nodes in the current data set (It is loading right now, so not finished yet). As you can see there is a lot of information about the tree nodes as records and fields. 1020 fields in the database, not bad! introspector_simple# select from_type,to_type,usage,count(*) from node_usage group by from_type,to_type,usage order by count(*) desc; from_type | to_type | usage | count ---------------+-----------------+-------+------- field_decl | identifier_node | name | 1020 field_decl | integer_cst | size | 1020 field_decl | record_type | scpe | 1007 field_decl | field_decl | chan | 917 field_decl | pointer_type | type | 754 tree_list | tree_list | chan | 737 function_decl | function_type | type | 512 function_decl | identifier_node | name | 512 tree_list | pointer_type | valu | 495 function_decl | function_decl | chan | 485 type_decl | type_decl | chan | 345 function_type | integer_cst | size | 322 function_type | tree_list | prms | 319 record_type | field_decl | flds | 265 record_type | integer_cst | size | 265 tree_list | void_type | valu | 260 type_decl | identifier_node | name | 258 field_decl | integer_type | type | 229 type_decl | record_type | type | 207 integer_cst | integer_type | type | 193 record_type | identifier_node | name | 182 pointer_type | integer_cst | size | 165 record_type | record_type | unql | 152 tree_list | integer_type | valu | 152 integer_type | integer_cst | max | 140 integer_type | integer_cst | min | 140 integer_type | integer_cst | size | 140 function_type | integer_type | retn | 133 type_decl | integer_type | type | 129 integer_type | type_decl | name | 121 integer_type | integer_type | unql | 106 pointer_type | record_type | ptd | 105 record_type | type_decl | name | 103 function_type | pointer_type | retn | 91 var_decl | identifier_node | name | 78 function_type | void_type | retn | 71 var_decl | integer_cst | size | 71 var_decl | var_decl | chan | 69 const_decl | enumeral_type | type | 65 const_decl | identifier_node | name | 65 tree_list | identifier_node | purp | 64 tree_list | integer_cst | valu | 64 const_decl | const_decl | chan | 60 var_decl | integer_type | type | 44 pointer_type | integer_type | ptd | 26 type_decl | function_decl | chan | 24 var_decl | pointer_type | type | 24 function_decl | type_decl | chan | 19 tree_list | enumeral_type | valu | 19 pointer_type | pointer_type | unql | 18 pointer_type | function_type | ptd | 17 field_decl | union_type | scpe | 13 tree_list | real_type | valu | 13 field_decl | enumeral_type | type | 12 function_type | real_type | retn | 12 enumeral_type | integer_cst | max | 11 enumeral_type | integer_cst | min | 11 enumeral_type | integer_cst | size | 11 enumeral_type | tree_list | csts | 11 field_decl | record_type | type | 11 parm_decl | function_decl | scpe | 11 parm_decl | identifier_node | name | 11 parm_decl | integer_cst | size | 11 type_decl | enumeral_type | type | 11 array_type | integer_cst | size | 9 array_type | integer_type | domn | 9 field_decl | array_type | type | 9 pointer_type | type_decl | name | 9 type_decl | pointer_type | type | 9 array_type | integer_type | elts | 8 complex_type | integer_cst | size | 8 complex_type | type_decl | name | 8 function_decl | parm_decl | args | 8 function_decl | var_decl | chan | 8 function_type | record_type | retn | 8 pointer_type | void_type | ptd | 8 type_decl | complex_type | type | 8 parm_decl | pointer_type | argt | 7 parm_decl | pointer_type | type | 7 pointer_type | pointer_type | ptd | 7 type_decl | real_type | type | 7 var_decl | function_decl | chan | 7 enumeral_type | enumeral_type | unql | 6 enumeral_type | type_decl | name | 6 real_type | integer_cst | size | 6 real_type | type_decl | name | 6 tree_list | complex_type | valu | 6 type_decl | const_decl | chan | 6 var_decl | array_type | type | 6 const_decl | type_decl | chan | 5 function_type | enumeral_type | retn | 4 function_type | function_type | unql | 4 function_type | type_decl | name | 4 parm_decl | integer_type | argt | 4 parm_decl | integer_type | type | 4 tree_list | record_type | valu | 4 type_decl | function_type | type | 4 var_decl | record_type | type | 4 void_type | type_decl | name | 4 array_type | pointer_type | elts | 3 function_type | complex_type | retn | 3 parm_decl | parm_decl | chan | 3 real_type | real_type | unql | 3 type_decl | var_decl | chan | 3 type_decl | void_type | type | 3 void_type | void_type | unql | 3 array_type | record_type | elts | 2 field_decl | real_type | type | 2 field_decl | union_type | type | 2 integer_type | identifier_node | name | 2 pointer_type | real_type | ptd | 2 string_cst | array_type | type | 2 union_type | field_decl | flds | 2 union_type | integer_cst | size | 2 var_decl | string_cst | init | 2 var_decl | type_decl | chan | 2 boolean_type | integer_cst | size | 1 boolean_type | type_decl | name | 1 type_decl | boolean_type | type | 1 type_decl | union_type | type | 1 __________________________________________________ Do You Yahoo!? Yahoo! Tax Center - online filing with TurboTax http://taxes.yahoo.com/ |
