ssSearchEngine

About ============= ssSearchEngine is a search engine designed to search over tables and lists in web pages. Development Team: - Azadeh Nikfarjam <azadeh.nikfarjam@gmail.com> - Ehsan Emadzadeh <eemadzadeh@gmail.com> - Matt Gleason <matt.gleason@gmail.com> Setup ============= Prerequisites: - Linux OS - "graphviz" tools, install using this command: sudo apt-get install graphviz - MySql server To use the search engine with existing data you need to do following steps: 1. create a database 2. restore database_data.sql into the created database 3. update configuration.conf file to reflect your database settings and paths 4. run core.SearchEngine and pass query as argument: java -classpath bin:lib/mysql-connector-java-5.1.14-bin.jar:lib/urlrewrite-3.2.0.jar: lib/weka.jar:lib/commons-codec-1.4.jar:lib/commons-logging-1.1.1.jar: lib/httpclient-4.1.1.jar:lib/httpclient-cache-4.1.1.jar:lib/httpcore-4.1.jar: lib/httpmime-4.1.1.jar:lib/jsoup-1.6.1.jar:lib/lucene-core-3.3.0.jar: lib/semanticvectors-2.4.jar:lib/gson-1.7.1.jar:lib/json.jar:lib/commons-lang3-3.0.1.jar :lib/servlet-api-2.5.jar:lib/dragontool.jar:lib/stanford-postagger.jar core.SearchEngine "YOUR QUERY" this will generate a image file for the result graph in the specified path in "configuration.conf" Web interface ============= Prerequisites: - Apache web server - PHP5 apache module 1. Copy following files and folders to web directory: - "lib" - "bin" - files in "php" 2. update configuration.conf result image path to "x.png" in web directory 3. update permission of the folders: chmod 777 -R web_root_directory 4. browse "Search.php" in your browser Crawling HTML tables ============= run crawler.Crawler Parsing HTML tables ============= run core.TableParser version 0.1