Menu

Thesis Table Of Contents

Zsolt J.

Thesis Table Of Contents

  • Q: where to put "similar tools" section? :)
  • Q: need "naming conventions" in DevManual/Methods ?
  • Q: really need PPT ?

TODO: insert "trans. level" stuff to somewhere

  • Introduction
    • Justification
      • many databases, need time to search manually on all of them
      • need a tool which does the stuff
      • interesting issue :D
      • it needs wise planning, how to handle sites universally
    • Project (short)
      • combinates searching in more websites
      • runs through all the sites, submits search, parses result list and pubpages
      • stores data in db
      • shows on GUI
  • User Manual
    • Problem (short)
      • many databases, need time to search manually on all of them
      • site list
      • need proxy list, they don't tolerate rare querying
    • Methods (short)
      • runs through all the sites, submits search, parses result list and pubpages
      • stores data in db
      • shows on GUI
    • How to use
      • tutorial with screenshots, descriptions
  • Developer Manual
    • Problem (detailed)
      • needed a universal engine - which handles all sites
      • html parsing, regex
      • q
    • Methods (detailed) + definitions
      • universal engine, based on config files
      • regex patterns for each site
      • caching
      • multithreading
    • Structure
      • packages
      • classes
      • database
      • gui
    • Test plan
      • Method and results
    • Future ideas
      • search result tabs
      • statistics, diagrams

Presentation plan (for the final exam)

  • Problem
    • many sites
    • need to search on all of them
    • they display data differently (+screenshots, red circles)
    • they don't tolerate rare querying
  • Solution
    • needed to find similarities, and rules
    • regex patterns, what type of patterns do we need (list, list item, etc.)
    • submit search, download & parse pages, store results
    • use proxy list, random proxy for every request
  • Result (marketing :D)
    • nice GUI (+screenshots)
    • easy to use, screenshots of a search (type in, in progress, result list, pub info)
    • config panels
    • expandable with more databases
  • Future ideas
    • search tabs
    • stats, diags
    • homepage where users of the world can share more PDB definitions for the program (?)

Related

Wiki: Home