Search Results for "structure"

Supports strings, arrays, arrays of objects, and nested object structures. The schema is not tied to the structure of the page you're scraping, allowing you to pull the data in the structure of your choosing. The API is entirely composable, giving you great flexibility in how you scrape each page. Paginate through websites, scraping each page. X-ray also supports a request delay and a pagination limit. Scraped pages can be streamed to a file, so if there's an error on one page, you won't lose what you've already scraped. ...

========== NOTE: (AS OF 11/05/2015) 4chan html structure has changed, full images are downloaded as well as the thumbnail. Fix coming shortly (after my exams are over) to stop the thumbnails from downloading. ========== This is the first release of my 4chan image downloader. This downloader packs loads of great features such as the search ability. Check the features section and be sure to let me know if you want a feature added.

ht://Check is more than a link checker. It's particularly suitable for checking broken links, anchors and web accessibility barriers, but retrieved data can also be used for Web structure mining. Uses a MySQL backend. Derived from ht://Dig.

State of the art query expansion module for Lucene combined with BM25 ranking function which can take into account some semantic structure in the query using our clauses approach.

This project uses a combination of JSP tag, Factory pattern classes and XML to display directory structures. The directory will be specified in the JSP tag, then it will call the package to generate a XML document that describes the directory structure.

Webfilemanger, written in OO-Php, with fulltext retrieval capabilities (just for PDF files at the moment...). Interface similar to explorer/konqueror, with tree structure on the left side. mod_mysql_auth integrated to grant user control, and OWASP ph

Open Taxonomy - Web-based end-user navigation and editing of a tag-based taxonomy. Uses Ruby on Rails to support collaborative building of a web directory structure. Popular tags/categories can be "Elected" to become the official taxonomy.

PHP based CMS system which is designed to run on any PHP capable web-server Features: - No own templating language - No cryptographic urls (urls will follow menu structure) - XHTML 1.0 Strict, CSS 2.1 compliant - Follow WAI suggestions - I18n

Syncato is a Weblog Web Services system built on top of Berkeley DB XML, Webware and Python. It has a number of unique features; XPath access to all content via URLs, XSL-T presentation and extremely flexible database structure.

Potnia is a subject gateway software, developed for scientific directories, including journals, papers, bibliographic databases, research webs and so on. Database structure is compliant to Dublin Core Metadata Set

Keeping it simple and fast. To be used by the TUX Web Server and runnig from ram partition. Or by any other server. Change content periodicly instead of dynamicly. Use the file structure as base for organising you\'re site. Easy to use

RAHoo is a PHP-based, self-documenting, easy to install, fully customizaable web application written in PHP using MySQL and a suitable web server. Use it to keep a directory structure of links similar to Yahoo or the Google search directories but focuse

TopoWeb is about web topology, the linked structure of the web. Harness the power of link awareness, a method not just for surfing hyperlinks backwards to find content, but also, for publishing content.

A PHP photo album storing all the non-graphic data in MySQL. You can write and display comments on pictures in multi languages. Exporia's directory structure is streight-forward and it works with PHP's safe mode.

The jGroups Package is a Java package providing a few classes to abstract over the structure and contents of Yahoo! Groups message archives. Due to the state the package is currently in it is only available from its CVS repository.

Rakibolana is an on-line dictionary in which the words of languages based on south-east asian language structure. Rakibolana uses J2EE containers includin tomcat and Jboss. The technology involved uses Design patterns, EJB, JSP, Struts framework, SAX par

A system to retrieve and display in 3D the structure of the Internet (or as much as can be analysed). It should allow for an interesting perspective of the way pages are linked and clustered. It will hopefully also provide a more intuitive way of browsing