A software used to crawler websites and make sitemaps.
Desenvolvido em Delphi X2 mas com total compatibilidade para Delphi 7, esta ferramenta vasculha um site determinado pelo usuario e atravez das tags "<a href='..." inicia um processo de Crawling no mesmo. Armazenando as informacoes em um banco de dados SQLli existe a possibilidade da criacao de um mapa do website. Developed in Delphi X2 but with full compatibility for Delphi 7, this tool scans a site given by the User and trough tags "<a href = '..." begins the process of Crawling therein. Storing information in a database SQLli enables the creation of a sitemap.
XML bindings and a GUI for creating and editing XBMC Scrapers
This program is an editor for creating XBMC Scrapers. It is similar to ScraperEditor, an other editor using ScraperXML, that runs under .Net environment. This program runs under Sun/Oracle's Java Runtime. HELP WANTED! I am looking for someone, who would help me writing documentation, like user's manual and on-line help. Also if someone want to help, translated language files are always welcome...
Jake is a console based app written in python and qt4. Plugins will let you do almost anything, for example, search in google, translate, view images, talk with it (aka AI bot). Also, skining system will let you choose how should jake look.
ARADO RSS Feed Reader is a URL Database for Websearch and RSS Feed Reading, which saves your added Bookmarks & RSS-Feeds and syncs newest URLs with your connected devices. Store and Search your all your URLs in ARADO. As framework c++ / Qt is used.
Multi-Function web search tool. It does reverse phone lookups, IP and domain lookups, zip and area code, Google searches. Windows based program. Use the installer or run the stand alone program without having to install anything.
TorrentPlunder allows you to easily and fastly search for many torrents over the same tracker. To use it, create a file with any text editor and fill it line by line with the search string(s) then run it and follow the instructions!
Nucular Archiving System for creating full text indices for fielded data. Python API, web, and command line interfaces. Fast. Very light weight. Concurrent read/writes with no possible locking issues. No server process. Proximity. Facets. Funny name.
Rivulet base on Nutch and Lucene.It's use a user-interface (web browser) to operate all programs,And Solr the same functionality, but through visual means configured to support distributed and clustering, is a powerful enterprise search software
A web crawler which uses regular expressions on text downloaded from a site.
A crawler which can get contents from web sites.
The crawler can crawl many types of web sites, including portals, digital newspapers, twitter-likes among others.
Free plagiarism software for Windows
Easy-to-use plagiarism detection software for Windows XP and later. Ideal for students, teachers, writers and bloggers. Turnitin free alternative.
Guide and Script to Download Google History
Ever wanted to download all your Google history and then perhaps delete it? For people who would like to download their own Google history. Simply; 1. Goto https://history.google.com/history/lookup?q=&output=rss&num=<B>1000</B>&start=<B>0</> and save the page as xml (its a rss feed) 2. then goto https://history.google.com/history/lookup?q=&output=rss&num=<B>2000</B>&start=<B>1000</B> and save as xml (and then change num = 3000 and start = 2000, then 4000 & 3000 etc...you get the idea.) This will work well with 99% of users as they will only have a few pages. Others can use this project. It's relies on automating a user's browser session. Read the wiki to follow the steps needed to do this before using the script.
Aura Link Spirit - Link/Domain Checker
Free Aura Link Spirit‘s features gives you the ability to check; Google Pagerank Google Index, Bing Index, Total # of Active Backlinks, Total # of Unique Active Backlinks, Total # of NoFollow Links that Point to Link/Domain, Alexa Traffic Rank, Alexa Links, Dmoz List, Total # of Facebook Likes, Page Title… It has proxy support and multi-threaded
Starts web search upon any selected text in any app with a hotkey.
If you mark some text in the browser and right-click it, there is an option in the context menu to "Search Google" for that selected phrase. Have you ever wondered, why isn't such an option present in many other every day apps? A solution arrives with Web Search Quickey! Now you can perform all your searches from nearly any application, all you need to do is to have some (preferably meaningful) text selected and press the hotkey. The search results will be instantly presented in your default browser (in a new tab, if it happens to be already open). Latest version allows to choose the search engine and define your preferred hotkey. You may need to add exception to your anti-virus, firewall etc. Please find more details in a readme file.
Portable Open Source Intelligence (OSINT) Web Browser
Oryon OSINT Browser is a web browser designed to assist researchers in conducting Open Source Intelligence (OSINT) investigations. Oryon comes with dozens of pre-installed tools and a selected set of links cataloged by category. To safely use all Oryon Browser options, it is recommended that you take the following steps: 1. Check your browser privacy settings. Reset all settings if necessary or make the necessary changes. 2. Disable browsing history (extension: History On / Off) 3. Enable free proxy (extension: Hotspot Shield Free VPN Proxy) 4. Create a dedicated gmail account 5. Create dedicated accounts on Facebook and Twitter 6. Take a look at the collection of links 7. Check out the Oryon Tools bookmarklet 8. Check installed add-ons (extensions: Context, Extension Manager) 9. Save a copy of the QueryTool spreadsheet on your GoogleDrive and check its performance with your cases 10. Log in to the MIIS YouTube channel and watch practical video tutorials.
Desktop Search - Speed up searching your Windows PC and Outlook emails
Copernic Desktop Search helps you search within your computer for documents, files & emails. Download the best Desktop Search today for free. Copernic Desktop Searchallows you to centralize your document, file & email searches in one unique interface. You can search your files & documents on your computer, external and network drives. Increase your search speed and your organization's productivity while reducing the time lost trying to find those documents. Join the largest Desktop Search users with 4,000,000+ users in more than 125 countries.
Google Search, Google Site Search, Google News from the terminal
googler is a power tool to Google (Web & News) and Google Site Search from the command-line. It shows the title, URL and abstract for each result, which can be directly opened in a browser from the terminal. Results are fetched in pages (with page navigation). Supports sequential searches in a single googler instance. googler was initially written to cater to headless servers without X. You can integrate it with a text-based browser. However, it has grown into a very handy and flexible utility that delivers much more. For example, fetch any number of results or start anywhere, limit search by any duration, define aliases to google search any number of websites, switch domains easily... all of this in a very clean interface without ads or stray URLs. The shell completion scripts make sure you don't need to remember any options. googler isn't affiliated to Google in any way. Demo: https://asciinema.org/a/85019
GUI for masscan (Windows)
GUI for the fastest port scanner - masscan. https://github.com/robertdavidgraham/masscan
Scan country IP ranges in CIDR format or scan links
Scan country IP ranges in CIDR format or scan links. Links will be saved in MySQL database.
DuckDuckGo from the terminal
ddgr is a cmdline utility to search DuckDuckGo from the terminal. While googler is highly popular among cmdline users, in many forums the need of a similar utility for privacy-aware DuckDuckGo came up. DuckDuckGo Bangs are super-cool too! So here's ddgr for you! Unlike the web interface, you can specify the number of search results you would like to see per page. It's more convenient than skimming through 30-odd search results per page. The default interface is carefully designed to use minimum space without sacrificing readability. ddgr isn't affiliated to DuckDuckGo in any way. Demo: https://asciinema.org/a/151849
Search the web for videos, audios, eBooks, torrents and much more
What is WebCrunch? WebCrunch is intended to provide a very powerful web server indexing and search service allowing you to find a file among millions of files located on public servers around the internet. The search engine is powered by a database that holds information about all the files web servers have. The information about the files is gathered by an intelligent web crawler that runs every 2 to 4 days. It keeps the database clean and up-to-date with the previous contents and new entries for each web server address submitted by members.