Open Source Python Search Engines

Searx is a free and open source internet metasearch engine that respects your privacy. It aggregates results from over 70 search services, providing accurate, relevant results with absolutely no user tracking or profiling going on. It’s like having your very own private search engine. It has secure, encrypted connections and does not use cookies by default, giving you the assurance that your searches are 100% private and secure. Searx can also be used over Tor, providing you online anonymity. Searx can be easily integrated with any search engine of your choice. Start searching with absolute privacy and peace of mind with Searx!

SpiderFoot is an open source intelligence automation tool. Its goal is to automate the process of gathering intelligence about a given target, which may be an IP address, domain name, hostname or network subnet. SpiderFoot can be used offensively, i.e. as part of a black-box penetration test to gather information about the target or defensively to identify what information your organisation is freely providing for attackers to use against you.

Torrent Search is a cross-platform application, allowing to search for torrent files on different websites. Supported websites are integrated through plugins, which allows to easily extend the number of websites supported.

This is an ***old archive*** of tools developed for facilitating the use of Creative Commons licenses and metadata. --- For the most up to date representation of any of the projects listed here, please see: http://creativecommons.org/project/Developer.

A Python wrapper for the Google web API. Allows you to do Google searches, retrieve pages from the Google cache, and ask Google for spelling suggestions.

Bookmark-Manager is an advanced bookmark management utility for Windows supporting importing/exporting and merging of Internet Explorer favorites, Opera hotlists, Mozilla, Netscape, and Firefox bookmarks, XBEL, and HTML lists.

This project implements a Python API for the Yahoo Search Webservices API. pYsearch is an OO abstraction of the web services, with emphasis on ease of use and extensibility.

Pyndex is a simple and fast full-text indexer and Bayesian classifier implemented in Python. It uses Metakit as its storage back-end. It works well for quickly adding search to an application, and is also well suited to in-memory indexing and search.

URL Grabber is a windows tool used to capture all the links in the website or webpage. And Store it in a text file.

Fetches topics with new posts from ZetaBoards forums and does something with the URLs, like opening them in a browser. Configurations can be stored and manipulated for quicker fetching. Development, translations, bug reports, etc. are handled at Launchpad: https://launchpad.net/zb-fetcher SourceForge is used to host released files.

googler is a power tool to Google (Web & News) and Google Site Search from the command-line. It shows the title, URL and abstract for each result, which can be directly opened in a browser from the terminal. Results are fetched in pages (with page navigation). Supports sequential searches in a single googler instance. googler was initially written to cater to headless servers without X. You can integrate it with a text-based browser. However, it has grown into a very handy and flexible utility that delivers much more. For example, fetch any number of results or start anywhere, limit search by any duration, define aliases to google search any number of websites, switch domains easily... all of this in a very clean interface without ads or stray URLs. The shell completion scripts make sure you don't need to remember any options. googler isn't affiliated to Google in any way. Demo: https://asciinema.org/a/85019

Written in python, Reverse Phone Lookup is a simple program that when given a phone number, will search the white pages and display the information returned (First Name, Last Name, Address, City, State, and Zip code). Note: This program no longer works.

Tyriel is an open-source search engine written in python and designed to run within a small group of sites (but potentially extensible to a greater scope).

a small collection of python 3000 scripts/modules used to automate searching craigslist.org cities and categories for interesting stuff; these scripts currently use html screen scraping, since craigslist currently has no api

ddgr is a cmdline utility to search DuckDuckGo from the terminal. While googler is highly popular among cmdline users, in many forums the need of a similar utility for privacy-aware DuckDuckGo came up. DuckDuckGo Bangs are super-cool too! So here's ddgr for you! Unlike the web interface, you can specify the number of search results you would like to see per page. It's more convenient than skimming through 30-odd search results per page. The default interface is carefully designed to use minimum space without sacrificing readability. ddgr isn't affiliated to DuckDuckGo in any way. Demo: https://asciinema.org/a/151849

This plug-in for Google Desktop is a simple web spider (Könguló is Icelandic for spider) that crawls websites you specify, e.g. intranet websites, and dumps them into Google Desktop. You must install Google Desktop prior to installing the plug-in.

GOOPY: Python module to search google (with CLI included). With the module you can create python programs that can access google results. The CLI allows you to surf google without leaving bash!

This is a Python script to parse your irssi logs and input them into a MySQL database which you can then use to search and display your logs on the web. It incrementally updates the database from the logs and is ideally run as a cronjob often.

pyTube is a python-based commandline YouTube search. One can search for videos and display them in their default web browser. Requires python 2.5 and gdata.

FTP crawler is designed to provide an easy web interface to searching files on the FTP and a crawler to index files on FTP servers.

1. Add JBoss Application Server 4.2.3.GA for JDK 6. 2. Cleanup for Windows and deprecated files. 3. Off CONSOLE records - http://forums.dcm4che.org/jiveforums/thread.jspa?messageID=4787

PYIGS is a Python package that provides an interface to Google! Suggest results. It may be run standalone or incorporated as a module. Currently it supports a basic query, with or without result match listings. Later it will include a caching server.

Pagecast makes it easy to submit lists of URLs to Internet search engines. Advanced features include: ability to check the URL's for certain problematic conditions. Designed to be simple to use, but effective.

The Porn Toolkit is a collection of scripts or programs to download free porn videos automatically.

PqDL is considered as a flexible yet useful tool which can help to download Pocket Queries that have more than 500 caches from geocaching.com. Pocket Queries that contain more than 500 caches won't be sent per mail. UNIX USERS: Manual checkout!