Open Source Python Search Engines

Searx is a free and open source internet metasearch engine that respects your privacy. It aggregates results from over 70 search services, providing accurate, relevant results with absolutely no user tracking or profiling going on. It’s like having your very own private search engine. It has secure, encrypted connections and does not use cookies by default, giving you the assurance that your searches are 100% private and secure. Searx can also be used over Tor, providing you online anonymity. Searx can be easily integrated with any search engine of your choice. Start searching with absolute privacy and peace of mind with Searx!

SpiderFoot is an open source intelligence automation tool. Its goal is to automate the process of gathering intelligence about a given target, which may be an IP address, domain name, hostname or network subnet. SpiderFoot can be used offensively, i.e. as part of a black-box penetration test to gather information about the target or defensively to identify what information your organisation is freely providing for attackers to use against you.

Torrent Search is a cross-platform application, allowing to search for torrent files on different websites. Supported websites are integrated through plugins, which allows to easily extend the number of websites supported.

Bookmark-Manager is an advanced bookmark management utility for Windows supporting importing/exporting and merging of Internet Explorer favorites, Opera hotlists, Mozilla, Netscape, and Firefox bookmarks, XBEL, and HTML lists.

This is an ***old archive*** of tools developed for facilitating the use of Creative Commons licenses and metadata. --- For the most up to date representation of any of the projects listed here, please see: http://creativecommons.org/project/Developer.

ddgr is a cmdline utility to search DuckDuckGo from the terminal. While googler is highly popular among cmdline users, in many forums the need of a similar utility for privacy-aware DuckDuckGo came up. DuckDuckGo Bangs are super-cool too! So here's ddgr for you! Unlike the web interface, you can specify the number of search results you would like to see per page. It's more convenient than skimming through 30-odd search results per page. The default interface is carefully designed to use minimum space without sacrificing readability. ddgr isn't affiliated to DuckDuckGo in any way. Demo: https://asciinema.org/a/151849

This project implements a Python API for the Yahoo Search Webservices API. pYsearch is an OO abstraction of the web services, with emphasis on ease of use and extensibility.

URL Grabber is a windows tool used to capture all the links in the website or webpage. And Store it in a text file.

SE Auditor is a program for analyzing web pages for search engines. SE Auditor is application that you can use to view statistical data about your website, in order to improve its position within the Web search results. SE Auditor is addressed to SEO professionals, website designers, developers, website testers and owners. SE Auditor enables you to check meta description, keywords, sitemap, the number of links and keyword consistency, the text/HTML ratio and many more ranking / usability / social factors. Unlike other programs of this type SE Auditor is: - free - fast, do not waste your time (the audit process goes smooth as butter) - simple to understand interface (you can see at a glance) - shows the data important in optimizing your site - based on the collected data allows to generate a PDF report with hints - is accurate (for example in counting words, characters, calculating text/html ratio..)

Basically this allows you to be able to automate searches by putting in search terms through any .txt file appropriately formatted and then the program picks that up and basically opens the link through your computer. You must login to Swagbucks for this to work. With that in mind, the title speaks for itself. To find new releases, check the version folder in each designated Operating System here. To get archived releases (ill-advised), check out the GitHub: https://github.com/geekdictionarypro/Swagbucks-Web-Search-Bot

This project aims to provide an offline version of wikipedia, available from the web browser.

MovieGrabber has now moved to GitHub! https://github.com/binhex/moviegrabber

BandStalker is a utility that monitors local websites to inform you when your favorite bands are touring through your city.

Ferret CMS is a Content Management System based on Zope. It is focused on easy administration and fast deployment of a web site. It has a workflow mechanism with roles that can be assigned to backend users.

A simple app that builds a library of your music, then fetches information from metal-archives, discogs, etc. and shows you what you're still missing (e.g. new releases). Moved to http://github.com/KenjiTakahashi/gayeogi

HarvestMan is a fully functional, multithreaded webcrawler cum offline-browser. It is highly customizable and supports as much as 55 plus options for controlling and customizing offline browsing. It is written entirely in the Python programming language.

Lupy is a full text indexer for Python. It is a port of Jakarta Lucene 1.2 to Python. Specifically, it reads and writes indexes in Lucene binary format. Like Lucene, it is sophisticated and scalable.

Download code, Learn code, Share code. The Ongoing Object-oriented Perl Project. scripts, tutorials, modules, case studies, anything OOPerl --not excluding contributions of OO discipline in other programming languages.

Software, information, data sets and documentation for the Web as Corpus community.

Wixi is a multi-platform wiki application for the desktop. It is written in python/wxpython and does anything you might expect from a wiki application. Generating html from text is done by txt2tags, wich is simple and easy to learn.

A drop-in framework for adding tagging (folksonomy) capabilities to existing applications

"Swish-e is a fast, flexible, and free open source system for indexing collections of Web pages or other files" (http://swish-e.org/ ) This module provides a Python API for this software.

Starting from various input files, we parse to find a list of addresses, then display them on a map.

Agile Author is a framework for developing networked repositories of digital information such as digital libraries and content management systems.

The Semantic Web Peer - Allegra is an innovative library for Semantic Web applications development. It provides a framework for asynchronous network peer programming, a simple stack of Internet standards implementations, and two new network applications: