Showing 77 open source projects for "scrape"

View related business solutions
  • Our Free Plans just got better! | Auth0 by Okta Icon
    Our Free Plans just got better! | Auth0 by Okta

    With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

    You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your secuirty. Auth0 now, thank yourself later.
    Try free now
  • Bright Data - All in One Platform for Proxies and Web Scraping Icon
    Bright Data - All in One Platform for Proxies and Web Scraping

    Say goodbye to blocks, restrictions, and CAPTCHAs

    Bright Data offers the highest quality proxies with automated session management, IP rotation, and advanced web unlocking technology. Enjoy reliable, fast performance with easy integration, a user-friendly dashboard, and enterprise-grade scaling. Powered by ethically-sourced residential IPs for seamless web scraping.
    Get Started
  • 1
    webStraktor is a programmable World Wide Web data extraction client. Its purpose is to scrape HTML based content via the HTTP protocol and extract relevant information. webStraktor features a scripting language to facilitate the collection, the extraction and the storage of information available on the web, including images. The scripting language uses elements of the Regular Expression and xPath syntax. The webStraktor scripting language has a small instruction set and its syntax is easy...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 2

    Scra.php

    Scrape anything!

    The ultimate customiseable YAML-ised Web Scraper for PHP
    Downloads: 0 This Week
    Last Update:
    See Project
  • 3

    wdtvscraper

    Media scraper for WDTV devices.

    Scrape themoviedb.org and thetvdb.com for metadata of movies and tv series stored on a WDTV device.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 4
    A little script to scrape your account on T-Mobiles website and report how many minutes you've used. You can dial #MIN# (#646#) on your phone to get this information, but I can't find any way to get this information programmatically and T-Mobile doesn't make it easy to just grab that information off their website.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Build Securely on AWS with Proven Frameworks Icon
    Build Securely on AWS with Proven Frameworks

    Lay a foundation for success with Tested Reference Architectures developed by Fortinet’s experts. Learn more in this white paper.

    Moving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
    Download Now
  • 5
    Static Code and Runtime Analysis based on Perl
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6
    WebExtractor360 is a free and open source web data extractor. It uses Regular Expressions to find, extract and scrape internet data quickly and easily.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 7
    Scripts (written in Java) that scrape the entire inventory of products available "in store" on walgreens.com and make it available as a spreadsheet.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8
    Scripts (written in Java) that scrape the entire inventory of a specific walmart store (from walmart.com) and make it available as a spreadsheet.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    This project aims to be an easy to maintain minimal WoW Addon that scrapes all available auctions on the AH. Then the LUA file is paresed into a C# application that places it into a database, and allows useful info to be generated.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Find out just how much your login box can do for your customer | Auth0 Icon
    Find out just how much your login box can do for your customer | Auth0

    With over 53 social login options, you can fast-track the signup and login experience for users.

    From improving customer experience through seamless sign-on to making MFA as easy as a click of a button – your login box must find the right balance between user convenience, privacy and security.
    Sign up
  • 10
    Web Scraper Basic
    The Web Scraper Basic application is a PHP and MySQL powered web scraping tool. Web Scraper Basic allows the user to scrape data from websites in a nice easy to use interface.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    Simple C# tool example project to scrape info from a webpage. This is a quick hack for a school project, done in one evening so I dont have to type the same printers into Excel or Access for the twentiest time ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12
    .NET 3.5 classes that scrape the HTML from http://gatherer.wizards.com and provides a means for saving the data in different formats for offline use.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    Scrape wunderground weather files and display relevant weather stats for farmers.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14
    eBayScraper is a Java application designed to scrape auction information from eBay and provide the user detailed information about specific auctions and allow the user to track certain auctions over time.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15
    DumpTorrent is a non-interactive text mode program which displays BitTorrent .torrent file information, including size, file names, announce[-list], comment, publisher and info_hash. It can also query (scrape) tracker for current downloader count.
    Leader badge
    Downloads: 19 This Week
    Last Update:
    See Project
  • 16
    Sinon is a Java tool that extracts textual information from Web sites. In other words, it is a tool that can be used to scrape any kind of text (HTML included) available in the Internet or in a filesystem. The extraction is driven by a XML file.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    CiteULike is a free service to help academics share, store, and organise the papers they're reading. This open source project contains the code to scrape citations from publishers' web sites.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18
    PHP Nuke BitTorrent Module is a PHP Nuke Module that allow webmasters to host on their portals a fully functional Bit Torrent archive. Torrent upload, automatic scrape, comments, rates, privacy rules, internal tracker and much more!
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    Utility to 'scrape' player information for Front Office Football
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20
    Smutster is an easily-customizable utility designed to "scrape" free adult content from known sites, storing and organizing it in a local database. A reference client is also included. Written in Java for cross-platform use.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21
    TorrentSniffer is a Java library for reading BitTorrent information. TorrentSniffer currently implements the following sections of the BitTorrent Protocol Specification 1.0: Metainfo File Structure, Bencoding and Tracker 'scrape' Convention.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 22
    A robust website scraping framework that uses XML, XPath, RegEx and scripting to consume, parse, normalize and traverse HTML based on a set of seed URLs. Scrape.NET is built using C#, TidyForNet (the p-invoke only version) and HTML Tidy.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 23

    vB-mTurk-Scraper-1.1

    Scrapes vBulletin forums for links to mTurk HITS

    vB-mTurk-Scraper Can scrape vBulletin forums for links to mTurk HITS Written in: Python 2.* (Not 3 Compatible OR Tested) Requires: BeautifulSoup and requests To install BeautifulSoup run: pip install beautifulsoup4 OR: easy_install beautifulsoup4 To install requests run: pip install requests OR: easy_install requests Information required to run program: HITS Thread Number (Changes Daily: 5 digit number found in the thread URL) Forum URL Page To Start From Number Of Pages...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24
    SALMON or Servers Alive Monitoring System is a data scraper and mimic panel for the Servers Alive system. It uses PHP and MySQL to scrape data from a Servers Alive HTML page and dump it into a database.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    This is a program for my sister that will run on the command line and scrape ISBNs off a website, cross reference w/ amazon, and make a CSV out of the data.
    Downloads: 0 This Week
    Last Update:
    See Project