Showing 76 open source projects for "scrape"

View related business solutions
  • Cyber Risk Assessment and Management Platform Icon
    Cyber Risk Assessment and Management Platform

    ConnectWise Identify is a powerful cybersecurity risk assessment platform offering strategic cybersecurity assessments and recommendations.

    When it comes to cybersecurity, what your clients don’t know can really hurt them. And believe it or not, keep them safe starts with asking questions. With ConnectWise Identify Assessment, get access to risk assessment backed by the NIST Cybersecurity Framework to uncover risks across your client’s entire business, not just their networks. With a clearly defined, easy-to-read risk report in hand, you can start having meaningful security conversations that can get you on the path of keeping your clients protected from every angle. Choose from two assessment levels to cover every client’s need, from the Essentials to cover the basics to our Comprehensive Assessment to dive deeper to uncover additional risks. Our intuitive heat map shows you your client’s overall risk level and priority to address risks based on probability and financial impact. Each report includes remediation recommendations to help you create a revenue-generating action plan.
  • RMM Software | Remote Monitoring Platform and Tools Icon
    RMM Software | Remote Monitoring Platform and Tools

    Best-in-class automation, scalability, and single-pane IT management.

    Don’t settle when it comes to managing your clients’ IT infrastructure. Exceed their expectations with ConnectWise RMM, our MSP RMM software that provides proactive tools and NOC services—regardless of device environment. With the number of new vulnerabilities rising each year, smart patching procedures have never been more important. We automatically test and deploy patches when they are viable and restrict patches that are harmful. Get better protection for clients while you spend less time managing endpoints and more time growing your business. It’s tough to locate, afford, and retain quality talent. In fact, 81% of IT leaders say it’s hard to find the recruits they need. Add ConnectWise RMM, NOC services and get the expertise and problem resolution you need to become the advisor your clients demand—without adding headcount.
  • 1
    scraper-with-chatgpt
    It is a powerful data scraping tool that helps you extract information from various online sources. Easily collect data from Google SERP, Maps, Shopify, Zillow, and more. With a user-friendly interface, you can scrape and save data in JSON or Excel formats. Unlock insights from the web effortlessly with scrape-it.cloud API.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 2
    TorrentPier

    TorrentPier

    🐂 Bull-powered BitTorrent tracker engine

    TorrentPier — bull-powered BitTorrent Public/Private tracker engine, written in php. High speed, simple modification, high load architecture. In addition, we have very helpful official support forum, where it's possible to get any support and download modifications for engine.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 3
    ConsoleWebScraper

    ConsoleWebScraper

    It allows you to input a URL and it will scrape the HTML content...

    ConsoleWebScraper is a simple console application that allows you to scrape web pages and save the results. Usage Open a command prompt as administrator. Navigate to the directory containing the utility. Run the utility as a command-line argument. For example: .\ConsoleWebScraper.exe When you start the application, you'll see a title and a menu guide. The menu guide will tell you what commands you can use. After the application has successfully completed its operation...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 4
    Till

    Till

    DataHen Till is a companion tool to your existing web scraper

    DataHen Till is a companion tool to your existing web scraper that instantly makes it scalable, maintainable, and more unblockable, with minimal code changes on your scraper. Integrates with any scraper in 5 minutes. Web scraping is usually easy to get started, especially on a small scale. However, as you try to scale it up, it gets exponentially difficult. Scraping 10,000 records can easily be done with simple web scraper scripts in any programming language, but as you try to scrape millions...
    Downloads: 0 This Week
    Last Update:
    See Project
  • All-in-One Payroll and HR Platform Icon
    All-in-One Payroll and HR Platform

    For small and mid-sized businesses that need a comprehensive payroll and HR solution with personalized support

    We design our technology to make workforce management easier. APS offers core HR, payroll, benefits administration, attendance, recruiting, employee onboarding, and more.
  • 5
    JobFunnel

    JobFunnel

    Scrape job websites into a single spreadsheet with no duplicates.

    Scrape job websites into a single spreadsheet with no duplicates. Automated tool for scraping job postings into a .csv file. You can search for jobs with YAML configuration files or by passing command arguments. By performing regular scraping and reviewing, you can cut through the noise of even the busiest job markets. Run funnel with your settings YAML to populate your master CSV file with jobs from available providers. JobFunnel can be easily automated to run nightly with crontab. If you have...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 6
    Downloads: 1 This Week
    Last Update:
    See Project
  • 7

    tripadvisor-crawler

    Simple TripAdvisor crawler for RU segment (tripadvisor.ru)

    This project can scrape three categories of TripAdvisor objects - hotels, restaurants and attractions [now is in development state] of user-defined location. It collects object information including coordinates via Google Place API and all reviews in all lanuages.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8
    SCVZ menza

    SCVZ menza

    App za prikaz jelovnika u studentskoj menzi u Varaždinu

    Aplikacija napravljena u Flutter framework-u. Projekt koji sam radio u slobodno vrijeme i želim predstaviti prilikom prijave za studentsku praksu. Aplikacija komunicira s Flask serverom koji scrape-a podatke sa službene stranice menze. Server aplikaciji vraća json u kojoj se nalazi današnji jelovnik. Trenutno je server hostan na Heroku platformi. https://scvzmenza-app.herokuapp.com/danas
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    Marathon

    Marathon

    Deploy and manage containers (including Docker) on top of Apache Mesos

    ... application. You can run databases like MySQL and Postgres, and have storage accounted for by Mesos. Supply an HTTP endpoint to receive notifications, for example to integrate with an external load balancer. Query them at /metrics in JSON format, push them to systems like Graphite, StatsD and DataDog, or scrape them using Prometheus.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Gain insights and build data-powered applications Icon
    Gain insights and build data-powered applications

    Your unified business intelligence platform. Self-service. Governed. Embedded.

    Chat with your business data with Looker. More than just a modern business intelligence platform, you can turn to Looker for self-service or governed BI, build your own custom applications with trusted metrics, or even bring Looker modeling to your existing BI environment.
  • 10
    X-RAY

    X-RAY

    The next web scraper, see through the <html> noise

    Supports strings, arrays, arrays of objects, and nested object structures. The schema is not tied to the structure of the page you're scraping, allowing you to pull the data in the structure of your choosing. The API is entirely composable, giving you great flexibility in how you scrape each page. Paginate through websites, scraping each page. X-ray also supports a request delay and a pagination limit. Scraped pages can be streamed to a file, so if there's an error on one page, you won't lose...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    SEO MACROSCOPE

    SEO MACROSCOPE

    SEO Macroscope is a website scanning tool, to check your website

    ... pages. Export reports to Excel and CSV formats. Generate and export text and XML sitemaps from the crawled pages. Analyze redirect chains. Use custom filters to verify the presence/absence of tracking tags. Use CSS Selectors, XPath Queries, and Regular Expressions to scrape website data.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12
    django-dynamic-scraper

    django-dynamic-scraper

    Creating Scrapy scrapers via the Django admin interface

    ..., but it is well suited for the relatively common case of regularly scraping a website with a list of updated items (e.g. news, events, etc.) and then dig into the detail page to scrape some more infos for each item. Django Dynamic Scraper tries to keep its data structure in the database as separated as possible from the models in your app, so it comes with its own Django model classes for defining scrapers, runtime information related to your scraper runs and classes.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    google-play-scraper

    google-play-scraper

    Node.js scraper to get data from Google Play

    Node.js module to scrape application data from the Google Play store. Retrieves the full detail of an application. Retrieves a list of applications from one of the collections at Google Play. Retrieves a list of apps that results of searching by the given term. Returns the list of applications by the given developer name. Given a string returns up to five suggestions to complete a search query term. Retrieves a page of reviews for a specific application. Returns a list of similar apps...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14
    Simple-Scrape is a simple web-scraping library that allows for programmatic access to HTML code. No further techniques are needed and the library is very compact and thus easy to use.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15
    mp3scraper

    mp3scraper

    Scrape web pages for MP3 links and generate RSS files.

    Moved to GitHub. https://github.com/ggocek/mp3scraper
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    JAWS - Just Another Web Scraper

    JAWS - Just Another Web Scraper

    A simple Web Scraper using Regular Expression or Html Agility

    JAWS or Just Another Web Scraper, is part of the Data Scraping Softwares developed by SVbook, alongside JATI (Image to Text) and JAVT (Video to Text). JAWS offer easy interface to scrape data from the website using regular expression, text preprocessing, or HTML Agility Pack.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    metabase=universal data-storage for "things". with its dynamical structure, it's a strong back-end application. motivation:store any data in an "universal admin" (maybe scrape it from different sources),edit,categorize,reorganizes,process,publis
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18

    Gene Name Errors Screen

    Scrape and screen gene name errors in Excel files

    Here we provide a suite of bash scripts that were used to identify, download and screen for gene name errors in Excel files that are published as supplementary files in academic journals as well as the NCBI GEO database. These were run on Ubuntu 14.04 LTS.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 19

    Currency Manager

    Windows project for managing the purchase/sale of foreign currency

    A new windows based software used to buy/sell foreign currency. Very simple to use, interfaces to standard Epson TM-88V receipt printers. Links to XE.com for currency rates and calculates selling/purchase rates based upon standard margins.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20
    Squirrel Post Scraper

    Squirrel Post Scraper

    This tool will scrape any new posts from a specific an Facebook page

    It will keep watching a specific Facebook page and waits until it publish a new posts. If the target page has published any posts, then it will be copied to your page. You can append text or hashtags, or even URLs to scraped posts.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21
    chrome-extensions-examples

    chrome-extensions-examples

    All Chrome Extension examples collected into one repository

    This is not an official mirror of the Chrome extension examples. Report any issues with the examples themselves to Google's issue trackers/forums. The Chrome Extensions examples did not exist as a Git repository, and browsing both the samples page and the VCViewer did not seem particularly handy. So, I decided to scrape the content into this repository for easier browsing and (possible) editing.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22

    Elite Dangerous OCR Learner

    Learn tool for the Elite Dangerous OCR tool

    This tool will search for candidate characters, filter them, let the user tell which charachters they are, then analyses the known candidates to create templates used by the Elite Dangerous OCR tool to scrape trading data from screenshots.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 23
    ...------------------------------ D4arker is my version of an all-in-one dorking tool written in pure bash. It leverages Google AND Bing main search pages to scrape a large amount of links based on provided search terms. You can choose to search a single dork at a time or you can make lists with one dork per line and perform mass scans. Once your done with that, or maybe you have links gathered from other means, you can move to the Analyzing tools to test for common signs of vulnerabilities. The results are neatly so
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24
    Amazon ASIN Check

    Amazon ASIN Check

    Get Price and Rating of list of ASIN numbers.

    This program uses a list of Amazon Standard Identification Number to scrape the price, rating and sold by data of the product. Input is a text file and data is outputted as a CSV file. Written in C# and developed by B.J Erasmus. This project was given by HNS2014 on freelancer.com
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    webStraktor is a programmable World Wide Web data extraction client. Its purpose is to scrape HTML based content via the HTTP protocol and extract relevant information. webStraktor features a scripting language to facilitate the collection, the extraction and the storage of information available on the web, including images. The scripting language uses elements of the Regular Expression and xPath syntax. The webStraktor scripting language has a small instruction set and its syntax is easy...
    Downloads: 0 This Week
    Last Update:
    See Project