Search Results for "web crawler source code"
Sort By:
Showing 54 open source projects for "web crawler source code"
View related business solutions-
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
1
Locust
Scalable open source load testing tool
Locust is an open source user load testing tool written in Python. The idea behind Locust is to swarm your web site or other systems with attacks from simulated users during a test, with each user behavior defined by you using Python code. This swarming process is then monitored from a web UI in real-time, and will help identify any bottlenecks in your code before real users can come in. -
2
SikuliX
Now continued as OculiX — see oculix.org
...It uses image recognition powered by OpenCV to identify GUI components and can act on them with mouse and keyboard actions. This is handy in cases when there is no easy access to a GUI's internals or the source code of the application or web page you want to act on. This SourceForge entry is preserved for historical reference. Please get the latest version from https://github.com/oculix-org/Oculix/releases. -
3
Testcontainers node
Supports tests, providing lightweight, throwaway instances of database
Testcontainers is an open source library for providing throwaway, lightweight instances of databases, message brokers, web browsers, or just about anything that can run in a Docker container. No more need for mocks or complicated environment configurations. Define your test dependencies as code, then simply run your tests and containers will be created and then deleted. -
4
cypress
Fast, easy and reliable testing for anything that runs in a browser
The web has evolved. Finally, testing has too. Fast, easy and reliable testing for anything that runs in a browser. Installing Cypress is simple. No dependencies, extra downloads, or changes to your code required. Write tests easily and quickly, and watch them execute in real time as you build your web application. Debugging your tests in CI is as easy as running tests locally. With built in parallelization and load balancing. Record CI test results, screenshots and video, and view... -
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
5
phantomas
Headless Chromium-based web performance metrics collector
Headless Chromium-based modular web performance metrics collector. Modular approach, each metric is generated by a separate "module". phantomas "core" acts as an events emitter that each module can hook into. In-depth metrics such as: number of events bound via jQuery, calls to window.writeor complex and duplicated CSS selectors (via analyze-css). JSON as an output format. Easy integration with other nodejs projects via CommonJS module (see API docs). Metrics can be emitted from the... -
6
TestCafe
A Node.js tool to automate end-to-end web testing
TestCafe is a Node.js tool for automating end-to-end web testing. All you have to do is set it up, write tests in JS or TypeScript, run them and view the results. There’s no need for WebDrivers or other testing software. Installing TestCafe takes just one minute and one command. TestCafe lets you create smart, stable tests with no manual timeouts. It can run parallel tests, saving you on test execution time, and can even build readable tests with PageObject. TestCafe runs on all popular... -
7
ciao
HTTP checks & tests (private & public) monitoring
HTTP checks & tests (private & public) monitoring - check the status of your URL. ciao checks HTTP(S) URL endpoints for a HTTP status code (or errors on the lower TCP stack) and sends a notification on status change via E-Mail or Webhooks. It uses Cron syntax to schedule the checks and comes along with a Web UI and a RESTful JSON API. Create an open-source web application for checking URL statuses with a UI and a REST API which is easy to install and maintain (no external dependencies like Databases, Caches, etc.) in public and private environments. -
8
Ddosify
High-performance load testing tool, written in Golang
vLoad tests should be done regularly to avoid being caught unprepared. Find out the maximum service capacity of your web system. Start the test either instantly or for a future date. Define your periodic load tests. Without load tests, businesses understand the load capacity of their systems when they become inaccessible during campaign times such as Black Friday or Cyber Monday. Determine the origins of requests and the test duration with our easy-to-use web interfaces. Review past load... -
9
nodejs-integration-tests-best-practices
Beyond the basics of Node.js testing
Component/integration test is a hybrid between E2E and unit tets. It's gaining a lot of popularity and going by the testing diamond model it is considered as the default technique for the modern backend. Its main idea is testing an entire component (e.g., Microservice) as-is, through the API, with all the layers including the database but fake anything extraneous. This brings both high confidence and great developer experience. However, doing it right, fast, exhaustive and maximizing the... -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
10
Cerberus Testing
The Open Source Test Automation Platform
Cerberus Testing is a scalable test automation platform for teams searching to accelerate software delivery with confidence. Cerberus Testing is a test automation platform that allows iteration with quality and speed through test definition, execution, and reporting. The platform allows the creation of automated test cases through an easy-to-use web interface without any need for development skills - automated test implementation and management now become available for all elements of the... -
11
Fronsetia
A web application for testing webservices
Fronsetia (Free Online Service Testing Application) is a Java web application that allows testing webservices (REST and SOAP). No end-user installations required, just deploy the application on your server and pass the link so that users can use their usual browsers to access Fronsetia. You can think of Fronsetia as a simple version of SoapUI on the web, or a simple and free and open-source version of the "wls_utc" utility. See the project homepage https://fronsetia.sourceforge.io and... -
12
LazyLoad
LazyLoad is a lightweight, flexible script that speeds up your website
LazyLoad is a fast, lightweight and flexible script that speeds up your web application by loading images only as they enter the viewport. LazyLoad supports responsive images. LazyLoad is a lightweight (2.4 kB) and flexible script that speeds up your web application by deferring the loading of your below-the-fold images, animated SVGs, videos and iframes to when they will enter the viewport. It’s written in plain “vanilla” JavaScript, it leverages the IntersectionObserver API, it supports... -
13
speedtest-cli
Command line interface for testing internet bandwidth using speedtest
Command line interface for testing internet bandwidth using speedtest.net. It is not a goal of this application to be a reliable latency reporting tool. Latency reported by this tool should not be relied on as a value indicative of ICMP style latency. It is a relative value used for determining the lowest latency server for performing the actual speed test against. Speedtest CLI brings the trusted technology and global server network behind Speedtest to the command line. Measure internet... -
14
CEF Python
Python bindings for the Chromium Embedded Framework (CEF)
Python bindings for the Chromium Embedded Framework (CEF). CEF Python is an open source project founded by Czarek Tomczak in 2012 to provide Python bindings for the Chromium Embedded Framework (CEF). The Chromium project focuses mainly on Google Chrome application development while CEF focuses on facilitating embedded browser use cases in third-party applications. Lots of applications use CEF control, there are more than 100 million CEF instances installed around the world. There are... -
15
Marathon -GUI Test Runner Web, Swing, FX
Marathon supports testing of Java/Swing and Java/Fx applications.
Marathon provides an integrated environment for test script creation and execution. Supported FW: Web, Java Swing/ Java FX. Currently, Marathon supports JRuby script models for recording the test scripts.Marathon test runner generates Allure test reports.Marathon allows for grouping of test cases.It also has an option of inserting modules while recording(in MarathonITE while recording). It allows tester to inset checklist while recording and also takes screen capture and annotate it in... -
16
Beego
Open source framework to build & develop applications in the Go way
Beego is an open source, high-performance web framework for building and developing applications in Go. Beego offers plenty of superb features, including RESTful support, MVC architecture, powerful built-in modules, intelligent routing and monitoring, plus Go-specific features like interfaces and struct embedding. Beego is very easy to use. Features like code hot compile, automated testing, as well as automated packing and deploying allow you to build your applications in a snap. ... -
17
Zombie.js
Fast, full-stack, headless browser testing using node.js
Insanely fast, headless full-stack testing using Node.js. Zombie 6.x is tested to work with Node 8 or later. If you need to use Node 6, consider using Zombie 5.x. If you’re going to write an insanely fast, headless browser, how can you not call it Zombie? Zombie it is. Zombie.js is a lightweight framework for testing client-side JavaScript code in a simulated environment. No browser required. Zombie will work with other testing frameworks. Since Mocha supports promises. Just like your... -
18
matchMedia() polyfill
matchMedia polyfill for testing media queries in JS
matchMedia() polyfill is a JavaScript polyfill that brings matchMedia-style media query testing to environments that need compatibility support. It lets developers test whether a CSS media type or media query applies directly from JavaScript. The library is useful for responsive behavior that depends on screen size, device type, orientation, or other media query conditions. It can be used with a companion addListener polyfill when code needs to react to changes over time. The project was... -
19
gremlins.js
Monkey testing library for web apps and Node.js
Gremlins.js is an open-source monkey testing library written in JavaScript. It unleashes a horde of undisciplined gremlins on a web app in order to check its robustness. We've modernized the code of Gremlins.js, our monkey testing library for frontend apps. It's now super easy to detect memory leaks in your JavaScript code. Gremlins.js comes with 5 types of undisciplined gremlins that will try to break your web application: the clicker, the form filler, the scroller, the typer and the toucher. ... -
20
A Java Web crawler: multi-threaded, scalable, with high performance, extensible and polite. It can be used to crawl and index any web or enterprise domain and is configurable through a XML configuration file.
-
21
SoaBox lets you create a virtual version of your SOA environment. Clients (WS-Webservices,RESTful, JMS, HTTP, FTP, Filesystem, POJOs/Custom Code), servers (HTTP/Endpoints) and data (XML, SOAP, CSV, etc). It's written in Java and runs with JBoss 5.x and 6.x
-
22
r-u-dead-yet
R-U-Dead-Yet? (RUDY) Original source code files
R-U-Dead-Yet, or RUDY for short, implements the generic HTTP DoS attack via long form field submissions. RUDY attack targets web applications by starvation of available sessions on the web server. RUDY keeps sessions at halt using never-ending POST transmissions and sending an arbitrarily large content-length header value. Licensed under the GNU GPL v3 DISCLAIMER: USE ON YOUR OWN RISK. THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDER OR CONTRIBUTORS "AS IS" AND ANY EXPRESS OR... -
23
The SoapUI download has moved to https://www.soapui.org/downloads/soapui/source-forge.html With more than 9 million downloads SoapUI is the de-facto standard for REST and SOAP API functional, security and performance testing.
-
24
sitecheck
Modular web site spider for web developers.
More than just a link checker, sitecheck is a website spider (also known as a crawler) which can assist with SEO by testing an entire site plus both inbound links from search engines and outbound links to other sites for the following issues: looping redirects (HTTP 301/302), broken links (HTTP 404), server errors (HTTP 500), spelling mistakes, low readability scores (using the Flesch Reading Ease test), missing/empty/duplicate meta tags, duplicate content, slow page speed, W3C validation... -
25
TestMP
Test Management Platform for Automation
TestMP is a test platform facilitating the management of automation test cases, data, environments in an automated way. It has the following features: 1. Instant Update of Test Case Doc & Status Document test cases just in code, and no longer bother to maintain them in another place. The web console will instantly update test document and measures upon test run. 2. Auto-generation of Metrics Report to Signoff Test robustness, effectiveness, and efficiency are evaluated into a...
