Search Results for "web crawler source code"
Sort By:
Showing 483 open source projects for "web crawler source code"
View related business solutions-
Save Up to 91% on Cloud Compute With Spot VMsRun batch jobs at 60-91% off with Spot VMs. Long-running workloads get automatic discounts with sustained use.
-
$300 Free Credits to Build on Google CloudStart your next project with $300 in free Google Cloud credit. Spin up VMs, run containers, query petabytes in BigQuery, or build agents with Gemini Enterprise Agent Platform. Once your credits are used, keep building with 20+ always-free tier products including Compute Engine, Cloud Storage, GKE, and Cloud Run functions. No commitment required—just sign up and start building.
-
1
Spatie Crawler
An easy to use, powerful crawler implemented in PHP
Spatie Crawler is a PHP library that allows developers to crawl websites and extract information efficiently. It can be used for web scraping, link checking, or automated testing of web pages. The library is simple to use and supports customizable crawling strategies, including controlling crawl depth and handling redirects. It’s suitable for building crawlers that navigate large or dynamically generated websites. -
2
SiteOne Crawler
SiteOne Crawler is a website analyzer and exporter
SiteOne Crawler is a very useful and easy-to-use tool you'll ♥ as a Dev/DevOps, website owner or consultant. Works on all popular platforms - Windows, macOS, and Linux (x64 and arm64 too). It will crawl your entire website in depth, analyze and report problems, show useful statistics and reports, generate an offline version of the website, generate sitemaps, or send reports via email. Watch a detailed video with a sample report for Astro. build website. This crawler can be used as a... -
3
Yii Web Programming Framework
Yii PHP Framework 1.1.x
Yii, a high-performance component-based PHP framework. Yii is a fast, secure, and efficient PHP framework. Flexible yet pragmatic. Works right out of the box. Has reasonable defaults. Yii gives you the maximum functionality by adding the least possible overhead. Sane defaults and built-in tools helps you write solid and secure code. Write more code in less time with simple, yet powerful APIs and code generation. The minimum requirement by Yii is that your Web server supports PHP 5.1.0 or... -
4
KodExplorer
A web based file manager, web IDE / browser based code editor
KodExplorer is a file manager for the web. It is also a web code editor, which allows you to develop websites directly within the web browser. You can run KodExplorer either online or locally, on Linux, Windows, or Mac-based platforms. The only requirement is to have PHP 5 available. Use experience like operating system, Rich context menu, and toolbar, drag, and drop, shortcut keys. All operations with files and folders on a remote server (copy, cut, paste, move, remove, upload, create... -
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
5
Laravel Framework
Elegant PHP web application framework with expressive syntax
Laravel is a popular open-source PHP web framework designed for building modern web applications with an elegant and readable syntax. It emphasizes developer productivity, offering features like routing, Eloquent ORM, blade templating, and an extensive ecosystem of packages. Laravel makes common tasks like authentication, caching, and session management simple and intuitive, making it a top choice for PHP developers. -
6
Laravel Pint
Laravel Pint is an opinionated PHP code style fixer for minimalists.
Laravel Pint is an opinionated PHP code-style fixer for minimalists. Pint is built on top of PHP-CS-Fixer and makes it simple to ensure that your code style stays clean and consistent. Pint is automatically installed with all new Laravel applications so you may start using it immediately. By default, Pint does not require any configuration and will fix code style issues in your code by following the opinionated coding style of Laravel. Pint is included in recent releases of the Laravel... -
7
Bloxtor framework
Bloxtor is a professional and intelligent framework
Bloxtor is a professional and intelligent web-development framework designed for No-Coders, Low-Coders, and Coders alike. It functions as a versatile code reader and converter, seamlessly transforming code into visual environments and visual components back into code. The concept is to provide a centralized AI-powered web development platform with multiple levels of Citizen Development, empowering both technical and non-technical developers to easily create any type of web application, while... -
8
Webgrind
Xdebug Profiling Web Frontend in PHP
Webgrind is an Xdebug profiling web frontend for PHP, offering a lightweight and easy-to-use interface to visualize profiling data. It helps developers identify performance bottlenecks in their applications by displaying function call statistics, memory usage, and execution time. Webgrind is ideal for performance analysis and optimization of PHP code, providing insights into code efficiency. -
9
phpMyAdmin
A web interface for MySQL and MariaDB
phpMyAdmin is a free software tool written in PHP, intended to handle the administration of MySQL over the Web. phpMyAdmin supports a wide range of operations on MySQL and MariaDB. Frequently used operations (managing databases, tables, columns, relations, indexes, users, permissions, etc) can be performed via the user interface, while you still have the ability to directly execute any SQL statement. phpMyAdmin comes with a wide range of documentation and users are welcome to update our wiki... -
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
10
Timber themes
Create WordPress themes with OOP code and the Twig template engine
Timber helps you create fully-customized WordPress themes faster with more sustainable code. With Timber, you write your HTML using the Twig Template Engine separate from your PHP files. This cleans up your theme code so, for example, your PHP file can focus on being the data/logic, while your Twig file can focus 100% on the HTML and display. Once Timber is installed and activated in your plugins directory, it gives any WordPress theme the ability to take advantage of the power of Twig and... -
11
PHP dotenv
Loads environment variables automatically
You should never store sensitive credentials in your code. Storing configuration in the environment is one of the tenets of a twelve-factor app. Anything that is likely to change between deployment environments, such as database credentials or credentials for 3rd party services, should be extracted from the code into environment variables. Basically, a .env file is an easy way to load custom configuration variables that your application needs without having to modify .htaccess files or... -
12
Testcontainers for PHP
Implementation for PHP
Testcontainers is a PHP package that makes it simple to create and clean up container-based dependencies for automated integration/smoke tests. The package is inspired by the Testcontainers project for Java. Use a containerized instance of your database to test your data access layer code for complete compatibility, without requiring a complex setup on developer machines. Trust that your tests will always start with a known state. Use containerized web browsers, compatible with Selenium, to... -
13
Yii 2
The Fast, Secure and Professional PHP Framework
Yii is a fast, secure, and efficient PHP framework. Flexible yet pragmatic. Works right out of the box. Has reasonable defaults. Yii gives you the maximum functionality by adding the least possible overhead. Sane defaults and built-in tools helps you write solid and secure code. Write more code in less time with simple, yet powerful APIs and code generation. It is fast, secure and efficient and works right out of the box pre-configured with reasonable defaults. The framework is easy to... -
14
multiOTP open source
PHP strong authentication library, web interface & CLI, OATH certified
multiOTP is a PHP class, a powerful command line utility and a web interface developed by SysCo systèmes de communication sa in order to provide a completely free and easy operating system independent server side implementation for strong two factors authentication solution. multiOTP supports hardware and software tokens with different One-Time Password algorithms like OATH/HOTP, OATH/TOTP and mOTP (Mobile-OTP). QRcode generation is also embedded in order to support provisioning of Google... -
15
_s
Inactive project
Underscores is a no-frills WordPress starter theme engineered to give developers a clean, standards-based foundation for building custom themes. It provides semantic templates, accessibility-minded markup, and a minimal stylesheet that sets sensible defaults without imposing a visual identity. The codebase includes template tags, custom header and menu scaffolding, widget areas, and translation-ready strings to speed up common theme tasks. Its structure is intentionally opinionated about... -
16
WireUI
TallStack UI components
Wire UI is a library of components and resources to empower your Laravel and Livewire application development. Starting a new project with Livewire can be time-consuming when you have to create all the components from scratch. Wire UI helps to skip this step and get you straight to the development phase. A set of 450+ free MIT-licensed high-quality SVG icons for you to use in your web projects. Available as basic SVG icons. Reusable blade components to increase usability in your project.... -
17
Gaufrette
PHP library that provides a filesystem abstraction layer
Gaufrette is a PHP library designed to abstract filesystem operations, providing a consistent interface to interact with various storage backends. It allows developers to work with files stored locally, on cloud platforms, or via network protocols, without changing the code. Gaufrette supports plugins for caching, metadata management, and file transformation, making it a flexible choice for file management in web applications. -
18
Aimeos core
Aimeos PHP ecommerce framework for ultra fast online shops
Aimeos-Core is the core library and framework for the Aimeos ecommerce ecosystem, providing the essential building blocks for flexible, scalable online shops, marketplaces, and enterprise commerce applications. Unlike a monolithic shop application, Aimeos-Core is designed as a modular framework that you can embed into your own web app, enabling you to define custom front-ends and workflows while relying on its robust commerce services for catalog, cart, checkout, orders, and customer... -
19
API Platform Core
The server component of API Platform, hypermedia and GraphQL APIs
API Platform Core is an easy-to-use and powerful system to create hypermedia-driven REST and GraphQL APIs. It is a component of the API Platform framework and it can be integrated with the Symfony framework using the bundle distributed with the library. It natively supports popular open formats including JSON for Linked Data (JSON-LD), Hydra Core Vocabulary, OpenAPI v2 (formerly Swagger) and v3, HAL and Problem Details. Build a working and fully-featured CRUD API in minutes. Leverage the... -
20
DOMPDF Wrapper for Laravel
A DOMPDF Wrapper for Laravel
Require this package in your composer.json and update composer. This will download the package and the dompdf + fontlib libraries also. After updating composer, add the ServiceProvider to the providers array in config/app.php. You can optionally use the facade for shorter code. To change the configuration, copy the config file to your config folder and enable it in bootstrap/app.php. You can create a new DOMPDF instance and load a HTML string, file or view name. You can save it to a file, or... -
21
Phalcon
High performance, full-stack PHP framework delivered as a C extension
Its innovative architecture makes Phalcon the fastest PHP framework ever built! Developers do not need to know C to use Phalcon. Its functionality is exposed as PHP classes and interfaces under the Phalcon namespace, ready to be used. Zephir/C extensions are loaded together with PHP one time on the web server's daemon start process. Classes and functions provided by the extension are ready to use for any application. The code is compiled and isn't interpreted because it's already compiled to... -
22
Elgg
A social networking engine in PHP/MySQL
Introducing a powerful open-source social networking engine. Providing you with the core components needed to build a socially aware web application. Elgg is an award-winning open source social networking engine that provides a robust framework on which to build all kinds of social environments, from a campus-wide social network for your university, school or college or an internal collaborative platform for your organization to a brand-building communications tool for your company and its... -
23
Production-ready Docker PHP
Production-ready Docker images for PHP. Optimized for Laravel
serversideup/php is an optimized set of Docker Images for running PHP applications in production. Everything is designed around improving the developer experience with PHP and Docker. Gone are the days of configuring each environment differently, and gone are the days of trying to figure out why your code works in one environment and not the other. These images are highly optimized to run modern PHP applications, no matter where you want your application to run. Ditch FPM for a modern way of... -
24
AWS Service Provider for Symfony
A Symfony bundle for including the AWS SDK for PHP
A Symfony bundle for including the AWS SDK for PHP. The AWS SDK for PHP makes it easy for developers to access Amazon Web Services in their PHP code, and build robust applications and software using services like Amazon S3, Amazon DynamoDB, Amazon Glacier, etc. You can get started in minutes by installing the SDK through Composer or by downloading a single zip or phar file from our latest release. By default, the configuration is handled by the SDK rather than by the bundle, and no... -
25
CodeWP Local is a desktop application that allows you to run WordPress, Laravel 13, and PHP-based websites locally on your Windows machine — no technical expertise required. It comes bundled with everything you need: Nginx, PHP 8.3/8.4, MariaDB, and phpMyAdmin — all managed through a clean, modern interface.
