Search Results for "web crawler source code"
Sort By:
Showing 118 open source projects for "web crawler source code"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Gemini 3 and 200+ AI Models on One PlatformBuild generative AI apps with Vertex AI. Switch between models without switching platforms.
-
1
Blockly
The web-based visual programming editor
The Blockly library adds an editor to your app that represents coding concepts as interlocking blocks. It outputs syntactically correct code in the programming language of your choice. Custom blocks may be created to connect to your own application. Blockly in a browser allows web pages to include a visual code editor for any of Blockly's five supported programming languages, or your own. Blockly plugins are self-contained pieces of code that add functionality to Blockly. Blockly codelabs... -
2
tabler icons
1950 free MIT-licensed high-quality SVG icons
A set of over 1950 free MIT-licensed high-quality SVG icons for you to use in your web projects. Over 1950 pixel-perfect icons for web design. Free and open-source icons designed to make your website or app attractive, visually consistent, and simply beautiful. Each icon is designed on a 24x24 grid and a 2px stroke. All icons are built with SVG, so you can place them as <img>, background-image and inline in HTML code. -
3
iCn3D
Web-based protein structure viewer and analysis tool
"I see in 3D" (iCn3D) Structure Viewer is not only a web-based 3D viewer, but also a structure analysis tool interactively or in the batch mode using NodeJS scripts based on the npm package icn3d. iCn3D synchronizes the display of 3D structure, 2D interaction, and 1D sequences and annotations. Users' custom displays can be saved in a short URL or a PNG image. The complete package of iCn3D including Three.js and jQuery is in the directory "dist" after you get the source code with the "Code" button. ... -
4
YesPlayMusic
Play Music for Windows / macOS / Linux
High-quality third-party NetEase cloud player, supports Windows / macOS / Linux :electron. Overseas users can play directly (need to log in to NetEase Cloud account). Support UnblockNeteaseMusic, automatically replace grayed out song links with various audio sources (web version not supported). Various audio sources" refers to audio sources that are enabled by default. YouTube audio source needs to install yt-dlp by itself. Daily automatic check-in (check-in on mobile and computer at the... -
$300 in Free Credit Towards Top Cloud ServicesStart your project in minutes. After credits run out, 20+ products include free monthly usage. Only pay when you're ready to scale.
-
5
You-Get
Dumb downloader that scrapes the web
...It’s also a good choice for when you want to get rid of any closed-source technology or proprietary JavaScript code from running on your computer. -
6
xeokit SDK
Open source JavaScript SDK for viewing high-detail 3D BIM
...Keep everything on your own servers. Get your models on the Web using a toolkit of production-proven components that save you costly research, development, and maintenance. Keep data, viewer and conversion tools on your own servers. No overloaded cloud services, or unpredictable costs. No hassles with data protection laws. You get the source code. Customize and extend it however you want. Join our community of 3D Web programming experts and industry leaders. ... -
7
Jimp
An image processing library written entirely in JavaScript for Node
An image processing library for Node written entirely in JavaScript, with zero native dependencies. If you're using this library with TypeScript the method of importing slightly differs from JavaScript. Instead of using require, you must import it with ES6 default import scheme. If you're using a web bundles (webpack, rollup, parcel) you can benefit from using the module build of jimp. Using the module build will allow your bundler to understand your code better and exclude things you aren't... -
8
Amazon EC2 Metadata Mock
A tool to simulate Amazon EC2 instance metadata
Instance metadata is data about your instance that you can use to configure or manage the running instance. Instance metadata is divided into categories, for example, hostname, events, and security groups. You can also use instance metadata to access user data that you specified when launching your instance. For example, you can specify parameters for configuring your instance, or include a simple script. You can build generic AMIs and use user data to modify the configuration files supplied... -
9
TL WebRTC File (tl-rtc-file)
WebRTC P2P online web media streaming tool
tl-rtc-file is a lightweight JavaScript library that enables real-time, peer-to-peer file sharing using WebRTC. It allows users to transfer files directly between browsers without relying on a server, cloud storage, or backend infrastructure. The library is ideal for building web apps, chat systems, or support tools that require fast and secure file exchange with minimal setup. With optional compression and simple integration, tl-rtc-file emphasizes efficiency and privacy in web-based file sharing. -
AI-generated apps that pass security reviewRetool lets you generate dashboards, admin panels, and workflows directly on your data. Type something like “Build me a revenue dashboard on my Stripe data” and get a working app with security, permissions, and compliance built in from day one. Whether on our cloud or self-hosted, create the internal software your team needs without compromising enterprise standards or control.
-
10
SkiaSharp
SkiaSharp is a cross-platform 2D graphics API for .NET platforms
SkiaSharp is a cross-platform 2D graphics API for .NET platforms based on Google's Skia Graphics Library. It provides a comprehensive 2D API that can be used across mobile, server and desktop models to render images. Building SkiaSharp is mostly straight forward. The main issue is the multiple dependencies for each platform. However, these are easy to install as they are found on the various websites. If you are just working on managed code, it is even easier as there mays to skip all the... -
11
RestorePhotos.io
Restoring old and blurry face photos with AI
RestorePhotos.io is an AI web app for restoring old, blurry, or low-quality face photos and bringing them back to life. It wraps the GFPGAN model (served via Replicate) behind a friendly Next.js front end, so non-technical users can upload an image and receive an enhanced version without ever touching ML code. The workflow is straightforward: you upload a photo, the serverless API route sends it to Replicate, and the restored image is returned and displayed in the UI. The project is... -
12
Krypt
Build a Web 3.0 React Solidity blockchain application
This repository accompanies a step-by-step tutorial for building a Web3 decentralized application that connects a React front end to Ethereum smart contracts written in Solidity. It walks you through setting up MetaMask, configuring a local or test blockchain, and wiring contract methods to a clean, modern UI. The project emphasizes end-to-end learning: from authoring and compiling a smart contract, to deploying it, and then interacting with it via web3 libraries in React. It demonstrates... -
13
Stremio Core
Types, addon system, UI models, core logic
Stremio Core is the Rust engine that powers Stremio’s apps by centralizing all reusable logic behind discovery, catalogs, metadata, streams, add-ons, and user/library state. It exposes a clean set of modules—types, addon_transport, and state_types—so apps can talk to add-ons, model UI state, and react to events without duplicating code. The architecture is inspired by Elm: immutable state, message-driven updates, and explicit side-effects (“effects”) keep behavior predictable and testable.... -
14
Audacity
A free multi-track audio editor and recorder
...Audacity is free software, developed by a group of volunteers and distributed under the GNU General Public License (GPL). Programs like Audacity are also called open source software, because their source code is available for anyone to study or use. There are thousands of other free and open source programs, including the Firefox web browser, the LibreOffice or Apache OpenOffice office suites and entire Linux-based operating systems such as Ubuntu -
15
RhinOS
RhinOS, CMS, Content Management System, Josep Sanz Campderrós
RhinOS is a framework to develop web sites using the latest features to provide a fastest access and administration to the web portal. The main features are: - Parametrized CMS and simple and efficient pseudo-code parser. -
16
SPPAS
SPPAS - the automatic annotation and analyses of speech
SPPAS is a scientific computer software package written and maintained by Brigitte Bigi of the Laboratoire Parole et Langage, in Aix-en-Provence, France. Available for free, with open source code, there is simply no other package for linguists to simple use in the automatic annotations of speech, the analyses of any kind of annotated data and the conversion of annotated files. SPPAS is able to produce automatically speech annotations from a recorded speech sound and its orthographic... -
17
Kerach Go
A petite text shaderer whose entire code fits into a single html file
A petite text shaderer whose entire code fits into a single html file. GitHub repository: https://github.com/Northstrix/kerach-go Link: https://northstrix.github.io/kerach-go/ The app is fully localized into: ✅ English ✅ Hebrew ✅ Italian ✅ Latin American Spanish ✅ Brazilian Portuguese ✅ Japanese ✅ Cantonese -
18
Music Library & Player
Easily access your music collection from any device, anywhere.
Music Library & Player utilizes PHP and vanilla javascript to deliver your web-accessible music library via HTML5 audio in a fully responsive and modern interface. The library does not require a database back-end. It parses the directory structure, best suited for a [ROOT]/[ARTIST]/[ALBUM]/[TRACKS] type of layout. This isn't required, but makes for the best user experience. Random playlists can also be generated. The code contained in this script has not been minified. It is written... -
19
twitch-batch-downloader
Automate the download of entire Twitch.tv channels
Automate the download of entire Twitch.tv channels with its metadata. Save each Twitch video into its own folder, with date and time values, video ID, stream metadata, frame screenshot, .ts parts list and sha256 hash. Keep the original ts files and generate mp4 files from them. It requires a shell and some command line utilities. See README.md for details in the Code/git section. -
20
Mermaid.js to SVG Converter
Visualize the diagrams of your projects
...The trick is to ask the AI to write a diagram in Mermaid.js format that solidifies the structure of the project and then use that as context to keep the AI reminded at all times what the project is as a whole. This will prevent it from changing things its not supposed to change. This standalone offline web app will convert that mermaid.js code into a visual SVG image so that YOU as a human will be able to understand what the AI think about the structure of your projects so you can see it and fix any misconceptions until the diagram is correct for your project. (Source code is included in the html itself. Open it in a web browser to use.) -
21
Nof Go
A petite color palette generator
A petite color palette generator whose entire code fits within a single html file. Link: https://northstrix.github.io/nof-go/ GitHub repository: https://github.com/Northstrix/nof-go -
22
GeoTools, the Java GIS toolkit
Toolkit for working with and mapping geospatial data
GeoTools is an open source (LGPL) Java code library which provides standards compliant methods for the manipulation of geospatial data. GeoTools is an Open Source Geospatial Foundation project. The GeoTools library data structures are based on Open Geospatial Consortium (OGC) specifications. -
23
Audio Satanifier 666
Easily apply cool gnarly voice filters to your audio files
Transform pure innocent audio files, speech, music, etc into unholy demonic abominations. Audio Satanifier 666 is a fun easy-to-use browser-based tool forged in the pits of hell, for voice actors, musicians, sound designers, for memes, for creative projects or anyone else who want to twist their sound into something absolutely diabolical! Layperson friendly - you'll be able to apply cool effects to your audio file even if you know nothing about audio engineering. Theres also a... -
24
Dead Deer 3.14.82.2025
3D modeler, 3D game maker, 3D demo maker
3D modeler, 3D game maker, 3D demo maker. to model and create games, demos. Scripting language allows you to code interactions in pseudo-C with the animation and synthesize your own rendering with own-made shaders. Import FBX, BLEND, GLTF, OBJ, 3DS, DAE, X, XML, STL, PCB, ASC, PLY, GSPLATS. Cross-platform project WINDOWS 32/64 /MACOSX 10.6/ 10.8+/APPLSilicon /LINUX/iOS/ANDROID/WINDOWS PHONE/GOOGLE VR/OPEN VR/OCULUS VR/WEBASM/UWP8/10/OPENXR, PIs (ARM32/64), RISCV Players and... -
25
Obsidian MEDILIG
Obsidian MEDILIG (Medical Life Guard) App Local-First Offline-First
Obsidian MEDILIG (Medical Life Guard): An easy-to-use, flexible, secure, cross-platform medical knowledge management system for patient's Electronic Health Record (EHR) that is built on top of Obsidian software application for the design, implementation and use of autonomous, multilingual, clinical documents from primary care to continuing care.
