Search Results for "web crawler source code"
Sort By:
Showing 30 open source projects for "web crawler source code"
View related business solutions-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
$300 Free Credits to Build on Google CloudStart your next project with $300 in free Google Cloud credit. Spin up VMs, run containers, query petabytes in BigQuery, or build agents with Gemini Enterprise Agent Platform. Once your credits are used, keep building with 20+ always-free tier products including Compute Engine, Cloud Storage, GKE, and Cloud Run functions. No commitment required—just sign up and start building.
-
1
GH Archive
GH Archive is a project to record the public GitHub timeline
...The dataset is also published through Google BigQuery for large-scale SQL-style exploration without downloading every archive. Its structure supports trend analysis, visualizations, machine learning, and open-source ecosystem research. The repository contains the crawler, supporting scripts, and website code, while the actual event files are hosted separately. -
2
Ruby on Rails
Web Application Framework written in Ruby
Rails is a web application development framework written in the Ruby programming language. It is designed to make programming web applications easier by making assumptions about what every developer needs to get started. It allows you to write less code while accomplishing more than many other languages and frameworks. Experienced Rails developers also report that it makes web application development more fun. -
3
gist(1)
Potentially the best command line gister
gist(1) is a web-based code and text sharing platform created to allow developers to quickly store, share, and collaborate on snippets of code or notes. It integrates closely with Git, enabling version control, revisions, and forking, which makes it suitable for both temporary sharing and long-term storage of reusable code fragments. Users can create public or private gists, depending on whether they want to share their content openly or keep it accessible only via a link. The platform... -
4
DevDocs
API Documentation Browser
The devdocs repository powers the DevDocs web application, a fast, offline-friendly documentation browser for many programming languages, libraries, and APIs. It aggregates documentation from multiple sources (e.g., MDN, Python, Ruby, Git, etc.), converts them into a uniform format, and indexes them for instant text searching. The codebase includes a backend that handles ingestion, parsing, and transformation of documentation sources into a static site structure, as well as the client side... -
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
5
Sinatra
Classy web-development dressed in a DSL
Sinatra is a minimalist Ruby web framework that focuses on simplicity and flexibility, letting developers define web applications in just a few lines of code. Its DSL maps routes directly to Ruby blocks, making it straightforward to build APIs, small services, and quick prototypes without the overhead of full-stack frameworks like Rails. Despite its simplicity, Sinatra supports middleware, templates, sessions, filters, and helpers, so it can grow with more complex requirements. The framework... -
6
jekyll-theme-8bit
A Jekyll theme inspired by classic 8bit games
A Jekyll theme inspired by classic 8-bit games. Jekyll-theme-8bit has been scaffolded by the Jekyll new-theme command and therefore has all the necessary files and directories to have a new Jekyll site up and running with zero-configuration. Snippets of code within the _includes directory that can be inserted in multiple layouts (and another include-file as well) within the same theme-gem. -
7
Jazzy
Soulful docs for Swift & Objective-C
jazzy is a command-line utility that generates documentation for Swift or Objective-C. Instead of parsing your source files, jazzy hooks into Clang and SourceKit to use the AST representation of your code and its comments for more accurate results. The output matches the look and feel of Apple’s official reference documentation, post WWDC 2014. Jazzy can also generate documentation from compiled Swift modules using their symbol graph instead of source code. You need development tools to... -
8
ciao
HTTP checks & tests (private & public) monitoring
HTTP checks & tests (private & public) monitoring - check the status of your URL. ciao checks HTTP(S) URL endpoints for a HTTP status code (or errors on the lower TCP stack) and sends a notification on status change via E-Mail or Webhooks. It uses Cron syntax to schedule the checks and comes along with a Web UI and a RESTful JSON API. Create an open-source web application for checking URL statuses with a UI and a REST API which is easy to install and maintain (no external dependencies like Databases, Caches, etc.) in public and private environments. -
9
bootstrap_form
Repository of the bootstrap_form gem
Official repository of the bootstrap_form gem, a Rails form builder that makes it super easy to create beautiful-looking forms using Bootstrap 5. bootstrap_form is a Rails form builder that makes it super easy to integrate Bootstrap v5-style forms into your Rails application. It provides form helpers that augment the Rails form helpers. bootstrap_forms's form helpers generate the form field and its label and all the Bootstrap mark-up required for proper Bootstrap display. bootstrap_form. You... -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
10
StimulusReflex
Build reactive applications with the Rails tooling you already know
StimulusReflex is a Ruby on Rails framework for building reactive, real-time web interfaces without moving most application logic into a heavy frontend framework. It connects Stimulus controllers, Rails server-side actions, Action Cable, and CableReady to respond to user interactions over WebSockets. When a user clicks, types, submits, or triggers another event, the server processes the action and sends DOM updates back to the browser. This lets developers keep validation, persistence,... -
11
Jekyll Pure Liquid Table of Contents
A GitHub Pages compatible Table of Contents generator
GitHub Pages can't run custom Jekyll plug-ins so when generating Tables of Contents (TOCs), you're stuck with either a JavaScript solution or using kramdown's {:toc} option. However, by using {:toc}, you are forced to have that code next to your actual markdown and you can't place it in a layout. This means every. single. post. will need to have the snippet. If you choose the JavaScript approach, that's perfectly fine but what if JS is disabled on someone's browser or your page is just... -
12
GitLab CE Server For Local Intranets
The Free & Popular Community git Server in a Complete Virtual Machine
This VM is created for 2 reasons: 1. Very little initial setup work required to make a GIT Server live, within minutes. 2. This system should keep running for Years, without requiring Updates / Breakages. If you are new to Virtual Machines, then please watch the Video below ( taken from my other project. just replace td with gi wherever mentioned ) After starting this VM, please login to its administration panel with: Website Address: https://gi.local/ ( Accept Any Warnings due to... -
13
Premonition
Add block-styled content to your site. Like summaries, notes and hints
Premonition is a Jekyll plugin that can transform Markdown blockquotes into styled blocks of code. The default template and stylesheet focus on creating info boxes, but through the templating system, you can modify it to suit your needs. With version 4 we also introduced a new citation box. -
14
Jekyll::Asciinema
Liquid tag for embedding asciicasts recorded with asciinema
Provides a Liquid tag for embedding asciicasts recorded with asciinema for use in Jekyll sites. After checking out the repo, run bin/setup to install dependencies. Then, run bin/console for an interactive prompt that will allow you to experiment. -
15
brutalist-blog
Minimalistic theme that automatically supports dark & light modes
Minimalistic Jekyll theme that automatically supports dark and light modes for blogs. -
16
Marathon -GUI Test Runner Web, Swing, FX
Marathon supports testing of Java/Swing and Java/Fx applications.
Marathon provides an integrated environment for test script creation and execution. Supported FW: Web, Java Swing/ Java FX. Currently, Marathon supports JRuby script models for recording the test scripts.Marathon test runner generates Allure test reports.Marathon allows for grouping of test cases.It also has an option of inserting modules while recording(in MarathonITE while recording). It allows tester to inset checklist while recording and also takes screen capture and annotate it in... -
17
Not Pure Poole
A simple, beautiful, and powerful Jekyll theme for blogs
Not Pure Poole is a simple, beautiful, and powerful Jekyll theme for blogs. It is built on Poole and Pure. -
18
Noir
Noir is a modern, responsive and customizable theme for Jekyll
Noir is a modern, responsive and customizable theme for Jekyll 4. Typography is paid close attention to and a dark mode-friendly color scheme will be displayed automatically. It builds upon a standard Jekyll install in a number of ways. A wide variety of HTML elements commonly used in online Markdown writing (blockquotes, headers, tables, boxes/buttons, figure captions, code blocks, footnotes) have been styled. HTML, SASS and Config files are included for the theme's design and... -
19
API Umbrella
Open source API management platform
API Umbrella is an open source API management platform for exposing web service APIs. The basic goal of API Umbrella is to make life easier for both API creators and API consumers. APIs can assume the boring stuff (access control, rate limiting, analytics, etc.) is already taken care if the API is being accessed, so common functionality doesn't need to be implemented in the API code. -
20
Jekyll-Pug
Finally be able to code with Pug on Jekyll
Finally, be able to code with Pug on Jekyll. Jekyll-Pug is a plugin and Jekyll-Bliss is a wrapper that goes on top of Jekyll. Jekyll-Bliss does all of the heavy lifting (Pug/Sass compiling, minification) and leaves Jekyll to build your site. This results in faster compile times. -
21
jekyll-version-plugin
Liquid tag plugin for Jekyll rendering a version identifier for Jekyll
A Liquid tag plugin for Jekyll that renders a version identifier for your Jekyll site sourced from the git repository containing your code. Great if you want to display the version of your project on your site automatically each time your site is built. Identify and highlight the build of your project by calling the tag from your Jekyll project. -
22
Meta Tag Generator. Allows you to research SEO keywords generate proper compliant meta tags and output them to a HTML or text file for insertion into a finished web project.
-
23
rails-ajax
Add Ajax capabilities to Rails websites with history, bookmarking...
Add Ajax capabilities to Rails websites, with minimal code changes. Supports history, bookmarking, partial refreshes, Rails flashes, user callbacks, scripts execution, redirections. Built upon Rails-UJS and jQuery. -
24
Zoozle Search & Download Suchmaschine
Zoozle 2008 - 2010 Webpage, Tools and SQL Files
Download search engine and directory with Rapidshare and Torrent - zoozle Download Suchmaschine All The files that run the World Leading German Download Search Engine in 2010 with 500 000 unique visitors a day - all the tools you need to set up a clone. Code Contains: - PHP Files for zoozle - Perl Crawler for gathering new content to database and all other cool tools i have... -
25
Framework for making Windows applications that are one .exe file in AutoHotKey_L,C++,C#, VB.NET,Java,Groovy,Common Lisp,Nemerle,Ruby,Python,PHP,Lua,Tcl,Perl,Jint,S#,WSH VBScript,HTML/JavaScript/CSS,COM, PowerShell without compiling . For .NET 4.
