Search Results for "web crawler source code"
Sort By:
Showing 90 open source projects for "web crawler source code"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Try Google Cloud Risk-Free With $300 in CreditUse your credit across every product. Compute, storage, AI, analytics. When it runs out, 20+ products stay free. You only pay when you choose to.
-
1
RobotsTxt
The repository contains Google's robots.txt parser
This is a high-performance, production-tested library for parsing and evaluating robots.txt rules against crawler user agents. It implements the core semantics of the Robots Exclusion Protocol: user-agent sections, Allow/Disallow directives, wildcard handling, and precedence rules. The code is optimized for speed and low memory so large crawls can evaluate millions of URLs quickly. It also focuses on correctness—edge cases like overlapping patterns and longest-match resolution are handled... -
2
J2ObjC
A Java to iOS Objective-C translation tool and runtime
J2ObjC is an open-source command-line tool from Google that translates Java source code to Objective-C for the iOS (iPhone/iPad) platform. This tool enables Java source to be part of an iOS application's build, as no editing of the generated files is necessary. The goal is to write an app's non-UI code (such as application logic and data models) in Java, which is then shared by web apps (using GWT), Android apps, and iOS apps. -
3
iCn3D
Web-based protein structure viewer and analysis tool
"I see in 3D" (iCn3D) Structure Viewer is not only a web-based 3D viewer, but also a structure analysis tool interactively or in the batch mode using NodeJS scripts based on the npm package icn3d. iCn3D synchronizes the display of 3D structure, 2D interaction, and 1D sequences and annotations. Users' custom displays can be saved in a short URL or a PNG image. The complete package of iCn3D including Three.js and jQuery is in the directory "dist" after you get the source code with the "Code" button. ... -
4
STranslate
A ready-to-go translation ocr tool developed with WPF/WPF
STranslate is a lightweight, open-source machine translation front end that lets users translate text between languages using a variety of supported back-end translation engines or APIs, offering a simple GUI for quick translation tasks without needing to write code or use complex web UIs. The application is designed to be small, cross-platform, and flexible, giving users the ability to type or paste text and receive instant translations while optionally selecting the desired language pairs or switching between multiple service providers. ... -
Gemini 3 and 200+ AI Models on One PlatformBuild generative AI apps with Vertex AI. Switch between models without switching platforms.
-
5
bbbike
An information system for cyclists in Berlin and Brandenburg
A bike information system for cyclists in Berlin and Brandenburg (Germany) with a map view and a routing engine. There's a graphical interface (based on Perl/Tk) as well as an Web interface. Source code may be found at Github: https://github.com/eserte/bbbike/ -
6
...You can also connect directly with the companies supporting the development. Source code available on github https://github.com/geonetwork/
-
7
SPPAS
SPPAS - the automatic annotation and analyses of speech
SPPAS is a scientific computer software package written and maintained by Brigitte Bigi of the Laboratoire Parole et Langage, in Aix-en-Provence, France. Available for free, with open source code, there is simply no other package for linguists to simple use in the automatic annotations of speech, the analyses of any kind of annotated data and the conversion of annotated files. SPPAS is able to produce automatically speech annotations from a recorded speech sound and its orthographic... -
8
PlateEditor
PlateEditor, a free web application to work with multi-well plates
...It doesn't require any installation. - PlateEditor is available at this address: https://plateeditor.sourceforge.io - The source code is also available on GitHub, visit: https://github.com/vindelorme/PlateEditor More information about the source code and the API are available there (the wiki is still under construction, thanks for your patience!) For a list of recent updates, visit: https://sourceforge.net/p/plateeditor/wiki/Updates/ Hoping PlateEditor will make your life easier in the lab! ... -
9
CleverPsych Practice Management
FREE software to manage your psychology or allied health solo practice
CleverPsych is FREE software for psychologists and other allied health professionals who run their own practices. We have been using CleverPsych in our own practice in Australia since 2007. The system enables you to record your clients, appointments, services, organisations and referring doctors. The aim is to make operations like generating standard letters, claiming from the government and insurance companies, and reporting income, much easier. Look in the Files tab for... -
Earn up to 16% annual interest with Nexo.Put idle assets to work with competitive interest rates, borrow without selling, and trade with precision. All in one platform. Geographic restrictions, eligibility, and terms apply.
-
10
GeoTools, the Java GIS toolkit
Toolkit for working with and mapping geospatial data
GeoTools is an open source (LGPL) Java code library which provides standards compliant methods for the manipulation of geospatial data. GeoTools is an Open Source Geospatial Foundation project. The GeoTools library data structures are based on Open Geospatial Consortium (OGC) specifications. -
11
DeepSee
Visualize deep ocean biogeochemical sediment samples in 2D and 3D!
DeepSee is an interactive workspace for deep ocean scientists to upload sediment core data and map images and see their sampling history displayed across multiple connected views at once! 🦑🦀🐚 🚀 For a live demo, visit: https://www.its.caltech.edu/~datavis/deepsee/ 🌱 To get started, visit our Wiki: https://sourceforge.net/p/deepsee/wiki/Home/ 🧑💻 To modify DeepSee for your own project, visit our GitHub repository: https://github.com/orphanlab/DeepSee/ --- Created by Adam Coscia,... -
12
Traccar (GPS tracking system)
Open source system for GPS tracking devices
...Application includes embedded web server to track devices on map. Official web page: https://www.traccar.org/ Demo: https://www.traccar.org/demo-server/ Source code repository: https://github.com/tananaev/traccar Issues tracker: https://github.com/tananaev/traccar/issues -
13
SGraph
Create charts by retrieving data from Stata on-the-fly
SGraph is a web application that interacts with Stata for creating graphs. It is a demo application that demostrates how to exploit SWire for creating web applications that communicate with Stata. SGraph is an open source project and you can download the code from the project web site web site or try the app on-line here: http://sgraph-with-swire.sourceforge.net/ The source project is hosted in GitHub: https://github.com/lomagno/sgraph -
14
openPOWERLINK
An Open Source POWERLINK Stack
openPOWERLINK is an Open Source Industrial Ethernet stack for communication in hard real-time. It can be operated as both, Managing Node (master) and Controlled Node (slave). With version 2.0, the source code has been cleanly split into an application-oriented user library and a time-critical stack driver. The latter may be moved to a dedicated communication processor or into a kernel module to deliver enhanced performance while still keeping the API in user space. ... -
15
queXC
Web based system for cleaning and classifying open text fields
An Open Source, web based data cleaning and coding system. queXC takes a data file (such as questionnaire data) and cleans the text input fields by spacing and spell checking them. Operators then code text fields using new/existing coding schemes. -
16
MToolBox
A bioinformatics pipeline to analyze mtDNA from NGS data
...MToolBox provides also a Variant Call Format file (version 4.0) featuring, for the first time, allele-specific heteroplasmy. Please, check out the most recent updates of the source code with the Github repository of MToolBox: https://github.com/mitoNGS/MToolBox or visit the Web version of MToolBox @ MSeqDR: https://mseqdr.org/mtoolbox.php -
17
DigiOz .NET Portal
ASP.NET MVC Based Portal CMS System to Create an Instant Website
DigiOz .NET Portal is a FREE web based portal CMS system written in ASP.NET MVC 5 in C# which uses a Microsoft SQL Database to allows webmasters to setup and customize an instant website for either business or personal use. List of Technologies used: - ASP.NET MVC 5 - Microsoft SQL Server - Bootstrap - HTML 5 - jQuery Demo Site: http://digioznetportal.digioz.net/ Source Code: https://sourceforge.net/p/digioznetportal/codenew/ci/master/tree/ Installation Instructions: https://sourceforge.net/p/digioznetportal/wiki/Home/ Help Wanted: If you are a developer, and wish to join the project, please email us at support@digioz.com. -
18
C-squares
Concise spatial query and representation system (c-squares)
C-squares is an easily implemented method for storage, querying and display of spatial data locations, based on a hierarchical, grid-based representation of the Earth' surface. Source code for encoding, decoding, mapping, etc. is provided via this site. Additional support is available by contacting the system developer, Tony.Rees@marinespecies.org; see also the c-squares home page at http://www.cmar.csiro.au/csquares/ . -
19
PHP-Module-Loader
Simple PHP Module Loader Source Code
This is an easy to use PHP-Module-Loader Script for any purpose. Future Versions may be more complex. This Version of the PHP-Module-Loader is the most simple. Have fun trying and don't forget to give some Feedback on my project pages. In Version 1.1 Final is absolute path given to avoid problems. The $_GET Variable is now escaped. Now you can try out the new namegenerator module with the PHP-Guestbook or with the PHP-Module-Loader You can get PHP-Modul-Loader @ GitHub:... -
20
Python4Proteomics Course
Python course for Proteomics analysis
Python course (in Spanish) for Proteomics analysis using basically Jupyter NoteBooks. For more information, you can have a look at the readme.md file in the source code tree: https://sourceforge.net/p/lp-csic-uab/p4p/code/ci/default/tree/readme.md -
21
Bridge Designer and Contest
A national virtual bridge engineering contest for kids of all ages.
Bridge Designer has been replaced with the web app ASCE Bridge Designer, Cloud Edition. Binaries posted here will go away on 1 July 2026. The source repo will remain. A national virtual bridge engineering contest with prizes for middle and high school kids, grades 6 to 12, but anyone can enter for fun. Based on the award-wining Bridge Designer client software, now open source through this project. Web site infrastructure supports worldwide participation in qualifying and semifinal rounds... -
22
DrawGlycan-SNFG
Renders glycans and glycopeptides with frag. info using SNFG format
DrawGlycan-SNFG is a simple and robust drawing tool for displaying glycans and glycopeptides from IUPAC-condensed format text inputs. It also supports the depiction of glycan and glycopeptide fragmentation. The program is available in the form of web (link below) and standalone GUI applications. Program source code is also provided.. The web and GUI apps do not require any additional software to run. To install the GUI version, simply download and run the installer for PC or Mac. To install in Linux, follow in-package instructions or visit the VirtualGlycome.org FAQ page. ... -
23
codelyzer
Static analysis for Angular projects
...In the configuration file can implement custom pre-processing and template resolution logic. Lint rules encode logic for syntactic & semantic checks of TypeScript, HTML, CSS and Angular expressions source code. -
24
panFMP is a generic framework suitable for harvested XML metadata that is searchable through Apache Lucene without any additional RDBMS. Fields can be defined by XPath allowing for full text queries on all types of fields including numerical ranges. The code was moved to Github: https://github.com/pangaea-data-publisher/panfmp
-
25
Accent Tool Suite
Accent interfaces and controls systems through goals and policies
Accent (Advanced Component Control Enhancing Network Technologies) is a comprehensive tool suite that interfaces a variety of communications systems and allows these systems to be controlled through goals (high-level user aims) and policies (lower-level system rules). Accent has been applied to the domains of: o Call Control: for telecommunications, particularly call control in Internet telephony o Home Care: for home automation and telecare, particularly for domestic appliances...
