Crawl websites, sync to vector databases, and power RAG applications. Pre-built integrations for LLM pipelines and AI assistants.
Build data pipelines that feed your AI models and agents without managing infrastructure. Crawl any website, transform content, and push directly to your preferred vector store. Use 10,000+ tools for RAG applications, AI assistants, and real-time knowledge bases. Monitor site changes, trigger workflows on new data, and keep your AIs fed with fresh, structured information. Cloud-native, API-first, and free to start until you need to scale.
Try for free
Reach Your Audience with Rise Vision, the #1 Cloud Digital Signage Software Solution
Rise Vision is the #1 digital signage company, offering easy-to-use cloud digital signage software compatible with any player across multiple screens. Forget about static displays. Save time and boost sales with 500+ customizable content templates for your screens. If you ever need help, get free training and exceptionally fast support.
W3mon is a tool that can be used to monitor a set of web sites.
By continually polling such web sites (say, once per hour), the
respective webmasters can be notified by e-mail whenever an outage
occurs.
Protect your bandwith and increase traffic to your vBulliten web site.
This project is to keep the location of files a secret that are on FTP of a vBulliten forums website. Avoid using the vB attachments database and hide file locations.
LCat is a php/mysql cataloging system for hyperlinks, intended for use on websites. It is build around a set of objects providing the basic functionality and complemented with a set of scripts and templates to perform communication with the user.
Ideal for lending professionals who are looking for a feature rich loan management system
Bryt Software is ideal for lending professionals who are looking for a feature rich loan management system that is intuitive and easy to use. We are 100% cloud-based, software as a service. We believe in providing our customers with fair and honest pricing. Our monthly fees are based on your number of users and we have a minimal implementation charge.
PANDA - Polish Nuke Distribution for all who doesn't speak english quite well... PANDA is to make install and administration of PHPNuke very easy in polish language, containing all in polish language.
aWebVisit analyses web logfiles for visit information like: entry/transit/exit points, internal links followed, length of visit and time spent.
aWebVisit-Map then allows you to examine the links followed by your visitors to and from each web page...
This Linklist uses a MySQL backend. It can handle mutiple Linklists in only 3 tables. Every Linklist has also Categories and Moderator functions. The Admin page has rich amount of features including easy un-/install. The design is clear but cool.
All-in-one security tool helps you prevent ransomware and breaches.
SIEM + Detection and Response for IT Teams
Blumira’s detection and response platform enables faster resolution of threats to help you stop ransomware attacks and prevent data breaches. We surface real threats, providing meaningful findings so you know what to prioritize. With our 3-step rapid response, you can automatically block known threats, use our playbooks for easy remediation, or contact our security team for additional guidance. Our responsive security team helps with onboarding, triage and ongoing consultations to continuously help your organization improve your security coverage.
JoBo is a web site mirroring tool. It has a graphical UI but there is a also command line version. Supports robot exclusion protocol (but this can be disabled)
Harvest is a web indexing package, originally disigned for distributed indexing,
it can form a powerful system for indexing both large and small web sites.
Also now includes Harvest-NG a highly efficient, modular, perl-based web
crawler.
TightURL takes a very long URL as input, and returns a very short URL.
Example (long URL)
http://service.domain.net/de/cgi/g.fcgi/startpage?site=greetings&CUS-GHTOO=43
Exampe (short URL)
http://www.yourdomain.com/174733788
phpSitemapNG is a free Google Sitemaps generator written in PHP, but also generates RSS-based, txt-based and HTML-based sitemap files. It will spider your website and can also index the filesystem.
Monitoring tool with support to Websites, RSS, Webservices and Databases. Has notifications by email and RSS and you can access metrics like availability, latency and load time by a web-based GUI. Runs standalone with an embedded HTTP server.