Search Results for "warc"
Sort By:
Showing 4 open source projects for "warc"
View related business solutions-
Google Cloud’s AI-powered APIs help you translate documents, websites, apps, audio files, videos, and more at scale with best-in-class quality and enterprise-grade control and security.
-
ChangeGear provides IT staff with the functions required to manage everything from ticketing to incident, change and asset management and more. ChangeGear includes a virtual agent, self-service portals and AI-based features to support analyst and end user productivity.
-
1
ipwb
A distributed and persistent archive replay system using IPFS
InterPlanetary Wayback (ipwb) facilitates permanence and collaboration in web archives by disseminating the contents of WARC files into the IPFS network. IPFS is a peer-to-peer content-addressable file system that inherently allows deduplication and facilitates opt-in replication. ipwb splits the header and payload of WARC response records before disseminating into IPFS to leverage the deduplication, builds a CDXJ index with references to the IPFS hashes returned, and combines the header... -
2
WebCorpus
Hadoop framework for scalable processing of large web corpora
WebCorpus is a Hadoop-based framework that enables you to calculate statistics on large web corpora extracted from web crawls. -
3
The archive-crawler project is building Heritrix: a flexible, extensible, robust, and scalable web crawler capable of fetching, archiving, and analyzing the full diversity and breadth of internet-accesible content.
-
4
Access and manipulation tools, parsers and writers, for web archives stored in Internet Archive ARC and WARC files.
-
Google Cloud is a cloud-based service that allows you to create anything from simple websites to complex applications for businesses of all sizes.
- Previous
- You're on page 1
- Next