GH Archive collects public GitHub activity and preserves it as a historical dataset for analysis. It polls GitHub’s event feed and groups the raw responses into compressed hourly JSON archives. The records cover actions such as commits, forks, issue activity, comments, and repository membership changes. Researchers can download specific hours, days, or longer periods with ordinary HTTP tools and process the events in their own systems. The dataset is also published through Google BigQuery for large-scale SQL-style exploration without downloading every archive. Its structure supports trend analysis, visualizations, machine learning, and open-source ecosystem research. The repository contains the crawler, supporting scripts, and website code, while the actual event files are hosted separately.

Features

  • Hourly compressed JSON event archives
  • Public GitHub activity captured from event feeds
  • Direct HTTP downloads by hour, day, or date range
  • Public BigQuery dataset for SQL-style analysis
  • Raw event payloads preserved with minimal processing
  • Crawler, scheduling, and data-processing utilities

Project Samples

Project Activity

See All Activity >

Categories

Libraries

License

MIT License

Follow GH Archive

GH Archive Web Site

Other Useful Business Software
$300 Free Credits for Your Google Cloud Projects Icon
$300 Free Credits for Your Google Cloud Projects

Start building on Google Cloud with $300 in free credits. No commitment, no credit card required until you're ready to scale.

Launch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
Start Free Trial
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of GH Archive!

Additional Project Details

Programming Language

Ruby

Related Categories

Ruby Libraries

Registered

2 days ago