Showing 1 open source project for "distributed computing"

View related business solutions
  • $300 Free Credits to Build on Google Cloud Icon
    $300 Free Credits to Build on Google Cloud

    New customers can spin up VMs, build with AI, and query data at no cost.

    Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
    Start Free
  • Train ML Models With SQL You Already Know Icon
    Train ML Models With SQL You Already Know

    BigQuery automates data prep, analysis, and predictions with built-in AI assistance.

    Build and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
    Start Free
  • 1
    build nanoGPT

    build nanoGPT

    Video+code lecture on building nanoGPT from scratch

    ...The accompanying video lecture explains how the code develops into a reproduction of the 124-million-parameter GPT-2 model. The project covers tokenization, transformer architecture, optimization, distributed training, data loading, and performance improvements. It includes FineWeb data preparation and HellaSwag evaluation utilities. With sufficient computing resources, the same general code can scale toward larger GPT-3-style configurations. The repository focuses on pretraining rather than instruction tuning or conversational fine-tuning.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Previous
  • You're on page 1
  • Next