GPT-2 PyTorch is a compact educational implementation of OpenAI’s GPT-2 text generator in PyTorch. It uses pretrained weights converted for PyTorch rather than training the language model from scratch. Users can begin generation from a supplied prompt or request unconditional samples. Command-line options control sample count, batch size, output length, temperature, and top-k filtering. The repository includes a runnable Python script, dependency file, and Google Colab notebook for faster experimentation. It is best suited to studying an early Transformer language model and its sampling process rather than building a modern production system.
Features
- Conditional text generation
- Unconditional text sampling
- Temperature-based sampling controls
- Adjustable top-k filtering
- Command-line generation interface
- Google Colab demonstration notebook
Categories
AI ModelsLicense
MIT LicenseFollow GPT2-Pytorch with Text-Generator
Other Useful Business Software
$300 Free Credits to Build on Google Cloud
Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of GPT2-Pytorch with Text-Generator!