This is a Pytorch implementation of Reformer. It includes LSH attention, reversible network, and chunking. It has been validated with an auto-regressive task (enwik8).

Features

  • Positional Embeddings
  • Masking
  • Documentation available
  • Examples available
  • Reformer Encoder Decoder Architecture
  • Product Key Memory
  • Customize Feedforward
  • Helpers for training auto-regressive models

Project Samples

Reformer PyTorch Screenshot 1

Project Activity

See All Activity >

Categories

Machine Learning

License

MIT License

Follow Reformer PyTorch

Reformer PyTorch Web Site

Other Useful Business Software
$300 Free Credits to Build on Google Cloud Icon
$300 Free Credits to Build on Google Cloud

New customers can spin up VMs, build with AI, and query data at no cost.

Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
Start Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of Reformer PyTorch!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

Python

Related Categories

Python Machine Learning Software

Registered

2024-08-12
Report inappropriate content