This is a Pytorch implementation of Reformer. It includes LSH attention, reversible network, and chunking. It has been validated with an auto-regressive task (enwik8).

Features

  • Positional Embeddings
  • Masking
  • Documentation available
  • Examples available
  • Reformer Encoder Decoder Architecture
  • Product Key Memory
  • Customize Feedforward
  • Helpers for training auto-regressive models

Project Samples

Reformer PyTorch Screenshot 1

Project Activity

See All Activity >

Categories

Machine Learning

License

MIT License

Follow Reformer PyTorch

Reformer PyTorch Web Site

Other Useful Business Software
Custom VMs From 1 to 96 vCPUs With 99.95% Uptime Icon
Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
Try Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of Reformer PyTorch!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

Python

Related Categories

Python Machine Learning Software

Registered

2024-08-12
Report inappropriate content