Search Results for "trade"

FairScale is a collection of PyTorch performance and scaling primitives that pioneered many of the ideas now used for large-model training. It introduced Fully Sharded Data Parallel (FSDP) style techniques that shard model parameters, gradients, and optimizer states across ranks to fit bigger models into the same memory budget. The library also provides pipeline parallelism, activation checkpointing, mixed precision, optimizer state sharding (OSS), and auto-wrapping policies that reduce...

The “quantitative” repository by Jack-Cherish is a tutorial-style codebase for quantitative trading written in Python — essentially a learning resource that guides users through building algorithmic trading strategies step by step. It’s organized as a sequence of lessons (lesson1, lesson2, etc.), making it approachable for learners who want to understand both theory and practice in quantitative finance. The repo is evidently tied to a popular video series (on Bilibili) that reportedly drew...

...The repository provides implementations of sparse attention layers, training code, and evaluation scripts for benchmark datasets. It highlights both fixed and learnable sparsity patterns that trade off computational cost and model expressiveness. By enabling tractable training on longer contexts, the project opened the door to applications in large-scale text and image generation. Though archived, it remains a key reference for efficient transformer research, influencing many later architectures that aim to extend sequence length while reducing compute.