Marin
Framework for research and development of foundation models
Marin is an open-source research platform and community for developing foundation models through transparent, reproducible experimentation. It covers the complete model-building pipeline from data curation and filtering through tokenization, pretraining, post-training, and evaluation. Experiments and decisions are documented as they occur, including unsuccessful approaches. The framework is primarily used for large language models but has also supported audio-text, DNA, and protein modeling...