Search Results for "notes"

...This gives RWKV important advantages for long-context use, including lower memory pressure and no traditional key-value cache requirement. The repository includes training code, model notes, research material, and references to current RWKV weights. Its main value is providing the foundation for experimenting with efficient large language models that combine transformer-like scalability with RNN-like runtime behavior.

...It includes classic and advanced models such as fastText, TextCNN, BERT, TextRNN, RCNN, hierarchical attention networks, seq2seq attention, Transformers, dynamic memory networks, entity networks, ensembles, and boosting methods. The repository also includes training, prediction, testing, preprocessing, sample data, cached data guidance, and performance comparison notes. Overall, it is a hands-on reference for developers and researchers who want to experiment with deep learning methods for text classification.

Apache MXNet is an open source deep learning framework designed for efficient and flexible research prototyping and production. It contains a dynamic dependency scheduler that automatically parallelizes both symbolic and imperative operations. On top of this is a graph optimization layer, overall making MXNet highly efficient yet still portable, lightweight and scalable.

Awesome Artificial Intelligence, Machine Learning and Deep Learning as we learn it. Study notes and a curated list of awesome resources of such topics. This repo is dedicated to engineers, developers, data scientists and all other professions that take interest in AI, ML, DL and related sciences. To make learning interesting and to create a place to easily find all the necessary material. Please contribute, watch, star, fork and share the repo with others in your community.

This repository contains code examples for the course CS 20: TensorFlow for Deep Learning Research. It will be updated as the class progresses. Detailed syllabus and lecture notes can be found in the site. For this course, I use python3.6 and TensorFlow 1.4.1.