Search Results for "idea"

The blocksparse repository provides efficient GPU kernels (TensorFlow custom ops) for block-sparse matrix multiplication and convolution operations. The idea is to exploit block-level sparsity — i.e. treat matrices or weight tensors as composed of blocks, many of which may be zero or unused — to save compute and memory when sparsity patterns are structured. This is particularly useful in models like Sparse Transformers, where attention matrices or intermediate layers may adopt block-sparse patterns to scale better. ...

This is the fifth or sixth generation of this idea, the big difference being that we have written some bootloader code and have started mapping out the kernel layout and structure. We have decided upon a core programming language for the kernel, and the core language for almost everything else. With a focus on isolating the MAJOR kernel features from the system itself, in what until now has remained research only instances, we hope to create a fully functioning exokerne.

The Patagonia OS is intended to work with x86 computers. It is for general purposes and can be modified easily and add drivers for other devices. The main idea of this kernel is transform PCs into research machines.