Search Results for "patterns"

Custom thread scheduler with custom data-structure and scheduling algorithm. Custom Mutex, Semaphore implementation and asynchronous messaging system that combines Observer and Visitor patterns. System is implemented on top of Windows system and not ported to any hardware, uses Windows thread for context saving. Code also has tested common data-structure implementation. System is designed for multi-core platform. System is tested at basic level, not fully. Press Command run button after typing a command as Enter is not supported on the command prompt. ...

...The idea is to exploit block-level sparsity — i.e. treat matrices or weight tensors as composed of blocks, many of which may be zero or unused — to save compute and memory when sparsity patterns are structured. This is particularly useful in models like Sparse Transformers, where attention matrices or intermediate layers may adopt block-sparse patterns to scale better. The repo implements both blocksparse and blockwise convolution/transpose-convolution primitives, with support for preparing, executing, and verifying those ops on NVIDIA GPUs. ...