Popular repositories Loading

1. heinsen_routing heinsen_routing Public

   Reference implementation of "An Algorithm for Routing Vectors in Sequences" (Heinsen, 2022) and "An Algorithm for Routing Capsules in All Domains" (Heinsen, 2019), for composing deep neural networks.

   Python 171 17

2. heinsen_sequence heinsen_sequence Public

   Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)

   98 4

3. git-gpg git-gpg Public archive

   Use git on an untrusted server via a GPG-encrypted repository.

   Python 34 4

4. sata_attention sata_attention Public

   Reference implementation of "Self-Attention at Constant Cost per Token via Symmetry-Aware Taylor Approximation" (Heinsen and Kozachkov, 2026)

   Python 32 5

5. heinsen_attention heinsen_attention Public

   Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)

   Python 24 1

6. torch_parallel_scan torch_parallel_scan Public

   Simple and fast parallel scan over sequences of tensors, with any binary associative function you specify, for PyTorch (Franz A. Heinsen, 2024)

   Python 17 1