#interface #high-level #access #accelerator #safe #ai #tenstorrent

app luwen

A high-level interface for safe and efficient access Tenstorrent AI accelerators

1 unstable release

0.3.6 Mar 18, 2024

#214 in Machine learning

Download history 150/week @ 2024-03-18 22/week @ 2024-04-01

172 downloads per month

Apache-2.0

50KB
1K SLoC

Luwen

Named after Antonie van Leeuwenhoek who invested the microsope.

Official Repository

https://github.com/tenstorrent/luwen

Design

There are three usecases that I want to support here

  1. High level interface to software tooling allowing all syseng diagnostics collectable via tt-smi and tt-mod to be readback and interacted with as a library.
    • This will only be a high level interface so it will only support pci connections and remote connections via pci
    • Will ignore all details of using communication channels such as which pci tlb or which erisc core to use.
  2. General chip discovery and init, replacing create-ethernet-map and tt-smi wait. We'll probably also add the ability to issue resets.
  3. Low level syseng-only debug capability (via pyluwen)
    • To avoid needing to have multiple in flight stacks you will be able to drop down a level and access the implemented communication apis directly. Practically this means direct access to the types defined in luwen-ref. This means that you can modify pci tlbs and erisc cores being used or cut out the middle man entirely and issue raw calls.

Dependencies

~9–19MB
~234K SLoC