#interface #accelerator #tenstorrent #ai #access #high-level #safe

app luwen

A high-level interface for safe and efficient access Tenstorrent AI accelerators

1 unstable release

0.3.6 Mar 18, 2024

#572 in Hardware support

Apache-2.0

50KB
1K SLoC

Luwen

Named after Antonie van Leeuwenhoek who invested the microsope.

Official Repository

https://github.com/tenstorrent/luwen

Design

There are three usecases that I want to support here

  1. High level interface to software tooling allowing all syseng diagnostics collectable via tt-smi and tt-mod to be readback and interacted with as a library.
    • This will only be a high level interface so it will only support pci connections and remote connections via pci
    • Will ignore all details of using communication channels such as which pci tlb or which erisc core to use.
  2. General chip discovery and init, replacing create-ethernet-map and tt-smi wait. We'll probably also add the ability to issue resets.
  3. Low level syseng-only debug capability (via pyluwen)
    • To avoid needing to have multiple in flight stacks you will be able to drop down a level and access the implemented communication apis directly. Practically this means direct access to the types defined in luwen-ref. This means that you can modify pci tlbs and erisc cores being used or cut out the middle man entirely and issue raw calls.

Dependencies

~10–19MB
~243K SLoC