attention-viz

Visualizing query-key interactions in language + vision transformers

• Preprint: https://arxiv.org/abs/2305.03210
• Demo: http://attentionviz.com/
• Docs: https://catherinesyeh.github.io/attn-docs/

set up instructions

1. Clone repo and navigate into folder:

git clone https://github.com/catherinesyeh/attention-viz.git
cd attention-viz

2. Ask Catherine for data folder. It should be included in the web folder like so:

3. Navigate to back end:

cd web/back/

4. Create virtual env and activate:

python3 -m venv env
source env/bin/activate

5. Install requirements:

pip3 install -r requirements.txt

6. Start back end:

python3 run.py

7. Navigate to front end:

cd ../front

8. Install necessary packages and start front end:

npm i
npm run serve

9. The interface should be running at: http://localhost:8561