I will share some useful or interesting papers about neuromorphic processor

[TVLSI'23] This repository contains the source code for the paper "FireFly: A High-Throughput Hardware Accelerator for Spiking Neural Networks with Efficient DSP and Memory Optimization"

A scalable, efficient, and lightweight language model that eliminates the need for matrix multiplication (MatMul) operations, leveraging ternary weights and element-wise operations. This repository…

This project aims to enable language model inference on FPGAs, supporting AI applications in edge devices and environments with limited resources.

🔥🔥🔥 A collection of some awesome public CUDA, cuBLAS, TensorRT and High Performance Computing (HPC) projects.

Implementation for MatMul-free LM.

A paper list of spiking neural networks, including papers, codes, and related websites. 本仓库收集脉冲神经网络相关的顶会顶刊论文和代码，正在持续更新中。

Scraping repository of the most relevant topics with regards to Spatio-Temporal Neural Networks available in the arXiv archive. The repository and workflow is based on https://github.com/SpikingChe…

Grok open release

LLM inference in C/C++

LLM training in simple, raw C/CUDA

Dataset for ML-guided Accelerator Design

A minimal GPU design in Verilog to learn how GPUs work from the ground up

HGRN2: Gated Linear RNNs with State Expansion

Offical implementation of "QKFormer: Hierarchical Spiking Transformer using Q-K Attention" (NeurIPS 2024 Spotlight)

[HPCA'21] SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning

Open source machine learning accelerators

FPGA based Vision Transformer accelerator (Harvard CS205)

You can run it on pynq z1. The repository contains the relevant Verilog code, Vivado configuration and C code for sdk testing. The size of the systolic array can be changed, now it is 16X16.

Fully opensource spiking neural network accelerator

The codes and artifacts associated with our MICRO'22 paper titled: "Adaptable Butterfly Accelerator for Attention-based NNs via Hardware and Algorithm Co-design"

Machine learning on FPGAs using HLS

FlexASR: A Reconfigurable Hardware Accelerator for Attention-based Seq-to-Seq Networks

Research and Materials on Hardware implementation of Transformer Model

Open-Sora: Democratizing Efficient Video Production for All

Transformer related optimization, including BERT, GPT

This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.