Skip to content

Flash-Linear-Attention models beyond language

Notifications You must be signed in to change notification settings

fla-org/fla-zoo

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

23 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

FLA-Zoo: Flash-Linear-Attention models beyond language

This repository implements a collection of Flash-Linear-Attention models that extend beyond language, supporting vision, video, and more.

diagram

News

  • $\texttt{[2025-01-25]}$: This repo is created with vision models.

Features

  • vision: fla-zoo currently supports vision models. A simple documentation is in here.

Installation

Requirements:

As an actively developed repo, no released packages are provided.

TODO

  • Write documentation for vision models.
  • Release training scripts for vision models.

About

Flash-Linear-Attention models beyond language

Topics

Resources

Stars

Watchers

Forks

Languages