Skip to content

Latest commit

 

History

History
124 lines (96 loc) · 3.88 KB

README.md

File metadata and controls

124 lines (96 loc) · 3.88 KB
Raw

PhysMamba

Codes of paper "PhysMamba: Efficient Remote Physiological Measurement with SlowFast Temporal Difference Mamba" Arxiv Accepted by Chinese Conference on Biometric Recognition (CCBR 2024 Oral)

Set up

Code is based on rPPG-Toolbox

  • Environment
conda create -n PhysMamba python=3.8
pip install torch==2.0.0 torchvision==0.15.1 torchaudio==2.0.1 --index-url https://download.pytorch.org/whl/cu118
  • Install packages
pip install -r requirements.txt
  • Install causal-conv1d
cd causal-conv1d
python setup.py install
  • Install Mamba
cd mamba
python setup.py install

Datasets

  • MMPD
    • Jiankai Tang, Kequan Chen, Yuntao Wang, Yuanchun Shi, Shwetak Patel, Daniel McDuff, Xin Liu, "MMPD: Multi-Domain Mobile Video Physiology Dataset", IEEE EMBC, 2023
       data/MMPD/
   |   |-- subject1/
   |       |-- p1_0.mat
   |       |-- p1_1.mat
   |       |...
   |       |-- p1_19.mat
   |   |-- subject2/
   |       |-- p2_0.mat
   |       |-- p2_1.mat
   |       |...
   |...
   |   |-- subjectn/
   |       |-- pn_0.mat
   |       |-- pn_1.mat
   |       |...
  • UBFC-rPPG
    • S. Bobbia, R. Macwan, Y. Benezeth, A. Mansouri, J. Dubois, "Unsupervised skin tissue segmentation for remote photoplethysmography", Pattern Recognition Letters, 2017.
       data/UBFC-rPPG/
   |   |-- subject1/
   |       |-- vid.avi
   |       |-- ground_truth.txt
   |   |-- subject2/
   |       |-- vid.avi
   |       |-- ground_truth.txt
   |...
   |   |-- subjectn/
   |       |-- vid.avi
   |       |-- ground_truth.txt
  • PURE
    • Stricker, R., Müller, S., Gross, H.-M.Non-contact "Video-based Pulse Rate Measurement on a Mobile Service Robot" in: Proc. 23st IEEE Int. Symposium on Robot and Human Interactive Communication (Ro-Man 2014), Edinburgh, Scotland, UK, pp. 1056 - 1062, IEEE 2014
       data/PURE/
   |   |-- 01-01/
   |      |-- 01-01/
   |      |-- 01-01.json
   |   |-- 01-02/
   |      |-- 01-02/
   |      |-- 01-02.json
   |...
   |   |-- ii-jj/
   |      |-- ii-jj/
   |      |-- ii-jj.json

Train

Cross-dataset

  • Training on UBFC-rPPG and Test on PURE
  1. Modify the configuration file ./configs/train_configs/UBFC-rPPG_UBFC-rPPG_PURE_PHYSMAMBA
  2. Run python main.py --config_file ./configs/train_configs/UBFC-rPPG_UBFC-rPPG_PURE_PHYSMAMBA.yaml
  • Training on PURE and Test on UBFC-rPPG
  1. Modify the configuration file ./configs/train_configs/PURE_PURE_UBFC-rPPG_PHYSMAMBA_BASIC.yaml
  2. Run python main.py --config_file ./configs/train_configs/PURE_PURE_UBFC-rPPG_PHYSMAMBA_BASIC.yaml

Intro-dataset on UBFC-rPPG

  1. Modify the configuration file ./configs/train_configs/UBFC_INTRO_PHYSMAMBA.yaml
  2. Run python main.py --config_file ./configs/train_configs/UBFC_INTRO_PHYSMAMBA.yaml

Citation

@inproceedings{luo2024physmamba,
  title={PhysMamba: Efficient Remote Physiological Measurement with SlowFast Temporal Difference Mamba},
  author={Chaoqi Luo and Yiping Xie and Zitong Yu},
  booktitle={Chinese Conference on Biometric Recognition (CCBR)},
  year={2024}
}