Skip to content

[IV2022] pytorch implementation for 'CSFlow: Learning Optical Flow via Cross Strip Correlation for Autonomous Driving'

License

Notifications You must be signed in to change notification settings

MasterHow/CSFlow

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

CSFlow: Learning Optical Flow via Cross Strip Correlation for Autonomous Driving

The implementations of CSFlow: Learning Optical Flow via Cross Strip Correlation for Autonomous Driving. We achieve state-of-the-art accuracy on KITTI-2015 flow benchmark.

News

  • 2022-5 [NEW:fire:] CSFlow is accepted to IV 2022 as an ORAL PRESENTATION. (Top 10%)
  • 2022-4 [NEW:fire:] CSFlow is accepted to 2022 33rd IEEE Intelligent Vehicles Symposium (IV).

Install

python setup.py develop

Pretrained Model

The pretrained model that the paper used can be found there:

Download link 1 (Tencent WeiYun):

https://share.weiyun.com/5t6TadPB

Download link 2 (Baidu Cloud):

https://pan.baidu.com/s/1Hcj-sm5t0h6lYckOBiWjzA?pwd=6kur

Download link 3 (Google Drive):

https://drive.google.com/drive/folders/1_Fb4eLfT4bZo3g8hCX5cO28lMsDKuHvE?usp=sharing

The content in the above links are consistent, if you encounter network problems, you can try switching to the other link. They can also be found in the Github Releases tab.

Train and Eval

To train, use the following command format:

python ./tools/train.py
--model CSFlow
--dataset Chairs
--data_root $YOUR_DATA_PATH$
--batch_size 1
--name csflow-test
--validation Sintel
--val_Sintel_root $YOUR_DATA_PATH$
--num_steps 100
--lr 0.0004
--image_size 368 496
--wdecay 0.0001

To eval, use the following command format:

python ./tools/eval.py
--model CSFlow
--restore_ckpt ./checkpoints/CSFlow-kitti.pth
--eval_iters 24
--validation KITTI
--val_KITTI_root $YOUR_DATA_PATH$

For more details, please check the code or refer our paper.

Folder Hierarchy

* local: you should create this folder in your local repository and these folders will not upload to remote repository.

├── data (local)            # Store test/training data
├── checkpoints (local)     # Store the checkpoints
├── runs (local)            # Store the training log
├── opticalflow             # All source code
|   ├─ api                  # Called by tools
|   ├─ core                 # Core code call by other directorys. Provide dataset, models ....
|   |   ├─ dataset          # I/O of each dataset
|   |   ├─ model            # Models, includeing all the modules that derive nn.module
|   |   ├─ util             # Utility functions
├── tools                   # Scripts for test and train
├── work_dirs (local)       # For developers to save thier own codes and assets

Citation

If you find our project helpful in your research, please cite with:

@article{shi2022csflow,
  title={CSFlow: Learning optical flow via cross strip correlation for autonomous driving},
  author={Shi, Hao and Zhou, Yifan and Yang, Kailun and Yin, Xiaoting and Wang, Kaiwei},
  journal={arXiv preprint arXiv:2202.00909},
  year={2022}
}

Devs

Hao Shi,YiFan Zhou

Need Help?

If you have any questions, welcome to e-mail me: [email protected], and I will try my best to help you. =)

About

[IV2022] pytorch implementation for 'CSFlow: Learning Optical Flow via Cross Strip Correlation for Autonomous Driving'

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages