Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Custom video data support #1722

Open
samet-akcay opened this issue Feb 9, 2024 Discussed in #1721 · 7 comments · May be fixed by #1996
Open

Custom video data support #1722

samet-akcay opened this issue Feb 9, 2024 Discussed in #1721 · 7 comments · May be fixed by #1996
Labels
Feature Good First Issue Issues that can be picked up by someone unfamiliar with the repo and would like to contribute.

Comments

@samet-akcay
Copy link
Contributor

samet-akcay commented Feb 9, 2024

Discussed in #1721

Originally posted by samet-akcay February 9, 2024
Anomalib currently supports a number of video anomaly detection datasets. Similar to image folder data support, it would be great to support a custom datamodule for video datasets.

@Bepitic
Copy link
Contributor

Bepitic commented Mar 18, 2024

Hello, @samet-akcay I wish to take this.

@samet-akcay
Copy link
Contributor Author

Sure, all yours

@samet-akcay samet-akcay added the Good First Issue Issues that can be picked up by someone unfamiliar with the repo and would like to contribute. label Mar 18, 2024
@Bepitic
Copy link
Contributor

Bepitic commented Mar 22, 2024

Hello @samet-akcay, I am finishing the code, in: bepitic-anomalib-custom-videoFolder
I have a couple of minor doubts:
The first one is the format that we can admit ( atm I'm accepting only '.AVI' as the data and '.npy' as the mask), I have also a utility function taken from ShanghaiTech DatasetModule ( _convert_training_videos ), that converts all the videos in a folder to solve some incompatibility issues, We could use this to solve some incompatibilities.

Secondly, should I create a Notebook to explain the functionality of this piece of code and the anomalib functionality with video?
Thank you for the work.

@samet-akcay
Copy link
Contributor Author

I think it would be good to get @djdameln's opinion here as well..

@djdameln
Copy link
Contributor

Ideally I think we should support various video formats, including .avi, .mp4 and folder of image frames at the minimum. Same for the ground truth, I think it would be best to allow multiple formats for maximum flexibility. At the minimum, I feel we should support folder of ground truth image masks (like UCSDped) and .npy and .pt for numpy arrays and pytorch tensors respectively.

A notebook to showcase the functionality would be great!

Final piece of advice would be to have a close look at the Folder dataset and try to match the API of that class as closely as possible in your video folder dataset, which would be good for consistency and usability.

@samet-akcay
Copy link
Contributor Author

Thanks @djdameln

@RitikaxShakya
Copy link

RitikaxShakya commented Mar 28, 2024

@samet-akcay Hello! I would like to contribute on this Issue, but i think @Bepitic is already working on this. Can you maybe recommend me another gfi in this repo? Thank You!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Feature Good First Issue Issues that can be picked up by someone unfamiliar with the repo and would like to contribute.
Projects
Status: 🗂️ Backlog
Development

Successfully merging a pull request may close this issue.

4 participants