SQFS for ImageNet
Currently, we only have a sqfs for ImageNet's training set. In my case, I also need to use the validation set.
So, I have created a sqfs for the whole ImageNet dataset.
At the moment, the file is in my home directory.
Because ImageNet is a commonly used dataset, I think we could perhaps have
this ImageNet sqfs in /home/space/datasets-sqfs
.
To this end, I have also done a latency benchmark.
Caveat: the utilization of the cluster (on 2024/03/01) might also influence the numbers in the table.
Code for the experiment can be found at https://git.tu-berlin.de/pchormai/benchmark-squash-fs-for-imagenet-dataset.