PyTorch
gan
image-generation
jamestompkin commited on
Commit
1d36072
·
verified ·
1 Parent(s): c45f516

Correct the model card: dataset, conditioning, FID, usage and licence

Browse files
Files changed (1) hide show
  1. README.md +47 -41
README.md CHANGED
@@ -1,59 +1,65 @@
1
  ---
 
 
 
 
 
2
  datasets:
3
  - ILSVRC/imagenet-1k
4
- pipeline_tag: unconditional-image-generation
5
  ---
6
 
7
- # Model Card for ImageNet 32x32 R3GAN Model
8
 
9
- This model card provides details about the R3GAN model trained on the ImageNet dataset found in the NeurIPS 2024 paper: https://arxiv.org/abs/2501.05441
 
 
10
 
11
- ## Model Details
 
 
 
 
 
 
 
 
12
 
13
- The model achieves 1.27 Frechet Inception Distance-50k on ImageNet64x64 class conditional ImgNet generation.
14
 
15
- ### Model Description
 
 
 
 
16
 
17
- This model is a generative adversarial network (GAN) based on the R3GAN architecture, specifically trained to synthesize high-quality and realistic images from the ImageNet dataset.
 
18
 
19
- - **Developed by:** Brown University and Cornell University
20
- - **Funded by:** National Science Foundation and National Institute of Health (See paper for funding details)
21
- - **Shared by:** [Optional: Specify sharer if different from developer]
22
- - **Model type:** Generative Adversarial Network
23
- - **Language(s) (NLP):** N/A
24
- - **License:** [Specify License, e.g., MIT, Apache 2.0, or a custom license]
25
- - **Finetuned from model:** N/A
26
 
27
- ### Model Sources
 
28
 
29
- - **Repository:** https://github.com/brownvc/R3GAN/
30
- - **Paper:** https://openreview.net/forum?id=OrtN9hPP7V
31
- - **Demo:** [Optional: Provide a link to a demo or example usage]
32
 
33
- ## Uses
 
 
34
 
35
- ### Direct Use
36
 
37
- This model can be used to generate high-resolution images similar to those in the ImageNet dataset. Its primary application includes research in generative models and image synthesis.
 
 
 
 
 
 
 
 
38
 
39
- ### Downstream Use
40
 
41
- The model can be fine-tuned for specific subsets of the ImageNet dataset or other similar datasets for domain-specific image generation tasks.
42
-
43
- ### Out-of-Scope Use
44
-
45
- The model should not be used for generating deceptive or misleading content, malicious purposes, or tasks where realistic image synthesis could cause harm.
46
-
47
- ## Bias, Risks, and Limitations
48
-
49
- The model inherits biases present in the ImageNet dataset, including potential overrepresentation or underrepresentation of certain classes. Users should critically evaluate and mitigate biases before deploying the model.
50
-
51
- ### Recommendations
52
-
53
- - Avoid using the model for sensitive applications without thorough bias evaluation.
54
- - Ensure appropriate credit is given when publishing or sharing generated images.
55
-
56
- ## How to Get Started with the Model
57
-
58
- Below is an example of how to use the model for image generation:
59
- - Will add later
 
1
  ---
2
+ license: cc-by-nc-4.0
3
+ tags:
4
+ - gan
5
+ - image-generation
6
+ - pytorch
7
  datasets:
8
  - ILSVRC/imagenet-1k
 
9
  ---
10
 
11
+ # R3GAN: ImageNet 32×32
12
 
13
+ The class-conditional (1,000 classes) R3GAN generator for ImageNet at 32×32, from the NeurIPS 2024 paper
14
+ [The GAN is dead; long live the GAN! A Modern GAN Baseline](https://arxiv.org/abs/2501.05441)
15
+ (the proposed configuration, config E).
16
 
17
+ | | |
18
+ |---|---|
19
+ | Dataset | ImageNet-1k (ILSVRC 2012) |
20
+ | Resolution | 32×32 |
21
+ | Conditioning | class-conditional (1,000 classes) |
22
+ | FID (50k samples) | 1.27, as reported in the paper |
23
+ | File | `network-snapshot-final.pkl`: the final training snapshot; its `G_ema` network is the generator |
24
+ | Code | https://github.com/brownvc/R3GAN |
25
+ | Licence | [CC BY-NC 4.0](https://creativecommons.org/licenses/by-nc/4.0/) |
26
 
27
+ ## Generating images
28
 
29
+ ```
30
+ git clone https://github.com/brownvc/R3GAN && cd R3GAN
31
+ python gen_images.py --seeds=0-7 --outdir=out --class=0 \
32
+ --network=https://huggingface.co/brownvc/R3GAN-ImgNet-32x32/resolve/main/network-snapshot-final.pkl
33
+ ```
34
 
35
+ The model is class-conditional, so `--class` is required (class 0 is tench).
36
+ The code requires the same packages as the official StyleGAN3 repository.
37
 
38
+ ## Intended use and limitations
 
 
 
 
 
 
39
 
40
+ The model is intended for research on generative models. It reproduces the statistics of its training data,
41
+ ImageNet-1k (1.28 million web images in 1,000 classes), including the known biases of a web-scraped dataset. Do not use it to create deceptive content or content that could cause harm.
42
 
43
+ ## Licence
 
 
44
 
45
+ The weights are released under [CC BY-NC 4.0](https://creativecommons.org/licenses/by-nc/4.0/). The code that runs them is a separate work: the
46
+ `R3GAN/` directory of the GitHub repository is under the MIT licence, and the rest of the repository, which derives
47
+ from StyleGAN3, is under NVIDIA's Source Code License.
48
 
49
+ ## Citation
50
 
51
+ ```bibtex
52
+ @inproceedings{huang2024the,
53
+ title={The {GAN} is dead; long live the {GAN}! A Modern {GAN} Baseline},
54
+ author={Nick Huang and Aaron Gokaslan and Volodymyr Kuleshov and James Tompkin},
55
+ booktitle={The Thirty-eighth Annual Conference on Neural Information Processing Systems},
56
+ year={2024},
57
+ url={https://openreview.net/forum?id=OrtN9hPP7V}
58
+ }
59
+ ```
60
 
61
+ ## Acknowledgements
62
 
63
+ Brown University and Cornell University. Nick Huang was supported by a Brown University Division of Research Seed
64
+ Award, James Tompkin by NSF CAREER 2144956, and Volodymyr Kuleshov by NSF CAREER 2145577 and NIH MIRA 1R35GM15124301.
65
+ Compute was provided by Databricks Mosaic Research.