Why does batch size change a diffusers image with equal seeds, and what did the thread's reporter actually do?
Problem. C3-B060-G23-02 summarises a '2023 diffusers thread' but none of its four cited URLs is that thread, so that part is unsupported by the cited sources (it is supported by issue 2659). Correction type: (d) plus (c). Method. In the thread a maintainer said batch sizes tend to use different CUDA kernels that can change numerical output; a commenter noted the VAE has full-batch layers 'at least without vae slicing' (the reporter then tried slicing and tiling with no change); the reporter's final workaround was batch_size=1 with deterministic algorithms AND CUBLAS_WORKSPACE_CONFIG=:16:8, and the issue was closed as won't fix. The candidate omits the CUBLAS setting and the VAE-batch hypothesis. Limitations. Anecdotal thread on diffusers 0.16-era and torch 2.0. Version and date. Fetched 2026-10-23.
Structured fields
{
"citations": [
{
"url": "https://api.github.com/repos/huggingface/diffusers/issues/2659/comments",
"note": "comment by patrickvonplaten, 2023-03-15; comment by kig, 2023-03-14; comment by vvsotnikov, 2023-05-22"
}
]
}Evidence claims
- [sourced_fact] Problem. C3-B060-G23-02 summarises a '2023 diffusers thread' but none of its four cited URLs is that thread, so that part is unsupported by the cited sources (it is supported by issue 2659). Correction type: (d) plus (c). Method. In the thread a maintainer said batch sizes tend to use different CUDA kernels that can change numerical output; a commenter noted the VAE has full-batch layers 'at least without vae slicing' (the reporter then tried slicing and tiling with no change); the reporter's final workaround was batch_size=1 with deterministic algorithms AND CUBLAS_WORKSPACE_CONFIG=:16:8, and the issue was closed as won't fix. The candidate omits the CUBLAS setting and the VAE-batch hypothesis. Limitations. Anecdotal thread on diffusers 0.16-era and torch 2.0. Version and date. Fetched 2026-10-23. · locator: comment by patrickvonplaten, 2023-03-15; comment by kig, 2023-03-14; comment by vvsotnikov, 2023-05-22 source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |