2022-08-29 22:55:56 +00:00
|
|
|
<h1 align='center'><b>Stable Diffusion Dream Script</b></h1>
|
|
|
|
|
|
|
|
<p align='center'>
|
2022-09-15 14:53:41 +00:00
|
|
|
<img src="docs/assets/logo.png"/>
|
2022-08-29 22:55:56 +00:00
|
|
|
</p>
|
2022-08-17 01:34:37 +00:00
|
|
|
|
2022-08-30 19:40:56 +00:00
|
|
|
<p align="center">
|
|
|
|
<img src="https://img.shields.io/github/last-commit/lstein/stable-diffusion?logo=Python&logoColor=green&style=for-the-badge" alt="last-commit"/>
|
|
|
|
<img src="https://img.shields.io/github/stars/lstein/stable-diffusion?logo=GitHub&style=for-the-badge" alt="stars"/>
|
|
|
|
<br>
|
|
|
|
<img src="https://img.shields.io/github/issues/lstein/stable-diffusion?logo=GitHub&style=for-the-badge" alt="issues"/>
|
|
|
|
<img src="https://img.shields.io/github/issues-pr/lstein/stable-diffusion?logo=GitHub&style=for-the-badge" alt="pull-requests"/>
|
|
|
|
</p>
|
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
This is a fork of [CompVis/stable-diffusion](https://github.com/CompVis/stable-diffusion), the open
|
|
|
|
source text-to-image generator. It provides a streamlined process with various new features and
|
|
|
|
options to aid the image generation process. It runs on Windows, Mac and Linux machines, and runs on
|
|
|
|
GPU cards with as little as 4 GB or RAM.
|
2022-09-11 16:58:06 +00:00
|
|
|
|
|
|
|
_Note: This fork is rapidly evolving. Please use the
|
2022-09-15 14:53:41 +00:00
|
|
|
[Issues](https://github.com/lstein/stable-diffusion/issues) tab to report bugs and make feature
|
|
|
|
requests. Be sure to use the provided templates. They will help aid diagnose issues faster._
|
|
|
|
|
|
|
|
**Table of Contents**
|
2022-09-02 21:54:55 +00:00
|
|
|
|
2022-09-11 15:52:43 +00:00
|
|
|
1. [Installation](#installation)
|
2022-09-15 14:53:41 +00:00
|
|
|
2. [Hardware Requirements](#hardware-requirements)
|
|
|
|
3. [Features](#features)
|
|
|
|
4. [Latest Changes](#latest-changes)
|
|
|
|
5. [Troubleshooting](#troubleshooting)
|
|
|
|
6. [Contributing](#contributing)
|
|
|
|
7. [Contributors](#contributors)
|
|
|
|
8. [Support](#support)
|
|
|
|
9. [Further Reading](#further-reading)
|
|
|
|
|
|
|
|
## Installation
|
2022-08-30 03:15:49 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
This fork is supported across multiple platforms. You can find individual installation instructions
|
|
|
|
below.
|
2022-08-26 06:17:14 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
- ### [Linux](docs/installation/INSTALL_LINUX.md)
|
2022-08-26 06:17:14 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
- ### [Windows](docs/installation/INSTALL_WINDOWS.md)
|
2022-08-26 02:57:30 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
- ### [Macintosh](docs/installation/INSTALL_MAC.md)
|
|
|
|
|
|
|
|
## Hardware Requirements
|
2022-08-28 20:14:29 +00:00
|
|
|
|
2022-09-11 15:52:43 +00:00
|
|
|
**System**
|
2022-08-28 20:14:29 +00:00
|
|
|
|
2022-09-11 15:52:43 +00:00
|
|
|
You wil need one of the following:
|
2022-08-28 20:14:29 +00:00
|
|
|
|
2022-09-11 16:58:06 +00:00
|
|
|
- An NVIDIA-based graphics card with 4 GB or more VRAM memory.
|
2022-09-11 15:52:43 +00:00
|
|
|
- An Apple computer with an M1 chip.
|
2022-08-28 20:14:29 +00:00
|
|
|
|
2022-09-11 15:52:43 +00:00
|
|
|
**Memory**
|
2022-08-28 20:14:29 +00:00
|
|
|
|
2022-09-11 15:52:43 +00:00
|
|
|
- At least 12 GB Main Memory RAM.
|
2022-08-28 20:14:29 +00:00
|
|
|
|
2022-09-11 15:52:43 +00:00
|
|
|
**Disk**
|
2022-08-26 03:19:17 +00:00
|
|
|
|
2022-09-11 15:52:43 +00:00
|
|
|
- At least 6 GB of free disk space for the machine learning model, Python, and all its dependencies.
|
2022-08-26 02:57:30 +00:00
|
|
|
|
2022-08-28 20:14:29 +00:00
|
|
|
**Note**
|
2022-08-26 02:57:30 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
If you are have a Nvidia 10xx series card (e.g. the 1080ti), please run the dream script in
|
|
|
|
full-precision mode as shown below.
|
2022-08-26 02:57:30 +00:00
|
|
|
|
2022-09-11 15:52:43 +00:00
|
|
|
Similarly, specify full-precision mode on Apple M1 hardware.
|
2022-08-26 03:19:17 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
To run in full-precision mode, start `dream.py` with the `--full_precision` flag:
|
2022-08-25 13:47:27 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
```bash
|
2022-09-11 15:52:43 +00:00
|
|
|
(ldm) ~/stable-diffusion$ python scripts/dream.py --full_precision
|
2022-08-28 20:14:29 +00:00
|
|
|
```
|
2022-08-23 05:58:47 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
## Features
|
2022-09-09 00:39:51 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
### Major Features
|
2022-08-23 22:26:28 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
- #### [Interactive Command Line Interface](docs/features/CLI.md)
|
2022-08-23 22:26:28 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
- #### [Image To Image](docs/features/IMG2IMG.md)
|
2022-09-11 16:58:06 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
- #### [Inpainting Support](docs/features/INPAINTING.md)
|
2022-08-23 22:26:28 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
- #### [GFPGAN and Real-ESRGAN Support](docs/features/UPSCALE.md)
|
2022-09-12 19:46:07 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
- #### [Seamless Tiling](docs/features/OTHER.md#seamless-tiling)
|
2022-08-23 22:26:28 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
- #### [Google Colab](docs/features/OTHER.md#google-colab)
|
2022-08-23 22:26:28 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
- #### [Web Server](docs/features/WEB.md)
|
2022-08-23 22:26:28 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
- #### [Reading Prompts From File](docs/features/OTHER.md#reading-prompts-from-a-file)
|
2022-08-23 22:26:28 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
- #### [Shortcut: Reusing Seeds](docs/features/OTHER.md#shortcuts-reusing-seeds)
|
2022-08-23 22:26:28 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
- #### [Weighted Prompts](docs/features/OTHER.md#weighted-prompts)
|
2022-08-23 22:26:28 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
- #### [Variations](docs/features/VARIATIONS.md)
|
2022-08-23 22:26:28 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
- #### [Personalizing Text-to-Image Generation](docs/features/TEXTUAL_INVERSION.md)
|
2022-08-28 20:14:29 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
- #### [Simplified API for text to image generation](docs/features/OTHER.md#simplified-api)
|
2022-08-23 22:26:28 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
### Other Features
|
2022-08-23 22:26:28 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
- #### [Creating Transparent Regions for Inpainting](docs/features/INPAINTING.md#creating-transparent-regions-for-inpainting)
|
2022-08-23 22:26:28 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
- #### [Preload Models](docs/features/OTHER.md#preload-models)
|
2022-08-23 22:26:28 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
## Latest Changes
|
2022-08-21 23:57:48 +00:00
|
|
|
|
2022-09-11 16:58:06 +00:00
|
|
|
- v1.14 (11 September 2022)
|
2022-09-03 17:46:29 +00:00
|
|
|
|
2022-09-11 16:58:06 +00:00
|
|
|
- Memory optimizations for small-RAM cards. 512x512 now possible on 4 GB GPUs.
|
|
|
|
- Full support for Apple hardware with M1 or M2 chips.
|
2022-09-15 14:53:41 +00:00
|
|
|
- Add "seamless mode" for circular tiling of image. Generates beautiful effects.
|
|
|
|
([prixt](https://github.com/prixt)).
|
2022-09-11 16:58:06 +00:00
|
|
|
- Inpainting support.
|
|
|
|
- Improved web server GUI.
|
|
|
|
- Lots of code and documentation cleanups.
|
2022-09-03 17:46:29 +00:00
|
|
|
|
|
|
|
- v1.13 (3 September 2022
|
2022-08-29 22:55:56 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
- Support image variations (see [VARIATIONS](docs/features/VARIATIONS.md)
|
|
|
|
([Kevin Gibbons](https://github.com/bakkot) and many contributors and reviewers)
|
|
|
|
- Supports a Google Colab notebook for a standalone server running on Google hardware
|
|
|
|
[Arturo Mendivil](https://github.com/artmen1516)
|
|
|
|
- WebUI supports GFPGAN/ESRGAN facial reconstruction and upscaling
|
|
|
|
[Kevin Gibbons](https://github.com/bakkot)
|
|
|
|
- WebUI supports incremental display of in-progress images during generation
|
|
|
|
[Kevin Gibbons](https://github.com/bakkot)
|
|
|
|
- A new configuration file scheme that allows new models (including upcoming
|
|
|
|
stable-diffusion-v1.5) to be added without altering the code.
|
|
|
|
([David Wager](https://github.com/maddavid12))
|
2022-08-29 16:58:48 +00:00
|
|
|
- Can specify --grid on dream.py command line as the default.
|
|
|
|
- Miscellaneous internal bug and stability fixes.
|
2022-09-03 14:56:06 +00:00
|
|
|
- Works on M1 Apple hardware.
|
|
|
|
- Multiple bug fixes.
|
2022-08-29 16:58:48 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
For older changelogs, please visit the **[CHANGELOG](docs/features/CHANGELOG.md)**.
|
2022-08-30 19:40:56 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
## Troubleshooting
|
2022-08-17 02:49:47 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
Please check out our **[Q&A](docs/help/TROUBLESHOOT.md)** to get solutions for common installation
|
|
|
|
problems and other issues.
|
2022-08-30 03:08:04 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
## Contributing
|
2022-09-08 11:34:03 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
Anyone who wishes to contribute to this project, whether documentation, features, bug fixes, code
|
|
|
|
cleanup, testing, or code reviews, is very much encouraged to do so. If you are unfamiliar with how
|
|
|
|
to contribute to GitHub projects, here is a
|
|
|
|
[Getting Started Guide](https://opensource.com/article/19/7/create-pull-request-github).
|
2022-09-08 11:34:03 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
A full set of contribution guidelines, along with templates, are in progress, but for now the most
|
|
|
|
important thing is to **make your pull request against the "development" branch**, and not against
|
|
|
|
"main". This will help keep public breakage to a minimum and will allow you to propose more radical
|
|
|
|
changes.
|
2022-09-03 14:56:06 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
## Contributors
|
2022-09-03 14:56:06 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
This fork is a combined effort of various people from across the world.
|
|
|
|
[Check out the list of all these amazing people](docs/other/CONTRIBUTORS.md). We thank them for
|
|
|
|
their time, hard work and effort.
|
2022-09-03 14:56:06 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
## Support
|
2022-08-17 01:34:37 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
For support, please use this repository's GitHub Issues tracking service. Feel free to send me an
|
|
|
|
email if you use and like the script.
|
2022-08-17 01:34:37 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
Original portions of the software are Copyright (c) 2020
|
|
|
|
[Lincoln D. Stein](https://github.com/lstein)
|
2022-08-24 13:31:17 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
## Further Reading
|
2022-08-24 13:31:17 +00:00
|
|
|
|
2022-09-15 14:53:41 +00:00
|
|
|
Please see the original README for more information on this software and underlying algorithm,
|
|
|
|
located in the file [README-CompViz.md](docs/other/README-CompViz.md).
|