README.md

Prompt-to-Prompt

Slight modifications on the original Prompt-to-Prompt repo to make it a portable library

Overview

This repo is a modified version of the original Prompt-to-Prompt repo

The directory prompt_to_prompt in this repo is a portable library with APIs: edit, refine and reweight in the original paper, together with a custom PromptToPromptPipeline pipeline

This repo also implements a basic version of PnP-Inversion as an advanced inversion technique for editing

Supported Pipelines

diffusers.StableDiffusionPipeline

• CompVis/stable-diffusion-v1-4
• runwayml/stable-diffusion-v1-5 (deprecated)

diffusers.StableDiffusionXLPipeline

• stabilityai/stable-diffusion-xl-base-1.0 with stabilityai/stable-diffusion-xl-refiner-1.0

PNDMScheduler, EulerDiscreteScheduler and FlowMatchEulerDiscreteScheduler in diffusers do not support accurate inversion

Usage

This repo requires the Unified-SD-Pipeline repo

1. Run git clone https://github.com/zcc31415926/Unified-SD-Pipeline.git to clone the foundation pipeline repo

2. Run git clone https://github.com/zcc31415926/Prompt-to-Prompt.git to clone the prompt-to-prompt repo

3. Copy all contents in Prompt-to-Prompt into Unified-SD-Pipeline, and merge the two scripts directories

Run ./edit.sh, refine.sh or reweight.sh to edit / refine / reweight a given image according to given settings

Modify ./edit.sh, refine.sh or reweight.sh for customized experimental settings