Skip to content

A Cog implementation of canny SDXL ControlNet supporting Replicate's LoRA weights.

Notifications You must be signed in to change notification settings

BatouResearch/Cog-SDXL-ControlNet-LoRA

Repository files navigation

Cog SDXL Canny ControlNet with LoRA support

Replicate demo and cloud API

This is an implementation of Stability AI's SDXL as a Cog model with ControlNet and Replicate's LoRA support.

Basic Usage

For prediction:

cog predict -i prompt="shot in the style of sksfer, ..." -i [email protected] -i lora_weights="https://pbxt.replicate.delivery/mwN3AFyYZyouOB03Uhw8ubKW9rpqMgdtL9zYV9GF2WGDiwbE/trained_model.tar"

You may need to increase the default lora_scale value to big values such as 0.8 ... 0.95.

Limitations

  • lora_weights only accepts models trained in Replicate and is a mandatory parameter.
  • expert_ensemble_refiner is currently not supported, you can use base_image_refiner instead.
  • For the moment, the model only uses canny as the conditional image.

For further improvements of this project, feel free to fork and PR!

About

A Cog implementation of canny SDXL ControlNet supporting Replicate's LoRA weights.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages