Skip to content

feat: Add Krea2OstrisEdit support#1775

Open
stduhpf wants to merge 2 commits into
leejet:masterfrom
stduhpf:Krea2OstrisEdit
Open

feat: Add Krea2OstrisEdit support#1775
stduhpf wants to merge 2 commits into
leejet:masterfrom
stduhpf:Krea2OstrisEdit

Conversation

@stduhpf

@stduhpf stduhpf commented Jul 10, 2026

Copy link
Copy Markdown
Contributor

Summary

Adds support for Krea2 fine-tunes with editing capabilities trained with https://github.com/ostris/ai-toolkit

Ref: Krea2OstrisEdit

Related Issue / Discussion

N/A

Additional Information

Example:

reference image:
VG

prompt: "a white yeti with horns reading a book that is titled "Ostris + Krea2 Style Reference""

style_reference LoRA: https://huggingface.co/ostris/krea2_turbo_style_reference
(also filter bypasss lora applied to the weights directly)

seed: 9499

master (no image conditioning) No LoRA (with mmproj) No LoRA (without mmproj) style_reference LoRA (with mmproj) style_reference LoRA (without mmproj)
output - Copy (464) output output output - Copy (467) output - Copy (468)

Checklist

@stduhpf

stduhpf commented Jul 10, 2026

Copy link
Copy Markdown
Contributor Author

Bonus: llm-vision only (disabled reference latents for the DiT):

no LoRA style_reference LoRA
output output - Copy (470)

Maybe this could be an option? (what would be the best UI for that?)

@stduhpf

stduhpf commented Jul 10, 2026

Copy link
Copy Markdown
Contributor Author

... and now I find this one, which seems to use different setup:
model: https://huggingface.co/conradlocke/krea2-identity-edit
implentation: https://github.com/lbouaraba/comfyui-krea2edit

  • refs are concatenated before the target image rather than after, but since non-causal attention permutation invarient, I'm pretty sure this doesn't matter as long as the RoPE ids are the same
  • Uses a slightly different prompt format (probably not that important)
  • Does not force timestep=0 for the refs

Just disabling the separate timestep for the refs seems to be enough to make it work pretty well

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant