I’ve been trying to transition from SD1.5 to SDXL for a while, but old prompting habits die hard.

Even more difficult was finding a model to produce the look I prefer. Most seem to love realism, 3D pixar style, anime, and super airbrushed.

If you have any tips for SDXL models, loras, prompting for this style, etc. please let me know!

parameters:

1girl, demon woman with bangs and ram horns and wings, holding bloody human heart, solo, sitting with knees up, (full body:0.6), looking at viewer, (dark fantasy theme:1.1) (glowing eyes:1.05), thick lines, flat shading

Negative prompt: low quality, deformed, embedding:negativeXL_D, embedding:unaestheticXL_Sky3.1,

Steps: 10, Sampler: dpmpp_3m_sde_simple, CFG scale: 1.0, Seed: 212036223314935, Size: 1024x1024, Model hash: 268a170aa6, Model: grogmixTURBO_v10

(and some inpainting/upscaling)

  • theUnlikely@sopuli.xyzOPM
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    7 months ago

    Ones I’ve found so far are:

    • GrogMix TURBO
    • _CHEYENNE_
    • RealCartoon-XL (sometimes?)
    • PixelPaint
    • PixelWaveTurbo

    I’ve seen good images using Pony XL, but my attempts with it have so far produced messy slop so I’m not sure what I’m doing wrong there.

    • Even_Adder@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      3
      ·
      edit-2
      7 months ago

      Check out the important information section on Pony Diffusion V6 XL’s page. It says: “Make sure you load this model with clip skip 2 (or -2 in some software), otherwise you will be getting low quality blobs.”. Find some images you like and work off of their prompts to learn to make your own,

      • theUnlikely@sopuli.xyzOPM
        link
        fedilink
        English
        arrow-up
        1
        ·
        7 months ago

        Thanks for the reply, but yeah, I’ve definitely tried that. In ComfyUI for this model, setting it to -2 doesn’t actually do anything compared to no node for that at all. Setting it to -1 of course ruins it though.

        It seems really temperamental with the styles. It seems to vastly change just by changing a few words that aren’t related to style at all.

        This is the best I’ve gotten with it after hours if fiddling. Most of the image is good, but the face and hands never are.

        • Even_Adder@lemmy.dbzer0.com
          link
          fedilink
          English
          arrow-up
          2
          ·
          7 months ago

          Try using some LoRA. You have to use LoRA trained on Pony Diffusion, since the training process moved it far away enough from regular SDXL that Controlnets aren’t even compatible with it,

          • theUnlikely@sopuli.xyzOPM
            link
            fedilink
            English
            arrow-up
            1
            ·
            7 months ago

            Yeah it seems like loras are necessary. For that image I used the concept art twilight lora.