What are the basic settings for text2mask?

[yasainet]

Thank you for creating this wonderful extension.
Of course, I enjoyed using the previous txt2mask as well! (However, after updating StableDiffusion webui automatic1111 to 1.6.0, it is no longer available. (However, after updating StableDiffusion webui automatic1111 to 1.6.0, it no longer works.)

So, once again, I am learning to use this application!
However, the features are too rich and it is taking me a long time to learn. Yes, as you can tell, I am not good at English 😭.

I will get to the point.

Purpose

• I want to convert only faces to AI at i2i
• Body and background remain the original photo.

My settings

Question.

• Is there any problem with settings such as prompt?
• Unprompted > wizard > shortcord settings are ok? I don't fully understand how to set it up.
• If I check Auto-include this in prompt, do I need to include the shortcode on the prompt side?

Sorry for my poor English.
I thank you very much.

[ThereforeGames]

Hi @yasainet,

Thank you for reaching out! Your English is better than most. 🙂

Let me see if I can answer your questions:

Is there any problem with settings such as prompt?

Based on your screenshot, it looks like [txt2mask] was not activated; I would expect to see it as part of the "Unprompted Prompt" value in the output panel, e.g.

Unprompted Prompt: [txt2mask method='clipseg' mode='add' sketch_alpha=0.0 precision=100.0 padding=0.0 smoothing=20.0 neg_precision=100.0 neg_padding=0.0 neg_smoothing=20.0 stamp_method='stretch' stamp_x=0.0 stamp_y=0.0]face[/txt2mask]detailed beautiful face

Your setup looks okay. Auto-include this in prompt tells the Wizard to automatically insert the shortcode into your prompt based on the UI settings. Something else might be interfering here - please try the following:

• Disable your other extensions.
• Press "Generate Shortcode" and see if it produces a [txt2mask] block for you. If it does, try adding that block to your prompt manually.
• Check if the Wizard works correctly with another shortcode, like [#] (this is a simple comment block that won't affect the output.) Does [#] appear in the "Unprompted Prompt" if you auto-include it?
• Check your console for errors.

Additionally, here are some general recommendations on getting the most from [txt2mask]:

• Increase your denoising strength to around 0.8. Your current value of 0.5 will have a mild effect.
• Enable Show mask in output to see precisely what region(s) are being selected.
• You probably don't need to specify body|background as a negative mask, in fact doing so might harm the result. Broadly speaking, you would want to use the negative mask to deselect something inside of the positive mask, e.g. a mask of face with a negative mask of mouth.

I hope that helps. Let me know if you have any other questions.

[yasainet]

Thanks a lot for all the advice!
Your advice has helped me understand a little better.

Please allow me to ask additional questions to further understand this wonderful application!

---

Purpose (I changed a few things).

• I want to AI only faces using i2i and t2mask.
• Only the mouths will remain the same as the original image.
• Background and body, of course, remain the same as in the original image

Assumption

• version: v1.6.0

• python: 3.10.6

• torch: 2.0.1+cu118

• xformers: 0.0.20

• gradio: 3.41.2

• aac4796 : latest

• shortcode

• text2mask

  • content : face
  • negative mask prompt, negative_mask : mouth

The Unprompted settings are the defaults except for the ones mentioned above.

Various extensions are installed, but all are disabled.

Configuration

Pattern 1

With Auto-include this in prompt checked, no shored code in prompt, negative prompt.

Result

The entire picture has changed.
Checking Auto-include this in prompt is not reflected in the generated result.

Pattern 2

Run Generate Shortcode without Auto-include this in prompt checked.
The shortcode listed in RESULT is included in prompt.

Result

As I expected, the behavior is unintended.

--- ......................

QUESTION 1

Even though I have content : face and Negative mask prompt: mouth, the shortcode is not reflected in the shortcode when I run Generate Shortcode.
Is this the intended behavior?

[txt2mask method="clipseg" mode="add" sketch_alpha=0.0 precision=100.0 padding=0.0 smoothing=20.0 neg_precision=100.0 neg_padding=0.0 neg_ smoothing=20.0 stamp_method="stretch" stamp_x=0.0 stamp_y=0.0][/txt2mask]

Question 2

[txt2mask method="clipseg" mode="add" sketch_alpha=0.0 precision=100.0 padding=0.0 smoothing=20.0 neg_precision=100.0 neg_padding=0.0 neg_ smoothing=20.0 stamp_method="stretch" stamp_x=0.0 stamp_y=0.0]face[/txt2mask]

content : face manually added! With the above modifications, and after writing in the prompt and performing Generate, only the face was converted!
But of course the Negative mask prompt: mouth is not reflected.

I understand how to specify content, but I don't know how to specify Negative mask prompt.
Can you please tell me how to describe it again?
Of course, I have read all the documentation but my reading comprehension and English are not good enough, sorry.

Question 3

Checking Show mask in output show has no effect.
Where is this function masked? but it is not shown on the webui screen nor in the outoputs folder.
Please let me know how to solve this problem, because I would like to see the visualization of the mask.

---

I know this is very long, but I would be very happy to get an answer!

Translated with www.DeepL.com/Translator (free version)

[yasainet]

I have noticed something after touching it for a while.

It appears that Generate Shorcode is not working.
After adjusting some parameters and trying to Generate Shorcode, there is no change in the RESULT.

[yasainet]

I re-installed from scratch and all is well... I also solved the question I asked by re-reading your issue.

Thank you for your time! Thank you for the wonderful app.

[ThereforeGames]

I'm glad to hear you got it fixed! I wonder what caused it to break in the first place. 🤔

Marked your comment as the answer in case someone else has the same issue.