AI Art text prompt study: 51 subjects in the paper “Design Guidelines for Prompt Engineering Text-to-Image Generative Models”

  AI Art, Disco Diffusion, NightCafe

In this post, I generate images to show what the CLIP model thinks about some widely used subject terms. In addition, I also show results for some combinations of subject and style words.

Key words study

51 keywords: Ocean, forest, house, eye, bird,dancing, flower, mountain, rain, car, universe, sadness, love, fish, sleeping, apple, alien, reflection, serenity, relaxation, computer, boy,women, thought, snake, dream, fear, happiness, pain, victory, compassion, beauty, reality, chaos, singing, hate, peace, concern, success, intelligence, kindness, freedom, loyalty, time, nostalgia, courage, progress, trust, website, artificial intelligence, ai art generator

Seasons: spring, summer, autumn, winter

weather:

When picking the prompt, focus on subject and style keywords instead of connecting words;

When generating, generate between 3 to 9 diferent seeds to get a representative idea of what a prompt can return;

When generating,for fast iteration, using shorter lengths of optimization between 100 and 500 iteration is sufcient;

When choosing the style of the generation, feel free to try any style, no matter how niche or broad;

When picking the subject of the generation, pick subjects that can complement the chosen style in level of abstractness;

When looking at the results, present users with trigger warnings for pareidolia and ofensive content.

Vivian Liu and Lydia B. Chilton

4 Seasons

12 Time in a day words

dusk, dawn,night,sunup,sunset,midday,morning,sunrise,evening, night,sundown,noontime,afternoon

24 Weather phenomena

Some interesting combinations