AI-generated images are all the rage right now with people using Craiyon (formerly known as DALL-E mini) to create nonsensical memes. Now, Meta throws its hat into the ring with its own image generator, but with a greater emphasis on creating artistic pieces.
The AI tool is called Make-A-Scene (opens in new tab) and it uses a combination of text prompts and sketch outlines to produce a 2,048 x 2,048 pixel image. Meta demonstrated the tool in a video in which the company asks multiple artists to create a work of art.
One artist, Alexander Reben, had Make-A-Scene create a high-resolution image of a hot dog floating in the sky and fed the system a simple sketch of an oval over a square. In fact, Make-A-Scene created a detailed image of a hot dog floating over a body of water. The sketches themselves don’t need to be very detailed. It’s about giving the AI a rough idea of what you want the final image to look like.
Meta added sketches as part of the image generation process because, it claims, text prompts alone don’t reflect an artist’s intent very well. The company gives the example of asking the tool to create an image of a zebra riding a bicycle. If only the text prompt is displayed, the zebra in the image may be too large or pointing in the wrong direction. Sketches give Make-A-Scene a structure to follow.
Images created with Make-A-Scene match the sketch outline rather than the text prompt. According to developer tests and reviewers, generated images were “better aligned” with the outline 99.54 percent of the time. The tool accounted for text input 66.3 percent of the time.
It is unknown if and when Make-A-Scene will be released to the public. Meta alludes to the tool used to help people in their own creative endeavors or an art director in their marketing campaign. We also don’t know how the sketches will work.
Will people be able to upload their own designs to the image generator or will they be provided by the developers? We’ve reached out to Meta for more information on the sketches and will update this post if he ever responds.
Meta says it will be making a presentation for Make-A-Scene at this year’s ECCV event (opens in new tab) (European Conference on Computer Vision) taking place in Tel Aviv, Israel. The event starts on October 23rd and lasts until October 27th.
Analysis: Future with AI
AI generator tools are an intriguing concept that has produced some incredible results. We’ve created some of our own unusual AI artworks using Google’s Imagen AI Generator.
AI imaging tools aren’t quite ready to take on experienced artists, and most are closed to the public for fear of abuse, save for Craiyon, which uses an open-source model (opens in new tab) to replicate OpenAI’s DALL-E. But there are developers building AI tools outside of art creation. Favorable namefor example, is an AI tool that can generate a name for your business if you stick to ideas.
There are also AI writing tools to help in writing content quickly. As a matter of fact, We have a list of the best for 2022, but they require human intervention to edit them. We just hope they don’t get too good or we’re unemployed.