On Tuesday, Adobe announced major updates to AI image synthesis features across several products, including Photoshop, Illustrator, and Adobe Express. The updates include three new generative AI models—Firefly 2, Firefly Design Model, and Firefly Vector Model—which improve its previous offerings and add new capabilities. With the vector model, Adobe is notably launching its first text-to-vector AI image generator.
It’s been a busy year for generative AI, and Adobe has not been content to sit it out. In March, the graphic design software giant debuted its text-to-image synthesis model called Firefly, which it billed as an ethical alternative to Stable Diffusion and Midjourney due to being trained on Adobe Stock imagery only. Firefly can generate novel images based on text descriptions called prompts (i.e., “a scenic vista” or “a beefy-looking barbarian”). The company later brought the technology to Photoshop and web apps, and promised to cover any legal bills that might arise from copyright claims against artwork generated with its tools.
Now, Adobe is extending its reach with a wave of new generative AI features. Adobe’s Firefly Image 2 model is an update to its original Firefly AI image generator, which powers Photoshop features like Generative Fill. Adobe claims this new version offers improved image quality, particularly in areas like foliage, skin texture, and facial features. In addition to these enhancements, the Firefly Image 2 model introduces AI-driven editing capabilities that can adjust various photo settings like depth of field and motion blur. A new “Prompt Guidance” feature also aids users in refining the wording of their text descriptions and automatically completes prompts to boost efficiency.
Adobe unveiled a “Generative Match” feature, allowing users to match the style of generated content to specific images. It’s basically an “img2img” feature, similar to the technique often used in Stable Diffusion. This could appeal to companies wanting to consistently apply their brand style across various materials. The feature will remain in beta, and commercial use won’t be permitted during this trial period.
Adobe also introduced new Firefly models specifically for Illustrator that let users create editable vector images based on text prompts. Vector graphics differ from bitmapped graphics (found in files such as JPEGs) because the vector shapes are stored as mathematical formulas and can be scaled to any size without quality loss.
While Adobe claims that the Firefly Vector Model is “the world’s first generative AI model for vector graphics,” a quick Google search disproves this claim, showing earlier vector-based AI models that range from commercial offerings to older experimental research. However, it’s safe to say that this is the first vector-generating AI model from a company that is currently considered a major player in the image synthesis space. It’s also notable that the technology is baked into one of the world’s most popular vector graphics editors, Adobe Illustrator.
Meanwhile, in Adobe Express, Adobe’s Firefly Design model focuses on generating customizable templates for various media types, from print to online advertising. They call it “text to template,” in contrast to “text to image” with Firefly 2.
Adobe’s push to the mainstream
Since the launch of DALL-E 2 in April 2022, image synthesis models have improved in quality rapidly. Adobe’s additions come when competitors such as Stability AI, Midjourney, Microsoft, OpenAI, and Meta have continued to update their image synthesis tools. If you’ve followed our AI coverage, you’re likely familiar with the general controversy over AI-generated artwork due to unresolved issues over copyright and worries about replacing human artists. Adobe has not magically waved those issues away completely, but it hopes to keep moving image synthesis technology into the mainstream.
Adobe’s design leader, Scott Belsky, goes into detail in a blog post about new policies being developed to “prohibit abuse, discourage bad actors, and encourage transparency and attribution,” including training its AI models on licensed and public domain content and applying content moderation to the training data set.
The company has also introduced features like Content Credentials to mark AI-generated content using metadata, and it is advocating for legislative measures such as the FAIR Act, which would provide legal recourse for artists whose styles are intentionally and commercially impersonated through AI tools. Even if some of those initiatives don’t gain traction, they allow Adobe to say it’s working on the issue while it continues its AI rollout.
Firefly 2 (including Generative Match) is available for testing in Adobe’s web-based beta and is expected to be integrated into Creative Cloud apps later. Meanwhile, the Firefly Vector model is available via an Adobe Illustrator update in the Creative Cloud app, and Firefly Design Model is available as a beta feature in Adobe Express.