Adobe Photoshop is revolutionizing image editing with its latest feature called Generative Fill, harnessing the power of AI to extend images and manipulate objects based on text prompts. This cutting-edge tool, utilizing Adobe’s AI image generator Firefly, was previously available as a web-only beta and is now launching in beta within Photoshop, with a full release expected later this year.
Generative Fill seamlessly integrates into the Photoshop workflow, operating within individual layers of an image file. Whether users want to expand image borders (outpainting) or create new objects, the tool presents three options for selection. When used for outpainting, the system can generate image extensions automatically, but it performs even better with user-guided instructions. This functionality bears resemblance to Photoshop’s existing Content-Aware Fill feature, offering users enhanced control over the editing process.
Although I haven’t personally tested Generative Fill, I witnessed a live demonstration that showcased its impressive capabilities alongside its limitations. While some generated objects, such as cars and puddles, appeared unnatural within the image, the tool excelled at handling backgrounds and filling empty spaces. In certain instances, it even managed to incorporate visual elements from the original photograph, mimicking light sources and creating reflections in generated water.
For creators familiar with AI image generation tools, such feats may not be entirely surprising. However, the integration of this technology into mainstream applications like Photoshop brings these capabilities to a broader audience.
In addition to its functionality, Firefly’s training data stands as another crucial aspect. Adobe assures that the model is exclusively trained on content for which the company possesses the necessary rights, including Adobe Stock images, openly licensed content, and copyright-restricted content. In theory, this ensures that anything created using the Generative Fill feature is safe for commercial use, offering a sense of security to creatives and agencies who may have been hesitant to utilize AI tools due to potential legal implications.
Generative Fill also incorporates Content Credentials, a system likened to a “nutrition label” that attaches attribution data to images when shared online. This information informs viewers whether the content was created or modified using AI. To verify the Content Credentials of an image, users can inspect it via verify.contentauthenticity.org, which provides a comprehensive overview of relevant information.
Ashley Still, Senior Vice President of Digital Media at Adobe, emphasized the impact of integrating Firefly directly into creative workflows, stating, “By integrating Firefly directly into workflows as a creative co-pilot, Adobe is accelerating ideation, exploration, and production for all of our customers. Generative Fill combines the speed and ease of generative AI with the power and precision of Photoshop, empowering customers to bring their visions to life at the speed of their imaginations.”
While Generative Fill is not yet available in the full release of Photoshop, users can experience it firsthand by downloading the desktop beta app or accessing it as a module within the Firefly beta app. Adobe plans to introduce the feature to the public Photoshop app in the second half of 2023.
Adobe has been progressively incorporating AI-powered tools into its products, with Sensei, another of Adobe’s AI models, driving features like higher-quality object selections in Photoshop. Firefly is already utilized in Adobe Illustrator for vector-based image recoloring, and Adobe intends to integrate Firefly with Adobe Express, a cloud-based design platform that competes with services like Canva, although no official release date has been confirmed.