Apple, Samsung, and Google are rolling out generative AI capabilities to fix poorly framed smartphone images. These new tools allow users to expand backgrounds or reposition subjects after a photo has been taken.
Apple Intelligence's reliance on the iPhone 16
Apple is introducing new generative capabilities within iOS 27 to address the common frustration of poorly composed images. By integrating these tools directly into the Photos app, the company aims to give users more control over their final compositions without requiring professional editing software.
The "Extend" and "Reframe" features, which are part of the Apple Intelligence suite, allow users to expand photo borders or change the point of capture. As reported in the source article, these speciifc Apple tools are only available on iPhone 16 models or later, meaning older devices will not have access to these specific generative functions even if they can run the new operating system.
Using the "Extend" tool allows a user to add space around a subjject, such as adding more background above a person's head. the "Reframe" tool goes a step further by allowing users to rotate, zoom, or adjust the perspective of a shot, with the AI generating the missing visual data to fill in the gaps.
Samsung's "Move" tool and Google's "Auto frame" alternatives
Samsung Galaxy users can utilize the Galaxy AI Photo Assist to manipulate individual elements within a frame. This approach focuses on object manipulation, allowing users to select a person or item and reposition them within the existing shot.
The Samsung "Move" tool specifically lets a user tap or draw around an object to resize or rotate it, using generative AI to fill in the background that was previously obscured. According to the report, this provides a different but comparable utility to the expansion tools found on Apple devices.
Google Pixel owners can access the "Auto frame" feature through the Google Photos app to recompose tight shots. Similar to Apple's expansion method, Google's tool can use AI to fill in missing areas and extend the background of a photo that was originally too tightly cropped.
The risk of AI artifacts in faces and text
Generative AI technology often struggles to accurately render complex details like human anatomy or written language. While these tools can rescue a composition, they may introduce "strange details" that look unnatural to the human eye.
Users should be particularly cautious when applying these edits to images containing faces, hands, or text. The source notes that AI can struggle with letters and numbers, meaning street signs, storefronts, or text on clothing may appear distorted after an AI-driven expansion or reframe.
Variable rollout across regions and languages
Feature availability remains a significant unknown for many users due to geographic and linguistic restrictions. Apple has indicated that some Apple Intelligence features may be subject to usage limits or may not be available in all regions.
Google also manages its rollout gradually,meaning Pixel users might not see the "Auto frame" option immediately upon updating their software. Because availability depends on specific device models, accounts, and locations, users are encouraged to check for updates and save edited images as new copies to preserve their original shots.
Comments 0