Saturday, June 21, 2025

OpenAI’s New Image AI Nails Newton’s Spectrum and Draws Triangular Wheels, Too

OpenAI\'s new image-generation AI model, \
OpenAI’s new image-generation AI model, “ChatGPT 4o Image Generation,” recreated physicist Isaac Newton’s spectrum theory with precise explanations and colors. / Photo courtesy of OpenAI
OpenAI\'s new image-generation AI model, \
OpenAI’s new image-generation AI model, “ChatGPT 4o Image Generation,” created a new image using one it previously generated based on physicist Newton’s spectrum theory.”/ Photo courtesy of OpenAI
OpenAI\'s new image-generation AI model, \
OpenAI’s new image-generation AI model, “ChatGPT 4o Image Generation,” created another new image using one previously generated based on physicist Newton’s spectrum theory.” / Photo courtesy of OpenAI

OpenAI is replacing its image-generation AI model DALL-E 3 with “ChatGPT 4o Image Generation” (hereafter referred to as ChatGPT Image).

ChatGPT Image is powered by OpenAI’s generative AI model GPT-4, combining advanced text comprehension with high-level image generation capabilities. As a result, it can generate more complex and accurate images that better match demanding user requests compared to DALL-E 3. OpenAI plans to make ChatGPT Image available through ChatGPT soon.

On Tuesday, OpenAI briefed Korean correspondents and announced the launch of ChatGPT Image. It is OpenAI’s first new image-generation AI model in a year and six months since the release of DALL-E 3 in September 2023.

Even with detailed prompts, DALL-E 3 often failed to fully meet user needs, leading to increasing calls for improvement. According to OpenAI, ChatGPT Image represents a significant advancement over DALL-E 3 in terms of capabilities.

OpenAI first launched DALL-E in January 2021 and released an improved version, DALL-E 2, in April 2022. Since then, the company has continued to upgrade its image-generation AI. OpenAI stated that ChatGPT Image would fully replace DALL-E 3. However, the DALL-E 3 service will be phased out gradually to accommodate users who are familiar with it.

Gabriel Goh, an OpenAI employee in charge of multimodal operations (handling text, images, and audio simultaneously), emphasized that ChatGPT Image is not an upgraded version of DALL-E 3 but an entirely different image-generation AI model. He explained that this represents a shift in OpenAI’s image generation AI from novelty to practicality.

One of its biggest strengths is its ability to follow complex, multi-step user instructions. For example, when a user enters a prompt like “a blue star and a red triangle” into ChatGPT, ChatGPT Image accurately reflects the properties of each object to generate the exact image the user wants.

OpenAI explained that testing showed ChatGPT Image can accurately generate up to 15 different user-specified objects. It added that this exceeds the previous model’s performance, DALL-E 3.

OpenAI\'s new image-generation AI model, \
OpenAI’s new image-generation AI model, “ChatGPT 4o Image Generation,” accurately rendered up to 15 user-specified objects. / Photo courtesy of OpenAI

Unlike DALL-E 3, ChatGPT Image has no difficulty generating images beyond common sense.

Jackie Shannon, another OpenAI employee working on multimodal operations, explained that when given a prompt like “a bicycle with triangular wheels,” ChatGPT Image does not struggle like DALL-E 3 but immediately generates an accurate image with triangular wheels. It can also create four-panel comics using precise text and character placement and develop new images by creatively reusing existing visuals from physicist Newton’s prism experiment.

Because of its advanced capabilities, OpenAI expects the AI model to benefit educational and graphic materials. In one example, ChatGPT Image accurately generated eight types of whales, including a blue whale for an academic poster, with all colors correctly rendered.

Shannon predicted that ChatGPT Image would help AI evolve from creating fun visual effects to becoming a practical tool. She added, “We’re excited that OpenAI is opening the door for anyone to create detailed and accurate visual materials easily.”

ChatGPT Image is available for free to all OpenAI users through ChatGPT. It is also used in OpenAI’s video-generation AI model, Sora. The tool responds in Korean as well. However, whether “ChatGPT Image” will perform as well in Korean as in English remains uncertain. OpenAI plans to update the model to ensure accurate performance in Korean and other languages.

Hot this week

Japan’s Steel Giant Takes Over US Steel: What It Means for American Workers

Nippon Steel acquires U.S. Steel for $14.1 billion, ensuring U.S. government oversight and maintaining its headquarters in Pittsburgh.

Trump’s Ultimatum to Iran Jolts Oil Prices into Unsteady Climb

Oil prices rose slightly as markets reacted to Trump's ultimatum to Iran, with WTI and Brent crude experiencing minor gains.

Wall Street Wobbles After Powell Says No Rush on Rate Cuts

U.S. markets closed mixed after the Fed maintained interest rates, with tech stocks like Tesla and Nvidia gaining amid cautious investor sentiment.

Apple Joins Google in Map Export Request, Vows Flexible Compliance

Apple seeks South Korean approval to export high-precision map data, offering to accommodate government demands unlike Google.

Wall Street Takes a Dive as Tensions Rise Over Iran

The New York stock market fell sharply due to rising tensions in the Middle East and declines in major tech and solar stocks.

Topics

Japan’s Steel Giant Takes Over US Steel: What It Means for American Workers

Nippon Steel acquires U.S. Steel for $14.1 billion, ensuring U.S. government oversight and maintaining its headquarters in Pittsburgh.

Trump’s Ultimatum to Iran Jolts Oil Prices into Unsteady Climb

Oil prices rose slightly as markets reacted to Trump's ultimatum to Iran, with WTI and Brent crude experiencing minor gains.

Wall Street Wobbles After Powell Says No Rush on Rate Cuts

U.S. markets closed mixed after the Fed maintained interest rates, with tech stocks like Tesla and Nvidia gaining amid cautious investor sentiment.

Apple Joins Google in Map Export Request, Vows Flexible Compliance

Apple seeks South Korean approval to export high-precision map data, offering to accommodate government demands unlike Google.

Wall Street Takes a Dive as Tensions Rise Over Iran

The New York stock market fell sharply due to rising tensions in the Middle East and declines in major tech and solar stocks.

Brent and WTI Climb Following Heightened Concerns Over Iran Conflict

Oil prices surged amid rising tensions in the Middle East, with fears of disruptions to Iranian oil exports following Trump's return.

Why Stablecoins Struggle to Compete with Credit Cards in America

Stablecoins lack consumer incentives compared to credit cards, limiting adoption despite potential in specific payment areas.

Wall Street Bounces Back: Stocks Rally Amid Iran-Israel Ceasefire Hopes

US stock indices rebounded on the 16th as reports emerged of Iran seeking negotiations amidst ongoing conflicts.

Related Articles