After teasing its big AI plans, Apple has revealed Apple Intelligence, a new AI system that will be available in iOS 18, iPadOS 18, and macOS Sequoia.
As part of its WWDC 2024 keynote, Apple detailed this new system. This includes Writing Tools, which will be built into the next major OS updates for iPhones, iPads, and Macs. These tools will allow for actions such as proofreading, rewriting, and summarizing tech in various apps, like Notes, Mail, and even some undisclosed third-party apps.
Apple Intelligence, take the wheel
Apple Intelligence will also introduce Priority Messages and Notifications in iMessage and the Apple Mail app. The former will stack the notifications in order of the most important ones and summarize longer-written notifications to save time. The latter will add a new section at the top of the Mail app's inbox, displaying the most urgent emails, such as your boarding pass for a flight you are about to catch or an important meeting happening at work today.
Summarization will also be available on the Notes and Phone apps, allowing users to record, transcribe, and summarize audio. Apple mentions in a press release that when a recording is initiated, participants will notified once a call is being recorded, and once that call concludes, Apple Intelligence will generate a summary to provide the biggest takeaways.
Generative AI images will also be included. The two most notable are Image Playground and Genmoji. The former is a GenAI image generator that creates images in iMessage based on conversation concepts. The latter creates brand-new emojis based on text descriptions provided by the user.
The Photos app is also getting souped up with Apple Intelligence. This includes making it easier to search for photos and videos when typing in more natural language to find that visual asset on your iPhone. The Clean Up tool will identify and remove "distracting objects," like photobombers, in the photo's background without a noticeable alteration to the image's subject.
Siri: Apple Intelligence Era
According to Apple, Siri, the company's AI voice assistant, is also being revamped to be more natural, relevant, and personal, along with a revamped UI that visibly looks more discrete than the Orb-shape that was available for the assistant.
In addition, Siri also has a text messaging feature, allowing you to ask Siri to set an alarm without having to say it out loud. Making it convenient when you are in situations such as in a loud public area or you do not want people to listen to what you are asking Siri.
Apple further explains that Siri's new AI smarts will provide device support for users "everything they go," and answer a slew of questions on how to perform specific tasks on an iPhone, iPad, and/or Mac. Whether it is learning how to take a screenshot on Mac, or how to learn how to use the new Scheduled Messages feature coming to iMessage via iOS 18 later this year.
Siri's AI capabilities will also provide onscreen awareness. One example Apple demonstrated included an iPhone user areceiving an address from their contact and asking Siri to update the contact card to include that address.
ChatGPT's Integration in Apple Hardware
As rumors previously implied, Apple is partnering with OpenAI to develop its new AI system. One such example of this new partnership is ChatGPT-4o integration into Apple platforms. When asking a question, Siri can leverage ChatGPT's expertise when applicable to provide an efficient answer for the user. Apple confirmed that users will be asked to use ChatGPT before their inquiries, including any documents or photos, are sent to the chatbot, and the answers from ChatGPT will be presented directly from Siri.
For more on what was announced at this year's WWDC, check out our Everything Announced.
Taylor is a Reporter at IGN. You can follow her on Twitter @TayNixster.