Apple Intelligence: New AI features coming to iPhone, iPad & Mac

Apple Intelligence: New AI features coming to iPhone, iPad & Mac

By Dino Gane-Palmer

While recent years have seen a surge in new AI technologies, Apple appeared to be lagging in the race. But, on June 10 of this year, this all changed when Apple debuted Apple Intelligence. The tech giant is all set to integrate generative AI across its ecosystem and improve user interactions on iPhones, iPads, and Macs. 

The Apple Intelligence beta is set to launch this fall with iOS 18, iPadOS 18, and macOS Sequoia. It will be initially available in U.S. English on devices like the iPhone 15 Pro and Macs with M1 chips. The full public release of Apple Intelligence will coincide with new device launches later in the year.

This article explores Apple Intelligence’s core features, its new privacy standards, and its integration with ChatGPT, among other developments.

What is Apple Intelligence?

Apple Intelligence is a new suite of AI-driven capabilities designed for integration across various Apple devices. It will improve the user experience by bringing advanced generative AI features directly into Apple’s ecosystem. This initiative aims to enrich Apple devices with smarter functionalities while upholding strict privacy standards.

Which devices will be compatible with Apple Intelligence?

All the latest devices will feature Apple artificial intelligence to ensure users can access cutting-edge AI features. Below is a list of Apple Intelligence supported devices:

  • iPhone 15 Pro
  • iPhone 15 Pro Max
  • iPad Pro (with M1 chip or later)
  • iPad Air (with M1 chip or later)
  • MacBook Air (with M1 chip or later)
  • MacBook Pro (with M1 chip or later)
  • iMac (with M1 chip or later)
  • Mac Mini (with M1 chip or later)
  • Mac Studio (with M1 Max or later)
  • Mac Pro (with M2 Ultra)

Key features of Apple Intelligence:

Apple Intelligence introduces a set of advanced AI capabilities for various devices. This section will explore the core features of Apple AI in detail.

Features of Apple Intelligence

Integration across Apple’s ecosystem

Apple Intelligence integrates across iOS 18, iPadOS 18, and macOS Sequoia. This cross-platform functionality enhances the user experience on iPhones, iPads, and Macs. Users can expect a unified interface and consistent performance across all devices.

The core of Apple Intelligence lies in its advanced integration of generative AI with personal context. By utilizing the power of Apple silicon, it adapts to individual user needs and preferences. This personalized approach ensures that every interaction with the device is relevant and tailored.

Apple silicon enables real-time language and image processing directly on the devices. This boosts performance and also ensures privacy by limiting data exposure. Users benefit from faster responses and a more secure environment for their personal data.

New writing tools

Advanced writing tools are being introduced by Apple’s generative AI to enhance user experience across various applications. These tools are accessible in Mail, Notes, Pages, and even third-party apps. It will allow users to improve their writing wherever they choose to work.

The major features of the writing tools include rewriting, proofreading, and summarizing. Rewrite allows users to alter the tone of their text, making it suitable for different audiences and occasions. Moreover, the Proofread function checks grammar, word choice, and sentence structure. It offers corrections and explanations for suggested edits. The summarize option simplifies text into an easily understandable format. It is ideal for quick reviews or those needing an overview without going into the details.

Improved communication

Priority Messages and Smart Reply are some of the latest Apple Intelligence features for better email management in Mail. Priority Messages help users quickly spot urgent emails to ensure nothing important gets missed. Smart Reply suggests responses to incoming messages, speeding up email handling and improving productivity.

On the notification front, Apple Intelligence introduces Priority Notifications and the Reduce Interruptions feature. Priority Notifications highlight critical alerts at the top of the notification stack, which makes them immediately noticeable. The Reduce Interruptions feature filters notifications, only showing those that require urgent attention. This helps the users maintain focus on their current tasks.

Audio and visual innovations

Apple Intelligence enhances audio interactions with its ability to record, transcribe, and summarize audio seamlessly. In the Notes and Phone apps, users can initiate a recording during a call, and participants are notified automatically. Once the call ends, the system generates a summary. This helps the users recall critical points without revisiting the entire conversation.

The Image Playground feature within Apple Intelligence offers a unique way for users to express themselves through digital art. Users can create animations, illustrations, or sketches. They can select from different styles to match their mood or the content’s purpose. This tool is integrated within various apps, including Messages, allowing instant artistic creations that enhance communication.

Genmoji introduces a personalized emoji experience and enables users to generate custom emojis by typing descriptions. This feature brings a new level of customization to digital expressions. It allows users to represent emotions or reactions that standard emojis cannot capture. By integrating Genmoji within messaging and email, Apple ensures that personal communication is fun and highly expressive.

New capabilities in Photos app

Apple Intelligence improves the Photos app by allowing users to search for images using natural language. This feature makes it easy to find specific memories, such as a graduation ceremony or people enjoying holidays at a resort. Users can access their desired photos without going through their countless albums.

The new Clean Up tool in the Photos app helps users remove unwanted objects from images. This tool preserves the focus on the subject and improves the overall composition of the photo. It’s an invaluable aid for refining pictures before sharing or printing.

The Memories feature of Apple Intelligence transforms how users relive their favorite moments. By simply describing a theme or event, the AI gathers relevant photos and videos to create a narrative movie. This feature also suggests appropriate background music from Apple Music, which further improves the storytelling experience.

Has Apple set a new standard for privacy in AI?

Apple has introduced important measures to augment privacy in the realm of artificial intelligence. Here is how the company is upholding strict privacy measures in Apple Intelligence: 

  • Private cloud compute: Apple’s private cloud compute allows computational tasks to be flexibly distributed between on-device processing and cloud-based servers. It ensures that sensitive data can be processed locally whenever possible to improve user privacy.
  • On-device processing: Many of Apple Intelligence’s AI models run directly on the device. This minimizes data exposure by reducing the need to send personal information to the cloud.
  • Cryptographic security measures: Apple ensures that devices only communicate with servers whose software has been publicly logged and verified. This system enhances the security and privacy of user data.
  • Independent verification: The company allows independent experts to inspect the code that runs on its servers, which adds a layer of trust in Apple’s privacy practices.
  • Data minimization: By focusing on processing data on the user’s device and not retaining data on servers, Apple minimizes the amount of personal data that can be exposed or compromised.

Apple Intelligence redefines Siri’s capabilities:

Apple Intelligence has led the transition of Siri from a voice-only interface to also accepting typed queries. This change allows for more discreet and versatile interactions. It accommodates users in noisy environments or those preferring text. 

Visual redesign

Siri has moved away from the traditional icon to a blue, glowing border that encircles the screen. This new design modernizes the interface and visually signifies Siri’s active engagement. The glowing border is designed to be subtle yet noticeable, providing a clear indication without being intrusive. 

Advanced language understanding

Siri’s capabilities have been enriched with deeper language understanding. The ability to understand context and nuances in language equips Siri to handle a wider range of requests more intelligently. These improvements mark a step forward in making digital assistants more contextually responsive.

More actions

Siri can now perform new actions across both Apple and third-party apps. This integration allows for more seamless user experiences. Users can expect smoother workflows and better app interoperability.

Onscreen awareness

Siri now has onscreen awareness, which allows it to perform context-sensitive actions. It understands the current app context to offer relevant suggestions. This feature enhances productivity by reducing the need for manual input.

How will Apple Intelligence use ChatGPT?

Apple Intelligence will integrate ChatGPT access into iOS 18, iPadOS 18, and macOS Sequoia. Users will be able to use ChatGPT for understanding and generating text, as well as for image creation. This functionality will be available in systemwide writing tools.

When a user makes a request, Siri can refer to ChatGPT for additional expertise to give more accurate responses. Before submitting any query to ChatGPT, users will be prompted for permission. This allows Apple to maintain user confidentiality while utilizing advanced AI capabilities.

Privacy is paramount with the integration of ChatGPT into Apple Intelligence. All interactions with ChatGPT through Apple devices will obscure the user’s IP address, and no data will be stored by OpenAI. This ensures that while users benefit from advanced AI tools, their information remains secure and private.

Why won’t Apple Intelligence be released in Europe?

Apple’s decision not to release Apple Intelligence in Europe is rooted in regulatory concerns. The European Union’s digital markets act (DMA) requires that devices operate seamlessly across different platforms. This interoperability mandate conflicts with Apple’s commitment to privacy and data security.

Apple fears that adhering to the DMA’s rules could compromise the integrity of its products. Specifically, the company is concerned about user privacy and the security of their data. This has led Apple to withhold the launch of their AI-driven features, including Apple Intelligence, in the EU.

Apple Intelligence offers capabilities such as proofreading, rewriting texts, and custom emoji creation. However, these features depend heavily on accessing and processing user data. Apple believes that DMA’s requirements might prevent them from protecting this data effectively.

Consequently, Apple is working with the European Union to find a solution that respects both the DMA and the security of their products. They aim to introduce these features without compromising safety. Until a viable path is found, Apple Intelligence will remain unavailable in the EU market.

What’s next?

With Apple Intelligence, the future of user productivity looks promising. Apple’s integration of generative AI across devices could redefine how users interact with technology daily. These advancements suggest a seamless experience that boosts efficiency and creativity.

Most importantly, Apple has set a new benchmark in maintaining user-privacy with its on-device processing. While Apple users may be quite satisfied with this development, the question remains whether other AI technologies can match Apple’s high privacy standards.

How PreScouter is helping companies with generative AI: 

Just like Apple is revolutionizing smartphones, at PreScouter, we’re looking to take the management and innovation consulting space to the next level – a level where industry players can find real value with AI. 

Chatbots like ChatGPT, Claude, or Perplexity are excellent “thinking partners” for boosting productivity and getting past the “blank page” dilemma. But they fall short when it comes to solving key pain points. 

Some of the pain points our clients face every day include:

  • Our team is spending too much time constantly visiting competitor websites, checking their press releases, patent filings, etc.
  • We often find articles and publications on a topic we are researching and send them to each other via email, where they can get lost or hard to find again. 
  • We have thousands of technical documents that describe our products and processes. Whenever there is a question, we have to contact an internal subject matter expert to sift through the data and find an answer.
  • Different people write our bid documents, and the style is never the same. Making the chapters coherent takes a lot of time.
  • We sell furniture in all the US states and many different countries. Each region has its regulations on materials (e.g., flammability) and other aspects. It’s very hard to stay on top of all the changes.

With generative AI, all of these challenges now have solutions. If anyone is curious to know what PreScouter is building to solve these challenges, let’s connect on LinkedIn

Interested in generative AI for your business, but not sure where to start? Schedule a complimentary brainstorming session with our AI experts here or email us at ai@prescouter.com

Never miss an insight

Get insights delivered right to your inbox

More of Our Insights & Work

Never miss an insight

Get insights delivered right to your inbox

You have successfully subscribed to our newsletter.

Too many subscribe attempts for this email address.

*