Xiaoyi is upgraded to an intelligent entity! HarmonyOS NEXT opens a new era of AI

 Huawei Developer Conference 2024 (HDC 2024) will gather again in Songshan Lake, Dongguan.

At this conference, the most noteworthy event was the official launch of HarmonyOS NEXT Beta for developers and pioneer users, and the comprehensive demonstration of HarmonyOS NEXT’s three major innovative features: full-scene, native intelligence, and native security.

HarmonyOS NEXT native intelligence: opening a new AI era

After abandoning the Android framework, HarmonyOS NEXT has become an operating system that is truly independent of Android and iOS. It can be said to be an unprecedented transformation. Among its many new features, native intelligence is undoubtedly one of the new features that can bring the most intuitive feelings and experience upgrades to users. For the first time, HarmonyOS NEXT deeply integrates AI and OS, building a new Hongmeng native intelligent framework, truly opening a new AI era.

Huawei’s AI capabilities sink into OS: making third-party applications naturally intelligent

Relying on Ascend’s computing power and Pangu’s large model, HarmonyOS NEXT has system-level AI capabilities.

It is understood that Huawei will sink AI capabilities into the OS and empower 15+ subsystems. Through the native smart base, AI capabilities are deeply integrated with the Hongmeng subsystems, allowing third-party applications to naturally have a more intelligent experience.

At the same time, the Pangu big model can better understand and match users’ high-level intentions, and combine the intent framework for service management and distribution. It not only helps users better obtain the personalized services they need, but also helps developers reach target users more accurately through diversified system entrances such as Xiaoyi Suggestions, Xiaoyi Dialogue, and Smart Search.

For Hongmeng developers, only one line of code is needed to call the system-level native AI capabilities. Users can also get a consistent AI interaction experience across applications at the system level.

For example, after Xiaohongshu is connected to the Image control, users only need to long press on the text area of ​​the image with one finger to select the text in the image; long press on the main body of the image with one finger to easily complete the cutout, obtaining an interactive experience consistent with the system gallery.

For Sina News, which has been connected to a reading control, after opening any news, you can click the “Listen to News” icon in the upper right corner to start the news listening function, and you can also link with the broadcast control center to realize background playback.

In short, by sinking AI capabilities, third-party applications in the HarmonyOS NEXT system will be “inherently” smarter. Developers can call upon the system’s AI capabilities at extremely low cost, which will also bring users an unprecedented revolutionary new intelligent experience.

Xiaoyi is upgraded to an intelligent agent: She is always on the screen and can be summoned at any time.

In addition, empowered by the Pangu big model and native intelligent system-level AI, HarmonyOS Next’s smart assistant Xiaoyi has been upgraded to Xiaoyi intelligent body for the first time. It not only has greatly enhanced memory and stronger reasoning and planning capabilities, but also has stronger knowledge question and answer capabilities, is more open, etc., allowing users to complete various tasks more efficiently.

It is reported that the newly upgraded Xiaoyi will appear in the system in a new form of “Xiaoyi super intelligent body”, resident on the screen, waiting for the user’s call at any time.

Xiaoyi has added a new entrance and a new wake-up animation to the desktop navigation bar. By dragging processing objects such as text, pictures, documents or videos to the navigation bar to “feed”, you can summon Xiaoyi to perform text extraction, translation, format conversion, and summary operations to handle daily affairs more efficiently.

For example, drag a text about a meeting notice to Xiaoyi, and Xiaoyi can pull up the calendar and quickly create a schedule based on the content of the notice; drag a book cover image to Xiaoyi, and you can quickly understand the introduction of the book and listen to the book with one click; drag a picture with a table to Xiaoyi, and Xiaoyi can directly convert it into a table file for efficient processing; drag an attachment in an email to Xiaoyi, and Xiaoyi can make a document summary to quickly grasp the key points. You can also continue to interact with Xiaoyi based on this summary, which is convenient and efficient.

It is worth mentioning that Xiaoyi Super Intelligent Agent also realizes “see and ask”. For example, by circling, Xiaoyi can ask questions, quickly add schedules, take notes, etc., shortening the operation path and more conveniently obtaining or recording information.

As we all know, it is very convenient to use mobile phones for entertainment and relaxation, but it is less efficient to edit documents. At this time, Xiaoyi’s super intelligent body comes in handy. For example, if a user wants to send a document to a customer, we can tell Xiaoyi to “convert the several pages of technical content in yesterday’s meeting materials into PDF.” Xiaoyi will quickly find the corresponding meeting materials in the mobile phone, extract the corresponding content and convert it into PDF. Then you can say to Xiaoyi: “Please reply to my boss’s email and ask him to check the attachments and attach this PDF.” Xiaoyi will edit the email and send it according to this requirement.

In this scenario, Xiaoyi organized four applications, namely search, file manager, email, and input method, to collaborate. In addition, Xiaoyi used a file segmentation tool to extract the required content and converted it into the corresponding format.

There is another scenario where we don’t know much about a product before buying a car or a mobile phone, and we can ask Xiaoyi to help answer questions. For example: ask about the comparison between the models of Jie M7 and M5, whether Huawei Mate60 and Pura 70 both support Lingxi communication, and introduce Huawei Mate60.

We can even ask: What is the function that allows you to scan codes without opening the app, what is a floating window, how to enable app clones, how to use air gestures, etc. Xiaoyi will provide users with professional and comprehensive answers to all kinds of questions.

The above cases are just the tip of the iceberg. For users, Xiaoyi Intelligent Agent brings a smarter, more capable and considerate system-level AI assistant experience. For the industry, after the interaction and intention understanding capabilities of Xiaoyi Intelligent Agent are upgraded, it will also create more and more accurate opportunities for ecological applications and services to reach users. Applications and services can access Xiaoyi Intelligent Agent through the intent framework to provide a more natural and efficient user experience.

For more surprising experiences of Xiaoyi Intelligent Body, you may want to wait until you upgrade to HarmonyOS NEXT in the future and experience it for yourself.

Kazam

Kazam is Focused on creating and reporting timely content in technology with a special focus on mobile phone technology. Kazam reports, analyzes, and reviews recent trends, news and rumors in mobile phone technology and provides the best possible insights to enhance your experience and knowledge.