AI 기반 모델이 호황을 누리고 있으며, ChapGPT와 SORA의 등장은 충격적이며, AI 프론티어 과학자와 기업이들은 AI 기반 모델이 모든 생활, 특히 기술 관련 분야를 재구성할 것이라고 지적하고 있습니다. 기술 제품으로서 지능형 자동차는 AI 기반 모델에 따라 어떻게 변화할 것인가?
기초 모델은 어떻게 지능형 자동차를 재구성하는가?
2023년 Changan Automobile은 L1 - L6 층을 포함한 자체 소프트웨어 구동 아키텍처(SDA)에 AI 엣지 및 AI 서비스 층을 추가하여 AI 기술은 지능형 자동차의 L3 EEA 층, L4 차량 OS 층, L6 차량 기능 응용 층(조종석, 연결성, 지능형 운전 포함), L7 클라우드 빅 데이터 층 등 대부분의 층에 영향을 미칩니다, L1 기계 계층의 섀시 부분과 L2 동력 계층의 배터리 부분은 실제로 AI 응용에 관여하고 있으며, L3 EEA 계층, L4 차량 OS 계층, L6 차량 기능 응용 계층(조종석, 커넥티비티, 지능형 운전 포함), L7 클라우드 빅 데이터 계층 등 대부분의 계층에 영향을 미치고 있는 것을 알 수 있습니다.
현재 OEM과 Tier 1은 차량 인텔리전스의 일부 또는 개발 프로세스의 일부 링크에 기본 모델을 활용하고 있습니다.
자동차의 AI 기반 모델의 일반적인 응용 동향을 살펴볼 때, 기반 모델의 진화도 함께 살펴볼 필요가 있는데, 텐센트 연구소의 조사 결과에 따르면, AI는 뇌에서 AI 에이전트로, CoPilot에서 자동 운전으로 진화할 것으로 보입니다.
에서는 AI Agent란 무엇일까?
기반 모델/AI Agent가 OS/APP를 대체할 것인가?
ResearchInChina는 다음과 같은 견해를 받아들인다: AI 기반 모델은 OS이고, AI 에이전트는 용도입니다. 지능형 제품 개발 패러다임은 기존 OS-APP의 생태계 패러다임에서 AI 기반 모델-AI Agent의 생태계 패러다임으로 변화합니다.
AI 에이전트는 단순한 텍스트 생성을 넘어선 AI 시스템으로, AI 에이전트는 대규모 언어 모델(LLM)을 핵심 컴퓨팅 엔진으로 사용하여 대화, 작업 수행, 추론을 수행하고 어느 정도의 자율성을 가질 수 있습니다. 즉, AI 에이전트는 복잡한 추론 능력, 메모리, 작업 수행 방법을 가진 시스템입니다. 따라서 NIO의 조종석에 탑재된 NOMI GPT와 Tesla FSD V12가 각각 조종석 영역과 지능형 주행 영역의 AI 에이전트임은 분명합니다.
플랫폼 수준의 AI 기술인 AI 기반 모델에는 ChatGPT와 ERNIE Bot과 같은 일류 기술 기업이 출시한 AI 기반 모델이 포함됩니다. 플랫폼 수준의 AI는 운영체제의 모든 측면을 강화하는 기술 기반이 될 것입니다. 이는 차세대 운영체제의 새로운 커널로 간주됩니다. 기존 운영체제의 커널은 주로 GPU, 메모리 등 시스템 하드웨어 리소스의 관리와 스케줄링을 담당하여 시스템의 정상적인 작동과 효율적인 사용을 보장합니다. 그러나 사용자의 요구가 증가함에 따라 AI 시스템은 인간과 관련된 많은 개인화된 경험을 분석해야합니다.
개인 지식 기반, 사람들의 위치 및 상태 인식, 사람들의 습관, 취미 및 기타 개인화 요소는 기존 운영 체제에서 효과적으로 계산 및 처리할 수 없습니다. 따라서 이러한 요구 사항을 충족시키기 위해서는 완전히 새로운 커널이 필요합니다. 플랫폼 수준의 AI 기반 모델의 강점은 여러 개인화 요소를 관리 및 처리하고 운영체제가 사용자의 의도를 정확하게 인식할 수 있다는 점입니다. 이러한 기능을 통해 새로운 운영체제는 모든 사람에게 '원하는 것을 추측하고 필요한 것을 이해하는' 지능형 경험을 제공할 수 있습니다.
이 보고서는 중국 자동차 산업에 대한 조사 분석을 통해 AI 기반 모델 현황과 미래 동향, 자동차 설계에 미치는 영향, 응용 사례 등의 정보를 제공합니다.
AI foundation models are booming. The launch of ChapGPT and SORA is shocking. Scientists and entrepreneurs at AI frontier point out that AI foundation models will rebuild all walks of life, especially tech-related fields. As a technological product, how will intelligent vehicles be changed by AI foundation models?
How foundation models will rebuild intelligent vehicles?
Following the "Automotive AI Foundation Model Technology and Application Trends Report, 2023-2024", a report which discusses impacts of AI foundation models on automotive industry from a macro perspective, ResearchInChina released the "AI Foundation Models' Impacts on Vehicle Intelligent Design and Development Research Report, 2024", the second report which researches the impacts of AI foundation models on vehicle intelligent design and development in the such aspects as hardware, operating system, application function, and cloud big data.
In 2023, Changan Automobile added AI edge and AI service layer to the original software-driven architecture (SDA) that includes L1-L6 layers. It can be seen that AI technology has affected most layers of intelligent vehicles: L3 EEA layer, L4 vehicle OS layer, L6 vehicle function application layer (including cockpit, connectivity and intelligent driving), L7 cloud big data layer, etc. The chassis part of L1 mechanical layer and the battery part of L2 power layer have actually involved AI application.
Currently, OEMs and Tier1s apply foundation models to part of vehicle intelligence, or to some link in the development process.
When viewing the general application trend of AI foundation models in vehicles, we also need to find an idea in the evolution of foundation models. According to the results of Tencent Research Institute, AI will evolve from the brain to AI Agent, and from CoPilot to autonomous driving.
So, what is AI Agent?
Will foundation model/AI Agent replace OS/APP?
ResearchInChina accepts the view: AI foundation model is the OS, and AI Agent is the application. The development paradigm of intelligent products will be changed from conventional OS-APP ecosystem paradigm to AI foundation model-AI Agent ecosystem paradigm.
What is AI Agent? It is an artificial intelligence (AI) system beyond simple text generation. AI Agent uses a large language model (LLM) as its core computing engine, so that it can make conversations, perform tasks, make inferences, and have a degree of autonomy. In short, AI Agent is a system with complex reasoning capabilities, memory and task execution methods. It is thus clear that NOMI GPT in NIO's cockpit and Tesla FSD V12 are AI Agents in the cockpit domain and intelligent driving domain, respectively.
AI foundation models, a platform-level AI technology, include those launched by first-tier technology companies, such as ChatGPT and ERNIE Bot. Platform-level AI can serve as the technological foundation to empower operating systems in all aspects. It is regarded as the new kernel of next-generation operating systems. The kernel of conventional operating systems is mainly responsible for managing and scheduling the system's hardware resources like GPU and memory to ensure normal operation and efficient utilization of system. Yet with increasing user demand, AI systems need to parse many human-related personalized experiences.
For personal knowledge base, people's location and status awareness, people's habits and hobbies and other personalization factors, conventional operating systems fall short of effective calculation and processing. We thus need a brand-new kernel to meet these requirements. The strength of platform-level AI foundation models is that they can manage and process multiple personal factors and help the operating system accurately recognize user intents. With such capabilities, fire-new operating systems can bring everyone an intelligent experience of "guess what you want and understand what you need."
In automotive cockpit applications, to achieve true personalization, automakers also need to further customize the AI foundation model according to the features of their own vehicle models and services, that is, AI Agent based on platform-level AI foundation model. We can see that Geely models (such as Jiyue and Galaxy) are based on Baidu ERNIE Bot-based cockpit systems, and Mercedes-Benz's in-car voice assistant are actually an AI Agent after being connected to ChatGPT.
At present, intelligent driving AI Agent and cockpit AI Agent are separate. As cockpit-driving integration develops, they will tend to be integrated. However when considering cockpit-driving integration, OEMs and Tier1s cannot only consider integration at the hardware level, but also need to take into account operating system and vehicle system architecture, especially rapid evolution of foundation models/AI Agent models.
Foundation model/AI Agent is currently a part of an operating system/APP ecosystem. Will it replace operating systems/APP models in the future? We think it's possible.
Foundation model-based agents will not only allow everyone to have an exclusive intelligent assistant with enhanced capabilities, but also change the mode of human-machine cooperation and bring broader human-machine fusion. There are three human-AI cooperation modes: Embedding, Copilot, and Agent.
In intelligent driving, the Embedding mode is equivalent to L1-L2 autonomous driving; the Copilot mode, L2.5 and highway NOA; the Agent mode, urban NOA and L3 autonomous driving.
In the Agent mode, humans set goals and provide necessary resources (e.g., computing power), then AI independently undertakes most of tasks, and finally humans supervise the process and evaluate the final results. In this mode, AI fully embodies the interactive, autonomous and adaptable characteristics of Agents and is close to an independent actor, while humans play more of a supervisor and evaluator role.
A large number of interactive operations that were originally enabled via IVI APP can now be achieved through natural interactions (voice, gesture, etc.) in the AI Agent mode. AI Agent even actively observes the inside and outside of the vehicle, makes a request inquiry, and can perform a task after being confirmed by the user.
Therefore, the development of AI Agent is bound to make a mass of previous apps unnecessary and will have a disruptive impact on the development and application of intelligent cockpit and intelligent driving.
The current AI foundation models are not an operating system, but a paradigm and architecture of AI models, focusing on how to enable machines to process multimodal data (text, image, video, etc.). AI Agent is more similar to an AI application or application layer, which requires the support of the underlying operating system and hardware for operation. It is not in itself responsible for the basic management and resource scheduling of the computer system. In the future, AI foundation models are likely to be combined with OS to become AIOS.
AI foundation models and AI Agent development have the following impacts on future operating systems:
Applets will disappear or evolve into AI Agent that calls foundation models;
OS may evolve into the foundation model + computing chip core cluster OS architecture;
AI foundation models as a platform redefine and empower all kinds of industrial application scenarios, and give rise to more human-computer interaction-centric native applications, including autonomous vehicles, robots and digital twin applications.