The prestigious IJCAI (International Joint Conference on Artificial Intelligence) 2024 has officially kicked off, featuring OPPO AI Center’s latest research paper and multiple cutting-edge AI innovations. OPPO is positioning itself at the forefront of #AI phone innovation. #OPPO
Innovative Zero-Shot Framework Revolutionizes Text-to-Image Video Generation
At IJCAI 2024, OPPO AI Center’s research paper, “Zero-shot High-fidelity and Pose-controllable Character Animation,” was prominently featured. This paper highlights OPPO’s tech expertise and continuous advancement in AI.
In the I2V (Image-to-Video) domain, common issues include inconsistent character appearances and poor detail retention, requiring vast video data for training. To address these challenges, OPPO AI Center introduced PoseAnimate, an innovative zero-shot I2V framework. PoseAnimate leverages pose information to control animation movements while maintaining scene content consistency. This framework achieves its goals through three key modules:
- Pose-Aware Control Module (PACM): Integrates various pose signals into text embeddings to retain content irrelevant to the character and ensure precise alignment of movements.
- Dual Consistency Attention Module (DCAM): Enhances temporal consistency, preserving character identity and intricate background details.
- Mask-Guided Decoupling Module (MGDM): Improves the fidelity of generated videos by decoupling characters from the background.
The OPPO team also proposed the Pose Alignment Transition Algorithm (PATA) to ensure alignment and smooth transitions of character poses. Experimental results demonstrate that PoseAnimate significantly outperforms existing advanced training methods in character consistency and detail fidelity, maintaining high temporal consistency throughout the generated animations.
Additionally, Dr. Yang Zhenyu from OPPO AI Center presented “Generative AI for Smartphone: Challenges, Opportunities, and Practices of OPPO” at IJCAI 2024, sharing practical experiences with AI industry partners and academia.
Accelerating the Application of Generative AI Technology
With the rapid development of generative AI technology, the smartphone industry is entering a new era of AI phones. As a global leader, OPPO is dedicated to integrating cutting-edge AI technology into its products, delivering a smarter and more convenient mobile experience for users.
This year, OPPO launched the Find X7 Series and the Reno12 Series 5G AI phones, showcasing its prowess in the mobile AI field. OPPO aims to bring generative AI features across its entire smartphone lineup for around 50 million users within the year.
OPPO believes that a true AI smartphone is not only about hardware enhancement but also a revolutionary breakthrough in user experience. To achieve this goal, OPPO has established a robust AI Center and engaged in deep collaborations with leading global tech companies, such as Google, Microsoft, and MediaTek. OPPO is committed to exploring hybrid (on-device and cloud) mobile AI technologies, driving innovative applications of AI on mobile devices.
Moreover, OPPO frequently participates in top-tier international AI conferences, sharing its latest AI research findings, maintaining close communication with the AI academic community, and continuously leading the industry’s development direction. Looking ahead, OPPO will continue to prioritize user-driven innovation, persistently exploring innovative applications of AI technology to provide users with the ultimate AI phone experience.
FAQs
1. What is IJCAI 2024? IJCAI 2024 is the International Joint Conference on Artificial Intelligence, a prestigious academic conference in the field of AI.
2. What is PoseAnimate? PoseAnimate is an innovative zero-shot I2V framework introduced by OPPO AI Center, leveraging pose information to control animation movements while maintaining scene content consistency.
3. What are the key modules of PoseAnimate? PoseAnimate includes the Pose-Aware Control Module (PACM), Dual Consistency Attention Module (DCAM), and Mask-Guided Decoupling Module (MGDM).
4. What AI features are in the Find X7 and Reno12 Series? The Find X7 and Reno12 Series 5G AI phones showcase OPPO’s advanced AI technology, offering smarter and more convenient mobile experiences.
5. How is OPPO contributing to the AI community? OPPO frequently participates in international AI conferences, sharing its latest research findings and maintaining close communication with the AI academic community.