With the development of AI-generated content (AIGC) technology, seeing “digital humans” upon opening the smartphone screen is no longer a novelty. For many people, however, watching a news program fully hosted by “digital humans” on television remains a fresh experience.
Recently, UniDT (Shanghai) Co., Ltd., a technology-based enterprise in Jing’an District, made a breakthrough in the R&D for innovative application of AIGC core technology. The company, in collaboration with the Yicai Channel, has launched the first live financial program fully hosted by “digital humans”. In the program, it synthesizes the host “Li Ting”, the on-site guest “Ying Youwei”, apart from the live guests being real people, and the studio setting, through its digital human technology, presenting magical scenes of conversations between digital humans.
According to the information obtained, UniDT, based on its self-developed large-scale multimodal pre-training technology and few-shot controllable generation technology, randomly collected several-minute broadcasting video clips of the host to create a vivid digital human image. These digital humans possess emotional expressions, visual appearance, speech patterns, lip movements, and body gestures similar to those of real human anchors. The program team can generate episodes without the need for real human appearances in subsequent usage. They only need to input text to achieve voice synthesis with similar tones, lip synchronization generation, and adaptive matching of bodily movements. The output information includes sound, posture, facial expressions, and actions, all naturally aligned with the input text. This approach solves a series of problems such as lengthy shooting and video production, enabling the generation of a program within a short time.
In recent years, there has been considerable industry attention on how to promote the strategic planning of the “AI + digital content industry” and expand the application of AI technology in various industries at a deeper level. UniDT, located in the Shibei High-tech Park of Jing’an District, is one of the earliest enterprises in the industry to embrace AI digital humans. It has already ventured into multiple industries, including finance, insurance, consumption, and media. The company has established deep collaborations with industry leaders such as China Life Insurance, Unilever, and Yicai, initiating extensive cooperation in the field of digital humans. They are gradually expanding their market share through standardized pricing, products, and services. In the future, Jing’an District will continue to focus on the “latter half” of generative AI models, unleashing the spillover driving effect of large models of enterprises like UniDT in vertical fields like intelligent cognition. Meanwhile, it also aims to create a digital industrial cluster that is competitive in the international market and represented by the Shibei Hi-Tech Park.