Monday, 17 February 2025
26.4 C
Singapore
21.8 C
Thailand
21.2 C
Indonesia
27.1 C
Philippines

The founder says Chinese AI can thrive with bigger models and more data

Stepfun's founder champions scaling laws and multimodality in AI development, predicting a trillion-parameter model revolution in China's AI industry.

If you follow the latest developments in artificial intelligence, youโ€™ll find that bigger models and more data are the keys to success. Jiang Daxin, the founder of Stepfun, a Shanghai-based AI start-up, believes in the power of scaling laws in large language model (LLM) development. Despite challenges like lower investment and a lack of advanced chips in China, Jiang remains optimistic.

Jiang, who used to work at Microsoft, shared his thoughts at the World Artificial Intelligence Conference (WAIC) in Shanghai. He predicts that LLMs will eventually reach hundreds of trillions of parameters, greatly enhancing their capabilities.

The promise of scaling laws

Scaling laws are all about the relationship between an AI modelโ€™s performance and its number of parameters. Generally, larger models perform better, especially with more data and excellent computational resources, although the improvements can slow down after a certain point. Big tech companies invest heavily in advanced technology, particularly Nvidiaโ€™s H100 chips, to maximize performance.

Jiang highlighted this trend in his talk. โ€œThe advancements in OpenAIโ€™s GPT series, which powers ChatGPT, and the massive investments in supercomputing centers by companies like Amazon, Microsoft, and Meta show that scaling laws work,โ€ he said on Saturday. However, he cautioned that the availability of data, skilled personnel, and concerns about return on investment could affect the pace of these advancements.

Since OpenAI launched ChatGPT in late 2022, Chinese tech giants and start-ups have been eager to develop their LLMs. China has over 200 AI models, including Alibabaโ€™s Tongyi Qianwen and Baiduโ€™s Ernie. Alibaba owns the South China Morning Post, which reported this news. Yet, many Chinese AI firms struggle to match the spending power of their US counterparts and focus instead on revenue-generating applications.

Stepfunโ€™s innovative models

Founded in April 2023, Stepfun has been dedicated to developing fundamental models. At WAIC, the company launched Step-2, a trillion-parameter LLM, along with the Step-1.5V multimodal model and the Step-1X image generation model.

Jiang also emphasized the importance of multimodality in creating a comprehensive AI. Multimodal models can process visual and other data types to develop internal representations of the external world. He explained that Stepfun aims to combine generative and comprehension abilities in a single model.

Stepfun also offers consumer-facing products, such as Yuewen, a ChatGPT-like personal assistant, and Maopaoya, an AI companion that can take on various character personalities.

The future of AI investment

โ€œLast year, global AI investments reached US$22.4 billion, with 70 to 80 percent going to companies developing large models,โ€ said Alex Zhou Zhifeng, managing partner at Qiming Venture Partners, at another WAIC side event. Qiming was an early investor in Stepfun.

Zhou noted that more investments in AI applications are expected soon, partly due to decreasing token costs. In AI, a token is a basic data unit processed by algorithms.

Peng Wensheng, an economist at China International Capital, added that Chinaโ€™s AI model market is projected to reach about 5.2 trillion yuan (US$715.1 billion) by 2030. The size of the size of the industrial AI market is expected to be around 9.4 trillion yuan.

This optimistic outlook suggests a bright future for AI development in China, driven by the potential of scaling laws and innovative models like those from Stepfun.

Hot this week

Apple TV+ is now available on Android

Apple TV+ is now available for Android users. It offers top shows and MLS streaming.

Hitachi Vantara and BMC join forces to enhance mainframe modernisation

Hitachi Vantara and BMC team up to enhance mainframe modernisation, reducing costs, improving security, and streamlining operations for hybrid cloud environments.

Apple Intelligence could come to Vision Pro in April

Apple could bring Apple Intelligence to Vision Pro in April, but a long-awaited Siri upgrade may face delays due to engineering issues.

Samsung may introduce a 6,000mAh battery in the Galaxy S26 series

Samsung is exploring silicon-carbon batteries for the Galaxy S26 series, potentially boosting capacity to 6,000mAh while addressing cycle life issues.

Commvault simplifies cloud security with CIS-hardened images for major cloud platforms

Commvault introduces CIS-hardened images for secure, simplified cloud deployments on major platforms, enhancing cyber resilience and regulatory compliance.