Monday, 17 February 2025
26.4 C
Singapore
21.8 C
Thailand
21.2 C
Indonesia
27.1 C
Philippines

OpenAI researcher resigns over safety concerns and criticises focus on ‘shiny products’

Jan Leike resigns from OpenAI, citing concerns that AI safety has been overshadowed by the development of consumer AI products.

Jan Leike, a leading researcher at OpenAI, has resigned, citing a shift in the company’s focus from safety to product development. His departure follows closely behind that of co-founder Ilya Sutskever, amidst growing concerns over the prioritisation of AI safety.

Leike’s resignation was highlighted by a series of posts on X (formerly Twitter), where he expressed concerns about OpenAI’s commitment to AI safety protocols. According to Leike, the organisation has increasingly favoured the development of consumer AI products like ChatGPT and DALL-E over the essential safety measures needed for advanced AI technologies. This shift comes after the disbandment of the Superalignment team, a group that Leike led, that was dedicated to addressing long-term AI risks.

The Superalignment Team and Its Disbandment

The Superalignment team was established in July to tackle “the core technical challenges” of AI safety as OpenAI ventured into developing AI capable of human-like reasoning. However, Wired reported that the team was disbanded, leading to further speculation about the company’s direction and safety commitments. OpenAI originally aimed to make their AI models publicly available, aligning with the organisation’s name and mission. However, these plans were altered, turning the models into proprietary knowledge due to concerns over potential misuse.

Leadership Changes and Future Directions

Following the departures of Leike and Sutskever, John Schulman, another co-founder, is set to take over Leike’s responsibilities. This change occurs in a tumultuous period for OpenAI, which also saw a notable failed attempt to oust CEO Sam Altman last year.

Leike’s decision to leave highlights a critical point of contention within OpenAI regarding its operational priorities. He emphasised the need for a serious approach to the implications of artificial general intelligence (AGI) to ensure it benefits all of humanity, a sentiment that he felt was being overshadowed by the pursuit of marketable products.

Hot this week

Apple Intelligence could come to Vision Pro in April

Apple could bring Apple Intelligence to Vision Pro in April, but a long-awaited Siri upgrade may face delays due to engineering issues.

Apple CEO Tim Cook hints at new product launch on February 19

Apple CEO Tim Cook teases a new product launch on February 19 with a cryptic post and video, sparking speculation about the next iPhone SE.

Sid Meier’s Civilization VII launches worldwide, bringing strategy gaming to new heights

Sid Meier’s Civilization VII launches globally on consoles and PC, promising an expansive strategy experience with new features and multiplayer options.

Powerbeats Pro 2 launched with heart rate monitoring, ANC, and improved fit

Apple launches Powerbeats Pro 2, which offers heart rate monitoring, ANC, improved fit, and up to 45 hours of battery life. It is available now for US$329.

Crystalline Resonance: Final Fantasy’s official piano concert returns to Singapore

Final Fantasy’s official piano concert, Crystalline Resonance, returns to Singapore on February 19. Don’t miss this magical night of live music!