Indeed, Musk suggested that synthetic data — data generated by AI models themselves — is the path forward. “The only way to supplement [real-world data] is with synthetic data, where the AI creates [training data],” he said. “With synthetic data … [AI] will sort of grade itself and go through this process of self-learning.”

Billionaire owner of X suggests shift to ‘synthetic’ data, though some warn of ‘model collapse’ - Anadolu Ajansı