Marcello Vitali-Rosati est confériencier invité @ DHSI

Dans le cadre de l'école d'été de la Digital Humanities Summer Institute (DHSI), Marcello Vitali-Rosati donnera une conférence lundi le 2 juin de 9h00 à 10h30. La conférence aura lieu à l'Université de Montréal et sera disponible en ligne ultérieurement. 

A Formal Definition of Creativity: LLM, Softmax and Temperature

"Machines can’t be creative! They can’t create anything new!" This is an idea already mentioned by Turing in his 1950 article (Computer Machinery and intelligence, the "Ada Lovelace objection") and which recurs notably in the recent (2021) seminal article “On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?”. But what does "creative" mean? What if the question wasn’t whether or not a machine can be creative, but rather to give one or more formal and unambiguous definitions of creativity? In my presentation, I will analyze this hypothesis by focusing on the notion of temperature as implemented in the activation functions (softmax) of LLMs.