S+T+ARTS

STARTS is an initiative of the European Commission to foster alliances of technology and artistic practice. As part of this initiative, the STARTS residencies foster pioneering collaborations and the STARTS Prize honors the most inspired results in the field of creativity and innovation at the crossings of science and technology with the arts. STARTS is funded through various schemes provided by the European Commission.

S+T+ARTS Prize 2020

The Simulacro-centric World. Version 3.1. Touch / Version 4.1. Gravity

Elena Serebryakova, Galina Bleikh
Touch:
Our project creates the preconditions for a dialogue with an AI, which lacks the concept of tactile contact because of its digital nature. The Miki Simulacrum grasps the meaning of tactile contact, thereby comprehending the broader concept of individuality.
Its AI:
– interprets the unique pattern of the lines of the hand as an individual code (ID) containing information about the human being;
– identifies the web of lines belonging to the hand of the person who has touched the scanner (the tablet), and categorizes it as a network concept.
In this category, the universal triangulated web (mesh) of the 3-dimensional surface is interpreted by the simulacrum as a personal ID, which corresponds to the person's "individuality".

Gravity:
Through the presence of the spectators, our simulacrum learns to:
– recognize us as entities that are subject to the force of gravity:
– transform the processed information into "personal experience".
This results in the activation of a Generative-Adversarial Network (GAN), which enables the simulacrum to build new neural connections to recognize gravity. It interprets the weight of the human body as a force that causes a deformation along the vertical y-axis.
The unusual way in which the simulacrum "understands" and "interprets" the reality of our world – in this case, gravity – enables our consciousness to become connected to the artificial intelligence.
The installation comprises a series of video screens on which the simulacrum is in a state of uniform rotational-vibrational motion backed by the soundtrack.
On the floor before the screen, there is an electronic scale, which the visitors can step onto. A special sensor transmits the numerical value of his/her weight to a computer program. The interpretation of this information by the simulacrum is reflected in its "behavior": it reacts to the weight parameters, being deformed along the vertical y-axis. The degree of deformation depends on the individual weight parameters.