Sculptor says he wants visitors to form their own relationships with art, without ‘anyone else interfering’