Fox sisters: Tale of the Nine Tails
Team Hongju Yang (Mind Computation Lab)
Advisor Professor Seung Wan Hong, Inha University
Funding details This project was supported by the National Research Foundation of Korea (NRF) grants funded by the Ministry of Education (Grant Number NRF- 2021R1A2C1004608).
While anthropomorphic animals from folklore are among the most popular creatures in fantasy movies, computer games, and extended reality, visualizations of their behavior rely mostly on animators’ imagination and the direct observation of real animals. The artist-driven creation describes emotional characteristics, but this method is limited in terms of discovering diverse unseen behaviors that lie beyond creators’ premade conception. To promote the verisimilitude of imaginary animals, the present study adopts a reinforcement learning (RL) agent simulation. This study investigates its effects on the autonomous behavioral generation and serendipitous responses of the nine-tailed Fox Sister, an anthropomorphic animal in Korean folklore. The developed agent is based on a physics-based controller with 43 skeletal joints.
To compute autonomous behavior transitions, we trained two different bipedal- and quadrupedal-walking actions to the fox-sister agent in one training sequence. Under the reward function, the given reward and penalty nudged the agent to decide the action depending on the contact of the body part with the physical environment. In several training steps, the Fox Sister agent also generates multiple unexpected behaviors, for instance, a forward roll during a quadrupedal walk responding to the given slopes. Additionally, the RL agent simulation enables the discovery of unknown functions of body components, for instance, using the nine tails to control body balancing in bipedal behaviors. This study addresses RL’s visualization of varying autonomous behaviors of imaginary folktale animals by simulating hypothetical relationships between body structures, motion generation, and environment. This RL simulation-driven character design can inspire creators' imagination and elevate emotional arousal among audiences.
Recreated digital model of the Fox Sister
This project takes inspiration from Gumiho, the mythical fox from 'The Tale of the Nine-Tailed,' a Korean folk tale, exploring how the behaviors of this anthropomorphic creature interact with people, evoking new and intriguing impressions.
Illustration ⓒ by Hongju Yang, 2020, Mind Computation Lab
Digital Model ⓒ by Hongju Yang, 2021, Mind Computation Lab
The physics-based model of the Fox Sister with 43 Skeletal Joints for Training
Reinforcement Learning Algorithm
Training Pipeline for Behavior Switch
Training Process
A hybrid action control is adopted to implement autonomous behavior transitions: The agent systemically selects bi- or quadrupedal actions based on the perceived environment and controls joint rotations and strength. Over 10 repeated measures, the RL Fox Sister generates behavioral transitions more frequently, including unexpected, divergent behaviors responding to training steps and environmental complexities such as level ground, slopes, and hurdles.
Training results 1 : behaviour transition
Training results 2 : unexpected behaviours
Rolling over after 4,499,973 training steps
Climbing an obstacle after 13,499,906 training steps
Epilog | This project is the long-standing legacy of our lab, starting in 2018. Let's meet the fox of the previous version!
Fox 2018
Fox 2023
Contact
Mind Computation Lab© Mind Computation Lab