Jeong hyo Kim
Meta / facebook
AR Filters, Animoji, 360 Video Call Background, Photo Effects, Art Strategy
Role : Designer / 3D Artist
At Meta, formerly known as facebook, I Developed 100+ AR effects, 50+ 360 Backgrounds effects and various photo filters using 3D and 2D motion for facebook app and facebook messenger camera. Some of my design and production was loved by millions of users and ranked #1 in both Global and US for the longest time in facebook AR history. The tremendous success of my Halloween Effect led the whole messenger AR team to plan the seasonal production for Halloween every year, and was later featured in Adweek, one of the most famous magazines on Branding and Marketing. I was also selected to be TF for 360 background production during the Covid19 Era to provide immersive and video call experience .
As an Designer / 3D Artist for Facebook and Messenger AR Camera, Here are different types project and tasks I was in charge of
-
Original Design of the AR face effects for Camera and Video Call
-
Original Design of the 360 Background for Camera and Video Call
-
Graphic, Motion and 3D Production of AR filters, 360 Backgrounds and Photo Effect.
-
Research and Development for New Materials in Spark AR
-
Research and Development for New Trigger Interaction
-
Research and Development for Face Deformations based on the Asian Aesthetic
-
Design and Production of Seasonal Effects including Valentine's, Halloween, Thanksgiving, Christmas Etc.
-
Partnership Effects with Brands and Artists including Disney, NASA, NFL, BT21, TinyTans and Joshua Vides.
-
Vendor Outsourcing Directing and Management
-
Instructor & Speaker for official Spark AR education sessions (600+ listeners)
-
Advisor for the Messenger Character Emoticon Approvals
AR Face Filters
[ 2D Designs ]
[ Final Results out of the Designs ]
[ More AR Face Effects Gallery]
I made a lot of new attempts and experiments while making AR effects at Meta. Among them, the most innovative project was the production of Animoji that could express facial expressions with mechanical characters. Here is the brief introduction to this journey.
[ Mechanical Animoji Project Design Sheet ]
Mechanical Animoji Transition Test with 3D Rig
Face Expression Test with Face Rig and LED Motion
Halloween Projects
Our favorite season was Halloween. Every year for Halloween, all team members prepared various concepts and forms of AR effects. In fact, this Halloween project wasn't something that everyone was involved in from the beginning. It was only a 3 AR effects project launched by a small team, including myself, for Halloween 2018. It was a tremendous success, breaking all global records. Therefore, from 2019, the next year, it was changed into a 10 AR project with everyone in the org, and in 2020, it got developed into the team's main project that presents effects every week for entire October.
As mentioned, the three Halloween effects released in 2018 were very successful. Among them, the extraordinary one is this Long Haired Ghost. This is an effect that I conceived from a Asian ghost, and since I was testing the diverse and fresh camera interactionsat the time, this was released as the fir effect using zoom in interactio and jump scare. This was a great success, changing all the effect rankings of camera and video calls for more than six months. This is still the biggest success on Facebook Messenger's single effct ranking record. I also achieved two consecutive years of high performance on the Halloween project or 2019 and 2020 too.
LONG HAIRED GHOST EFFECT
CAMERA
-
1.42 M Sends (Ranked #1 - Global / US)
-
161,522 Day Posts (Ranked #1 - Global / US)
-
99th Percentile (3 months)
RTC (Video Call)
-
258M Seconds (Ranked #1 - Global / US)
-
758,944 effect captures (Ranked #1 - Global / US)
Messenger Official Promoting My 2020 Halloween Effect
ADWEEK introduced Messenger's Halloween AR Project
360 AR Background
During Covid19, the minutes of video calls increased dramatically, and Facebook was no exception. Thus, we set up a TF team to work on the background with body sengmentation. This is not just a fixed image background, but a background that returns to 360 degrees. It is such a new effect that there were no competitors then and now. As a lead 3D artist, I worked on all the 3D pipeline, directed studios, and tested various technologies with number of inhouse Tehcnical Artists. I received the highest in-house evaluation (Excceed Expectations) with the following review from director.
" This was really a superhuman feat- she created this highly polished CG background all by herself. It matches or exceedes the quality of similar backgrounds which were made by studios with entire CG pipelines "
[ Halloween Background 360 Original Render ]
[ Screencapture and Detailed Render of Halloween Background]
[ Vaporwave City Background 360 Render ]
[ Vaporwave City Background Screencaptures ]
[ More 360 Background Projects ]
Partnerships / Collaboration
As a large global company, Facebook collaborated with several companies for partnership effects. For these kind of projects, we made some AR effects and some 360 backgrounds. We also collaborated with famous artists like Joshua Vides to create a 360 backgrounds. For these collaborations, I participated as a designer or 3D artist , and in some cases as a 3D advisor.
[ Partnership brands that my team collaborated together]
[ Partnership AR / Background Effects ]
[ Artist Collaboration that my team worked on ]
Post Photo Effect
And I also introduce some of my non-AR camera projects. I worked as a designer and motion animator with photo effects that did not include face detection or body segmentations. Some of my work became long-loved evergreen photo effects.
[ Post Photo Effect Design Deck ]
[ Post Photo Effect Samples ]
