Instant & Impersonal Aesthetic Assessment Model for Photos with Faces
Built a deep Convolutional Neural Network (CNN) based model trained with human-labeled data that can score images reliably and with high correlation to human perception, reducing the labor-intensive photo review process, and increasing user experience by sorting the profiles in the order of the scores allotted to the caregiver’s profile pictures.
While the client has excellent data-driven insights that help families narrow their candidates based on factors such as pay rates, location, family makeup and needs, the photo review process for the profile pictures for all caregivers’ accounts was manual. The customer service executives would manually skim through all the profile pictures uploaded to accept or reject them. We sought to automate this process of scoring and tagging all the caregivers’ profile pictures, based on some of the universally accepted aesthetic norms by introducing a deep CNN model.
Aesthetic quality assessment of photos is a challenging task, especially when taking into account the complexity of various photos and the subjectivity of human’s aesthetic perception. To solve this, we introduced a deep CNN model which can encode information regarding standard image quality (technically), and facial attributes (aesthetically), and continue to train it to combine these two to explicitly predict the aesthetics of the profile pictures.