Deep Collaborative Model for Mix-Domain Applied to Photo-Sketch Synthesis
Abstract
The process of sketch synthesis from real face photos is of great importance in the area of face recognition and remains a challenging issue for law enforcement agencies. Due to the different characteristics between sketch and photo and limited training data, photo/sketch synthesis has become the topic of great concern for the research community. In addition, recent synthesis models are unable to generate a high-resolution realistic photo/sketch. To determine these issues, we propose a novel synthesis framework by employing the contrastive lost and generative loss in the form of collaborative loss. This collaborative loss discovers the coherent features between the photo and sketches and recovers the underlying structure which can be helpful to generate high-resolution photo-sketch synthesis. We learn a multi-domain mapping relationship from the sketch-photo mix domain by transferring high-level quality from insufficient phot-sketch training data. The resultant identity-preserved face sketches can be treated as hidden data which can be combined with insufficient original data to recover the deficiency or underlying structure. We perform the qualitative and quantitative experiments on the challenging publically available photo-sketch datasets and yield better performance compared to the existing state-of-the-art framework
Copyright (c) 2021 University of Sindh Journal of Information and Communication Technology
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
University of Sindh Journal of Information and Communication Technology (USJICT) follows an Open Access Policy under Attribution-NonCommercial CC-BY-NC license. Researchers can copy and redistribute the material in any medium or format, for any purpose. Authors can self-archive publisher's version of the accepted article in digital repositories and archives.
Upon acceptance, the author must transfer the copyright of this manuscript to the Journal for publication on paper, on data storage media and online with distribution rights to USJICT, University of sindh, Jamshoro, Pakistan. Kindly download the copyright for below and attach as a supplimentry file during article submission