CG PROJECT AND Literature Study

As I delved further into the digital art world, I came across other talented artists, such as Hadi Karimi, Farzad Maleki, Alexander Beim, and Kris Costa. Farzad Maleki's work in particular impressed me. He creates intricately detailed digital sculptures based on classic paintings, such as a 3D version of Sebastiano Ricci's "Perseus Confronting Phineus with the Head of Medusa" and "The Battle of Anghiari, "inspired by Leonardo da Vinci's masterpiece. Hadi Karimi's digital portraits are incredibly lifelike, capturing the essence of historical figures with unparalleled realism. Additionally, Kris Costa's portraits, such as "Rick Baker" and "The African Warrior," captivated me with their "believable" realism, showcasing his mastery of intricate handcrafted details and deliberate artistic choices that infuse personality and vibrancy into each creation.

 To deepen my understanding of human essence and visual storytelling, I explored the works of traditional artists such as GMB Akash, a world-renowned photographer, Satyajit Ray, the legendary Bengali filmmaker, portrait artist Sahajahan Ahmed Bikash, watercolour artist Rajkumar Sthabathy, Liu Yunsheng, Leng Jun, oil painterFabiano Millaniand more. Their mastery in capturing human emotions and narratives has significantly influenced my approach to digital art, reinforcing the importance of blending traditional techniques with modern technology to create compelling and lifelike digital likenesses.

 They deeply inspired me to explore this new media to apply to my work. I understand that an artist's artwork can immortalize any person or time, and an artist can become immortal in people through their artwork, much like how we still remember Leonardo da Vinci or Michelangelo for their contributions to art

In my observation, only about 5-7% of CG artists can create lifelike 3D likenesses or digital avatars that genuinely capture character's emotions and fine photographic details. A genuine portrait does more than just provide a high-quality visual output; it brings out the subject's inner emotions and personality.

 Despite significant advancements in VR, AR, AI, 3D modelling, digital sculpting, 3D scanning, and numerous advanced software tools and graphic engines over the past decade, very few artists can produce super high-quality 3D likenesses. While AI and tools like MetaHuman in Unreal Engine 5 offer some automation, they still cannot match the ability of a traditional oil painter or sketch artist who can accurately recreate a person’s likeness based on a description alone. Many skilled 3D artists lack the traditional art skills and theoretical knowledge to create a true digital portrait, despite having the necessary tools at their disposal.

The purpose of my research is to explore the current pipelines and workflows used by top artists worldwide to create digital 3D likenesses. My goal is to develop a workflow that reduces technical complexity, enabling traditional fine artists to seamlessly translate their core artistic skills into the creation of digital 3D likenesses. This would create a bridge between traditional fine art skills and digital technology, facilitating smoother and more intuitive artistic expression in the digital realm.

 While other countries have undertaken projects involving digital 3D likenesses or human avatars, my country, Bangladesh, and the broader Indian subcontinent have yet no advancements in this field. My objective is to meticulously explore the workflow of digital 3D likeness creation and develop a more innovative and streamlined pipeline that can be applied across various projects.

 For instance, this technology can be harnessed to create 3D likenesses for emotional support, integrating them with interactive and immersive media such as VR, and reviving historical figures and celebrities. Furthermore, it can be utilized for educational content, enhancing virtual communication, next-generation games, interactive media, training, and recreating old master paintings and sculptures. By bridging traditional fine art skills with digital technology, we can unlock new possibilities for artistic expression and practical applications in numerous fields, including healthcare, entertainment, education, and marketing.

 This innovative approach allows for endless creative opportunities and fosters collaboration between artists and technologists. By revolutionizing how we interact with art and media, it blurs the lines between reality and virtual experiences. The potential for creativity and innovation in industries such as entertainment, education, and beyond is immense, offering new avenues for exploration and development.

For instance, this technology can be harnessed to create 3D likenesses for emotional support, integrating them with interactive and immersive media such as VR, and reviving historical figures and celebrities. Furthermore, it can be utilized for educational content, enhancing virtual communication, next-generation games, interactive media, training, and recreating old master paintings and sculptures. By bridging traditional fine art skills with digital technology, we can unlock new possibilities for artistic expression and practical applications in numerous fields, including healthcare, entertainment, education, and marketing.

 This innovative approach allows for endless creative opportunities and fosters collaboration between artists and technologists. By revolutionizing how we interact with art and media, it blurs the lines between reality and virtual experiences. The potential for creativity and innovation in industries such as entertainment, education, and beyond is immense, offering new avenues for exploration and development.

This disparity stems from technical and artistic challenges inherent in the process:

 The complexity of Human Anatomy and Expression: Crafting lifelike 3D likenesses demands a profound grasp of human anatomy, facial muscle structure, and subtle emotional nuances. Traditional artists, such as oil painters or sketch artists, undergo extensive training, enabling them to capture nuances often overlooked by CG artists.

 Advanced Texturing and Shading: High-fidelity 3D likenesses necessitate sophisticated texturing and shading techniques, accurately replicating skin, hair, and eyes. Tools like Substance Painter or Mari, paired with rendering engines like Arnold or V-Ray, achieve realistic lighting and shading.

 Limitations of Automation Tools: AI tools such as Unreal Engine 5's MetaHuman streamline digital avatar creation, yet lack customizable nuance for genuine likeness and emotional depth. Generic models necessitate extensive manual tweaking by skilled artists for realism.

 Incorporation of Traditional Art Skills: Several adept 3D artists lack fundamental traditional art skills essential for credible digital portraits. Techniques from traditional disciplines like drawing, painting, and sculpting provide insight into proportion, form, and lighting subtleties. Lacking these basics, even advanced digital tools may fail to capture lifelike results.

 Technical Expertise: Mastery of intricate 3D modelling and rendering software like ZBrush for sculpting, Maya for rigging and animation, and advanced renderers necessitates years of practice.

 Addressing these factors, few CG artists possess the comprehensive skills to craft 3D likenesses that capture both physical intricacies and emotional depth. My research aims to explore and overcome these challenges, developing workflows unifying traditional fine art with modern digital tools, and democratizing ultra-high 3D likenessstandards.

Some of my Portrait studies in traditional media

Case Studies 1: Einstein's Holographic Legacy: Bringing Nobel Laureates to Life

For the innovative "Heroes of Peace" exhibit at Swarovski Crystal Worlds, launched in November 2017, a groundbreaking holographic presentation showcases Nobel Peace Prize laureates, including luminaries such as Albert Einstein, Mahatma Gandhi, and MartinLuther King Jr. Central to this exhibit is the meticulously crafted 3D portrait of Albert Einstein, meticulously modelled and animated with cutting-edge technology. The creation process involved utilising industry-leading software such as Maya and ZBrush, with rendering achieved through Arnold. Einstein's iconic hair was meticulously groomed using Maya's interactive grooming tools, ensuring a lifelike representation. Notably, the model was entirely hand-sculpted, foregoing scans to ensure artistic precision, while textures were meticulously hand-painted in Substance Painter, enhancing the portrait's realism and detail. This project exemplifies the fusion of artistry and technology, pushing the boundaries of holographic display to present historical figures in an immersive and educational context. By enabling visitors to interact with Einstein and other laureates through holographic technology, the exhibit not only honours their contributions to peace but also transforms their legacies into captivating, interactive experiences for a contemporary audience.

Case Studies 2: Roald Amundsen: Artistic and Technical Mastery in Unreal Engine 5

In an ambitious fusion of artistry and cutting-edge technology, the project to digitally recreate Roald Amundsen as a 3D character in Unreal Engine 5 stands as a testament to both artistic vision and technical innovation.

 Artistically, the endeavour aims to capture the essence of Roald Amundsen's indomitable spirit and historical significance. Through meticulous digital sculpting and texturing processes, every detail of his appearance, from facial features to expedition gear, is faithfully recreated. Utilising advanced tools like Maya for modelling and ZBrush for intricate detailing, the character of Amundsen emerges as a lifelike representation that pays homage to his pioneering expeditions.

 Technically, Unreal Engine 5 provides the platform for bringing this digital double to life with unprecedented realism and interactivity. The engine's capabilities in rendering, lighting, and animation enable dynamic storytelling opportunities. Real-time rendering capabilities ensure that Amundsen's character can be experienced in high fidelity, whether in still images or dynamic animations depicting key moments from his expeditions.

 Moreover, the project leverages Unreal Engine 5's Digital Human technology to imbue Amundsen with nuanced facial expressions and realistic movements, enhancing the emotional resonance of his story. This technical prowess not only showcases the possibilities of virtual human creation but also underscores the project's commitment to pushing the boundaries of digital art and storytelling.

 Ultimately, the artistic and technical achievements of this project converge to offer a compelling portrayal of Roald Amundsen's legacy. By combining meticulous craftsmanship with state-of-the-art technology, the digital recreation of Amundsen serves as both a tribute to his pioneering spirit and a milestone in the advancement of digital humanities and interactive storytelling.

Case Studies 3: Hadi Karimi, Iran

Hadi Karimi is renowned in the realm of digital art for his extraordinary talent in crafting hyper-realistic portraits that transcend mere likeness, capturing the very essence and soul of his subjects. Through a meticulous approach to digital sculpting and texturing, combined with a profound understanding of anatomy and human expression, Karimi imbues his artworks with a lifelike quality that is both striking and emotive. Each piece by Karimi serves as a testament to his meticulous dedication to detail, where every pore, wrinkle, and expression is carefully crafted to achieve a level of realism that blurs the line between art and reality. Beyond celebrating the beauty of the human form, Karimi's works provoke introspection and emotional resonance, showcasing the transformative potential of digital art in exploring complex themes of identity, memory, and the human experience. His exceptional proficiency in digital sculpting and texturing techniques establishes him as a pivotal figure in contemporary digital art, with his portraits not only exemplifying technical mastery but also evoking profound historical and cultural narratives that contribute to the broader discourse on digital humanities.

Case Studies 4: The Most Famous Speech Never Given | Virtual Cinematography

This project aimed at urging 2024 U.S. Presidential Candidates and constituents to pass the Abolition Amendment, effectively ending slavery for all. Developed in collaboration with EP+Co and under the meticulous guidance of Harold Holzer from the Lincoln Forum, the project ensures historical accuracy in Lincoln's appearance and voice. Led by director RG Lacandola and with creative direction from Michael Guastaferro, Xavier Pérez played a pivotal role in Unreal Engine 5, overseeing cinematic lighting, look dev, cinematography, colour grading, film emulation, and post-production. This endeavour, crafted with a physically based lighting workflow and colour-graded in Davinci Resolve, represents a testament to blending historical authenticity with cutting-edge digital artistry.

Case Studies 5: Ian Spriggs' Kim Jung Gi Project: A Blend of Traditional Fine Art and 3D Likeness

In 2017, Ian Spriggs met the incredible artist Kim Jung Gi at the THU (Trojan Horse Was a Unicorn) event, forming a mutual admiration. Inspired by Kim's talent and kindness, Spriggs decided to create a portrait of him. In 2022, after getting encouragement from Andreand Chris, Spriggs asked Kim if he would be the subject of a portrait. Kim agreed with enthusiasm, and they quickly arranged a photo session. Tragically, shortly after returning home, Spriggs learned of Kim’s unexpected passing. Reflecting on Kim's pointing gesture in the photos, Spriggs realized it symbolized an invitation for all of us to believe in ourselves and pursue our potential. Determined to honour Kim’s legacy, Spriggs completed the portrait, which stands as a tribute to Kim Jung Gi's influence and an inspiring message to the art community. Spriggs' work, blending traditional fine art and advanced 3D techniques, underscores the power of portraiture to capture profound messages and immortalize influential figures.

Case Studies 5: Reviving and Preserving Artistic Legacies through AI

The integration of AI in art creation has sparked considerable interest and holds tremendous potential, as exemplified by two standout projects. The first, an AI-generated portrait of Salman Shah, an iconic figure in Bangladesh's film industry, showcases AI's capacity to empower artists and enrich visual storytelling. Despite his untimely demise in 1996, Salman Shah's enduring legacy continues to captivate the nation, with his passing remaining steeped in controversy. Razib Jahan Ferdous's skilful creation of the new AI-generated portrait of Salman Shah has garnered significant attention across Bangladesh, standing as a testament to AI's ability to revive artistic legacies and hinting at a future where technology breathes new life into the past.

Similarly, a pioneering project utilized AI to generate images of 19 Bangladeshi poets and 7 national heroes, revered as 'Bir Sreshtho' for their pivotal roles as freedom fighters. Faced with limited and ambiguous photographic references, the team employed AI, specifically leveraging the MidJourney tool, to enhance image quality through advanced manipulation and post-processing techniques. This meticulous process not only refined the images but also significantly improved their clarity and detail, offering a more accurate portrayal of these historical figures. By merging AI technology with artistic endeavours, the project effectively contributed to preserving and immortalizing the legacies of these eminent individuals for future generations. Integrating these AI-generated images into 3D likenesses with AR and VR technologies could enable immersive and interactive experiences, transforming traditional learning into dynamic, engaging encounters and revolutionizing the preservation and presentation of cultural heritage.

Case Studies 6: MetaHuman Animator Project ‘Blue Dot’

The MetaHuman Animator project represents a significant advancement in the realm of digital filmmaking, offering profound implications for the creation of hyper-realistic digital characters. This technology addresses the long-standing challenge of the uncanny valley by meticulously capturing and replicating minute facial details and expressions, as highlighted by actors such asRadivoje Bukvic. By integrating cinematic techniques from traditional film and enabling real-time adjustments through UnrealEngine, the project achieves a seamless blend of digital and conventional filmmaking practices. Furthermore, the focus on natural performance capture and eye movements not only enhances the emotional engagement of audiences but also democratises high-quality filmmaking, making it accessible to independent creators and smaller studios. This study underscores the potential of MetaHuman Animator to revolutionize both immersive storytelling in VR and AR environments and the broader digital medial landscape, promoting more authentic and emotionally resonant narratives. The project's innovative approach to facial performance capture and its applications across various media highlight its transformative impact on future digital content creation.

Methodology

My research integrates advanced 3D modelling, virtual reality (VR), and artificial intelligence (AI) technologies to create hyper-realistic 3D likenesses and immersive experiences, applicable to next-generation game art, development, and cinematic creation:

▪ High-resolution 3D Scanning and Photogrammetry: (Tools: High-resolution 3D scanners, photogrammetry software.)

Process: Capture detailed 3D models with precise geometry and texture for lifelike digital representations in VR and gaming.

▪ Advanced 3D Modeling, Digital Sculpting, and Texturing: (Tools: Maya, ZBrush, Substance Painter.)

Process: Utilize advanced digital sculpting and PBR texturing techniques to refine models, focusing on human anatomy, expressions, and realism in skin, hair, and clothing.

▪ AI-driven behavioural Modeling and Voice Simulation: (Tools: Machine learning algorithms, voice simulation software.)

Process: Develop AI models to simulate realistic behaviours and speech patterns, enhancing interactivity and emotional depth in digital avatars and NPCs.

▪ Integration of Haptic Feedback and Biofeedback Systems: (Tools: Advanced haptic devices, biofeedback sensors.)

Process: Incorporate haptic feedback for tactile sensations and biofeedback sensors to monitor emotional states. Dynamically adjust VR experiences to enhance immersion and therapeutic effects.

▪ Comprehensive Multisensory Integration: (Tools: Olfactory devices, thermal feedback systems, tactile actuators.)

Process: Enhance immersion with olfactory, thermal, and tactile feedback systems. Aim for deeper user interaction and engagement in virtual environments.

▪ Iterative Development and User Testing:

Process: Conduct iterative user testing to refine VR experiences based on feedback. Ensure emotional and narrative objectives are met, supporting continuous improvement and relevance.

▪ Digital Resurrection of Historical Figures and Celebrities:

Process: Use archival research and visual references to recreate accurate 3D likenesses with historical and cultural authenticity. Suitable for educational and immersive storytelling purposes.

▪ Recreation of Classic Artworks in 3D: (Tools: Maya, ZBrush, Substance Painter, Arnold.)

Process: Digitally recreate classic artworks to explore contemporary interpretations. Use sculpting, texturing, and rendering to bring traditional art into interactive digital formats.

▪ Integration with VR Platforms:(Tools: Unreal Engine, Unity.)

Process: Implement hyper-realistic 3D assets and interactive narratives in VR environments. Utilize VR's capabilities for emotional engagement and therapeutic benefits, particularly in contexts like grief and loss.

Application Across Domains

• Advancing Hyper-Realistic 3D Likeness Creation: exploring cutting-edge techniques such as 3D scanning, photogrammetry, and advanced digital sculpting to refine the realism of skin, hair, textures, and materials. This includes leveraging tools like Maya, ZBrush, Substance Painter, and Arnold, as well as integrating these models into interactive VR environments using Unreal Engine.

• Enhancing Emotional Engagement Through VR and AI: Developing AI-driven digital avatars with lifelike behaviours and speech patterns for therapeutic contexts like grief and loss. Incorporating technologies like machine learning, voice simulation, haptic feedback, and biofeedback sensors to create emotionally resonant and immersive VR experiences.

• Next-generation Game Art and Design: Investigating character design, motion capture, and advanced physics engines to develop more responsive and intuitive mechanics for fighting games. Exploring AR and VR to create dynamic, stylized game worlds that blend realism with experimental aesthetics.

• Cultural and Historical Preservation Through Digital Art: Digitally recreating classic masterpieces and exploring their integration into contemporary educational and cultural narratives. Contributing to the preservation of art and heritage through advanced digital techniques.

• Pushing the Boundaries of Immersive Storytelling: Bridging hyper-realistic modelling, VR, and AI to innovate in cinematic creation, emotional healing, and interactive media, with applications spanning entertainment, education, healthcare, and cultural preservation.