Projects
AI-driven Talking Avatar
Freelance Project
Dec 2024 - Now
Objective: Research and develop audio-driven photo-realistic face avatar animation with real-time rendering
Tools: PyTorch, AWS
Outcome: This is an ongoing project. We have obtained some results leveraging the neural rendering techniques and audio-to-motion algorithms.
Skills: Deep learning, Python programming, 3D Avatar, Gaussian Splatting
* No details can be provided due to NDA
ProbTalk3D: speech-driven 3D facial animation synthesis (generative AI)
Master Thesis Project
Sep 2023 - Jul 2024
Objective: Explore and evaluate non-deterministic deep learning methods like VAE, VQ-VAE, and diffusion models for audio-driven 3D facial animation synthesis.
Tools: PyTorch, PyTorch Lightning
Outcome: Our paper "ProbTalk3D" has been accepted for ACM MIG 2024 and will be published soon! The proposed models generate high-quality facial animations with emotional expressions, demonstrating superior performance compared to several recent methods.
Skills: Deep learning, Python programming, Audio/image processing, 3D animation
Top-down shooter game for player modeling
Course: AI for Game Technology
Sep 2023 - Oct 2023
Objective: Create a small game to collect player performance data and train a neural network for predicting game difficulty.
Contributions: Data processing, ML model development, sound design
Tools: TensorFlow, FL Studio
Outcome: Our team developed a game with 9 difficulty levels, collected player data (e.g., deaths, completion time), and trained a simple Multi-layer Perceptron (MLP) model for game difficulty prediction.
Skills: Machine learning, Python programming, Audio processing, Data processing
Wheel of Branding: Interactive game for kick-off meetings
Course: Small Project
May 2023 - Jun 2023
Objective: Develop an interactive game to enhance a marketing agency's client kick-off meetings.
Contributions: Game development
Tools: Unity, Canva, Adobe Illustrator
Outcome: The agency highly praised our final game for its ease of operation and alignment with its company vision.
Skills: Game development, C# programming
Insight Adventure: Interactive game for kick-off meetings
Course: Small Project
Apr 2023 - May 2023
Objective: Develop an interactive game to enhance a marketing agency's client kick-off meetings.
Contributions: Game development
Tools: Unity
Outcome: The agency appreciated the game’s creativity but wanted to simplify gameplay for more effective information gathering.
Skills: Game development, C# programming
Mocapphobia: 3D Animation Short Film
Course: Computer Animation
Apr 2023 - Jun 2023
Objective: Create a 3D animated short film using motion capture technology.
Contributions: Character design, animation post-processing
Tools: Vicon Shogun, Unreal Engine, Metahuman, ARKit
Outcome: We produced a short horror film inspired by "The Backrooms", which was praised for its realistic visuals and compelling storytelling.
Skills: 3D animation production
Voxel-based 3D reconstruction with OpenCV and CNN action recognition
Course: Computer Vision
Feb 2023 - Apr 2023
Objective: Acquire hands-on experience with voxel-based 3D reconstruction using OpenCV and action recognition using convolutional neural networks (CNNs).
Contributions: Program development
Tools: OpenCV, TensorFlow
Outcome: We achieved successful reconstruction of human positions from multiple camera perspectives and trained a CNN model that shows high precision in action recognition.
Skills: Python programming, Deep learning
* The code is private due to course requirements.
Donus & Sivion: Collaborative game for visually impaired players
Course: Sound and Music Technology
Nov 2022 - Jan 2023
Objective: Develop a game that enhances the experience for visually impaired players through effective sound design.
Contributions: Story design, scene construction, game development, sound design
Tools: Unity, FL Studio
Outcome: We developed a collaborative adventure game that encourages teamwork between visually impaired and sighted players. The game provides sound and visual guidance, promoting inclusivity within the gaming community. The name "Donus" is an anagram of "Sound", and "Sivion" is an anagram of "Vision".
Skills: Game design, Game development, C# programming, Audio processing
Purge: Game for crowd simulation
Course: Crowd Simulation
Nov 2022 - Jan 2023
Objective: Develop a game with a large number of NPCs, effectively using pathfinding algorithms.
Contributions: Character animation design
Tools: Godot, Adobe Photoshop
Outcome: We developed a zombie-hunting game where the player hunts NPCs. The NPCs are equipped with navigation and collision detection capabilities to simulate crowd behaviors.
Skills: Game design
Charity Project Display Platform: Website
Bachelor Thesis Project
Sep 2013 - Jul 2014
Objective: Design and build a website to facilitate participation in and oversight of charity projects.
Tools: C#
Outcome: Created a platform where users can donate and track the use of their funds, enhancing transparency in charity projects.
Skills: Web development, Website design, C# programming
