Personal Coach App With AI

The movements’ analysis and comparison happen in the server and the processes video is then returned to the user with personalized recommendations.

Team

2 Front End Engineers
1 Backend Engineer
1 Machine Learning Engineer
1 QA Engineer
1 Project Manager

Timeline

7 months

Location

UAE, Dubai

Tech Stack

C++, Python, TensorFlow, TensorflowLite, React.js, React Native

Summary

There are thousands of people all over the world who wish to work out properly but simply don’t know how. They cannot afford a personal instructor or may not keep an eye on all the intricacies of performing an exercise. As a result, they do not achieve set goals and may even give up on sports due to the disappointing experience in the past.

With this in mind, our client got an idea of a unique solution – an AI-powered virtual assistant. He approached Celadon with this idea and we immediately thought we could develop an AI-powered mobile app. With the help of artificial intelligence, the app would closely monitor the user via the camera and would compare the movements of the user to the ones we would upload as references – the movements of professional athletes and gym coaches. 

In addition, the app would also be able to monitor user’s progress and tailor an individual workout program just for the user and for all those who wish to work out in a fun and efficient way.

Example: a lady performs a set of exercises aimed at abs. The app will display the match of the user with the instructor and provide useful recommendations on improvement.

 

Challenge

  • To create a custom dataset so that the app is able to monitor and record certain movements and compare them to the ones that are indicated as references
  • To develop an optimized architecture
  • To translate a 2D body point into a 3D one by a separate model
  • To compare the instructor’s video and the received data from the user’s device

Solution

By using a set of tools listed above, we built a platform that processes the video data of the exercises that are performed by an instructor and also translates the 2D body point functions into 3D. 

Our app features a catalog of exercise templates for the user and can capture the video of the user performing the movements. 

The movements’ analysis and comparison happen in the server and the processes video is then returned to the user with personalized recommendations.

Let's Talk

Enter name
Enter phone
Enter email
+
attach file
We use cookies to provide and improve our services. By using our site, you consent to cookies. Know More +