How do I run this lip movement observation project?

  • Context: Python 
  • Thread starter Thread starter shivajikobardan
  • Start date Start date
  • Tags Tags
    Project
Click For Summary
SUMMARY

The discussion centers on running the Lip2Wav project, a tool for analyzing lip movements using Python. Users expressed confusion regarding the execution of the code, specifically referencing the unclear README.md documentation on GitHub. The project is intended for developers familiar with Python environments, as it involves preprocessing datasets, analyzing data, and training models through separate Python scripts. Participants recommend reviewing the README and consulting the original research paper for further clarification.

PREREQUISITES
  • Familiarity with Python programming and environments
  • Understanding of machine learning concepts and model training
  • Knowledge of dataset preprocessing techniques
  • Experience with GitHub repositories and README documentation
NEXT STEPS
  • Review the Lip2Wav README.md for detailed instructions on running the code
  • Study Python environment setup for machine learning projects
  • Learn about preprocessing datasets for model training
  • Read the original research paper associated with the Lip2Wav project for deeper insights
USEFUL FOR

Developers, data scientists, and researchers interested in lip movement analysis and machine learning model training will benefit from this discussion.

Technology news on Phys.org
jedishrfu said:
What wasnt clear?
IDK how to run this code? I mean where do I start?
 
shivajikobardan said:
IDK how to run this code? I mean where do I start?
Have you installed an environment that can run Python code?
 
  • Like
Likes   Reactions: sysprog and berkeman
scottdave said:
Have you installed an environment that can run Python code?
Indeed. OP, what is your knowledge level for software development environments? The code you have found is not really for the general public; it's meant for developers.
 
  • Like
Likes   Reactions: sysprog and berkeman
shivajikobardan said:
IDK how to run this code? I mean where do I start?
Your response. Reminds me of the Wizard in the Wizard of Oz movie when the balloon takes off without Dorothy.

I can't come back, I don't know how it works.

https://getyarn.io/yarn-clip/9c369b08-76b9-4eb8-b00e-432aa1a36977

What I meant was what step in the readme wasn't clear? This code isn't something run like a game or application, rather it's a collection of tools to pre process a dataset, to analyse the data, and then train a model.

Each task is a separate python script run as shown in the readme. Once the model is trained then you can write code to read in the model and use it to analyze some new video of someone talking.

I would get their paper and maybe even ask them about the steps they take and how they run their code beyond what is shown in the readme.
 
Last edited:
  • Like
Likes   Reactions: scottdave

Similar threads

MHB Running the Speaking by Observing Lip Movements Project
  • · Replies 6 ·
Replies
6
Views
1K
Python Why does my loop run slower with larger lists in Python?
  • · Replies 11 ·
Replies
11
Views
1K
Python Which project should I choose for a final year major project?
  • · Replies 10 ·
Replies
10
Views
2K
MHB Choosing a Project: My Criteria and Friends' Examples
  • · Replies 5 ·
Replies
5
Views
2K
Python I am trying to use alembic in python flask and it is not working
  • · Replies 13 ·
Replies
13
Views
5K
Python How do for loops work in python?
  • · Replies 5 ·
Replies
5
Views
2K
How do Jupyter notebook components work together?
  • · Replies 17 ·
Replies
17
Views
3K
Python Page not found 404 django-python
  • · Replies 4 ·
Replies
4
Views
5K
Python GTRPy - A python package for General Relativity Related Calculations
  • · Replies 7 ·
Replies
7
Views
4K
Python How Can I Combine Slicing and Reversing to Determine Palindromes in Python?
  • · Replies 55 ·
2
Replies
55
Views
7K