Extracting Relevant Information from Video Recordings - Investigate Phase

 Guiding Questions:



  1. Who is the target audience for this application?
  2. Are there any limitations or restrictions in terms of video format, length or language?
  3. What specific insights can the application extract from videos?
  4. Where can we find videos that will allow us to train our model?
  5. What technologies are used to transcribe audio from videos into text?


From where do we acquire data?



For this project, we decided to start off with Google Meet recordings for the various online courses held at Esprit, the majority being in French language. That is why we decided to partner up with Esprit as they will be providing us with the required resources and data in order to train this model and make this project come to life.

We will also be gathering various educational and business videos as data from different platforms, mainly Coursera and YouTube.

 


Model pipeline:

  1. Converting videos to audio data using MoviePy library
  2. Speech Recognition and transcription using the "SpeechRecognition" module which supports various recognition API's such as Google Speech.
  3. Sentiment Analysis.
  4. Keywords Extraction.
  5. Text Summarization using Google's Pegasus.
  6. Named-Entity Recognition using Spacy.
  7. Generating the full report after integrating all the previous functionalities.

Commentaires

Enregistrer un commentaire

Posts les plus consultés de ce blog

Extracting Relevant Information from Video Recording - Act Phase

Image
Solution Concept: Due to time constraints being a constant inconvenience besides internet accessibility issues, several students find themselves overwhelmed and unable to manage their tasks well and eventually messing up their work-life balance. That is why we opted for InfoMiner! InfoMiner is an   AI-powered video transcription and analysis service that can easily convert any lesson recording into accurate and searchable text, while generating a full report detailing key points such as a comprehensible summary, a question-answering panel as well as extracting main keywords and analyzing the speaker's sentiment.  Have we also mentioned that InfoMiner generates this whole report in mere seconds? Thus, making it a very useful tool for students to organize their time better, access information faster and easily creates detailed summaries that help them prepare for exams and retain information.    Video Transcription: As we previously mentioned, the video transcription process that we
Lire la suite

Extracting Relevant Information from Video Recordings - Engage Phase

Image
Introduction: As technology continues to advance, video content   has become an increasingly popular form of communication  and expression. From tutorials and presentations to  entertainment, advertisements and meetings, video is a  versatile medium that can convey a wealth of information and  emotions. However, extracting insights from video can be  challenging, especially if you have many videos to analyze and  you are a person who can’t focus during online sessions.  Fortunately, there is now a solution that can help you unlock  the full potential of your video content: an application that  automatically extracts insights from video. The application leverages NLP to analyze the audio and visual  elements of a video and identify patterns, trends, and key  insights. Whether you want to understand the sentiment of  your audience, track the performance of your marketing  campaigns, or analyze customer feedback, the application  provides you with a comprehensive and actionable overview o
Lire la suite