Skip to content

A full stack machine learning app that takes in lecture recordings as inputs and outputs their summaries.

Notifications You must be signed in to change notification settings

aditisandhu/simplify.ai

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

36 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

What is Simplify.AI?

A free, open-source web app that takes in lecture recordings as inputs and outputs their summaries. Simply drag and drop your audio file or find it from your computer, and your summary will generate in less than two minutes.

Screen Shot 2022-04-03 at 3 27 03 AM

How we built it

Our pipeline is in \model class sets. We built it using natural language processing models, specifically the Silero speech-to-text model and the Pegasus abstractive summarization model, and added additional scripts to add punctionuation, enhance audio quality, and finetune our summarization model.

original

What we learned

  • Abstractive summarization (Attention is all you need!)
  • The differences between Automatic Speech Recognition and Speech To Text models
  • Creating machine learning pipelines and transforming them into products

Notes

  • Currently, the actual conversion only works locally because we are looking to find an affordable hosting service

What's next

  • Explore pricing plans + enterprise usage
  • Adding a sentiment analysis feature to rate lecture quality in terms of engagement, tone, and impact
  • Allowing users to create accounts to access previous lecture summaries in one place
  • Building a dataset with inputted audio files, potentially separating it by professor

About

A full stack machine learning app that takes in lecture recordings as inputs and outputs their summaries.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 96.6%
  • Jupyter Notebook 1.4%
  • C 1.2%
  • Cython 0.4%
  • C++ 0.2%
  • JavaScript 0.1%
  • Other 0.1%