A free, open-source web app that takes in lecture recordings as inputs and outputs their summaries. Simply drag and drop your audio file or find it from your computer, and your summary will generate in less than two minutes.
Our pipeline is in \model class sets
. We built it using natural language processing models, specifically the Silero speech-to-text model and the Pegasus abstractive summarization model, and added additional scripts to add punctionuation, enhance audio quality, and finetune our summarization model.
- Abstractive summarization (Attention is all you need!)
- The differences between Automatic Speech Recognition and Speech To Text models
- Creating machine learning pipelines and transforming them into products
- Currently, the actual conversion only works locally because we are looking to find an affordable hosting service
- Explore pricing plans + enterprise usage
- Adding a sentiment analysis feature to rate lecture quality in terms of engagement, tone, and impact
- Allowing users to create accounts to access previous lecture summaries in one place
- Building a dataset with inputted audio files, potentially separating it by professor