Skip to content

This project utilizes PySpark and spaCy for NLP to summarize educational video transcripts, assessed with ROUGE metrics. It features two models: one with Spark DataFrames and machine learning, and another with Spark RDDs. This approach enhances accessibility by quickly extracting essential information.

Notifications You must be signed in to change notification settings

Shriyaak/Bigdata_transcript_summarization

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 

About

This project utilizes PySpark and spaCy for NLP to summarize educational video transcripts, assessed with ROUGE metrics. It features two models: one with Spark DataFrames and machine learning, and another with Spark RDDs. This approach enhances accessibility by quickly extracting essential information.

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published