Multi Modal Sentiment Detection
- Videos are in video folder
- CLM2 contains face outline from CLM software
- Transcripts and time intervals for each video are in folder ‘transcriptions’
- Perl time.pl
- Extract start and end of time segments into folder ‘transcriptions3’
- Matlab –r readdata.m
- This will divide each video using segment information into folder ‘transcription2’
- Check the width and height of the video
- Matlab –r crop_jul14.m
- This will crop each video and save in folder ‘cnninput’
- There are 10 folders for 50 videos each
- Matlab –r resizeall.m will reduce the resolution and duplicate the time series video
- Matlab –r maketrain.m divide each of the 10 files into train, val and test
- We can change the test files here with new dataset.
- Python pack_Data_vid_cv.py will pack files for deep cnn
- Cnninput/pack_Data_foldb.py this will pack same validation and test data
- cnn/convolutional_mlp_amazon.py will run deep cnn on all 10 files
- perl cnn_features.pl convert output to text
- matlab –r format.m
- matlab –r moud_rnn.m
- Output for each file is in classfmea.txt and allfmea.txt