Skip to content

JenKlein/AWS_PySpark_Amazon_Vine_Analysis

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 

Repository files navigation

AWS_PySpark_Amazon_Vine_Analysis

Overview

The purpose of this project was to analyze the Amazon reviews written by members of the paid Amazon Vine program on Software products. The Amazon Vine program is a service that allows manufacturers and publishers to receive reviews for their products - in this project we're analyzing reviews on software products. The Software review data was extracted from AWS, transformed in Google Colab with PySpark and loaded in to pgAdmin.

Tools

  • PySpark
  • PostgreSQL
  • AWS
  • Google Colab

Results

Customers Table

Screen Shot 2021-06-19 at 1 35 56 PM

Products Table

Screen Shot 2021-06-19 at 1 35 46 PM

Review ID Table

Screen Shot 2021-06-19 at 1 35 37 PM

Vine Review Table

Screen Shot 2021-06-19 at 1 35 25 PM

Summary

Paid Reviews with 5 star ratings

Screen Shot 2021-06-20 at 9 18 17 PM

Unpaid Reviews with 5 star ratings

Screen Shot 2021-06-20 at 9 19 55 PM

Bias of Vine Reviews

In total, there were 248 vine (paid) reviews, and 17,514 non-vine (unpaid) reviews. Of these reviews, those that had 5-star ratings there were 102 (1.94%) vine reviews, and 5,154 (98.06%) non-vine reviews. Of all the total rating scores, those with 5-star paid ratings made up 0.6%, and those with 5-star unpaid ratings made up 29%.

With 98.06% of 5 star reviews from unpaid customers, this shows that there was no positivity bias in the 5 stars review. In other words, the fact that people were paid did not bias the reviews. The fact that the overwhelming majority of reviews came from unpaid customers demonstrates that people were so satisfied with their software products that they did not require payment to leave a 5 star review.

Since the 5star unpaid reviews made up 29% of all of the reviews, it would be interesting to perform the same percentage calculations for each star rating to see the distribution of the reviews.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published