The Best Spotify Data Analysis Project You Need to Know

Today Data Analysis has become a major in businesses, research, metrological department and many other fields. The extracted information from the datasets helps make meaningful decisions, publish research papers, predict weather and many more. This Spotify Data Analysis Project video will teach you to perform exploratory data analysis using Python on music-related datasets. Spotify is the world's largest audio streaming platform with various features, including sharing songs freely and viewing the lyrics while playing the songs. You will learn to analyze, visualize and draw insights with Python libraries and functions.

Learn The Latest Trends in Data Analytics!

Post Graduate Program In Data AnalyticsExplore Program
Learn The Latest Trends in Data Analytics!

We will perform the Spotify Data Analysis using the Jupyter notebook. To perform data analysis, we need to download the Spotify dataset.

The datasets are downloaded from kaggle. You can visit the mentioned links and download your copies of the datasets.

After downloading the dataset, we will launch the Jupyter notebook and install the following libraries: pandas, numpy, matplotlib and seaborn.

Spotify_Data_Analysis_Project_1

  • Import the Following Libraries.

Spotify_Data_Analysis_Project_2

Now we will import the dataset as a csv file with the help of the read_csv function. I have stored the dataset in the Spotify datasets folder. Let's import and view the first five rows using the head() function.

Spotify_Data_Analysis_Project_3.

Here we have stored the dataset under a variable name df_tracks.

Output:

Spotify_Data_Analysis_Project_4.

When you download a dataset from an open repository, there are chances that the dataset would contain null values, so it's better to check them beforehand.

Learn The Latest Trends in Data Analytics!

Post Graduate Program In Data AnalyticsExplore Program
Learn The Latest Trends in Data Analytics!

  • Find Null Values Present in the Dataset.

We can check for the null values with the help of isnull() function present in the pandas library.

Spotify_Data_Analysis_Project_5

In this line of code, we have passed the dataframe name to the isnull() function and used the sum() function to calculate the total number of null value columns in the dataset.

Output:

Spotify_Data_Analysis_Project_6.

Here we can see all the columns in the dataset and we found out the song name column has 71 null values.

  • We Will Now Identify the Total Number of Rows and Columns in the Dataset and Check the Data Type and Memory Usage.

We will perform this action with the help of the info() method.

Spotify_Data_Analysis_Project_7.

Output:

Spotify_Data_Analysis_Project_8

Now let’s move ahead and perform our crucial analysis in this project.

  • Find Ten Least Popular Songs in the Spotify Dataset.

To get a list of least popular songs, we’ll sort the popularity column in ascending order using the sort_values() function.

Spotify_Data_Analysis_Project_9.

Output:

Spotify_Data_Analysis_Project_10

Your Data Analytics Career is Around The Corner!

Data Analyst Master’s ProgramExplore Program
Your Data Analytics Career is Around The Corner!

Descriptive Statistics

Let’s see some descriptive statistics for numerical variables present in our dataset.

We will use the describe() function and transpose() function 

Spotify_Data_Analysis_Project_11.

Output:

Spotify_Data_Analysis_Project_12

  • Top Ten Popular Songs With Popularity More Than 90.

Spotify_Data_Analysis_Project_13.

Output:

Spotify_Data_Analysis_Project_14

  • Make the Release Date Column as the Index Column.

We will perform this action with the help of the set_index function.

Spotify_Data_Analysis_Project_15

Output:

Spotify_Data_Analysis_Project_16

  • Find the Name of the Artist Present in the 18th Row of the Dataset.

We can  filter any specific information from the dataset with the help of the index location method that is iloc[].

Spotify_Data_Analysis_Project_17

Output:

Spotify_Data_Analysis_Project_18

Here we got the artist named Victor Boucher, who was present in the 18th row.

Start your Dream Career with the Best Resources!

Caltech Post Graduate Program in Data ScienceExplore Program
Start your Dream Career with the Best Resources!

  • Convert the Duration of the Songs From Milliseconds to Seconds.

We will convert the duration of the songs from milliseconds to seconds and verify it by printing the headings of the dataset to check whether the duration is converted into seconds.

Spotify_Data_Analysis_Project_19

Output:

Spotify_Data_Analysis_Project_20

  • Correlation Map

Now we will create our first visualization, a correlation map. First we will drop three unwanted keys, mode and explicit columns, and apply the pearson correlation method.

We will set the figure size for the correlation map to (14,6). We will use the heatmap() function to create our correlation map, plus we will set the annotation = True that will write the data value in each cell. We will set fmt=" .1g"; this is string formatting quotes used when adding annotations. Here cmap stands for the color map. You can google sns cmap and choose any color from the documentation if you wish.

Spotify_Data_Analysis_Project_21

Output:

Spotify_Data_Analysis_Project_22.

After running the piece of code, we got our correlation map. On the right side, you can see a scale ranging from -1 to +1. Here -1 denotes the variables that have the least or negative correlation, while the values above 0.0 denote the variables with a positive correlation. 

  • Let’s Move Ahead and Sample Only 4 Percent of the Whole Dataset.

Spotify_Data_Analysis_Project_23.

This line of code has provided us with 4 percent of the whole dataset that is 2346 rows. 

Output:

Spotify_Data_Analysis_Project_24.

Become a Certified Expert in AWS, Azure and GCP

Caltech Cloud Computing BootcampExplore Program
Become a Certified Expert in AWS, Azure and GCP

  • Create a Regression Plot Between Loudness and Energy. Let’s Plot It  in the Form of a Regression Line.

We will use the regplot() function present in the seaborn library to draw the regression plot.

Spotify_Data_Analysis_Project_25

Output:

Spotify_Data_Analysis_Project_26.

The result is plotted. There is a very high positive correlation between loudness and energy. You can also see that all the data points or the songs are in one direction. If the energy increases, the loudness of the song increases and similarly, if the song's loudness decreases, the energy of the track also decreases.

Similarly, we can plot another regression plot between popularity and acousticness.

  • Create a Regression Plot Between Popularity and Acousticness in the Form of a Regression Line.

Spotify_Data_Analysis_Project_27

Output:

Spotify_Data_Analysis_Project_28

Here, we can see the blue color regression line is in downward direction, which denotes if the acousticness of the song increases, the popularity decreases and similarly, if the popularity increases, the acousticness decreases.

Spotify_Data_Analysis_Project_29.

Now, we will use the seaborn library and the linepolt function.

  • Plot a Line Graph to Show the Duration of the Songs for Each Year.

30_DSP

Output:

Spotify_Data_Analysis_Project_31

We got the line plot. On the X-axis, we have the years and on the Y-axis, we have the duration. Here, we can see the songs from the 1920s to 1960s were of shorter duration. After 1960, the duration of the songs started increasing until 2010. From 2010 onwards, the duration again started declining. 

Learn The Latest Trends in Data Analytics!

Post Graduate Program In Data AnalyticsExplore Program
Learn The Latest Trends in Data Analytics!

Data Analysis Based on Genres of the Songs

Let’s now import the dataset using the pandas read_csv function. 

Spotify_Data_Analysis_Project_32

Output:

Spotify_Data_Analysis_Project_33

Here, we got our dataset.

  • Plot Duration of the Songs w.r.t. different Genres using a horizontal barplot.

Here we will use the barplot function present in the seaborn library.

Spotify_Data_Analysis_Project_34.

Output:

Spotify_Data_Analysis_Project_35.

Here, we got the Genres on Y-axis and Duration in milliseconds on the X-axis. We can analyze the data and find out that classical and world genres have longer duration of songs and children's music have shorter duration songs. 

  • Find top five genres by Popularity and pot a barplot for the same.

Spotify_Data_Analysis_Project_36

Output:

Spotify_Data_Analysis_Project_37

Here we got our top 5 genres based on the popularity that is Dance, Pop, Rap, Hip-Hop, Reggaeton. 

Learn over a dozen of data analytics tools and skills with Data Analytics Certification Program and gain access to masterclasses by Purdue faculty and IBM experts. Enroll and add a star to your data analytics resume now!

Conclusion

Today, businesses hire data analysts to analyze their collected data and use the extracted information to know more about their consumers. We can easily analyze the data and draw useful insights with various Python libraries and functions. 

From this article, we learned to analyze music data, created interesting visualizations, found correlations and extracted useful insights using the Spotify dataset. Check out Simplilearn's Data Analytics Certification Program in partnership with Purdue University and in collaboration with IBM. This program provides a hands-on approach with case studies and industry-aligned projects to bring the relevant concepts live. You will get broad exposure to key technologies and skills currently used in data analytics.

If you have any questions or inputs for our editorial team regarding this “The Best Spotify Data Analysis Project You Need to Know” article, do share them in the comments section below. Our team will review them and help solve them for you very soon!

Happy learning!

About the Author

Abhisar AhujaAbhisar Ahuja

Abhisar Ahuja is a computer science engineering graduate, he is well versed in multiple coding languages such as C/C++, Java, and Python.

View More
  • Disclaimer
  • PMP, PMI, PMBOK, CAPM, PgMP, PfMP, ACP, PBA, RMP, SP, OPM3 and the PMI ATP seal are the registered marks of the Project Management Institute, Inc.