notebooks/Music Dataset Preparation.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Music Data Preparation"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "import pandas as pd"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Since LastFM dataset is huge, firstly we clear this data. To do this, the procedure in [data-preprocessing.sh](../data-preprocessing.sh) should be followed. In this procedure, we simply remove the songs appeared less than 10 times and take unique songs. "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Below, songs from LastFM listening history and MSD genre dataset are loaded and merged. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(313324, 3)"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "last_fm_listening_hist = pd.read_csv('../data/lastfm-dataset-1K/lastfm_uniq_songs_ge9_wout_c_clean_wout_quotes.csv', sep=';')\n",
    "last_fm_listening_hist.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<bound method NDFrame.head of                       artist_name_lastfm  \\\n",
       "0                            ???? (????)   \n",
       "1                                    メリー   \n",
       "2                                    แดน   \n",
       "3                             ติ๊ก ชีโร่   \n",
       "4                             จ๊อบ บรรจบ   \n",
       "5                             ติ๊ก ชิโร่   \n",
       "6                             ติ๊ก ชีโร่   \n",
       "7                             ติ๊ก ชิโร่   \n",
       "8                            ไอซ์ ศรัณยู   \n",
       "9                                โฟร์-มด   \n",
       "10                               โฟร์-มด   \n",
       "11                                  그대지금   \n",
       "12                                 ไมโคร   \n",
       "13                                 Ｇｈｏｓｔ   \n",
       "14                                 ナイトメア   \n",
       "15                                 ดาจิม   \n",
       "16                                 スガシカオ   \n",
       "17                          เบิร์ด ธงไชย   \n",
       "18                          เบิร์ด ธงไชย   \n",
       "19                               ヤエル・ナイム   \n",
       "20                          マキシマム・ザ・ホルモン   \n",
       "21                       クリスタル・ケイ，ケミストリー   \n",
       "22      Ｙｏｕｒ　Ｓｏｎｇ　Ｉｓ　Ｇｏｏｄ，Ｂｅａｔ　Ｃｒｕｓａｄｅｒｓ   \n",
       "23                                   조영욱   \n",
       "24                                   メリー   \n",
       "25                                   ムック   \n",
       "26                                コタニキンヤ   \n",
       "27                                 スガシカオ   \n",
       "28                                 スガシカオ   \n",
       "29                                 スガシカオ   \n",
       "...                                  ...   \n",
       "313294                              2562   \n",
       "313295                              2562   \n",
       "313296                              2562   \n",
       "313297                              2562   \n",
       "313298                              2562   \n",
       "313299                              3582   \n",
       "313300                        5000 Volts   \n",
       "313301              5150 Mentally Insane   \n",
       "313302                              5566   \n",
       "313303                             12012   \n",
       "313304                             12012   \n",
       "313305                             12012   \n",
       "313306                             12012   \n",
       "313307                             12012   \n",
       "313308                             12012   \n",
       "313309                             12012   \n",
       "313310                             12012   \n",
       "313311                             12012   \n",
       "313312                             12012   \n",
       "313313                            129.01   \n",
       "313314                             35007   \n",
       "313315                        37500 Yens   \n",
       "313316                        37500 Yens   \n",
       "313317                        37500 Yens   \n",
       "313318                        37500 Yens   \n",
       "313319                        37500 Yens   \n",
       "313320                        37500 Yens   \n",
       "313321                        37500 Yens   \n",
       "313322                        37500 Yens   \n",
       "313323                            188910   \n",
       "\n",
       "                                      tra_id  \\\n",
       "0                                        NaN   \n",
       "1                                        NaN   \n",
       "2                                        NaN   \n",
       "3                                        NaN   \n",
       "4                                        NaN   \n",
       "5                                        NaN   \n",
       "6                                        NaN   \n",
       "7                                        NaN   \n",
       "8                                        NaN   \n",
       "9                                        NaN   \n",
       "10                                       NaN   \n",
       "11                                       NaN   \n",
       "12                                       NaN   \n",
       "13                                       NaN   \n",
       "14                                       NaN   \n",
       "15                                       NaN   \n",
       "16                                       NaN   \n",
       "17                                       NaN   \n",
       "18                                       NaN   \n",
       "19                                       NaN   \n",
       "20                                       NaN   \n",
       "21                                       NaN   \n",
       "22                                       NaN   \n",
       "23      0097631d-b35c-4831-b7b3-0583faa5b9da   \n",
       "24      00c84c05-79e2-439d-b3d7-480961431a3b   \n",
       "25      00dc6b69-77a3-4974-9d2b-a0ef978f0ef1   \n",
       "26      011d18d5-b476-4437-b325-cf54a31a6888   \n",
       "27      01a99015-41f2-4534-820d-74ff730f105e   \n",
       "28      020ef875-8ae4-4fd4-80f1-ae1f64d63462   \n",
       "29      028302b9-6d64-423c-9528-87d3319a7dab   \n",
       "...                                      ...   \n",
       "313294  8c8b1875-8aab-495a-bdfa-5026c74e1404   \n",
       "313295  a5970764-dcec-486b-a219-30d6a7f7e732   \n",
       "313296  b34b70c0-d204-4879-9c8e-4df497a753d1   \n",
       "313297  ba3494f3-c843-4d0c-ae43-23b2cc7e9a45   \n",
       "313298  c795bce7-e195-4c3f-bcf2-26d529b8456e   \n",
       "313299                                   NaN   \n",
       "313300  113bb21e-df0c-4e97-86cb-d7ffed62f35f   \n",
       "313301                                   NaN   \n",
       "313302                                   NaN   \n",
       "313303  08fcced5-be8c-4e16-a3b8-a1578aaf6a8f   \n",
       "313304  1339e1c3-57f9-43cb-a3db-0f3d6aadc2be   \n",
       "313305  242cf0bd-7d28-4c4d-8a50-2fee2003b01f   \n",
       "313306  3a8e6bfa-349a-4bd6-ad49-2918f06ef23e   \n",
       "313307  3f767487-85da-422f-b779-ad65cd656cdc   \n",
       "313308  47130735-52d1-4533-b82e-d8e7f60827ca   \n",
       "313309  95eacdec-7fe2-4e76-80cb-cd48775d6e2c   \n",
       "313310  a726b24f-3daa-4968-ac9d-4b5b7ce67001   \n",
       "313311  cf6022c8-6614-4153-b007-6f8bedda2a72   \n",
       "313312  e9fe6087-02b8-4c36-b01e-186934214c38   \n",
       "313313                                   NaN   \n",
       "313314  879a7421-3e5c-4afb-b13a-ef14811c397b   \n",
       "313315  2ae416a3-53ef-4235-9a6f-647d747a11fa   \n",
       "313316  355b42f7-1c84-45f4-ac7b-61b0d244b516   \n",
       "313317  67e39a54-1524-43f9-ba23-2c27ef4f6850   \n",
       "313318  9f752c61-afd8-483c-a11a-226c80610123   \n",
       "313319  a0a5c4d7-ce6d-4503-8c93-1ec7df5661f7   \n",
       "313320  a563cc15-aebe-48f0-bef6-b6097ceeacc6   \n",
       "313321  b20106c7-5c2f-4af0-bc0b-23e5e1c6f01d   \n",
       "313322  dc7115da-075b-44e8-bb5e-056593fd7d58   \n",
       "313323                                   NaN   \n",
       "\n",
       "                                          title_lastfm  \n",
       "0                                           ??????·???  \n",
       "1                                              -------  \n",
       "2                              แช่แวบ (ไม่อยากเป็นพระ)  \n",
       "3                                                 ไชโย  \n",
       "4                                              ดูเธอทำ  \n",
       "5                                           ตั๊ดสู้ฟุด  \n",
       "6                                        มนุษย์ค้างคาว  \n",
       "7                                 รักไม่ยอมเปลี่ยนแปลง  \n",
       "8                                 เพื่อนสนิทคิดไม่ซื่อ  \n",
       "9                                                ละลาย  \n",
       "10                                         เด็กมีปัญหา  \n",
       "11                                                 임정희  \n",
       "12                                               ไว้ใจ  \n",
       "13                                              ラブロマンス  \n",
       "14                                             Ｌｉｖｅｖｉｌ  \n",
       "15                                          พยัญชนะไทย  \n",
       "16                                    バクダン・ジュース（オリジナル）  \n",
       "17                                                ก็ดี  \n",
       "18                                        เถียงกันทำไม  \n",
       "19                                               ピクニック  \n",
       "20            チューチュー　ラブリー　ムニムニ　ムラムラ　プリンプリン　ボロンヌルル　レロレロ  \n",
       "21                       Ｔｗｏ　Ａｓ　Ｏｎｅ（Ｔｏｙｏｔａ「Ｗｉｓｈ」Ｃｍソング）  \n",
       "22                                         Ｆｏｏｌ　Ｇｒｏｏｖｅ  \n",
       "23                                     Praying Geum-Ja  \n",
       "24                           Bara To Katasumi No Blues  \n",
       "25                                        Hakanakutomo  \n",
       "26                                    In The Moonlight  \n",
       "27                                              夜空ノムコウ  \n",
       "28                                 Hajimete No Kimochi  \n",
       "29                                               正義の味方  \n",
       "...                                                ...  \n",
       "313294                                       Greyscale  \n",
       "313295                                        Kameleon  \n",
       "313296                                       The Times  \n",
       "313297                                        Moog Dub  \n",
       "313298                                           Redux  \n",
       "313299                   The Collective (Instrumental)  \n",
       "313300                                     I'M On Fire  \n",
       "313301                                     Click Click  \n",
       "313302                                          Injury  \n",
       "313303                                    With Shallow  \n",
       "313304                                            Burn  \n",
       "313305                            Aren'T You Dead Yet?  \n",
       "313306                                     Cheeky Doll  \n",
       "313307                                          Hermit  \n",
       "313308                                  Icy～Cold City～  \n",
       "313309                                      Melancholy  \n",
       "313310                                           Venom  \n",
       "313311                                   Wriggle Girls  \n",
       "313312                                   My Room Agony  \n",
       "313313  What You Waiting For Jacques Lu Cont'S Twd Mix  \n",
       "313314                                         Tsunami  \n",
       "313315                                  Canard Boiteux  \n",
       "313316                                     Intérieur 2  \n",
       "313317                                     Microphonie  \n",
       "313318                                           37501  \n",
       "313319                          The Sullivan'S Quartet  \n",
       "313320                                       Chapitres  \n",
       "313321                                     Intérieur 1  \n",
       "313322                                          Astero  \n",
       "313323                                          Mexica  \n",
       "\n",
       "[313324 rows x 3 columns]>"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "last_fm_listening_hist.columns = ['artist_name_lastfm', 'tra_id', 'title_lastfm']\n",
    "last_fm_listening_hist.head"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(59600, 34)"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "msd_genre = pd.read_csv('../data/msd_genre_dataset.csv')\n",
    "msd_genre.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<bound method NDFrame.head of                       genre            track_id              artist_name  \\\n",
       "0      classic pop and rock  TRFCOOU128F427AEC0         Blue Oyster Cult   \n",
       "1      classic pop and rock  TRNJTPB128F427AE9F         Blue Oyster Cult   \n",
       "2      classic pop and rock  TRLFJHA128F427AEEA         Blue Oyster Cult   \n",
       "3      classic pop and rock  TRCQZAG128F427DB97         Blue Oyster Cult   \n",
       "4      classic pop and rock  TRNXMNM128F427DB8C         Blue Oyster Cult   \n",
       "5      classic pop and rock  TRSIZRN128F427DB95         Blue Oyster Cult   \n",
       "6      classic pop and rock  TRDYTEO128F427DB90         Blue Oyster Cult   \n",
       "7      classic pop and rock  TRKSICM128F427DB8B         Blue Oyster Cult   \n",
       "8      classic pop and rock  TRCJRAM128F934658C         Blue Oyster Cult   \n",
       "9      classic pop and rock  TRIERYM128F934657C         Blue Oyster Cult   \n",
       "10     classic pop and rock  TRUMVIV128F934656F         Blue Oyster Cult   \n",
       "11     classic pop and rock  TRZXOTE128F933D967         Blue Oyster Cult   \n",
       "12     classic pop and rock  TRDEAWL128F933D96A         Blue Oyster Cult   \n",
       "13     classic pop and rock  TROHTCX128F933D965         Blue Oyster Cult   \n",
       "14     classic pop and rock  TRCTYAJ128F4266A8C         Blue Oyster Cult   \n",
       "15     classic pop and rock  TRJPXIV128F426697A         Blue Oyster Cult   \n",
       "16     classic pop and rock  TRXWSIN128F4265A40         Blue Oyster Cult   \n",
       "17     classic pop and rock  TRYWZCP128F4266CB7         Blue Oyster Cult   \n",
       "18     classic pop and rock  TRFBLMY128F426BEC9         Blue Oyster Cult   \n",
       "19     classic pop and rock  TRNVQPE128F426BBD2         Blue Oyster Cult   \n",
       "20     classic pop and rock  TRUUZXH128F426C1AD         Blue Oyster Cult   \n",
       "21     classic pop and rock  TRXQAEJ128F426C456         Blue Oyster Cult   \n",
       "22     classic pop and rock  TRYDTUP128F426BEC7         Blue Oyster Cult   \n",
       "23     classic pop and rock  TRFSSVS128F425B088         Blue Oyster Cult   \n",
       "24     classic pop and rock  TRWUBTF128F4278A66         Blue Oyster Cult   \n",
       "25     classic pop and rock  TRUEWMN128F4278A73         Blue Oyster Cult   \n",
       "26     classic pop and rock  TREFQBK128F4278A87         Blue Oyster Cult   \n",
       "27     classic pop and rock  TRJBEOE128F4278A64         Blue Oyster Cult   \n",
       "28     classic pop and rock  TRNJREN128F4267C9B         Blue Oyster Cult   \n",
       "29     classic pop and rock  TRJWTEZ128F4267D7E         Blue Oyster Cult   \n",
       "...                     ...                 ...                      ...   \n",
       "59570       soul and reggae  TRWSAEI12903CD9976                   Erikah   \n",
       "59571       soul and reggae  TRXQTYH128F427B166              Erykah Badu   \n",
       "59572       soul and reggae  TRGEOYT128F14AEB52              Erykah Badu   \n",
       "59573       soul and reggae  TRBQGVB128E078DF1C              Erykah Badu   \n",
       "59574       soul and reggae  TRBLOWV128E078DF24              Erykah Badu   \n",
       "59575       soul and reggae  TRFEFWB128E078DF21              Erykah Badu   \n",
       "59576       soul and reggae  TRJEXAE128E078DF1F              Erykah Badu   \n",
       "59577       soul and reggae  TRVERRQ128E078DF20              Erykah Badu   \n",
       "59578       soul and reggae  TRDTXNP128E078DF1E              Erykah Badu   \n",
       "59579       soul and reggae  TROMOTR128E078DF27              Erykah Badu   \n",
       "59580       soul and reggae  TRGOOOR128E078F970              Erykah Badu   \n",
       "59581       soul and reggae  TRBJQDI128E078F973              Erykah Badu   \n",
       "59582       soul and reggae  TRLILQK128E078F96D              Erykah Badu   \n",
       "59583       soul and reggae  TRSONAO128E078F976              Erykah Badu   \n",
       "59584       soul and reggae  TRRMGWC128F426733E              Erykah Badu   \n",
       "59585       soul and reggae  TRLBEFW128F427AB17              Erykah Badu   \n",
       "59586       soul and reggae  TRVNBVJ128F4267338              Erykah Badu   \n",
       "59587       soul and reggae  TROQTGM128F426733C              Erykah Badu   \n",
       "59588       soul and reggae  TROQETL128F4267337              Erykah Badu   \n",
       "59589       soul and reggae  TROVPQL128F4267331              Erykah Badu   \n",
       "59590       soul and reggae  TRGRYLK12903CE5D90              Erykah Badu   \n",
       "59591       soul and reggae  TRTTLJN12903CE5D98              Erykah Badu   \n",
       "59592       soul and reggae  TRDWQMR12903CE5D95              Erykah Badu   \n",
       "59593       soul and reggae  TROIRNZ12903CE5D91              Erykah Badu   \n",
       "59594       soul and reggae  TRWRJHE128F424D865              Erykah Badu   \n",
       "59595       soul and reggae  TRGYRMA128E078FC55              Erykah Badu   \n",
       "59596       soul and reggae  TRZZFQW128E078FC5A              Erykah Badu   \n",
       "59597       soul and reggae  TRAMYBB128F424D86D              Erykah Badu   \n",
       "59598       soul and reggae  TRABWFM128F424D86A  Erykah Badu / Dead Prez   \n",
       "59599       soul and reggae  TREBGAA128E078FC52              Erykah Badu   \n",
       "\n",
       "                                         title  loudness    tempo  \\\n",
       "0                              Mes Dames Sarat    -8.697  155.007   \n",
       "1                                      Screams   -10.659  148.462   \n",
       "2                         Dance The Night Away   -13.494  112.909   \n",
       "3                                Debbie Denise   -12.786  117.429   \n",
       "4                      (Don't Fear) The Reaper   -14.093  141.536   \n",
       "5                                Morning Final   -11.952  100.901   \n",
       "6                   The Revenge Of Vera Gemini   -11.839  132.361   \n",
       "7                             True Confessions   -13.760  121.001   \n",
       "8                    Out Of Stadion - Original   -18.054   70.724   \n",
       "9                      Ginger Snaps - Original   -20.142  142.760   \n",
       "10                     Demon's Kiss - Original    -9.619  138.290   \n",
       "11                       Remodeling - Original   -27.067  209.724   \n",
       "12               Spray That Scumbag - Original   -12.932  170.616   \n",
       "13                          Shadows - Original   -14.695    0.000   \n",
       "14                                     Screams   -10.648  148.764   \n",
       "15                                    Redeemed   -10.799  185.836   \n",
       "16                  Workshop Of The Telescopes   -11.413  120.171   \n",
       "17                           What Is Quicksand   -10.088   83.556   \n",
       "18                  Dominenance And Submission    -9.706  156.116   \n",
       "19                                    Godzilla   -12.083   88.548   \n",
       "20     E.T.I. (Extra Terrestrial Intelligence)    -7.264   97.298   \n",
       "21                       Don't Fear The Reaper    -8.829  149.121   \n",
       "22                                      Me 262    -5.589  163.069   \n",
       "23                            I Love The Night   -11.189  134.819   \n",
       "24                         The Red & The Black    -6.562  143.169   \n",
       "25                            I Love The Night   -11.675  134.837   \n",
       "26                               Joan Crawford    -8.498  129.014   \n",
       "27          Cities On Flame With Rock And Roll    -7.440  175.601   \n",
       "28                     (Don't Fear) The Reaper    -7.406  148.438   \n",
       "29                                   Dr. Music    -7.934  143.228   \n",
       "...                                        ...       ...      ...   \n",
       "59570                                Game Over    -6.924  240.368   \n",
       "59571                                    Honey    -7.903  140.055   \n",
       "59572                Next Lifetime (Interlude)   -15.444   39.300   \n",
       "59573                          Rimshot (Intro)    -8.712  138.334   \n",
       "59574                                Certainly    -8.848  159.715   \n",
       "59575                                    Ye Yo    -9.760  108.247   \n",
       "59576                                  Reprise   -16.202  165.054   \n",
       "59577                               Apple Tree   -10.893  100.206   \n",
       "59578                                  On & On    -8.537  153.644   \n",
       "59579                            Next Lifetime   -10.099   73.384   \n",
       "59580                                A.D. 2000   -12.117  136.330   \n",
       "59581                                 Bag Lady   -10.167  151.059   \n",
       "59582                                Hey Sugah   -13.869   63.805   \n",
       "59583                                 Bag Lady    -8.445  112.459   \n",
       "59584                                That Hump    -7.476  143.590   \n",
       "59585                                       Me    -9.568  190.241   \n",
       "59586                                  Twinkle    -9.115  123.739   \n",
       "59587                           Master Teacher    -8.008   67.924   \n",
       "59588                                 The Cell    -6.245  106.960   \n",
       "59589                                My People   -10.554  135.004   \n",
       "59590                             20 Feet Tall   -13.278   98.959   \n",
       "59591              Fall In Love (your funeral)    -8.052   91.836   \n",
       "59592                                  Umm Hmm    -7.960  111.986   \n",
       "59593                              Window Seat    -7.305  163.667   \n",
       "59594                          Back In The Day    -8.656   91.837   \n",
       "59595                                   Danger   -10.162   88.951   \n",
       "59596                                Hollywood    -5.466  130.615   \n",
       "59597                              Think Twice    -9.494   88.976   \n",
       "59598                                The Grind    -7.617   67.929   \n",
       "59599                               I Want You   -11.774   85.176   \n",
       "\n",
       "       time_signature  key  mode   duration      ...       var_timbre3  \\\n",
       "0                   1    9     1  246.33424      ...       1255.514569   \n",
       "1                   1    4     0  189.80526      ...       2007.653070   \n",
       "2                   1   10     0  158.19710      ...       1204.856777   \n",
       "3                   4    7     1  250.22649      ...        809.755802   \n",
       "4                   4    9     0  307.06893      ...       1093.684935   \n",
       "5                   1    0     1  254.17098      ...       1359.192352   \n",
       "6                   4    2     1  230.32118      ...       1091.707547   \n",
       "7                   4   10     1  177.55383      ...       1318.647325   \n",
       "8                   4   11     1   81.24036      ...        438.026413   \n",
       "9                   3   11     0   94.24934      ...       1154.653664   \n",
       "10                  4    4     0  232.75057      ...        979.351520   \n",
       "11                  4    2     1  133.51138      ...       1508.235294   \n",
       "12                  4    7     1  103.75791      ...       1921.065593   \n",
       "13                  0    5     0   24.99873      ...       1334.549848   \n",
       "14                  1    4     0  189.80526      ...       2009.330101   \n",
       "15                  4    2     1  231.39220      ...       1339.173843   \n",
       "16                  4    9     1  241.16200      ...       5643.754099   \n",
       "17                  4   11     0  220.26404      ...       2649.501054   \n",
       "18                  4   11     0  349.23057      ...        765.951410   \n",
       "19                  4    6     0  469.89016      ...       3011.904008   \n",
       "20                  4    9     1  226.03710      ...       1370.161001   \n",
       "21                  4   11     0  364.61669      ...       1394.512420   \n",
       "22                  4    2     1  488.69832      ...       1339.985138   \n",
       "23                  4    0     1  269.29587      ...       1484.381952   \n",
       "24                  1    7     1  268.69506      ...       1834.139541   \n",
       "25                  4    0     1  267.49342      ...       1467.427402   \n",
       "26                  1   11     0  295.23546      ...       1606.079058   \n",
       "27                  4    1     0  244.45342      ...       1688.157374   \n",
       "28                  4   11     0  402.49424      ...       1298.154169   \n",
       "29                  1    4     0  219.79383      ...       1019.980355   \n",
       "...               ...  ...   ...        ...      ...               ...   \n",
       "59570               7    6     0  372.87138      ...       3382.804475   \n",
       "59571               4   11     0  260.17914      ...       2982.926268   \n",
       "59572               4    1     0   90.30485      ...       6609.531167   \n",
       "59573               4    2     0  230.19057      ...       6072.794225   \n",
       "59574               5    8     1  418.11546      ...       4588.779010   \n",
       "59575               4    1     1  299.07546      ...       5005.267821   \n",
       "59576               4    2     1  135.36608      ...       3453.187961   \n",
       "59577               4   11     0  244.94975      ...       5183.800088   \n",
       "59578               4    2     1  330.47465      ...       3909.421356   \n",
       "59579               4    1     1  724.94975      ...       4931.188371   \n",
       "59580               4    2     1  291.68281      ...       1934.853590   \n",
       "59581               5    5     0  347.37587      ...       4161.853961   \n",
       "59582               3    8     1   51.43465      ...       2297.364678   \n",
       "59583               5    1     1  248.86812      ...       5232.507373   \n",
       "59584               4    1     1  324.64934      ...       3040.714327   \n",
       "59585               7   11     0  336.45669      ...       8756.279586   \n",
       "59586               5    4     0  416.75710      ...       2642.528941   \n",
       "59587               4    1     0  407.77098      ...       5004.673199   \n",
       "59588               7    7     0  260.88444      ...       1678.530467   \n",
       "59589               1    7     1  204.95628      ...       4283.042824   \n",
       "59590               1    9     1  204.59057      ...       5086.812554   \n",
       "59591               4   11     1  366.65424      ...       3259.714603   \n",
       "59592               5    8     0  225.90649      ...       3798.763731   \n",
       "59593               4    0     0  289.69751      ...       2949.900859   \n",
       "59594               3    5     0  286.90240      ...       2958.079368   \n",
       "59595               4   11     1  348.96934      ...       4339.425990   \n",
       "59596               3    9     1  332.32934      ...       3759.486850   \n",
       "59597               4    3     1  182.04689      ...       4288.018243   \n",
       "59598               3    0     1  169.42975      ...       2846.537149   \n",
       "59599               3    7     1  653.13914      ...       4674.278795   \n",
       "\n",
       "       var_timbre4  var_timbre5  var_timbre6  var_timbre7  var_timbre8  \\\n",
       "0       580.030472   598.485223   575.337671   322.068603   321.726029   \n",
       "1      1043.474073   585.694981   564.013736   510.177022   400.200186   \n",
       "2      2736.520024   730.233239   665.203452   535.775111   439.335059   \n",
       "3       563.908070   492.803819   378.382799   372.875044   231.941957   \n",
       "4       343.556047   889.163314   218.111796   304.862864   178.352161   \n",
       "5       384.056072   864.368376   360.171920   326.569007   220.121592   \n",
       "6       502.409438   874.805634   408.553695   319.441795   290.917731   \n",
       "7       505.413819   571.175737   513.284999   277.558959   293.769318   \n",
       "8      1593.669596   206.532081   291.642606   265.495363   449.678235   \n",
       "9      1091.284775   928.228142   215.511735   303.548280   195.966711   \n",
       "10      726.179193   828.238375   567.591972   407.145244   399.369804   \n",
       "11      830.539398   954.716883   376.052940   861.797349   343.801618   \n",
       "12     3082.288083   820.943041  2366.249848   313.741711   569.803501   \n",
       "13     4178.703085   799.660815   571.455371   404.722234   704.394134   \n",
       "14     1082.132359   576.308835   533.334559   520.747186   391.890231   \n",
       "15      920.726651   731.633249   691.358217   420.708019   410.938934   \n",
       "16     1376.240142  1851.498966   591.766335   676.557100   562.734660   \n",
       "17     1749.396143   873.862843  1051.257079   742.792278   785.814981   \n",
       "18      557.965109   655.596433   381.865699   292.628361   299.214101   \n",
       "19      831.376865  1083.863893   390.665130   624.887434   400.941197   \n",
       "20      390.510182   651.957340   375.357140   388.151741   245.883400   \n",
       "21      492.510936   765.497185   189.463227   263.922069   197.109781   \n",
       "22      771.574300   369.310354   448.843884   279.587654   253.110728   \n",
       "23      534.287567  1370.360216   394.186657   577.791223   296.142094   \n",
       "24      752.967416   751.386530   546.222639   224.539373   333.974737   \n",
       "25      519.096596  1397.819713   399.847098   562.625120   289.308967   \n",
       "26      774.261373   708.759244   702.207227   348.171347   343.254429   \n",
       "27     1201.209615   673.216887   747.409621   317.725064   439.654239   \n",
       "28      377.035019   769.156324   196.721751   341.730438   183.934605   \n",
       "29      477.179802   916.895115   452.782738   271.542631   272.673841   \n",
       "...            ...          ...          ...          ...          ...   \n",
       "59570  4177.048486  1218.488578  2963.158268   639.252292   774.025840   \n",
       "59571  1605.925242  1318.469123  1155.088748  1266.676631   473.375730   \n",
       "59572  2773.177155  1025.613156  1181.814974  2161.792452   717.763487   \n",
       "59573  3602.927358  2223.908482  1470.669921  1237.412160   504.488955   \n",
       "59574  2537.124361  1426.548622  1071.310636  1175.591375   538.183802   \n",
       "59575  3351.592688  1797.448034  1232.758909  1513.067053   506.055987   \n",
       "59576  2194.771846  1607.906673  1435.020521  1185.068220  1213.292738   \n",
       "59577  2703.097285  1670.409989  1021.239750  1277.662024   646.000292   \n",
       "59578  2693.551221  1082.707332  1192.174606   916.684823   488.058608   \n",
       "59579  2488.478990  1791.148230  1086.141854  1605.271867   457.432995   \n",
       "59580  2496.493422  1090.410658  1095.056673  1070.759476   490.429245   \n",
       "59581  3553.719662  1423.875358  1921.913346  1080.366823   878.795238   \n",
       "59582  2848.931020   580.431445  1314.458041   726.351109   475.534395   \n",
       "59583  4082.307981  1595.928232  1614.356003  1646.481950   587.773628   \n",
       "59584  3060.578349  1378.172043  1278.758141  1119.751121   933.003189   \n",
       "59585  3056.589087  1698.198430   882.960450   855.182968   541.872523   \n",
       "59586  2102.871301  1124.627957  1511.526425  1698.083100   907.624053   \n",
       "59587  3069.957116  1812.817498  1220.897158  1129.074718   876.879876   \n",
       "59588  2259.869032   712.313947  1775.004669   672.330568  1030.779201   \n",
       "59589  2540.627228  2644.478413  1187.551030  1252.166806   695.638521   \n",
       "59590  2109.475504  1995.501723  1027.713521  1677.255470   848.610018   \n",
       "59591  4692.906026  1105.764463  1728.468341   987.181987  1436.369102   \n",
       "59592  1466.635246  1313.272631   752.043811  1377.236322   362.015723   \n",
       "59593  3445.059669  1127.182773  1241.365578  1333.745624  1037.144386   \n",
       "59594  3326.410135  1299.009504  1811.916095   854.911960   661.251020   \n",
       "59595  4081.017023  1248.530483  1655.677367  1000.603204   650.139870   \n",
       "59596  3703.892394  1413.063618  1375.104641   951.467238   621.927699   \n",
       "59597  3694.070826  1336.559501  1613.559675  1017.527699  1155.936991   \n",
       "59598  3655.514437  1811.926034  1705.581355  1024.020625  1052.533278   \n",
       "59599  3350.057925  1415.012485  1638.098332   815.354914  1790.130881   \n",
       "\n",
       "       var_timbre9  var_timbre10  var_timbre11  var_timbre12  \n",
       "0       232.700609    186.805303    181.938688    151.508011  \n",
       "1       365.119588    238.099708    197.933757    251.577525  \n",
       "2       486.822970    265.333860    447.097987    251.880724  \n",
       "3       246.313305    168.400152     85.282462    339.897173  \n",
       "4       440.478867    142.669283     81.061326    208.355152  \n",
       "5       283.251241    172.577377     82.763464    326.986134  \n",
       "6       311.694864    240.331752    109.615674    201.444813  \n",
       "7       334.107780    184.003084    153.880156    214.218828  \n",
       "8       165.292659    176.428095    137.505580     98.510837  \n",
       "9       391.368149     92.610712    152.654449    204.460530  \n",
       "10      277.848215    259.236219    184.171651    238.287958  \n",
       "11      563.943829    156.977168    122.372526   1554.662416  \n",
       "12      175.725975    339.785380    541.929434    117.865374  \n",
       "13      195.357549    224.543729    132.973109    246.757908  \n",
       "14      361.113467    245.759075    199.213786    254.367589  \n",
       "15      418.890043    269.310068    247.084741    380.917127  \n",
       "16      508.145383    305.860108    161.023936    296.045243  \n",
       "17      303.176600    419.539119    341.563476    333.173311  \n",
       "18      265.168580    206.407348    149.576389    158.465521  \n",
       "19      275.566608    217.726906    156.903105    213.897969  \n",
       "20      365.812947    236.551715     96.349160    280.470760  \n",
       "21      292.388433    151.405604     97.926262    200.391925  \n",
       "22      253.998878    165.311835    165.213194    224.648008  \n",
       "23      325.913178    199.588032    135.316270    238.340126  \n",
       "24      243.773554    227.853333    187.525560    193.123760  \n",
       "25      322.006583    192.960609    136.493306    241.166334  \n",
       "26      359.764091    225.129491    184.248353    235.246280  \n",
       "27      517.113711    217.233394    232.100728    203.277814  \n",
       "28      164.108212    135.314960     87.901230    149.644540  \n",
       "29      281.144432    230.773822    178.710186    173.717240  \n",
       "...            ...           ...           ...           ...  \n",
       "59570   422.131872    617.396106    675.588643    263.530740  \n",
       "59571   799.541054    369.795254    411.218974    549.716312  \n",
       "59572   857.542525    647.484578    373.942823    547.900599  \n",
       "59573   349.256861    319.657347    565.783282    380.548608  \n",
       "59574   556.298293    373.685766    369.423306    542.453297  \n",
       "59575   557.159429    295.144030    486.630105    723.903997  \n",
       "59576   464.500859    614.507983    456.235398    447.772413  \n",
       "59577   459.120345    315.527215    362.441247    628.971359  \n",
       "59578   397.656996    335.921094    391.171410    449.465490  \n",
       "59579   640.814923    330.473528    410.875814    517.714660  \n",
       "59580   476.844816    301.328459    322.992640    604.265959  \n",
       "59581   785.997831    442.697408    505.862105    767.590862  \n",
       "59582   320.119999    492.963235    383.349800    312.589603  \n",
       "59583   559.488419    338.675524    572.860269    477.260112  \n",
       "59584   477.116751    627.901735    436.919522    594.714710  \n",
       "59585   455.890936    327.215682    435.912937    381.681691  \n",
       "59586   503.355419    434.923799    393.651343    396.008530  \n",
       "59587   487.667605    473.232900    531.444158    481.791847  \n",
       "59588   548.210792    543.245053    424.565553    268.325485  \n",
       "59589   428.649689    345.973107    323.380721    459.931348  \n",
       "59590   506.250871    490.391442    402.511335    335.370413  \n",
       "59591   405.367831    617.441452    669.821921    347.390881  \n",
       "59592   479.619521    251.784693    276.385797    344.769425  \n",
       "59593   444.940600    427.906384    486.911721    446.738452  \n",
       "59594   419.068479    418.439460    531.901731    407.200144  \n",
       "59595   487.150838    503.846148    641.508417    395.121718  \n",
       "59596   418.507034    409.707771    504.899788    350.913794  \n",
       "59597   422.885540    519.527734    538.895856    313.775934  \n",
       "59598   533.349475    591.853048    598.054091    443.893807  \n",
       "59599   562.270433    659.321422    531.850198    607.215961  \n",
       "\n",
       "[59600 rows x 34 columns]>"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "msd_genre.head"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(6568, 37)"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "last_fm_with_msd = pd.merge(last_fm_listening_hist, msd_genre,  how='inner', left_on=['artist_name_lastfm', 'title_lastfm'], right_on = ['artist_name','title'])\n",
    "last_fm_with_msd.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<bound method NDFrame.head of      artist_name_lastfm                                tra_id  \\\n",
       "0      Abigail Washburn  238d51be-5828-420a-849e-e54aff4a5ae7   \n",
       "1      Abigail Washburn  6f878f9c-d46e-47c0-8ed5-621e479aee67   \n",
       "2      Abigail Washburn  81beec63-eb38-4397-a09d-28ce575f3c50   \n",
       "3               Aborted  04f125fa-a6c6-46c1-9237-45ba99b231d6   \n",
       "4               Aborted  1225dfae-a116-46b9-ac9e-5ad5bb2ef9f6   \n",
       "5               Aborted  3fce030e-3589-496f-a279-8491b010fa88   \n",
       "6               Aborted  4cd3b9d5-6a49-469f-afa8-b89e89ee6a74   \n",
       "7               Aborted  59356807-86ba-4d19-a1dc-582567cdd7b5   \n",
       "8               Aborted  6e24127c-7006-4aa9-897d-64f551c0e0f5   \n",
       "9               Aborted  8c111c81-da6a-47a2-b9d1-7f26a1638ec5   \n",
       "10              Aborted  8ce9fa08-e558-44ff-86ef-d0d99f5d68fe   \n",
       "11              Aborted  93902ab2-f368-4d25-8dc0-cf6b5848f6b3   \n",
       "12              Aborted  93902ab2-f368-4d25-8dc0-cf6b5848f6b3   \n",
       "13              Aborted  95480217-668c-4fae-8ff6-9530676ea45c   \n",
       "14              Aborted  a85969ec-882e-4f31-9da5-6b905d3b876d   \n",
       "15              Aborted  aaaa6bc8-bfc5-4d7b-b62d-9a6004126892   \n",
       "16              Aborted  da13de04-366d-464d-a271-adcf9915ee28   \n",
       "17              Aborted  e1a05b18-f7e4-4caf-9f02-0304b5fd62ae   \n",
       "18              Aborted  f583277c-1e2a-414f-b4f2-4f1165153260   \n",
       "19              Aborted  fe1e9b5d-6b50-4e51-80bc-46ec146f32c7   \n",
       "20       Above & Beyond  afaedd84-c68c-4adc-98b9-0dbcfad1d903   \n",
       "21       Above & Beyond  bc03dc4a-a31f-4fda-957a-bbe16d483c16   \n",
       "22       Above & Beyond  fe2e0e57-2c39-4566-b2f3-2e14e1440692   \n",
       "23      Adrian Sherwood  f9a3c14e-7074-4724-904c-5d71f7bf9d30   \n",
       "24               Aghora  3c6aced1-95ca-4794-97cf-a06b15509a7e   \n",
       "25               Aghora  3e28cd6b-307c-4d3e-bb1c-a06e96310155   \n",
       "26               Aghora  4dbe6682-df2b-4e3f-a416-7623fb8b911d   \n",
       "27               Aghora  522938fa-0260-4530-a09e-e44ba7d1f2af   \n",
       "28               Aghora  640c54d4-edad-4d58-9381-8d4b7fbd71ff   \n",
       "29               Aghora  8335a60d-cf91-4cf9-88ac-f20cdc839488   \n",
       "...                 ...                                   ...   \n",
       "6538        Wolf Parade  96dfb84a-8a2f-47b7-8069-d13e1276ea55   \n",
       "6539        Wolf Parade  aa50da33-b121-4bdf-bc50-bb6e3f1efb83   \n",
       "6540      Woody Guthrie  0b1671f8-9cd4-4637-a40c-f4e3b56b4355   \n",
       "6541      Woody Guthrie  0b1671f8-9cd4-4637-a40c-f4e3b56b4355   \n",
       "6542      Woody Guthrie  21cbe988-35b2-4f20-aa0d-e18dcc84f14c   \n",
       "6543      Woody Guthrie  5cc99107-df31-4308-8b4c-0dab23156da3   \n",
       "6544      Woody Guthrie  5cc99107-df31-4308-8b4c-0dab23156da3   \n",
       "6545      Woody Guthrie  5cc99107-df31-4308-8b4c-0dab23156da3   \n",
       "6546      Woody Guthrie  5cc99107-df31-4308-8b4c-0dab23156da3   \n",
       "6547      Woody Guthrie  5cc99107-df31-4308-8b4c-0dab23156da3   \n",
       "6548      Woody Guthrie  7752bf0c-9cdc-4758-befb-9e6be61facf3   \n",
       "6549      Woody Guthrie  a2962097-0610-4603-8e3b-4728e52b0f9e   \n",
       "6550      Woody Guthrie  a2962097-0610-4603-8e3b-4728e52b0f9e   \n",
       "6551      Woody Guthrie  c98babfb-bdf9-41fc-9476-3367e6b9c55e   \n",
       "6552      Woody Guthrie  f95e0a36-70a0-4d07-aa6d-538b618e23f2   \n",
       "6553      Woody Guthrie  f95e0a36-70a0-4d07-aa6d-538b618e23f2   \n",
       "6554        World Party  245d423c-7871-467e-8634-ad317e3820a9   \n",
       "6555        World Party  44024234-e1eb-4c4c-87e7-7208c248b9cc   \n",
       "6556        World Party  44024234-e1eb-4c4c-87e7-7208c248b9cc   \n",
       "6557        World Party  91e54cd0-84a2-4c6a-a990-05104d27948d   \n",
       "6558        World Party  af9dcd5b-a9bb-465a-bdcc-d760712f4026   \n",
       "6559        World Party  f6e102d0-29e7-4c5f-bbdc-d407053e3cac   \n",
       "6560          Yellowman  47b030d3-34b0-4e81-808d-7c335dc22ee6   \n",
       "6561          Yellowman  e5384b35-11ed-4d63-b628-6a31da0e5c0a   \n",
       "6562         Zakk Wylde  62415c5c-d8b9-4c2b-b305-a4af57163ae2   \n",
       "6563         Zakk Wylde  9d9f4751-ff12-48c0-8340-d3c166c7cdb7   \n",
       "6564         Zakk Wylde  bf4ca214-116f-4e8a-ad15-42b9aded998b   \n",
       "6565         Zakk Wylde  e2d09358-492a-41ce-92ad-d14564af4132   \n",
       "6566         Zakk Wylde  f802bf5e-4c7d-48d0-a9c3-d826c57ec678   \n",
       "6567      14 Iced Bears  72a8f118-dadb-4e26-a9bf-151b5cf926d5   \n",
       "\n",
       "                            title_lastfm                  genre  \\\n",
       "0                              Sometimes                   folk   \n",
       "1                          Red & Blazing                   folk   \n",
       "2                   Single Drop Of Honey                   folk   \n",
       "3              A Cold Logistic Slaughter                  metal   \n",
       "4                    The Chondrin Enigma                  metal   \n",
       "5               Underneath Rorulent Soil                  metal   \n",
       "6                               Hecatomb                  metal   \n",
       "7                 The Gangrenous Epitaph                  metal   \n",
       "8                  A Methodical Overture                  metal   \n",
       "9                            The Inertia                  metal   \n",
       "10                    The Spaying Séance                  metal   \n",
       "11                     Gestated Rabidity                  metal   \n",
       "12                     Gestated Rabidity                  metal   \n",
       "13                 Blood Fixing The Bled                  metal   \n",
       "14                 Ingenuity In Genocide                  metal   \n",
       "15     Threading On Vermillion Deception                  metal   \n",
       "16           Prolific Murder Contrivance                  metal   \n",
       "17                              Avenious                  metal   \n",
       "18                       Dead Wreckoning                  metal   \n",
       "19      The Foul Nucleus Of Resurrection                  metal   \n",
       "20                         Alone Tonight  dance and electronica   \n",
       "21                                  Home  dance and electronica   \n",
       "22    Alone Tonight (Ronski Speed Remix)  dance and electronica   \n",
       "23                    Monastery Of Sound        soul and reggae   \n",
       "24                                 Lotus                  metal   \n",
       "25                                Moksha                  metal   \n",
       "26                                  Dime                  metal   \n",
       "27                          Dual Alchemy                  metal   \n",
       "28                   Open Close The Book                  metal   \n",
       "29                           Atmas Heave                  metal   \n",
       "...                                  ...                    ...   \n",
       "6538                    The Grey Estates  dance and electronica   \n",
       "6539                Fine Young Cannibals  dance and electronica   \n",
       "6540              This Land Is Your Land                   folk   \n",
       "6541              This Land Is Your Land                   folk   \n",
       "6542                            Car Song                   folk   \n",
       "6543                    Pretty Boy Floyd                   folk   \n",
       "6544                    Pretty Boy Floyd                   folk   \n",
       "6545                    Pretty Boy Floyd                   folk   \n",
       "6546                    Pretty Boy Floyd                   folk   \n",
       "6547                    Pretty Boy Floyd                   folk   \n",
       "6548                       Vigilante Man                   folk   \n",
       "6549                        Jesus Christ                   folk   \n",
       "6550                        Jesus Christ                   folk   \n",
       "6551             Talking Dust Bowl Blues                   folk   \n",
       "6552                   Worried Man Blues                   folk   \n",
       "6553                   Worried Man Blues                   folk   \n",
       "6554               And I Fell Back Alone   classic pop and rock   \n",
       "6555          Put The Message In The Box   classic pop and rock   \n",
       "6556          Put The Message In The Box   classic pop and rock   \n",
       "6557                   Is It Like Today?   classic pop and rock   \n",
       "6558                        Way Down Now   classic pop and rock   \n",
       "6559                       Ship Of Fools   classic pop and rock   \n",
       "6560                         Mad Over Me        soul and reggae   \n",
       "6561         Nobody Move Nobody Get Hurt        soul and reggae   \n",
       "6562                   The Things You Do   classic pop and rock   \n",
       "6563                    Way Beyond Empty   classic pop and rock   \n",
       "6564                Throwin' It All Away   classic pop and rock   \n",
       "6565                      Road Back Home   classic pop and rock   \n",
       "6566                     Too Numb To Cry   classic pop and rock   \n",
       "6567                         Come Get Me   classic pop and rock   \n",
       "\n",
       "                track_id       artist_name  \\\n",
       "0     TRIRMPK12903CF6F93  Abigail Washburn   \n",
       "1     TRASYLO12903CF6F9A  Abigail Washburn   \n",
       "2     TRACBTI12903CF6F9E  Abigail Washburn   \n",
       "3     TRRCTWT128F42421DA           Aborted   \n",
       "4     TRTQSAJ12903CF41B9           Aborted   \n",
       "5     TRVBKIB12903CF41C3           Aborted   \n",
       "6     TRTSDLD128F42421AF           Aborted   \n",
       "7     TRSFHFO128F42421B9           Aborted   \n",
       "8     TREGXTN12903CF41BA           Aborted   \n",
       "9     TRIEPGG128F42421C8           Aborted   \n",
       "10    TRBQJIP12903CF41BC           Aborted   \n",
       "11    TRTPDVD128F424219E           Aborted   \n",
       "12    TREFVJI128F423DC67           Aborted   \n",
       "13    TREHVVX128F4242190           Aborted   \n",
       "14    TRBNEGI12903CF41C0           Aborted   \n",
       "15    TRLQOED128F42421E4           Aborted   \n",
       "16    TRJWCKK12903CF41C2           Aborted   \n",
       "17    TRAQTXL12903CF41BB           Aborted   \n",
       "18    TRGSVKS128F4242183           Aborted   \n",
       "19    TRPPRVP12903CF41BE           Aborted   \n",
       "20    TRATLUZ12903CD483B    Above & Beyond   \n",
       "21    TRBFSYY128F933B175    Above & Beyond   \n",
       "22    TRIXOAE128F931581E    Above & Beyond   \n",
       "23    TRGJLEY128F14880C8   Adrian Sherwood   \n",
       "24    TRNNVPF128F428797F            Aghora   \n",
       "25    TRKRAMA128F4287981            Aghora   \n",
       "26    TRDWYNP128F4287985            Aghora   \n",
       "27    TRNMSIW128F4287984            Aghora   \n",
       "28    TRKCJDR128F4287982            Aghora   \n",
       "29    TRHQBZP128F4287980            Aghora   \n",
       "...                  ...               ...   \n",
       "6538  TRNNDCO128F42812B7       Wolf Parade   \n",
       "6539  TRLQPTE128F42812B9       Wolf Parade   \n",
       "6540  TRKMHDF128F92FE5B7     Woody Guthrie   \n",
       "6541  TRPOMLE12903CCB6DA     Woody Guthrie   \n",
       "6542  TRYTEAJ12903CE1A32     Woody Guthrie   \n",
       "6543  TRWFVNB12903CAAACF     Woody Guthrie   \n",
       "6544  TRPQRRW128F92FC1CF     Woody Guthrie   \n",
       "6545  TRPEVND12903CF4A79     Woody Guthrie   \n",
       "6546  TREOTYC12903CB1159     Woody Guthrie   \n",
       "6547  TRTYTPS12903CE1027     Woody Guthrie   \n",
       "6548  TRYGJWK12903CFF8EF     Woody Guthrie   \n",
       "6549  TRTLLZH12903CB1154     Woody Guthrie   \n",
       "6550  TRQVYSY128F9338838     Woody Guthrie   \n",
       "6551  TRKXQQF12903CCB6D7     Woody Guthrie   \n",
       "6552  TRVVRMU12903CAAAD1     Woody Guthrie   \n",
       "6553  TRBWFMD12903CFF90A     Woody Guthrie   \n",
       "6554  TRRZTZW128F932AEEE       World Party   \n",
       "6555  TREAMSX128F932AEE8       World Party   \n",
       "6556  TRLWQID128F9303F8B       World Party   \n",
       "6557  TRNRGXP128F932AEC3       World Party   \n",
       "6558  TRCULJS128F932AEE4       World Party   \n",
       "6559  TRGPOYZ128F932AF07       World Party   \n",
       "6560  TRASALB128F4233AE9         Yellowman   \n",
       "6561  TRHKZRX128F93364AF         Yellowman   \n",
       "6562  TRNKVUG12903D0CD1F        Zakk Wylde   \n",
       "6563  TRFDAWW12903D0CD12        Zakk Wylde   \n",
       "6564  TRPRBSG12903D0CD14        Zakk Wylde   \n",
       "6565  TRYBHMQ12903D0CD0F        Zakk Wylde   \n",
       "6566  TRIADWU12903D0CD1D        Zakk Wylde   \n",
       "6567  TRVQPPX128F92CF496     14 Iced Bears   \n",
       "\n",
       "                                   title  loudness    tempo  time_signature  \\\n",
       "0                              Sometimes    -6.937  111.510               1   \n",
       "1                          Red & Blazing   -12.666  117.243               1   \n",
       "2                   Single Drop Of Honey   -17.884   40.815               1   \n",
       "3              A Cold Logistic Slaughter    -6.450  126.372               1   \n",
       "4                    The Chondrin Enigma    -5.652  108.055               4   \n",
       "5               Underneath Rorulent Soil    -6.075  120.352               4   \n",
       "6                               Hecatomb    -6.304  125.213               1   \n",
       "7                 The Gangrenous Epitaph    -4.980  120.046               4   \n",
       "8                  A Methodical Overture    -5.008  110.120               4   \n",
       "9                            The Inertia    -5.865  158.521               3   \n",
       "10                    The Spaying Séance    -4.478  122.662               4   \n",
       "11                     Gestated Rabidity    -5.481  120.977               4   \n",
       "12                     Gestated Rabidity    -4.240  213.956               4   \n",
       "13                 Blood Fixing The Bled    -5.413  118.205               4   \n",
       "14                 Ingenuity In Genocide    -4.833  202.332               1   \n",
       "15     Threading On Vermillion Deception    -6.136  100.777               4   \n",
       "16           Prolific Murder Contrivance    -4.773  218.222               1   \n",
       "17                              Avenious    -4.435   89.604               4   \n",
       "18                       Dead Wreckoning    -6.387  105.820               1   \n",
       "19      The Foul Nucleus Of Resurrection    -5.713  208.704               3   \n",
       "20                         Alone Tonight    -8.131  137.877               4   \n",
       "21                                  Home    -8.274  137.932               1   \n",
       "22    Alone Tonight (Ronski Speed Remix)    -6.998  137.954               4   \n",
       "23                    Monastery Of Sound    -8.001  163.994               4   \n",
       "24                                 Lotus    -9.420  119.943               4   \n",
       "25                                Moksha    -3.921  175.065               7   \n",
       "26                                  Dime    -5.366  130.061               4   \n",
       "27                          Dual Alchemy    -5.357  140.169               4   \n",
       "28                   Open Close The Book    -4.582  140.455               5   \n",
       "29                           Atmas Heave    -4.007  180.025               7   \n",
       "...                                  ...       ...      ...             ...   \n",
       "6538                    The Grey Estates    -6.859  149.864               4   \n",
       "6539                Fine Young Cannibals   -10.018  118.087               4   \n",
       "6540              This Land Is Your Land   -20.915  104.667               4   \n",
       "6541              This Land Is Your Land   -19.636  107.180               4   \n",
       "6542                            Car Song   -16.147   95.180               3   \n",
       "6543                    Pretty Boy Floyd   -40.456  177.143               5   \n",
       "6544                    Pretty Boy Floyd   -21.465  102.351               4   \n",
       "6545                    Pretty Boy Floyd   -21.414  103.982               4   \n",
       "6546                    Pretty Boy Floyd   -20.222  122.703               4   \n",
       "6547                    Pretty Boy Floyd   -22.704   82.446               5   \n",
       "6548                       Vigilante Man   -17.706   99.643               1   \n",
       "6549                        Jesus Christ   -19.914  128.746               4   \n",
       "6550                        Jesus Christ   -10.328  114.445               1   \n",
       "6551             Talking Dust Bowl Blues   -21.373  116.293               4   \n",
       "6552                   Worried Man Blues   -36.056  114.674               4   \n",
       "6553                   Worried Man Blues   -18.950  113.319               4   \n",
       "6554               And I Fell Back Alone   -11.578  171.983               3   \n",
       "6555          Put The Message In The Box    -6.298  130.017               4   \n",
       "6556          Put The Message In The Box    -5.155  130.076               4   \n",
       "6557                   Is It Like Today?    -7.579  132.334               4   \n",
       "6558                        Way Down Now    -5.585  111.118               4   \n",
       "6559                       Ship Of Fools    -4.878  116.295               4   \n",
       "6560                         Mad Over Me    -8.955  159.785               4   \n",
       "6561         Nobody Move Nobody Get Hurt   -13.716  161.963               4   \n",
       "6562                   The Things You Do    -4.300  174.294               4   \n",
       "6563                    Way Beyond Empty    -5.067  105.510               4   \n",
       "6564                Throwin' It All Away    -5.008  131.087               4   \n",
       "6565                      Road Back Home    -4.587  140.272               4   \n",
       "6566                     Too Numb To Cry    -7.124  138.024               3   \n",
       "6567                         Come Get Me   -12.024   89.416               4   \n",
       "\n",
       "          ...       var_timbre3  var_timbre4  var_timbre5  var_timbre6  \\\n",
       "0         ...        666.118018   728.287176   465.029834   654.257658   \n",
       "1         ...       1255.027706  1128.480883  1032.767415   560.339289   \n",
       "2         ...       4606.643746  9308.677142  2008.470016  2090.427589   \n",
       "3         ...        636.624601  1829.881745   560.364525   748.960503   \n",
       "4         ...       1595.483272   496.593449   316.731837   331.305344   \n",
       "5         ...        648.781289   265.432945   493.502503   228.434942   \n",
       "6         ...        487.415125   834.854137   472.462584   529.836649   \n",
       "7         ...        359.106378   974.179574   288.839429   450.599466   \n",
       "8         ...        309.652944   734.024311   353.142079   366.783369   \n",
       "9         ...        419.169448   449.942216   286.209477   285.105570   \n",
       "10        ...        218.730222   128.794350   269.095079   223.922255   \n",
       "11        ...        457.808230   527.989615   334.204761   334.001710   \n",
       "12        ...        548.457720   406.956377   686.528305   402.176839   \n",
       "13        ...        388.491375   511.289732   377.856657   283.868853   \n",
       "14        ...        224.374627   314.862049   322.856430   269.174934   \n",
       "15        ...        948.784742   400.228960   504.259872   211.714414   \n",
       "16        ...        242.383709   430.622133   360.998174   338.023147   \n",
       "17        ...        232.780663   191.934958   338.736666   240.452363   \n",
       "18        ...       1791.013141   915.347939   933.026996   408.955411   \n",
       "19        ...        551.508870   487.550845   410.653106   280.867631   \n",
       "20        ...       1718.721748  1985.324327   735.630754   532.438860   \n",
       "21        ...       1933.877240  1440.313294   844.611372   556.122239   \n",
       "22        ...       1879.800584  1473.795753   692.765856   614.948658   \n",
       "23        ...       2518.788527  1251.276488  1659.483522   807.999962   \n",
       "24        ...       1023.616978  1933.353098   788.575175  1031.875314   \n",
       "25        ...        667.199189   965.509865   494.392754   387.690772   \n",
       "26        ...       1504.991477  1052.920372  1578.424278   705.318214   \n",
       "27        ...       1566.814498  1361.850468   717.792190   821.153887   \n",
       "28        ...       1570.592413   979.819252   493.705032   652.110877   \n",
       "29        ...        899.951114  1092.453125  1238.457009   630.728234   \n",
       "...       ...               ...          ...          ...          ...   \n",
       "6538      ...        824.394120  1095.336187   510.808438   621.643282   \n",
       "6539      ...       2798.305798  1892.972645   949.513695  1650.398860   \n",
       "6540      ...       1903.725435  1939.403385  1295.686337  1255.893317   \n",
       "6541      ...       1881.048770  2004.280747  1250.498553  1298.076370   \n",
       "6542      ...       1920.010648  2482.205992  2668.228425  1542.367109   \n",
       "6543      ...       1266.475348   920.258375  1731.420675   586.855336   \n",
       "6544      ...       1319.703015  1407.784105   963.220761  1282.319490   \n",
       "6545      ...       1650.604426  1500.078835  1193.501843  1384.109202   \n",
       "6546      ...       1034.703121  1159.659788  1049.436611   939.300931   \n",
       "6547      ...        832.419637  1122.280287   997.369325  1110.229451   \n",
       "6548      ...       3273.948013  2735.634394   946.041469  1537.730433   \n",
       "6549      ...       3320.358450  2641.051004  1388.544284  1788.239546   \n",
       "6550      ...       3062.729557  3416.127751  1429.988573  1607.387167   \n",
       "6551      ...        707.680746  1211.860766   670.043060   979.560959   \n",
       "6552      ...       1843.899979  1133.227308   819.841204   952.555401   \n",
       "6553      ...       2381.261887  1869.743570   831.834096  1477.745806   \n",
       "6554      ...       1370.182515  1102.991611   668.526534   866.716514   \n",
       "6555      ...        979.595010   518.459001   521.904305   450.451362   \n",
       "6556      ...        961.717485   473.990358   545.255589   389.409787   \n",
       "6557      ...        744.306754   639.038285   446.832774   446.306113   \n",
       "6558      ...        662.529498   259.089116   498.668685   187.201855   \n",
       "6559      ...       1100.479333   513.221522   385.871346   589.733358   \n",
       "6560      ...       2983.226899  2389.241427  1806.788458  1468.447678   \n",
       "6561      ...       1902.213424  2351.894077  1377.989644  1537.215784   \n",
       "6562      ...       1120.881334  1977.670918   633.543583  1245.532634   \n",
       "6563      ...       1041.718906  1229.589807   673.800315   638.660530   \n",
       "6564      ...        749.095012   557.122233  1093.719002   322.335332   \n",
       "6565      ...       1085.839815   568.537742   932.833579   478.593368   \n",
       "6566      ...        757.401510   957.735787   900.731472   625.476614   \n",
       "6567      ...       1053.904842   781.362883   703.627788   297.088110   \n",
       "\n",
       "      var_timbre7  var_timbre8  var_timbre9  var_timbre10  var_timbre11  \\\n",
       "0      351.989148   254.611756   241.334072    200.432008    157.329807   \n",
       "1      730.951534   287.235598   447.818565    214.382203    277.242375   \n",
       "2     2184.097256  1301.974154   514.824958    916.200846   1554.431479   \n",
       "3      263.815567   308.850406   251.735934    218.323933    240.353664   \n",
       "4      205.525393   301.011338   245.602417    146.633741    133.830178   \n",
       "5      321.490991   177.136525   533.988362    158.772734    116.911361   \n",
       "6      229.980154   232.798783   289.479489    189.001360    208.129047   \n",
       "7      254.623749   233.962651   281.921244    169.962321    133.213200   \n",
       "8      214.164046   238.896723   193.253469    152.204371    103.285874   \n",
       "9      221.617483   237.547477   233.426137    136.197733    148.085369   \n",
       "10     136.730868   168.887932   148.144287    129.466814    106.439662   \n",
       "11     159.602294   219.470850   231.189068    134.544645    119.762473   \n",
       "12     181.337752   207.465361   227.043678    144.582871    151.582288   \n",
       "13     143.612149   351.915208   176.888502    169.055129    123.426395   \n",
       "14     194.611833   238.434477   173.288558    143.495954    100.690689   \n",
       "15     436.491547   215.602642   195.717176    111.699994     88.060721   \n",
       "16     148.103692   266.022116   136.572591    134.514189    147.921747   \n",
       "17     196.198258   216.888126   171.503551    136.964516     86.103904   \n",
       "18     417.982937   397.390676   419.695376    182.264962    118.742712   \n",
       "19     215.140942   274.232773   156.949172    132.544816     70.813537   \n",
       "20     375.946521   296.976824   190.837305    318.815184    193.265880   \n",
       "21     342.366143   246.614660   210.251771    229.169572    152.949641   \n",
       "22     440.334211   399.573944   265.813382    258.842727    249.685559   \n",
       "23    1006.184982   448.035996   370.285069    354.053830    215.377956   \n",
       "24     484.465364   472.818425   429.000622    464.583425    220.225129   \n",
       "25     491.191654   214.217942   331.393162    188.581756    138.962479   \n",
       "26     391.264358   547.804058   482.367852    299.086863    232.896873   \n",
       "27     387.839973   408.165213   416.666514    321.640397    281.711372   \n",
       "28     600.634931   198.206162   430.125169    188.557545    165.719320   \n",
       "29     393.885107   287.343288   314.426366    205.922376    198.476938   \n",
       "...           ...          ...          ...           ...           ...   \n",
       "6538   278.355360   400.087618   273.329501    236.376127    221.168862   \n",
       "6539   763.106431   602.481864   359.232894    422.009507    404.776539   \n",
       "6540   975.695557   524.549766   612.897896    400.272293    307.372289   \n",
       "6541   990.445428   507.198713   687.244323    402.136397    319.346676   \n",
       "6542   783.988239   641.640296   968.437784    374.983980    507.952439   \n",
       "6543   897.539074   579.790960   584.274416    462.225269    172.548575   \n",
       "6544   953.772971   436.452504   574.009424    336.742315    300.076718   \n",
       "6545  1050.396737   500.708758   895.048470    404.128187    332.300473   \n",
       "6546   610.019654   461.464593   696.523455    347.733320    226.932078   \n",
       "6547   608.821401   387.990841   689.292536    302.250877    229.025478   \n",
       "6548   825.538367   468.046885   545.370442    363.513977    409.877750   \n",
       "6549   856.082178   982.265989   640.097523    489.628369    391.510129   \n",
       "6550   947.446651  1019.676593   940.379158    526.709091    565.638591   \n",
       "6551   620.117528   386.324344   422.513150    297.817065    263.452541   \n",
       "6552   657.352144   345.927743   441.776131    214.971101    217.740831   \n",
       "6553   704.932134   314.894636   502.536956    244.603131    374.660221   \n",
       "6554   546.494474   376.647161   266.221720    263.214887    177.252260   \n",
       "6555   224.565472   332.231329   245.081326    211.401422    126.816111   \n",
       "6556   228.828702   336.465263   240.810023    221.648339    117.397641   \n",
       "6557   233.907321   415.939641   295.962598    237.420479    129.577819   \n",
       "6558   266.859333   202.623177   148.883095    151.576495     69.457349   \n",
       "6559   267.879508   292.687696   209.882059    260.265901    124.499426   \n",
       "6560   756.070089  1297.873288   680.226189    761.106071    485.991546   \n",
       "6561   727.521592   687.408173   859.859614    524.073672    564.223459   \n",
       "6562   447.598243   512.453672   303.477798    327.526675    368.566610   \n",
       "6563   437.506634   408.108701   415.608883    250.450805    234.144366   \n",
       "6564   475.014052   303.617745   375.180637    192.383962    114.900055   \n",
       "6565   260.132987   295.479360   297.505388    196.812342    148.730447   \n",
       "6566   409.243829   649.797776   280.127772    376.230104    159.924869   \n",
       "6567   286.793397   262.787400   315.103225    253.517575    140.033718   \n",
       "\n",
       "      var_timbre12  \n",
       "0       205.699924  \n",
       "1       560.245773  \n",
       "2       647.123507  \n",
       "3       117.877781  \n",
       "4       103.826498  \n",
       "5       366.840763  \n",
       "6       101.863824  \n",
       "7       136.040543  \n",
       "8        97.456117  \n",
       "9       130.881752  \n",
       "10       94.992422  \n",
       "11       85.210768  \n",
       "12      112.406647  \n",
       "13       78.051851  \n",
       "14      147.980221  \n",
       "15      132.514012  \n",
       "16       93.038935  \n",
       "17      121.471966  \n",
       "18      139.367840  \n",
       "19       90.799444  \n",
       "20      135.681933  \n",
       "21      118.098386  \n",
       "22      111.379248  \n",
       "23      183.359901  \n",
       "24      294.197242  \n",
       "25      217.637534  \n",
       "26      358.723571  \n",
       "27      299.612558  \n",
       "28      244.760718  \n",
       "29      270.787717  \n",
       "...            ...  \n",
       "6538    213.991580  \n",
       "6539    228.077595  \n",
       "6540    210.177620  \n",
       "6541    233.641269  \n",
       "6542    285.106728  \n",
       "6543    497.858368  \n",
       "6544    237.541483  \n",
       "6545    288.412275  \n",
       "6546    278.721819  \n",
       "6547    236.220929  \n",
       "6548    364.012949  \n",
       "6549    369.272655  \n",
       "6550    473.238723  \n",
       "6551    248.059797  \n",
       "6552    257.679918  \n",
       "6553    158.296012  \n",
       "6554    235.753913  \n",
       "6555    179.171567  \n",
       "6556    184.188846  \n",
       "6557    171.208334  \n",
       "6558    103.932767  \n",
       "6559    148.406143  \n",
       "6560    285.896692  \n",
       "6561    372.806705  \n",
       "6562    199.948862  \n",
       "6563    174.527785  \n",
       "6564    232.730840  \n",
       "6565    194.006762  \n",
       "6566    142.768016  \n",
       "6567    165.434949  \n",
       "\n",
       "[6568 rows x 37 columns]>"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "last_fm_with_msd.head"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [],
   "source": [
    "last_fm_with_msd.to_csv(\"last_fm_songs_with_features.csv\", sep=';')"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.5"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}