AppScraper.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The goal of this little script is to get a bunch of ids for Steam games using Beautiful Soup. We'll just go straight to  steamdb.info and scrape that, since it has a simple interface. We'll avoid getting info on ALL of the apps, since some of them are DLC and some have little information about them (there are IDs but they contain nothing). But first, let's try scraping the first page, and then look at what we see."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "from bs4 import BeautifulSoup\n",
    "import requests"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "response = requests.get(\"https://steamdb.info/apps/\")\n",
    "content = response.content\n",
    "parser = BeautifulSoup(content, 'html.parser')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "So there's a lot to learn about this stuff, like how to actually parse everything. I can't manage to get all the information that I want. I'll come back to this."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[<tr>\n",
      "<th class=\"no-sort\" style=\"width:119px\"> </th>\n",
      "<th class=\"span1\">AppID</th>\n",
      "<th>Name</th>\n",
      "<th class=\"span2\">Last Updated</th>\n",
      "</tr>, <tr class=\"app\" data-appid=\"509980\">\n",
      "<td class=\"applogo\">\n",
      "<img alt=\"\" onerror=\"this.onerror=null;this.src='/static/img/applogo.gif'\" src=\"/static/camo/apps/509980/capsule_sm_120.jpg\">\n",
      "</img></td>\n",
      "<td><a href=\"/app/509980/\">509980</a></td>\n",
      "<td>\n",
      "<a aria-label=\"This app is in store\" class=\"pull-right tooltipped tooltipped-w\" href=\"//store.steampowered.com/app/509980/?utm_source=SteamDB&amp;utm_medium=SteamDB&amp;utm_campaign=SteamDB%20Apps%20Page\" style=\"margin:10px 10px 0 0\">\n",
      "<span class=\"octicon octicon-globe\"></span>\n",
      "</a>\n",
      "<a class=\"b\" href=\"/app/509980/\">Finding Bigfoot</a>\n",
      "<i class=\"subinfo\">Game</i>\n",
      "</td>\n",
      "<td class=\"timeago\" data-sort=\"1486673771\" title=\"2017-02-09T20:56:11+00:00\">February 9, 2017 – 20:56:11 UTC</td>\n",
      "</tr>, <tr class=\"app\" data-appid=\"590380\">\n",
      "<td class=\"applogo\">\n",
      "<img alt=\"\" onerror=\"this.onerror=null;this.src='/static/img/applogo.gif'\" src=\"/static/camo/apps/590380/capsule_sm_120.jpg\">\n",
      "</img></td>\n",
      "<td><a href=\"/app/590380/\">590380</a></td>\n",
      "<td>\n",
      "<a class=\"muted\" href=\"/app/590380/\">SteamDB Unknown App 590380</a>\n",
      "<i class=\"subinfo\">Unknown</i>\n",
      "</td>\n",
      "<td class=\"timeago\" data-sort=\"1486673713\" title=\"2017-02-09T20:55:13+00:00\">February 9, 2017 – 20:55:13 UTC</td>\n",
      "</tr>]\n"
     ]
    }
   ],
   "source": [
    "app_text = parser.find_all('tr')\n",
    "app_embedded = [a for a in app_text]\n",
    "print(app_embedded[0:3])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "def get_app_id(row):\n",
    "    attrs = row.attrs\n",
    "    if 'data-appid' in attrs:\n",
    "        if 'data-appid' in attrs['data-appid']:\n",
    "            return attrs['data-appid']['data-appid']\n",
    "        else:\n",
    "            return attrs['data-appid']"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "# This isn't working quite yet, we'll try this again later...\n",
    "def get_app_name(row):\n",
    "    links = row.find_all('a')\n",
    "    for a in links:\n",
    "        attrs = a.attrs\n",
    "        if 'class' in attrs:\n",
    "            text = a.text\n",
    "            if 'SteamDB Unknown App' in text:\n",
    "                return None\n",
    "            else:\n",
    "                print(a)\n",
    "                return text"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The first is unreliable, but if we go straight to Steam, we might get a better result:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# How about we try just going to steam?\n",
    "def get_from_steam(app_id):\n",
    "    loc = \"http://store.steampowered.com/app/\" + app_id + '/'\n",
    "    req = requests.get(loc)\n",
    "    c = req.content\n",
    "    parsed = BeautifulSoup(c, 'html.parser')\n",
    "    title = parsed.title.text\n",
    "    if 'Welcome to Steam' in title:\n",
    "        return None\n",
    "    else:\n",
    "        title = title.replace('on Steam','')\n",
    "        stripped = [c for c in title if 0 < ord(c) < 127]\n",
    "        return ''.join(stripped)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "It worked out, and whenever we get 'Welcome to Steam', we know that the app doesn't exist and we can continue searching through the next entries. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "def is_game(row):\n",
    "    info = row.find_all('i')\n",
    "    for i in info:\n",
    "        if 'Game' in i.text:\n",
    "            return True\n",
    "    return False"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "games = {}\n",
    "for row in app_embedded:\n",
    "    app_id = get_app_id(row)\n",
    "    links = row.find_all('a')\n",
    "    if app_id != None:\n",
    "        title = get_from_steam(app_id)\n",
    "        if title != None:\n",
    "            games[app_id] = title\n",
    "    # Then we need to go through all of the possibilities of a and find our name:\n",
    "    #title = get_app_name(row)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'221380': 'Age of Empires II HD ',\n",
       " '230270': 'N++ (NPLUSPLUS) ',\n",
       " '25000': 'Overgrowth ',\n",
       " '252490': 'Rust ',\n",
       " '252870': 'PULSAR: Lost Colony ',\n",
       " '253840': 'Shantae: Half-Genie Hero ',\n",
       " '260430': 'The Four Kings Casino and Slots ',\n",
       " '271240': 'Offworld Trading Company ',\n",
       " '272270': 'Torment: Tides of Numenera ',\n",
       " '286000': 'Tooth and Tail ',\n",
       " '288140': 'Jack Nicklaus Perfect Golf ',\n",
       " '289070': 'Save 20% on Sid Meier’s Civilization® VI ',\n",
       " '291860': 'Pit People® ',\n",
       " '298240': 'Red Crucible®: Firestorm ',\n",
       " '298900': 'Space Hulk: Deathwing ',\n",
       " '312660': 'Pre-purchase Sniper Elite 4 ',\n",
       " '332650': 'The Exiled ',\n",
       " '333950': 'Medieval Engineers ',\n",
       " '352460': 'Dead Realm ',\n",
       " '376210': 'The Isle ',\n",
       " '383120': 'Empyrion - Galactic Survival ',\n",
       " '390540': 'High Fidelity ',\n",
       " '394490': 'Buildanauts ',\n",
       " '414390': 'Dirty Bomb® - Down and Dirty Starter Pack ',\n",
       " '431650': 'Save 10% on Phoning Home ',\n",
       " '434030': 'Aerofly FS 2 Flight Simulator ',\n",
       " '439310': 'Until I Have You ',\n",
       " '447820': 'Day of Infamy ',\n",
       " '459350': 'Battlesloths 2025: The Great Pizza Wars ',\n",
       " '480490': 'Pre-purchase Prey ',\n",
       " '492420': 'Dirty Bomb - Fire and Light Pack ',\n",
       " '499470': 'Decksplash ',\n",
       " '499560': 'Fourtex Jugo ',\n",
       " '509980': 'Finding Bigfoot ',\n",
       " '510510': 'WWE 2K17 ',\n",
       " '513510': 'Intralism ',\n",
       " '521330': 'Tuebor: I Will Defend ',\n",
       " '530350': 'Smashbox Arena ',\n",
       " '536220': 'The Walking Dead: A New Frontier ',\n",
       " '544970': 'Milkmaid of the Milky Way ',\n",
       " '545250': 'Bloody Boobs ',\n",
       " '571740': 'Golf It! ',\n",
       " '572520': 'Dropzone ',\n",
       " '578260': 'Fluffy ',\n",
       " '581970': 'Zombie Ballz ',\n",
       " '582620': 'Copoka ',\n",
       " '586040': '8-Bit Armies: Arena ',\n",
       " '72850': 'The Elder Scrolls V: Skyrim ',\n",
       " '99900': 'Spiral Knights '}"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "games"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "So now that we have it working, we need to get it working and going through all the pages. Once we've done that, we can then turn that into a list of ids."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "...Rise: Battle Lines  :  386350\n",
      "Go! Go! Nippon! ~My First Trip to Japan~  :  251870\n",
      "Save 30% on Stage of Development: Indie City  :  591480\n",
      "Soviet Monsters: Ekranoplans  :  372160\n",
      "Toricky  :  477720\n",
      "Age of Empires II HD  :  221380\n",
      "RiME  :  493200\n",
      "DRAGON BALL XENOVERSE 2  :  454650\n",
      "Mind Unleashed  :  450740\n",
      "PULSAR: Lost Colony  :  252870\n",
      "AltspaceVRThe Social VR App  :  407060\n",
      "FORTIFY  :  505040\n",
      "Runbow  :  464650\n",
      "Labyrinth  :  412310\n",
      "Torch Cave  :  501690\n",
      "Sleengster  :  559500\n",
      "Rage Parking Simulator 2016  :  449630\n",
      "Squad  :  393380\n",
      "Pixvana SPIN Technology Preview  :  534690\n",
      "Torch Cave 2  :  533710\n",
      "Skull Rush  :  587210\n",
      "Fur Fun  :  589370\n",
      "High Fidelity  :  390540\n",
      "Urban Pirate: The 8-bit Soundtrack  :  523910\n",
      "Syndrome  :  409320\n",
      "Clash Cup Turbo  :  393280\n",
      "Red Crucible: Firestorm  :  298240\n",
      "Mutant Fighting Cup 2  :  561450\n",
      "Grappledrome  :  242610\n",
      "Constellation Distantia  :  570150\n",
      "Oxygen Not Included  :  457140\n",
      "Fernbus Simulator  :  427100\n",
      "Thunderbird: The Legend Begins  :  355460\n",
      "Rogalia  :  528460\n",
      "Cossacks 3  :  333420\n",
      "FEMINAZI: The Triggering  :  585550\n",
      "Ashes of the Singularity: Escalation  :  507490\n",
      "Super Dungeon Bros  :  306000\n",
      "Rust  :  252490\n",
      "Save 25% on Milkmaid of the Milky Way - Soundtrack  :  579960\n",
      "FEIST  :  327060\n",
      "Fishing Planet  :  380600\n",
      "War Thunder  :  236390\n",
      "Urban Pirate: The 8-bit Soundtrack  :  523910\n",
      "Soviet Monsters: Ekranoplans  :  372160\n",
      "Ethereal Legends  :  428980\n",
      "Rise: Battle Lines  :  386350\n",
      "Go! Go! Nippon! ~My First Trip to Japan~  :  251870\n",
      "Save 30% on Stage of Development: Indie City  :  591480\n",
      "Toricky  :  477720\n",
      "Age of Empires II HD  :  221380\n",
      "RiME  :  493200\n",
      "DRAGON BALL XENOVERSE 2  :  454650\n",
      "Mind Unleashed  :  450740\n",
      "PULSAR: Lost Colony  :  252870\n",
      "AltspaceVRThe Social VR App  :  407060\n",
      "FORTIFY  :  505040\n",
      "Runbow  :  464650\n",
      "Labyrinth  :  412310\n",
      "Torch Cave  :  501690\n",
      "Sleengster  :  559500\n",
      "Rage Parking Simulator 2016  :  449630\n",
      "Squad  :  393380\n",
      "Pixvana SPIN Technology Preview  :  534690\n",
      "Torch Cave 2  :  533710\n",
      "Skull Rush  :  587210\n",
      "Fur Fun  :  589370\n",
      "High Fidelity  :  390540\n",
      "Syndrome  :  409320\n",
      "Clash Cup Turbo  :  393280\n",
      "Red Crucible: Firestorm  :  298240\n",
      "Mutant Fighting Cup 2  :  561450\n",
      "Grappledrome  :  242610\n",
      "Constellation Distantia  :  570150\n",
      "Oxygen Not Included  :  457140\n",
      "Fernbus Simulator  :  427100\n",
      "Thunderbird: The Legend Begins  :  355460\n",
      "Rogalia  :  528460\n",
      "Cossacks 3  :  333420\n",
      "FEMINAZI: The Triggering  :  585550\n",
      "Ashes of the Singularity: Escalation  :  507490\n",
      "Super Dungeon Bros  :  306000\n",
      "Rust  :  252490\n",
      "Save 25% on Milkmaid of the Milky Way - Soundtrack  :  579960\n",
      "FEIST  :  327060\n",
      "Fishing Planet  :  380600\n",
      "War Thunder  :  236390\n",
      "Friday the 13th: The Game  :  438740\n",
      "Automation - The Car Company Tycoon Game  :  293760\n",
      "Tom Clancys The Division  :  365590\n",
      "Western 1849 Reloaded  :  576980\n",
      "Dead by Daylight  :  381210\n",
      "Save 20% on Fantasy Grounds  :  252690\n",
      "Golf It!  :  571740\n",
      "Awaken  :  555970\n",
      "A Gummy's Life  :  585190\n",
      "Empyrion - Galactic Survival  :  383120\n",
      "The Exiled  :  332650\n",
      "Skulls of the Shogun  :  228960\n",
      "Raw Data  :  436320\n",
      "Space Pilgrim Episode I: Alpha Centauri  :  429470\n",
      "Wevr Transport  :  450360\n",
      "Day of Infamy  :  447820\n",
      "ASTRONEER  :  361420\n",
      "Stage Presence  :  391640\n",
      "DCS World  :  223750\n",
      "Finding Bigfoot  :  509980\n",
      "Space Hulk: Deathwing  :  298900\n",
      "The Elder Scrolls V: Skyrim  :  72850\n",
      "Dead Realm  :  352460\n",
      "Copoka  :  582620\n",
      "Battlesloths 2025: The Great Pizza Wars  :  459350\n",
      "Dropzone  :  572520\n",
      "Pre-purchase Sniper Elite 4  :  312660\n",
      "Zombie Ballz  :  581970\n",
      "Until I Have You  :  439310\n",
      "Shantae: Half-Genie Hero  :  253840\n",
      "Tuebor: I Will Defend  :  521330\n",
      "Smashbox Arena  :  530350\n",
      "Fourtex Jugo  :  499560\n",
      "Decksplash  :  499470\n",
      "Torment: Tides of Numenera  :  272270\n",
      "The Four Kings Casino and Slots  :  260430\n",
      "Save 20% on Sid Meiers Civilization VI  :  289070\n",
      "Buildanauts  :  394490\n",
      "Save 10% on Phoning Home  :  431650\n",
      "The Isle  :  376210\n",
      "Jack Nicklaus Perfect Golf  :  288140\n",
      "The Walking Dead: A New Frontier  :  536220\n",
      "N++ (NPLUSPLUS)  :  230270\n",
      "Milkmaid of the Milky Way  :  544970\n",
      "Milkmaid of the Milky Way  :  544970\n",
      "Medieval Engineers  :  333950\n",
      "Bloody Boobs  :  545250\n",
      "Spiral Knights  :  99900\n",
      "Tooth and Tail  :  286000\n",
      "8-Bit Armies: Arena  :  586040\n",
      "Dirty Bomb - Fire and Light Pack  :  492420\n",
      "WWE 2K17  :  510510\n",
      "Pre-purchase Prey  :  480490\n",
      "Offworld Trading Company  :  271240\n",
      "Intralism  :  513510\n",
      "Pit People  :  291860\n",
      "Overgrowth  :  25000\n",
      "Dirty Bomb - Down and Dirty Starter Pack  :  414390\n",
      "Fluffy  :  578260\n",
      "Aerofly FS 2 Flight Simulator  :  434030\n",
      "A House of Many Doors  :  437250\n",
      "Goalie Challenge VR  :  588290\n",
      "Galaxy Control: 3D Strategy  :  435440\n",
      "ROKH  :  462440\n",
      "Domina  :  535230\n",
      "Gigachess  :  415910\n",
      "Captain Lycop : Invasion of the Heters  :  582180\n",
      "Captain Lycop : Invasion of the Heters  :  525070\n",
      "Panzer Warfare  :  513880\n",
      "Osiris: New Dawn  :  402710\n",
      "Save 75% on Why So Evil 2: Dystopia  :  354850\n",
      "Why So Evil  :  331710\n",
      "They Came From The Moon  :  432150\n",
      "/reality  :  562280\n",
      "PAYDAY 2: John Wick Heists  :  591710\n",
      "GooCubelets: The Void  :  505440\n",
      "GooCubelets: The Algoorithm  :  431270\n",
      "PAYDAY 2  :  218620\n",
      "GooCubelets: OCD  :  460660\n",
      "Save 67% on Aqua Moto Racing Utopia  :  468100\n",
      "GooCubelets 2  :  416270\n",
      "GooCubelets  :  397620\n",
      "Fiends of Imprisonment  :  410590\n",
      "Save 87% on Cyborg Detonator  :  462370\n",
      "Save 83% on Brilliant Bob  :  368900\n",
      "Break Into Zatwor  :  395980\n",
      "Save 87% on Beast Blaster  :  447880\n",
      "Absconding Zatwor  :  385200\n",
      "Zombie Boom  :  516700\n",
      "Marvel Heroes 2016  :  226320\n",
      "Amazing World  :  293500\n",
      "Battleborn  :  394230\n",
      "Mages of Mystralia  :  529660\n",
      "Obduction  :  306760\n",
      "Dinosaur Hunt  :  401190\n",
      "Deep Rock Galactic  :  548430\n",
      "Warhammer 40,000 : Eternal Crusade  :  375230\n",
      "Hive Jump  :  295670\n",
      "Dungeon Defenders II  :  236110\n",
      "rFactor 2  :  365960\n",
      "Holodrive  :  370770\n",
      "Gigachess Demo  :  424220\n",
      "Blast-off  :  391140\n",
      "Save 40% on Selatria: Advent of the Dakk'rian Empire  :  578890\n",
      "Veterans Online  :  492840\n",
      "Xbird  :  580150\n",
      "Locus Solus  :  499320\n",
      "Locus Solus  :  496570\n",
      "Alone With You - Official Soundtrack  :  583260\n",
      "Operation: New Earth  :  528740\n",
      "DYSTORIA  :  516580\n",
      "Assetto Corsa  :  244210\n",
      "Save 15% on Alone With You  :  564940\n",
      "Planet Coaster  :  493340\n",
      "Candy Machine  :  581980\n",
      "Hidden Folks  :  435400\n",
      "Yet Another Zombie Defense  :  270550\n",
      "Oozi: Earth Adventure  :  257990\n",
      "I, Zombie  :  307230\n",
      "REalM: Walk of Soul  :  417020\n",
      "Porno Studio Tycoon  :  535490\n",
      "HackyZack  :  508530\n",
      "Deus Ex: Mankind Divided  :  337000\n",
      "Russian SuperHero Dead Ivan  :  527770\n",
      "Save 50% on Darkest Dungeon  :  262060\n",
      "State of Mind  :  437630\n",
      "AdVenture Communist  :  462930\n",
      "War of Rights  :  424030\n",
      "Leadwerks Game Launcher  :  355500\n",
      "Leadwerks Game Engine  :  251810\n",
      "Sumer  :  464950\n",
      "HELLION  :  588210\n",
      "Skara - The Blade Remains  :  274620\n",
      "Save 10% on Transcendence  :  364510\n",
      "Pavlov Demo  :  557980\n",
      "Battle Chasers: Nightwar  :  451020\n",
      "Save 20% on Splasher  :  446840\n",
      "Signs of Life  :  263200\n",
      "Hob  :  404680\n",
      "Battalion 1944  :  489940\n",
      "Totemori  :  588180\n",
      "Gooblins  :  517620\n",
      "Theme Park Studio  :  254590\n",
      "Guild Quest  :  547680\n",
      "Premium Pool  :  434110\n",
      "Worlds Adrift  :  322780\n",
      "5 Minutes Rage  :  416700\n",
      "Parkitect  :  453090\n",
      "Save 75% on Raining Blobs  :  414370\n",
      "Rocketbirds 2 Evolution  :  582240\n",
      "Save 75% on Rock 'N' Roll Defense  :  438480\n",
      "CS:GO Player Profiles  :  585281\n",
      "CS:GO Player Profiles  :  585283\n",
      "CS:GO Player Profiles  :  585282\n",
      "Galactic Fighters  :  513960\n",
      "Battle Islands: Commanders  :  445720\n",
      "Hover Skate VR  :  566570\n",
      "Save 10% on The Horus Heresy: Battle of Tallarn - Iron Edition  :  515980\n",
      "PROTOThYPE  :  587070\n",
      "John Wick Chapter 2  :  590780\n",
      "Save 10% on Sunset Rangers  :  559340\n",
      "Alien Swarm: Reactive Drop  :  563560\n",
      "Save 20% on Fantasy Fairways  :  552690\n",
      "LawBreakers  :  350280\n",
      "Space Engineers  :  244850\n",
      "Balloon Chair Death Match  :  498990\n",
      "Save 10% on Xenon Valkyrie  :  573780\n",
      "Satellite Command  :  514670\n",
      "LEGO Worlds  :  332310\n",
      "Portal Knights  :  374040\n",
      "Tom Clancy's Rainbow Six Siege  :  359550\n",
      "Site Error :  459510\n",
      "Stardew Valley  :  413150\n",
      "Realpolitiks  :  588740\n",
      "John Wick Chronicles  :  382360\n",
      "Grim Dawn  :  219990\n",
      "From Shadows  :  582920\n",
      "Plague Inc: Evolved  :  246620\n",
      "Orbiz  :  572480\n",
      "Save 10% on Gunmetal Arcadia  :  332270\n",
      "Far Beyond: A space odyssey VR  :  531050\n",
      "Subnautica  :  264710\n",
      "Spellgear  :  470040\n",
      "DvDrum, Ultimate Drum Simulator!  :  385130\n",
      "Star Crusade CCG  :  415270\n",
      "Arma 3  :  107410\n",
      "Sombrero: Spaghetti Western Mayhem  :  472690\n",
      "Climbey  :  520010\n",
      "SQUAKE  :  526920\n",
      "Schacht  :  513300\n",
      "Dirty Bomb  :  333930\n",
      "HoCWar (Heroes of Card War)  :  512560\n",
      "Zero G Arena  :  467820\n",
      "Tormentor X Punisher  :  500670\n",
      "Homefront: The Revolution  :  223100\n",
      "Bloons TD Battles  :  444640\n",
      "Super Spring Ninja  :  523230\n",
      "Riders of Icarus  :  442080\n",
      "Farming Simulator 17  :  447020\n",
      "Civilization VI - Poland Civilization & Scenario Pack  :  512033\n",
      "Gates of Hell  :  400750\n",
      "Civilization VI - Vikings Scenario Pack  :  512032\n",
      "Grey Phobia  :  465050\n",
      "Shaolin vs Wutang  :  466110\n",
      "Tyto Online  :  544290\n",
      "Socxel | Pixel Soccer  :  586190\n",
      "Minos Strategos  :  577490\n",
      "Paladins  :  444090\n",
      "Burly Men at Sea - Original Soundtrack  :  537510\n",
      "Storage Inc 2  :  549390\n",
      "Motorsport Manager  :  415200\n",
      "Save 10% on We Are Chicago  :  414330\n",
      "ONRAID  :  511800\n",
      "My Super Tower 1  :  590450\n",
      "Tracks of Triumph: Industrial Zone  :  492240\n",
      "Tracks of Triumph: Good Old Times  :  576080\n",
      "The Last Photon  :  461570\n",
      "Save 40% on Queen's Quest 2: Stories of Forgotten Past  :  558790\n",
      "Save 87% on The First Spark  :  488200\n",
      "Tesla's Best Friend  :  545950\n",
      "Save 87% on Tracks of Triumph: Summertime  :  528210\n",
      "Ride 2  :  477770\n",
      "Z-Exemplar  :  434750\n",
      "Save 10% on Styx: Shards of Darkness  :  355790\n",
      "Tales of Destruction  :  486480\n",
      "Rocket League  :  252950\n",
      "Shadow Warrior 2  :  324800\n",
      "DayZ  :  221100\n",
      "Naval Action  :  311310\n",
      "PAYDAY 2: John Wick Weapon Pack  :  545100\n",
      "Crazy Machines 3  :  351920\n",
      "Star Trek: Bridge Crew  :  527100\n",
      "In Vitra  :  563270\n",
      "Battlezone 98 Redux  :  301650\n",
      "FLYING TIGERS: SHADOWS OVER CHINA  :  365810\n",
      "Save 10% on Quarantine  :  489370\n",
      "Last Wings  :  576090\n",
      "Outreach  :  501680\n",
      "The Wardrobe  :  497730\n",
      "Puzzle Island VR  :  571630\n",
      "White Noise 2  :  503350\n",
      "HITMAN  :  236870\n",
      "Tyranny  :  362960\n",
      "The Golf Club VR  :  489600\n",
      "MX Nitro  :  488690\n",
      "MapleStory  :  216150\n",
      "Dodge Master  :  567430\n",
      "Rock God Tycoon  :  410840\n",
      "Take On Mars  :  244030\n",
      "SCALPERS: Turtle & the Moonshine Gang  :  577280\n",
      "The Big Elk  :  449440\n",
      "Affected Zone Tactics  :  386640\n",
      "The Challenge  :  496440\n",
      "FSX Steam Edition: Toposim Canada Add-On  :  556219\n",
      "theHunter  :  253710\n",
      "Train Simulator  :  24010\n",
      "VERSUS SQUAD  :  471330\n",
      "Holy Potatoes! Were in Space?!  :  505730\n",
      "American Truck Simulator  :  270880\n",
      "Project CARS 2  :  378860\n",
      "Economic Conquest  :  576320\n",
      "DARIUSBURST Chronicle Saviours - Side Arms Hyper Dyne  :  572380\n",
      "DARIUSBURST Chronicle Saviours - Varth: Operation Thunderstorm  :  572381\n",
      "Dark Egypt  :  555920\n",
      "Wild Terra Online  :  500710\n",
      "Spellsworn  :  360620\n",
      "Battlerite  :  504370\n",
      "Insurgency  :  222880\n",
      "7 Days to Die  :  251570\n",
      "Camtasia - Subscription  :  253050\n",
      "Broken Sword 5 - the Serpent's Curse  :  262940\n",
      "DARIUSBURST Chronicle Saviours - Progear  :  572382\n",
      "Nine Parchments  :  471550\n",
      "Drifting Lands  :  322750\n",
      "Drifting Lands  :  327240\n",
      "Divinity: Original Sin 2  :  435150\n",
      "Fable Fortune  :  469830\n",
      "Save 15% on Bulletstorm: Full Clip Edition  :  501590\n",
      "Offworld Trading Company - Blue Chip Ventures DLC  :  553160\n",
      "Conan Exiles  :  440900\n",
      "Echo of Soul  :  290140\n",
      "Blood Feed  :  575950\n",
      "X3: Albion Prelude  :  201310\n",
      "X3: Terran Conflict  :  2820\n",
      "Zombie Exodus: Safe Haven  :  543980\n",
      "Spellweaver  :  429680\n",
      "Legend of Merchant  :  543140\n",
      "Rogue Operatives  :  393790\n",
      "Race Online  :  355010\n",
      "Hegemony III: Clash of the Ancients  :  308173\n",
      "Downward  :  506900\n",
      "Mafia III  :  360430\n",
      "3D Arcade Fishing  :  534910\n",
      "Ghost in the Shell: Stand Alone Complex - First Assault Online  :  369200\n",
      "Worms W.M.D  :  327030\n",
      "Age of Cavemen  :  454600\n",
      "Age of Cavemen  :  454600\n",
      "Stories Untold  :  558420\n",
      "Racket: Nx  :  428080\n",
      "Midas Gold Plus  :  557400\n",
      "Save 10% on Boogeyman 2  :  567130\n",
      "Revolve  :  412760\n",
      "Monster Puzzle  :  493700\n",
      "Save 5% on Husk  :  553960\n",
      "Laraan  :  493710\n",
      "Save 40% on Hell`s Little Story  :  586530\n",
      "Bitku  :  401800\n",
      "Scrap Mechanic  :  387990\n",
      "Dota 2  :  570\n",
      "GROOVY  :  372490\n",
      "Deus Ex: Breach  :  555450\n",
      "Primal Carnage: Onslaught  :  538790\n",
      "BasementVR  :  561390\n",
      "Team Racing League  :  504460\n",
      "Star Conflict  :  212070\n",
      "Fear Effect Sedna  :  546900\n",
      "Dig or Die  :  315460\n",
      "Robocraft  :  301520\n",
      "CLASH  :  416040\n",
      "Warbands: Bushido  :  556820\n",
      "We Are The Dwarves  :  395570\n",
      "Cublast HD  :  580590\n",
      "Northgard  :  466560\n",
      "Football Manager 2017  :  482730\n",
      "Save 50% on Batman - The Telltale Series  :  498240\n",
      "Moving Hazard  :  334670\n",
      "PlanetSide 2  :  218230\n",
      "MinosMaze - The Minotaur's Labyrinth  :  521100\n",
      "Site Error :  570626\n",
      "Snake Pass  :  544330\n",
      "Save 20% on Minimalism  :  585690\n",
      "Train Simulator: West Coast Main Line Over Shap Route Add-On  :  222613\n",
      "VEGA Conflict  :  339600\n",
      "Train Simulator: US Loco & Asset Pack  :  208306\n",
      "Mainlining  :  454950\n",
      "Save 50% on Train Simulator: Union Pacific SD70Ace Loco Add-On  :  208362\n",
      "Train Simulator: Union Pacific GP50 Loco Add-On  :  222634\n",
      "Life is Feudal: Forest Village  :  496460\n",
      "Pre-purchase Little Nightmares  :  424840\n",
      "Train Mechanic Simulator 2017  :  538810\n",
      "Riff Racer - Race Your Music!  :  351990\n",
      "Train Simulator: The Riviera Line: Exeter-Paignton Route Add-On  :  222632\n",
      "Warhammer: End Times - Vermintide  :  235540\n",
      "Badass Hero  :  465200\n",
      "The Holiday Express  :  222621\n",
      "Save 75% on Cities: Skylines  :  255710\n",
      "Skullgirls  :  245170\n",
      "Garry's Mod  :  4000\n",
      "Train Simulator: Southern Pacific Cab Forward Loco Add-On  :  208292\n",
      "Creature Clicker - Capture, Train, Ascend!  :  529240\n",
      "Train Simulator: Settle to Carlisle Route Add-on  :  65255\n",
      "Save 15% on Shiness: The Lightning Kingdom  :  366640\n",
      "Train Simulator: Settle Carlisle Specials Add-On  :  65258\n",
      "F1 2016  :  391040\n",
      "BUTCHER  :  474210\n",
      "Train Simulator: Southern Pacific SD70M Loco Add-On  :  222604\n",
      "Clouds & Sheep 2  :  439800\n",
      "Starship Survivor  :  560010\n",
      "ARK: Survival Evolved  :  346110\n",
      "War for the Overworld  :  230190\n",
      "Battle Brothers  :  365360\n",
      "Save 50% on Train Simulator: SD40-2 Independence Loco Add-On  :  222589\n",
      "Rogue Stormers  :  299480\n",
      "Train Simulator: ScotRail Class 380 EMU Add-On  :  208353\n",
      "Save 20% on Peak Angle: Drift Online  :  547410\n",
      "A Normal Lost Phone - Official Soundtrack  :  580700\n",
      "Train Simulator: Ruhr-Sieg Route Add-On  :  208304\n",
      "Blood Bowl 2  :  236690\n",
      "FOR HONOR BETA  :  572600\n",
      "SparkDimension  :  477140\n",
      "Total War: WARHAMMER  :  364360\n",
      "Gun Bombers  :  416180\n",
      "Save 70% on How to Survive 2  :  360170\n",
      "The Shape Of Heart  :  511090\n",
      "Save 15% on Vikings - Wolves of Midgard  :  404590\n",
      "Midvinter  :  452120\n",
      "Medieval Engineers - Deluxe  :  346360\n",
      "MyWorld  :  492150\n",
      "Train Simulator: PRR Alco RS11 Loco Add-On  :  222574\n",
      "sZone-Online  :  316390\n",
      "Train Simulator: Ohio Steel 2 Route Add-On  :  65243\n",
      "Gravity Sketch VR  :  551370\n",
      "Madness Cubed  :  453270\n",
      "RUNNING WITH RIFLES  :  270150\n",
      "Maya LT (with Stingray)  :  243580\n",
      "Save 35% on Greyhound Manager 2 Rebooted  :  586460\n",
      "Gang Beasts  :  285900\n",
      "Little Triangle  :  575050\n",
      "Save 10% on EZRA: The Stranger  :  587010\n",
      "Pre-purchase FOR HONOR  :  304390\n",
      "EXIT  :  535000\n",
      "Dark Throne  :  587490\n",
      "Emporea: Realms of War and Magic  :  416450\n",
      "Slash It 2  :  583760\n",
      "Adventures On The Polluted Islands  :  496690\n",
      "Rocketbirds 2 Evolution  :  470210\n",
      "Heroes of Havoc: Idle Adventures  :  251450\n",
      "Galactic Junk League  :  562590\n",
      "Patchwork  :  528250\n",
      "Save 20% on Brut@l  :  489260\n",
      "Army Gals  :  420980\n",
      "Save 20% on Brut@l  :  489260\n",
      "Army Gals  :  420980\n",
      "Train Simulator: Norfolk Southern SD40-2 High Nose Loco Add-On  :  208354\n",
      "Grand Theft Auto V  :  271590\n",
      "Box Maze  :  512020\n",
      "Detention  :  555220\n",
      "Save 50% on Train Simulator: Norfolk Southern Heritage SD70ACes Loco Add-On  :  222543\n",
      "Prominence Poker  :  384180\n",
      "Save 50% on Train Simulator: Norfolk Southern Heritage ES44ACs Loco Add-On  :  222542\n",
      "OBCIDIAN LEGACY  :  568190\n",
      "Train Simulator: Norfolk Southern GP38-2 High Hood Loco Add-On  :  258666\n",
      "Save 15% on Sudden Strike 4  :  373930\n",
      "Unhappy Ever After: Blood Tales  :  591030\n",
      "Save 50% on Train Simulator: Norfolk Southern Dash8-40C Loco Add-On  :  277732\n",
      "Don't Starve  :  219740\n",
      "Save 8% on SpaceJourney VR  :  574920\n",
      "Train Simulator: Norfolk Southern SD40-2 High Nose Long Hood Forward Loco Add-On  :  277737\n",
      "Save 50% on Train Simulator: NKP S-2 Class 'Berkshire' Loco Add-On  :  208348\n",
      "Guns of Icarus Online  :  209080\n",
      "Train Simulator: Network Southeast Class 47 Loco Add-On  :  24075\n",
      "Train Simulator: Munich - Garmisch-Partenkirchen Route Add-On  :  258652\n",
      "Elite Dangerous  :  359320\n",
      "TASTEE: Lethal Tactics  :  365190\n",
      "Train Simulator: MRCE ES 64 U2 'Taurus' Loco Add-On  :  222608\n",
      "Horror Hospital  :  576440\n",
      "DiRT 4  :  421020\n",
      "Save 50% on Train Simulator: MRCE ER20 Eurorunner Loco Add-On  :  222601\n",
      "Train Simulator: Metro-North P32 AC-DM 'Genesis' Loco Add-On  :  258655\n",
      "forma.8  :  510240\n",
      "Beats Fever  :  566780\n",
      "Train Simulator: Metro-North Kawasaki M8 EMU Add-On  :  258647\n",
      "Sky Sanctuary  :  526130\n",
      "Train Simulator: Metronom ME 146 Loco Add-On  :  222591\n",
      "Don't Starve Together  :  322330\n",
      "SMILE GAME BUILDER  :  483950\n",
      "Train Simulator: Liverpool-Manchester Route Add-On  :  258653\n",
      "Youtubers Life  :  428690\n",
      "Off-Road Paradise: Trial 4x4  :  556230\n",
      "Train Simulator: KwaZulu-Natal Corridor: Pietermaritzburg-Ladysmith Add-On  :  222622\n",
      "Save 50% on Train Simulator: InterCity Class 91 Loco Add-On  :  222625\n",
      "Train Simulator: Green & Gold HST DMU Add-On  :  24082\n",
      "Tricky Towers - Candy Bricks  :  570361\n",
      "Super Blackjack Battle 2 Turbo Edition - The Card Warriors  :  545200\n",
      "Tricky Towers  :  437920\n",
      "Save 10% on Lamm  :  586340\n",
      "Train Simulator: Great Northern F7 Empire Builder Loco Add-On  :  222590\n",
      "3D Sprite Renderer  :  468900\n",
      "Zero Escape: The Nonary Games  :  477740\n",
      "Train Simulator: Glasgow Airport Rail Link Route Add-On  :  24065\n",
      "Train Simulator: Fort Kent to Eagle Lake Route Add-On  :  24055\n",
      "Train Simulator: First Capital Connect Class 321 EMU Add-On  :  222623\n",
      "Dungeon Manager ZV 2 - Expansion Pack  :  584060\n",
      "Afghanistan '11  :  580710\n",
      "Train Simulator: EWS & Freightliner Class 08s Loco Add-On  :  222578\n",
      "Train Simulator: EWS Class 92 Loco Add-On  :  222607\n",
      "Worlds  :  304850\n",
      "Ancient Guardian  :  557580\n",
      "Dungeon Manager ZV 2  :  581210\n",
      "Train Simulator: E18 Loco Add-On  :  65254\n",
      "Train Simulator: Doncaster Works Route Add-On  :  24095\n",
      "Train Simulator: DB ICE 1 EMU Add-On  :  208377\n",
      "Crossout  :  386180\n",
      "FSX Steam Edition: Cessna C172N Skyhawk II Add-On  :  500234\n",
      "Train Simulator: DB BR423 EMU Add-On  :  222580\n",
      "Train Simulator: Colton & Northern Route Add-On  :  24029\n",
      "RPG Maker MV  :  363890\n",
      "Train Simulator: Class 390 EMU Add-On  :  208343\n",
      "Shock Tactics  :  473610\n",
      "Train Simulator: Class 156 Loco Add-On  :  65217\n",
      "Expeditions: Viking  :  445190\n",
      "Train Simulator: Canadian Mountain Passes: Revelstoke-Lake Louise  :  222582\n",
      "Unhappy Ever After  :  552350\n",
      "FortressCraft Evolved!  :  254200\n",
      "Train Simulator: Bristol-Exeter Route Add-On  :  65224\n",
      "Save 50% on Train Simulator: BR Class 422 4BIG EMU Add-On  :  222547\n",
      "Train Simulator: BR Class 27 Loco Add-On  :  258661\n",
      "Earth Liberation  :  563490\n",
      "Depths of Limbo  :  568400\n",
      "Train Simulator: Boston & Maine GE 44 Loco Add-On  :  222548\n",
      "Robinson: The Journey  :  579820\n",
      "Train Simulator: Amtrak F40PH California Zephyr Loco Add-On  :  208296\n",
      "Straimium Immortaly  :  515650\n",
      "Dragon Blood  :  562840\n",
      "theHunter: Call of the Wild  :  518790\n",
      "Infinite Minigolf  :  446550\n",
      "Peak Angle: Drift Online - Germany Cars Pack  :  591900\n",
      "Peak Angle: Drift Online - American Cars Pack  :  591890\n",
      "Save 25% on Dream Car Racing 3D  :  488550\n",
      "Peak Angle: Drift Online - Japan Cars Pack  :  591880\n",
      "Invisible, Inc.  :  243970\n",
      "Viscera Cleanup Detail  :  246900\n",
      "Save 15% on Sky Climbers  :  583750\n",
      "Warhammer 40,000: Space Wolf  :  553210\n",
      "Wayward  :  379210\n",
      "Site Error :  261430\n",
      "Gremlins, Inc.  :  369990\n",
      "Voodoo  :  467570\n",
      "Skylar & Plux: Adventure On Clover Island  :  452540\n",
      "Crusader Kings II  :  203770\n",
      "Warhammer: Vermintide VR - Hero Trials  :  410390\n",
      "Tactical Intervention  :  51100\n",
      "Save 20% on Kult of Ktulu: Olympic  :  586230\n",
      "Danger Room  :  552340\n",
      "The Wild Eight  :  526160\n",
      "Serious Sam VR: The First Encounter  :  552450\n",
      "Tabletopia  :  402560\n",
      "Soul Searching  :  586240\n",
      "When Our Journey Ends - A Visual Novel  :  563520\n",
      "Soldier Sortie :VR Agent 006  :  552300\n",
      "Save 20% on We Need to Go Deeper  :  307110\n",
      "Surgeon Simulator: Experience Reality  :  518920\n",
      "Retro Pinball  :  581590\n",
      "Crypt of the NecroDancer  :  247080\n",
      "Peak Angle: Drift Online - Russian Cars Pack  :  591070\n",
      "We Happy Few  :  320240\n",
      "Save 30% on Tales of Legends  :  578440\n",
      "A Demon's Game - Episode 1  :  569430\n",
      "DESYNC  :  390030\n",
      "LoveBeat  :  354290\n",
      "DYE  :  503550\n",
      "Pyro VR  :  586360\n",
      "Operation Abyss: New Tokyo Legacy  :  541450\n",
      "Dark and Light  :  529180\n",
      "Zone4  :  518660\n",
      "Wanderer: The Rebirth  :  568250\n",
      "Death Squared  :  471810\n",
      "4x4 Road Race  :  587770\n",
      "Life of Rome  :  381620\n",
      "Beach Ball Valley  :  454830\n",
      "Corona Blossom Vol.3 Journey to the Stars  :  562480\n",
      "8-Bit Commando  :  456000\n",
      "Ticket to Ride  :  108200\n",
      "ARK Park  :  529910\n",
      "8-Bit Commando  :  287860\n",
      "Evertree Inn  :  565990\n",
      "Mall Empire  :  592340\n",
      "Caladrius Blaze  :  386770\n",
      "Evertree Inn  :  565980\n",
      "RWBY: Grimm Eclipse  :  418340\n",
      "Save 50% on ROMANCE OF THE THREE KINGDOMS XIII / 13  :  363150\n",
      "The Binding of Isaac: Rebirth  :  250900\n",
      "Tales of Berseria  :  429660\n",
      "Pre-purchase Yooka-Laylee  :  360830\n",
      "Owlboy  :  115800\n",
      "Wizard King  :  577560\n",
      "VRChat  :  438100\n",
      "Atari Vault  :  400020\n",
      "Stonehenge VR  :  457650\n",
      "Snailiens  :  559280\n",
      "Snailiens  :  559280\n",
      "Mobile Astro  :  568210\n",
      "Dimensional Rift  :  580630\n",
      "Save 30% on Blue Effect VR  :  522020\n",
      "MonkeyKing VR  :  580540\n",
      "LONE WOLF: Horizon  :  429020\n",
      "Spooky's Jump Scare Mansion: HD Renovation  :  577690\n",
      "Einlanzer  :  553760\n",
      "Heroes & Generals  :  227940\n",
      "Call of Duty: Infinite Warfare  :  292730\n",
      "Skyling: Garden Defense  :  577160\n",
      "Crush Crush  :  459820\n",
      "Double Dragon IV  :  528610\n",
      "Lobotomy Corporation | Monster Management Simulation  :  568220\n",
      "Hate Free Heroes  :  514540\n",
      "The Crew  :  241560\n",
      "Evangeline  :  470170\n",
      "The Moonstone Equation  :  589100\n",
      "Switch  :  506090\n",
      "Badiya  :  545050\n",
      "9Dragons  :  390100\n",
      "Save 50% on GRAV  :  332500\n",
      "Warfare Online  :  468250\n",
      "SECLUSION  :  578740\n",
      "SportsBar VR  :  269170\n",
      "Tavern Tycoon - Dragon's Hangover  :  439340\n",
      "SWORDY  :  467900\n",
      "LOR - League of Runners  :  587390\n",
      "Putty Pals  :  489110\n",
      "Synergy  :  17520\n",
      "ToeJam & Earl: Back in the Groove  :  516110\n",
      "Fragmental  :  424040\n",
      "A Rose in the Twilight  :  548840\n",
      "CounterAttack  :  451600\n",
      "Brawlout  :  263720\n",
      "Games of Glory  :  342150\n",
      "Are You Ready?  :  553180\n",
      "Google Earth VR  :  348250\n",
      "Diamond  :  346390\n",
      "Rivals of Aether  :  383980\n",
      "Aleph Null  :  511420\n",
      "Duelyst  :  291410\n",
      "Save 33% on Miscreated  :  299740\n",
      "Man O' War: Corsair - Warhammer Naval Battles  :  344240\n",
      "Block King  :  535330\n",
      "Streets of Fury EX  :  350910\n",
      "Substance Designer 5 Indie  :  330160\n",
      "Save 25% on Containment Initiative  :  527700\n",
      "Beyond the City VR  :  585310\n",
      "RESIDENT EVIL 7 biohazard / BIOHAZARD 7 resident evil  :  418370\n",
      "Armello  :  290340\n",
      "STAR WARS SHADOWS OF THE EMPIRE  :  560170\n",
      "Vilmonic  :  458330\n",
      "Visual Novel Maker  :  495480\n",
      "The Banner Saga  :  237990\n",
      "Shadowverse CCG  :  453480\n",
      "PRO EVOLUTION SOCCER 2017 TRIAL EDITION  :  541180\n",
      "Pro Evolution Soccer 2017  :  456610\n",
      "Save 10% on Knot  :  575990\n",
      "Metal Carnage  :  566840\n",
      "Bedfellows FRENZY  :  574790\n",
      "Shadows of Adam  :  506510\n",
      "BallisticNG  :  473770\n",
      "Metal Carnage  :  512200\n",
      "QuiVr  :  489380\n",
      "Secret Ponchos  :  265750\n",
      "Bedfellows FRENZY  :  545430\n",
      "Subsiege  :  338640\n",
      "Hollow Knight  :  367520\n",
      "H1Z1: King of the Kill  :  433850\n",
      "Slime Rancher  :  433340\n",
      "Universe Sandbox   :  230290\n",
      "Rest House  :  582290\n",
      "Rogues Like Us  :  492410\n",
      "Survive Me Miolhr  :  418430\n",
      "Nights of Azure  :  527280\n",
      "Redactem  :  515280\n",
      "Curvatron  :  404700\n",
      "Redactem  :  502400\n",
      "Atelier Sophie: The Alchemist of the Mysterious Book  :  527270\n",
      "Pinball Arcade  :  238260\n",
      "Galactic Core: The Lost Fleet  :  571860\n",
      "Disgaea 2 PC  :  527090\n",
      "Tilt Brush  :  327140\n",
      "Disgaea 2 PC  :  495280\n",
      "H1Z1: King of the Kill Test Server  :  439700\n",
      "Rock-N-Rogue: A Boo Bunny Plague Adventure  :  439530\n",
      "The Other 99  :  415010\n",
      "Shadows  :  563380\n",
      "Blasters of the Universe  :  490490\n",
      "Stellar Tactics  :  465490\n",
      "Astral Terra  :  266190\n",
      "Save 40% on Civil War: Battle of Petersburg  :  584800\n",
      "B-17 Flying Fortress: The Mighty 8th  :  328900\n",
      "Animal Lover  :  542200\n",
      "FormulaNext  :  571080\n",
      "Mech Marines: Steel March  :  335940\n",
      "LightStrike  :  579130\n",
      "Street Warriors Online  :  417910\n",
      "FreeHolder  :  463800\n",
      "Cards and Castles  :  360730\n",
      "The Last Leviathan - Name a Port In-Game Upgrade  :  585471\n",
      "Depth  :  274940\n",
      "Substance Painter 2  :  454510\n",
      "Winds Of Trade  :  576260\n",
      "Save 40% on MiniBotz - SoundTrack  :  590500\n",
      "The Brookhaven Experiment  :  440630\n",
      "Mercenary Kings  :  218820\n",
      "It Lurks in the Woods  :  589620\n",
      "Infested Planet  :  204530\n",
      "I Am Road Comic  :  578130\n",
      "STARDROP  :  552880\n",
      "Gladiator: Sword of Vengeance  :  577580\n",
      "EmergeNYC  :  461430\n",
      "Brawlhalla  :  291550\n",
      "It Lurks in the Woods  :  590882\n",
      "It Lurks in the Woods  :  590883\n",
      "It Lurks in the Woods  :  590884\n",
      "Save 10% on PowersVR  :  589250\n",
      "Gunman Taco Truck  :  586310\n",
      "It Lurks in the Woods  :  590880\n",
      "It Lurks in the Woods  :  590881\n",
      "Z. Year One  :  430930\n",
      "Diesel Power  :  578190\n",
      "Life Goes On: Done to Death  :  250050\n",
      "TrickStyle  :  588490\n",
      "Beeftacular  :  491620\n",
      "Beeftacular  :  491620\n",
      "H1Z1: Just Survive - Atlas Cosmetic Skin Pack  :  565621\n",
      "H1Z1: Just Survive - Manitoba Cosmetic Skin Pack  :  565620\n",
      "H1Z1: Just Survive - Whiptail Cosmetic Skin Pack  :  565622\n",
      "H1Z1: Just Survive - FREE Alpaca Backpack  :  568110\n",
      "Save 40% on The Elder Scrolls Online: Tamriel Unlimited  :  306130\n",
      "Age of Empires II HD: The Forgotten  :  239550\n",
      "Candle  :  420060\n",
      "Ricks Hunter  :  569290\n",
      "Rec Room  :  471710\n",
      "Darwin's Demons  :  572020\n",
      "Shrouded in Sanity  :  444590\n",
      "Project Highrise  :  423580\n",
      "Narcosis  :  366870\n",
      "Save 80% on Lithium: Inmate 39  :  463470\n",
      "Lightspeed Frontier  :  548650\n",
      "Agents of Mayhem  :  304530\n",
      "Basketball Girls  :  467680\n",
      "Sentinels of the Multiverse  :  337150\n",
      "Bad Pad Demo  :  565420\n",
      "Leaving Lyndow Original Soundtrack  :  587660\n",
      "Ashes of the Singularity  :  228880\n",
      "SoulHunt  :  500420\n",
      "Guts and Glory  :  537340\n",
      "Leaving Lyndow  :  585840\n",
      "Indie Game Battle  :  407620\n",
      "Ryzom  :  373720\n",
      "Red Barton and The Sky Pirates  :  540590\n",
      "Save 10% on Bleed 2  :  396350\n",
      "Ultimate General: Civil War  :  502520\n",
      "BeamNG.drive  :  284160\n",
      "Enter the Gungeon  :  311690\n",
      "MasterpieceVR  :  504650\n",
      "Circles  :  460250\n",
      "Snapshot - DSLR Camera Control  :  388280\n",
      "The Barbarian and the Subterranean Caves  :  490690\n",
      "MAXCONTROL  :  508460\n",
      "BioShock 2 Remastered  :  409720\n",
      "fault - milestone one  :  286260\n",
      "Alpacapaca Dash  :  579230\n",
      "The Wild Eight  Soundtrack  :  590360\n",
      "Break Time!  :  578470\n",
      "Brawl of Ages  :  529840\n",
      "Cabals: Card Blitz  :  562540\n",
      "bob's game  :  529720\n",
      "Iliza Shlesinger: War Paint  :  591150\n",
      "Super Dungeon Tactics  :  463160\n",
      "BOOR  :  450170\n",
      "Doug Stanhope: Beer Hall Putsch  :  590740\n",
      "Heroes of Shadow Guard  :  438720\n",
      "Treehouse Basketball  :  568600\n",
      "Killing Floor 2  :  232090\n",
      "SONAR Steam Editions  :  380080\n",
      "Ra  :  562460\n",
      "Starfighter Origins  :  564950\n",
      "Organ Quarter Pre-Alpha Demo  :  544510\n",
      "RollerCoaster Tycoon World  :  282560\n",
      "The Royals  :  565938\n",
      "Bear With Me - Episode Two  :  583140\n",
      "Lara Croft GO  :  540840\n",
      "Cosmic Trip  :  427240\n",
      "Save 40% on Archery Practice VR  :  587830\n",
      "Witch Hunt  :  559650\n",
      "Natural Selection 2  :  4920\n",
      "Eternal Card Game  :  531640\n",
      "The Culling  :  437220\n",
      "Bad Dream: Coma  :  538070\n",
      "Techwars Online 2  :  523740\n",
      "Rise of Nations: Extended Edition  :  287450\n",
      "SMITE - 2017 Spring Split Season Ticket + Bonus FP  :  588270\n",
      "Legions of Tyrandel  :  537020\n",
      "Blackwood Crossing  :  453310\n",
      "WolfQuest  :  431180\n",
      "EDEN STAR  :  259570\n",
      "Invisigun Heroes  :  375750\n",
      "WWE 2K17 - MyPlayer Kick Start  :  570160\n",
      "WWE 2K17 - Accelerator  :  570170\n",
      "WWE 2K17 - NXT Enhancement Pack  :  570180\n",
      "WWE 2K17 - Legends Pack  :  570181\n",
      "WWE 2K17 - New Moves Pack  :  570190\n",
      "WWE 2K17 - Future Stars Pack  :  570200\n",
      "On The Path - Soundtrack  :  564870\n",
      "Save 40% on On The Path - The Thoughts , Generated by Trifles  :  566300\n",
      "On The Path - Guide to Gameplay  :  565400\n",
      "On The Path  :  555430\n",
      "Save 50% on Okhlos: Omega  :  400180\n",
      "Call of Duty: Black Ops III  :  311210\n",
      "Rogue Singularity  :  419710\n",
      "Locomancer  :  522600\n",
      "King Kaiju  :  556340\n",
      "Days of War  :  454350\n",
      "Save 25% on LogicBots  :  290020\n",
      "Idioctopus  :  571330\n",
      "Future Unfolding  :  539340\n",
      "Binary Trigger  :  570600\n",
      "Locomancer  :  490250\n",
      "Save 50% on GameGuru  :  266310\n",
      "MiniBotz  :  508520\n",
      "Crimsonland  :  262830\n",
      "Nash Racing  :  581200\n",
      "The Forest  :  242760\n",
      "Waves  :  107600\n",
      "The Living Dungeon  :  362290\n",
      "10 Second Ninja X  :  435790\n",
      "Galactic Civilizations III  :  226860\n",
      "Hearts of Iron IV  :  394360\n",
      "StarBreak  :  420790\n",
      "Tomorrow  :  405480\n",
      "Witches' Legacy: Slumbering Darkness Collector's Edition  :  586710\n",
      "Awesomenauts  :  204300\n",
      "Wacky Wings  :  585530\n",
      "Along the Edge  :  504390\n",
      "Has-Been Heroes  :  492290\n",
      "Waves 2  :  217120\n",
      "Rollout  :  509190\n",
      "On A Roll 3D  :  341090\n",
      "Radial-G : Racing Revolved  :  330770\n",
      "Soldiers: Arena  :  421010\n",
      "Henry The Hamster Handler  :  566880\n",
      "Holodance  :  422860\n",
      "Toribash  :  248570\n",
      "Echoes of the Fey Episode 0: The Immolation  :  585990\n",
      "Save 10% on VRemin (A Virtual Theremin)  :  582210\n",
      "KUBOOM  :  513000\n",
      "Hired Ops  :  374280\n",
      "The Sexy Brutale  :  552590\n",
      "Neon Chrome  :  428750\n",
      "Celestial Breach  :  547970\n",
      "Celestial Breach  :  547970\n",
      "Energy Invasion  :  513600\n",
      "Edna & Harvey: The Breakout  :  255320\n",
      "The Panic Room  :  436160\n",
      "Lazarus  :  510190\n",
      "A Normal Lost Phone  :  523210\n",
      "Battle Islands  :  305260\n",
      "Interstellar Rift  :  363360\n",
      "Gary Grigsby's War in the East  :  370540\n",
      "Save 40% on Machine Hunt  :  546930\n",
      "Regalia: Of Men and Monarchs  :  464150\n",
      "Blitzkrieg 3  :  235380\n",
      "Ellipsis  :  514620\n",
      "Randal's Monday  :  314810\n",
      "Last Answer  :  569760\n",
      "Aragami  :  280160\n",
      "Anyland  :  505700\n",
      "ComPet  :  532800\n",
      "Riding Club Championships  :  509420\n",
      "Zanzarah: The Hidden Portal  :  384570\n",
      "Save 25% on Stable Orbit  :  481190\n",
      "Ninja Stealth 2  :  585830\n",
      "Train Simulator: Clear Creek Log & Lumber Expansion Pack Add-On  :  376972\n",
      "Verdun  :  242860\n",
      "Overkill VR: Action Shooter FPS  :  518720\n",
      "NARUTO SHIPPUDEN: Ultimate Ninja STORM 3 Full Burst  :  234670\n",
      "Save 50% on Sorcerer King: Rivals  :  496730\n",
      "Altitude0: Lower & Faster  :  308080\n",
      "Starpoint Gemini Warlords  :  419480\n",
      "The Ship: Remasted  :  383790\n",
      "HEPH  :  567480\n",
      "FourChords Guitar Karaoke  :  476930\n",
      "Darksiders Warmastered Edition  :  462780\n",
      "Quote  :  432890\n",
      "Protonwar  :  461410\n",
      "Aim Hero  :  518030\n",
      "vRhythm  :  526440\n",
      "vRhythm  :  556170\n",
      "OneShot  :  420530\n",
      "OneShot OST  :  571210\n",
      "Odesi Music Composition  :  260990\n",
      "Urban Empire  :  352550\n",
      "Soul Saber 2  :  581230\n"
     ]
    }
   ],
   "source": [
    "import pandas as pd\n",
    "def crawl_pages(page_list):\n",
    "    games = {'game': [], 'game_id': []}\n",
    "    print('...', end='')\n",
    "    for page in page_list:\n",
    "        response = requests.get(\"https://steamdb.info/apps/\" + page)\n",
    "        content = response.content\n",
    "        parser = BeautifulSoup(content, 'html.parser')\n",
    "        app_text = parser.find_all('tr')\n",
    "        app_embedded = [a for a in app_text]\n",
    "        for row in app_embedded:\n",
    "            app_id = get_app_id(row)\n",
    "            links = row.find_all('a')\n",
    "            if app_id != None:\n",
    "                title = get_from_steam(app_id)\n",
    "                if title != None:\n",
    "                    print(title, ': ', app_id)\n",
    "                    #TODO: Make sure we clean up the title so that there are no non-unicode strings\n",
    "                    games['game'].append(title)\n",
    "                    games['game_id'].append(app_id)\n",
    "    g_df = pd.DataFrame(games)\n",
    "    g_df.to_csv(\"games.csv\")\n",
    "pages = ['page' + str(x) + '/' for x in range(1, 20)]\n",
    "pages.insert(0, '')\n",
    "crawl_pages(pages)"
   ]
  }
 ],
 "metadata": {
  "anaconda-cloud": {},
  "kernelspec": {
   "display_name": "Python [conda root]",
   "language": "python",
   "name": "conda-root-py"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.5.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}