TensorFlow_ObjectDetection_Demo05_ScreenCap_and_Update-v1.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Object Detection Demo 5: Stream of Images (Screen-capture + Webcam Feed)\n",
    "Welcome to the object detection inference walkthrough!  This notebook will walk you step by step through the process of using a pre-trained model to detect objects in an image. Make sure to follow the [installation instructions](https://github.com/tensorflow/models/blob/master/object_detection/g3doc/installation.md) before you start."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Imports"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "collapsed": true,
    "scrolled": true
   },
   "outputs": [],
   "source": [
    "import numpy as np\n",
    "import os\n",
    "import six.moves.urllib as urllib\n",
    "import sys\n",
    "import tarfile\n",
    "import tensorflow as tf\n",
    "import zipfile\n",
    "import getpass\n",
    "\n",
    "from collections import defaultdict\n",
    "from io import StringIO\n",
    "from matplotlib import pyplot as plt\n",
    "from PIL import Image\n",
    "\n",
    "from PIL import ImageGrab\n",
    "import time\n",
    "import pandas as pd\n",
    "\n",
    "import cv2"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Env setup"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# This is needed since the notebook is stored in the object_detection folder.\n",
    "sys.path.append(\"..\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Object detection imports\n",
    "Here are the imports from the object detection module."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "from utils import label_map_util\n",
    "\n",
    "from utils import visualization_utils as vis_util"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Model preparation "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Variables\n",
    "\n",
    "Any model exported using the `export_inference_graph.py` tool can be loaded here simply by changing `PATH_TO_CKPT` to point to a new .pb file.  \n",
    "\n",
    "By default we use an \"SSD with Mobilenet\" model here. See the [detection model zoo](https://github.com/tensorflow/models/blob/master/object_detection/g3doc/detection_model_zoo.md) for a list of other models that can be run out-of-the-box with varying speeds and accuracies."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# What model to download.\n",
    "MODEL_NAME = 'ssd_mobilenet_v1_coco_11_06_2017'\n",
    "MODEL_FILE = MODEL_NAME + '.tar.gz'\n",
    "DOWNLOAD_BASE = 'http://download.tensorflow.org/models/object_detection/'\n",
    "\n",
    "# Path to frozen detection graph. This is the actual model that is used for the object detection.\n",
    "PATH_TO_CKPT = MODEL_NAME + '/frozen_inference_graph.pb'\n",
    "\n",
    "# List of the strings that is used to add correct label for each box.\n",
    "PATH_TO_LABELS = os.path.join('data', 'mscoco_label_map.pbtxt')\n",
    "\n",
    "NUM_CLASSES = 90"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Download Model"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true
   },
   "source": [
    "opener = urllib.request.URLopener()\n",
    "opener.retrieve(DOWNLOAD_BASE + MODEL_FILE, MODEL_FILE)\n",
    "tar_file = tarfile.open(MODEL_FILE)\n",
    "for file in tar_file.getmembers():\n",
    "  file_name = os.path.basename(file.name)\n",
    "  if 'frozen_inference_graph.pb' in file_name:\n",
    "    tar_file.extract(file, os.getcwd())"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Load a (frozen) Tensorflow model into memory."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "detection_graph = tf.Graph()\n",
    "with detection_graph.as_default():\n",
    "    od_graph_def = tf.GraphDef()\n",
    "    with tf.gfile.GFile(PATH_TO_CKPT, 'rb') as fid:\n",
    "        serialized_graph = fid.read()\n",
    "        od_graph_def.ParseFromString(serialized_graph)\n",
    "        tf.import_graph_def(od_graph_def, name='')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Loading label map\n",
    "Label maps map indices to category names, so that when our convolution network predicts `5`, we know that this corresponds to `airplane`.  Here we use internal utility functions, but anything that returns a dictionary mapping integers to appropriate string labels would be fine"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "label_map = label_map_util.load_labelmap(PATH_TO_LABELS)\n",
    "categories = label_map_util.convert_label_map_to_categories(label_map, max_num_classes=NUM_CLASSES, use_display_name=True)\n",
    "category_index = label_map_util.create_category_index(categories)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{1: {'id': 1, 'name': 'person'},\n",
       " 2: {'id': 2, 'name': 'bicycle'},\n",
       " 3: {'id': 3, 'name': 'car'},\n",
       " 4: {'id': 4, 'name': 'motorcycle'},\n",
       " 5: {'id': 5, 'name': 'airplane'},\n",
       " 6: {'id': 6, 'name': 'bus'},\n",
       " 7: {'id': 7, 'name': 'train'},\n",
       " 8: {'id': 8, 'name': 'truck'},\n",
       " 9: {'id': 9, 'name': 'boat'},\n",
       " 10: {'id': 10, 'name': 'traffic light'},\n",
       " 11: {'id': 11, 'name': 'fire hydrant'},\n",
       " 13: {'id': 13, 'name': 'stop sign'},\n",
       " 14: {'id': 14, 'name': 'parking meter'},\n",
       " 15: {'id': 15, 'name': 'bench'},\n",
       " 16: {'id': 16, 'name': 'bird'},\n",
       " 17: {'id': 17, 'name': 'cat'},\n",
       " 18: {'id': 18, 'name': 'dog'},\n",
       " 19: {'id': 19, 'name': 'horse'},\n",
       " 20: {'id': 20, 'name': 'sheep'},\n",
       " 21: {'id': 21, 'name': 'cow'},\n",
       " 22: {'id': 22, 'name': 'elephant'},\n",
       " 23: {'id': 23, 'name': 'bear'},\n",
       " 24: {'id': 24, 'name': 'zebra'},\n",
       " 25: {'id': 25, 'name': 'giraffe'},\n",
       " 27: {'id': 27, 'name': 'backpack'},\n",
       " 28: {'id': 28, 'name': 'umbrella'},\n",
       " 31: {'id': 31, 'name': 'handbag'},\n",
       " 32: {'id': 32, 'name': 'tie'},\n",
       " 33: {'id': 33, 'name': 'suitcase'},\n",
       " 34: {'id': 34, 'name': 'frisbee'},\n",
       " 35: {'id': 35, 'name': 'skis'},\n",
       " 36: {'id': 36, 'name': 'snowboard'},\n",
       " 37: {'id': 37, 'name': 'sports ball'},\n",
       " 38: {'id': 38, 'name': 'kite'},\n",
       " 39: {'id': 39, 'name': 'baseball bat'},\n",
       " 40: {'id': 40, 'name': 'baseball glove'},\n",
       " 41: {'id': 41, 'name': 'skateboard'},\n",
       " 42: {'id': 42, 'name': 'surfboard'},\n",
       " 43: {'id': 43, 'name': 'tennis racket'},\n",
       " 44: {'id': 44, 'name': 'bottle'},\n",
       " 46: {'id': 46, 'name': 'wine glass'},\n",
       " 47: {'id': 47, 'name': 'cup'},\n",
       " 48: {'id': 48, 'name': 'fork'},\n",
       " 49: {'id': 49, 'name': 'knife'},\n",
       " 50: {'id': 50, 'name': 'spoon'},\n",
       " 51: {'id': 51, 'name': 'bowl'},\n",
       " 52: {'id': 52, 'name': 'banana'},\n",
       " 53: {'id': 53, 'name': 'apple'},\n",
       " 54: {'id': 54, 'name': 'sandwich'},\n",
       " 55: {'id': 55, 'name': 'orange'},\n",
       " 56: {'id': 56, 'name': 'broccoli'},\n",
       " 57: {'id': 57, 'name': 'carrot'},\n",
       " 58: {'id': 58, 'name': 'hot dog'},\n",
       " 59: {'id': 59, 'name': 'pizza'},\n",
       " 60: {'id': 60, 'name': 'donut'},\n",
       " 61: {'id': 61, 'name': 'cake'},\n",
       " 62: {'id': 62, 'name': 'chair'},\n",
       " 63: {'id': 63, 'name': 'couch'},\n",
       " 64: {'id': 64, 'name': 'potted plant'},\n",
       " 65: {'id': 65, 'name': 'bed'},\n",
       " 67: {'id': 67, 'name': 'dining table'},\n",
       " 70: {'id': 70, 'name': 'toilet'},\n",
       " 72: {'id': 72, 'name': 'tv'},\n",
       " 73: {'id': 73, 'name': 'laptop'},\n",
       " 74: {'id': 74, 'name': 'mouse'},\n",
       " 75: {'id': 75, 'name': 'remote'},\n",
       " 76: {'id': 76, 'name': 'keyboard'},\n",
       " 77: {'id': 77, 'name': 'cell phone'},\n",
       " 78: {'id': 78, 'name': 'microwave'},\n",
       " 79: {'id': 79, 'name': 'oven'},\n",
       " 80: {'id': 80, 'name': 'toaster'},\n",
       " 81: {'id': 81, 'name': 'sink'},\n",
       " 82: {'id': 82, 'name': 'refrigerator'},\n",
       " 84: {'id': 84, 'name': 'book'},\n",
       " 85: {'id': 85, 'name': 'clock'},\n",
       " 86: {'id': 86, 'name': 'vase'},\n",
       " 87: {'id': 87, 'name': 'scissors'},\n",
       " 88: {'id': 88, 'name': 'teddy bear'},\n",
       " 89: {'id': 89, 'name': 'hair drier'},\n",
       " 90: {'id': 90, 'name': 'toothbrush'}}"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "category_index"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Helper code"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "def load_image_into_numpy_array(image):\n",
    "  (im_width, im_height) = image.size\n",
    "  return np.array(image.getdata()).reshape(\n",
    "      (im_height, im_width, 3)).astype(np.uint8)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This is a helper function that takes the detection graph output tensor (np arrays), stacks the classes and scores, and determines if the class for a person (1) is available within a certain score and within a certain amount of objects"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "def object_counter(classes_arr, scores_arr, score_thresh=0.5):\n",
    "    # Process the numpy array of classes from the model\n",
    "    stacked_arr = np.stack((classes_arr, scores_arr), axis=-1)\n",
    "    # Convert to pandas dataframe for easier querying\n",
    "    detection_df = pd.DataFrame(stacked_arr)\n",
    "    # Retrieve total count of cars with score threshold above param value\n",
    "    detected_cars = detection_df[(detection_df[0] == 3.0) & (detection_df[1] > score_thresh)]\n",
    "    detected_people =  detection_df[(detection_df[0] == 1.0) & (detection_df[1] > score_thresh)]\n",
    "    detected_bicycles =  detection_df[(detection_df[0] == 2.0) & (detection_df[1] > score_thresh)]\n",
    "    detected_motorcycles =  detection_df[(detection_df[0] == 4.0) & (detection_df[1] > score_thresh)]\n",
    "    detected_buses =  detection_df[(detection_df[0] == 6.0) & (detection_df[1] > score_thresh)]\n",
    "    detected_trucks =  detection_df[(detection_df[0] == 8.0) & (detection_df[1] > score_thresh)]\n",
    "    \n",
    "    car_count = len(detected_cars)\n",
    "    people_count = len(detected_people)\n",
    "    bicycle_count = len(detected_bicycles)\n",
    "    motorcycle_count = len(detected_motorcycles)\n",
    "    bus_count = len(detected_buses)\n",
    "    truck_count = len(detected_trucks)\n",
    "\n",
    "    return car_count, people_count, bicycle_count, motorcycle_count, bus_count, truck_count"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "def car_counter(classes_arr, scores_arr, score_thresh=0.5):\n",
    "    # Process the numpy array of classes from the model\n",
    "    stacked_arr = np.stack((classes_arr, scores_arr), axis=-1)\n",
    "    # Convert to pandas dataframe for easier querying\n",
    "    detection_df = pd.DataFrame(stacked_arr)\n",
    "    # Retrieve total count of cars with score threshold above param value\n",
    "    detected_cars = detection_df[(detection_df[0] == 3.0) & (detection_df[1] > score_thresh)]\n",
    "    car_count = len(detected_cars)\n",
    "    \n",
    "    return car_count"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "def person_in_image(classes_arr, scores_arr, obj_thresh=5, score_thresh=0.5):\n",
    "    stacked_arr = np.stack((classes_arr, scores_arr), axis=-1)\n",
    "    person_found_flag = False\n",
    "    for ix in range(obj_thresh):\n",
    "        if 1.00000000e+00 in stacked_arr[ix]:\n",
    "            if stacked_arr[ix][1] >= score_thresh:\n",
    "                person_found_flag = True\n",
    "            \n",
    "    return person_found_flag"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### COCO Dataset Labeled Classes\n",
    "\n",
    "{1: {'id': 1, 'name': 'person'},\n",
    " 2: {'id': 2, 'name': 'bicycle'},\n",
    " 3: {'id': 3, 'name': 'car'},\n",
    " 4: {'id': 4, 'name': 'motorcycle'},\n",
    " 5: {'id': 5, 'name': 'airplane'},\n",
    " 6: {'id': 6, 'name': 'bus'},\n",
    " 7: {'id': 7, 'name': 'train'},\n",
    " 8: {'id': 8, 'name': 'truck'},\n",
    " 9: {'id': 9, 'name': 'boat'},\n",
    " 10: {'id': 10, 'name': 'traffic light'},\n",
    " 11: {'id': 11, 'name': 'fire hydrant'},\n",
    " 13: {'id': 13, 'name': 'stop sign'},\n",
    " 14: {'id': 14, 'name': 'parking meter'},\n",
    " 15: {'id': 15, 'name': 'bench'},\n",
    " 16: {'id': 16, 'name': 'bird'},\n",
    " 17: {'id': 17, 'name': 'cat'},\n",
    " 18: {'id': 18, 'name': 'dog'},\n",
    " 19: {'id': 19, 'name': 'horse'},\n",
    " 20: {'id': 20, 'name': 'sheep'},\n",
    " 21: {'id': 21, 'name': 'cow'},\n",
    " 22: {'id': 22, 'name': 'elephant'},\n",
    " 23: {'id': 23, 'name': 'bear'},\n",
    " 24: {'id': 24, 'name': 'zebra'},\n",
    " 25: {'id': 25, 'name': 'giraffe'},\n",
    " 27: {'id': 27, 'name': 'backpack'},\n",
    " 28: {'id': 28, 'name': 'umbrella'},\n",
    " 31: {'id': 31, 'name': 'handbag'},\n",
    " 32: {'id': 32, 'name': 'tie'},\n",
    " 33: {'id': 33, 'name': 'suitcase'},\n",
    " 34: {'id': 34, 'name': 'frisbee'},\n",
    " 35: {'id': 35, 'name': 'skis'},\n",
    " 36: {'id': 36, 'name': 'snowboard'},\n",
    " 37: {'id': 37, 'name': 'sports ball'},\n",
    " 38: {'id': 38, 'name': 'kite'},\n",
    " 39: {'id': 39, 'name': 'baseball bat'},\n",
    " 40: {'id': 40, 'name': 'baseball glove'},\n",
    " 41: {'id': 41, 'name': 'skateboard'},\n",
    " 42: {'id': 42, 'name': 'surfboard'},\n",
    " 43: {'id': 43, 'name': 'tennis racket'},\n",
    " 44: {'id': 44, 'name': 'bottle'},\n",
    " 46: {'id': 46, 'name': 'wine glass'},\n",
    " 47: {'id': 47, 'name': 'cup'},\n",
    " 48: {'id': 48, 'name': 'fork'},\n",
    " 49: {'id': 49, 'name': 'knife'},\n",
    " 50: {'id': 50, 'name': 'spoon'},\n",
    " 51: {'id': 51, 'name': 'bowl'},\n",
    " 52: {'id': 52, 'name': 'banana'},\n",
    " 53: {'id': 53, 'name': 'apple'},\n",
    " 54: {'id': 54, 'name': 'sandwich'},\n",
    " 55: {'id': 55, 'name': 'orange'},\n",
    " 56: {'id': 56, 'name': 'broccoli'},\n",
    " 57: {'id': 57, 'name': 'carrot'},\n",
    " 58: {'id': 58, 'name': 'hot dog'},\n",
    " 59: {'id': 59, 'name': 'pizza'},\n",
    " 60: {'id': 60, 'name': 'donut'},\n",
    " 61: {'id': 61, 'name': 'cake'},\n",
    " 62: {'id': 62, 'name': 'chair'},\n",
    " 63: {'id': 63, 'name': 'couch'},\n",
    " 64: {'id': 64, 'name': 'potted plant'},\n",
    " 65: {'id': 65, 'name': 'bed'},\n",
    " 67: {'id': 67, 'name': 'dining table'},\n",
    " 70: {'id': 70, 'name': 'toilet'},\n",
    " 72: {'id': 72, 'name': 'tv'},\n",
    " 73: {'id': 73, 'name': 'laptop'},\n",
    " 74: {'id': 74, 'name': 'mouse'},\n",
    " 75: {'id': 75, 'name': 'remote'},\n",
    " 76: {'id': 76, 'name': 'keyboard'},\n",
    " 77: {'id': 77, 'name': 'cell phone'},\n",
    " 78: {'id': 78, 'name': 'microwave'},\n",
    " 79: {'id': 79, 'name': 'oven'},\n",
    " 80: {'id': 80, 'name': 'toaster'},\n",
    " 81: {'id': 81, 'name': 'sink'},\n",
    " 82: {'id': 82, 'name': 'refrigerator'},\n",
    " 84: {'id': 84, 'name': 'book'},\n",
    " 85: {'id': 85, 'name': 'clock'},\n",
    " 86: {'id': 86, 'name': 'vase'},\n",
    " 87: {'id': 87, 'name': 'scissors'},\n",
    " 88: {'id': 88, 'name': 'teddy bear'},\n",
    " 89: {'id': 89, 'name': 'hair drier'},\n",
    " 90: {'id': 90, 'name': 'toothbrush'}}"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Establish Connection to GIS via ArcGIS API for Python"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Authenticate"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "import arcgis"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Attempting to log in to 'https://esrifederal.maps.arcgis.com'...\n",
      "Please sign in to your GIS and paste the code that is obtained below.\n",
      "If a web browser does not automatically open, please navigate to the URL below yourself instead.\n",
      "Opening web browser to navigate to: https://esrifederal.maps.arcgis.com/sharing/rest/oauth2/authorize?client_id=wt3QUR1M4eum0TVI&response_type=code&expiration=-1&redirect_uri=urn%3Aietf%3Awg%3Aoauth%3A2.0%3Aoob\n",
      "Enter code obtained on signing in using SAML: ········\n",
      "Successfully logged in as: albe9057@esri.com_esrifederal\n"
     ]
    }
   ],
   "source": [
    "portals_dict = {\n",
    "    \"esrifederal_gis\": r\"https://esrifederal.maps.arcgis.com\",\n",
    "    \"natgov_gis\": r\"http://esri-natgov105.eastus.cloudapp.azure.com/arcgis\",\n",
    "    \"dot_gis\": r\"http://dot.esri.com/portal\",\n",
    "    \"dev_gis\": r\"http://govdev.eastus.cloudapp.azure.com/arcgis\",\n",
    "    \"local_gis\": r\"https://anieto.esri.com/arcgis\",\n",
    "    \"brett_gis\": r\"https://agsbase.dcwebgis.net/portal\"\n",
    "}\n",
    "\n",
    "gis_url = portals_dict[\"esrifederal_gis\"]\n",
    "\n",
    "if gis_url == portals_dict[\"esrifederal_gis\"]:\n",
    "    gis_app_id = r\"wt3QUR1M4eum0TVI\"\n",
    "    print(\"Attempting to log in to '{0}'...\".format(gis_url))\n",
    "    gis = arcgis.gis.GIS(gis_url, client_id=gis_app_id)\n",
    "    print(\"Successfully logged in as: \" + gis.properties.user.username)\n",
    "else:\n",
    "    gis_username = getpass.getpass(prompt=\"Username: \")\n",
    "    gis_pw = getpass.getpass(prompt=\"Password: \")\n",
    "    print(\"Attempting to log in to '{0}'...\".format(gis_url))\n",
    "    gis = arcgis.gis.GIS(gis_url, gis_username, gis_pw, verify_cert=False)\n",
    "    print(\"Successfully logged in as: \" + gis.properties.user.username)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Retrieve the Object Detection Point Layer"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div class=\"item_container\" style=\"height: auto; overflow: hidden; border: 1px solid #cfcfcf; border-radius: 2px; background: #f6fafa; line-height: 1.21429em; padding: 10px;\">\n",
       "                    <div class=\"item_left\" style=\"width: 210px; float: left;\">\n",
       "                       <a href='https://esrifederal.maps.arcgis.com/home/item.html?id=e11e73c31f7a4550882eb4df3ed7a028' target='_blank'>\n",
       "                        <img src='data:image/png;base64,/9j/4AAQSkZJRgABAQEAAAAAAAD/2wBDAAgGBgcGBQgHBwcJCQgKDBQNDAsLDBkSEw8UHRofHh0aHBwgJC4nICIsIxwcKDcpLDAxNDQ0Hyc5PTgyPC4zNDL/2wBDAQkJCQwLDBgNDRgyIRwhMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjL/wAARCACFAMgDAREAAhEBAxEB/8QAHwAAAQUBAQEBAQEAAAAAAAAAAAECAwQFBgcICQoL/8QAtRAAAgEDAwIEAwUFBAQAAAF9AQIDAAQRBRIhMUEGE1FhByJxFDKBkaEII0KxwRVS0fAkM2JyggkKFhcYGRolJicoKSo0NTY3ODk6Q0RFRkdISUpTVFVWV1hZWmNkZWZnaGlqc3R1dnd4eXqDhIWGh4iJipKTlJWWl5iZmqKjpKWmp6ipqrKztLW2t7i5usLDxMXGx8jJytLT1NXW19jZ2uHi4+Tl5ufo6erx8vP09fb3+Pn6/8QAHwEAAwEBAQEBAQEBAQAAAAAAAAECAwQFBgcICQoL/8QAtREAAgECBAQDBAcFBAQAAQJ3AAECAxEEBSExBhJBUQdhcRMiMoEIFEKRobHBCSMzUvAVYnLRChYkNOEl8RcYGRomJygpKjU2Nzg5OkNERUZHSElKU1RVVldYWVpjZGVmZ2hpanN0dXZ3eHl6goOEhYaHiImKkpOUlZaXmJmaoqOkpaanqKmqsrO0tba3uLm6wsPExcbHyMnK0tPU1dbX2Nna4uPk5ebn6Onq8vP09fb3+Pn6/9oADAMBAAIRAxEAPwD2+sygoAKADGTj1pgDHIJ7UdQQi8Io9qbAWpAUd/pTQirefMiR93cfl1NXDS7M6uqUe4yMO0olCHb0yzc4qN2aWsi0hRsgYxjkU7Be5lRvOt2W+zoJeflEnHT6dKVkPWxNJNcSACWBETruEgbn0xWGIt7NmtH4x9jM7kRHACpngfStk9EZyWpdx70xCK6uMqQR04pAOBz0oAKAI5k8yFlHXHH1oewmroSM+ZGsg4YjmmnoCd0SK2fY+lAxaQBQAUAFABQAUAFACjr+B/lTQhjc4Ud6a7jHUgCkAvY0+gijKGaWd8j5AAM9gQc1b+BER1qO4yUJDbKykkyDByxrM1JNPUFXbBHbrTiKQpt3+2GTqh46+1G7DZFWVlhdY1ikIc9VGQK56nvLlZtDTUWxDSqfLEkZ+78y4PrmrhJvQmSS1NEpNFbg7Wkce3WtbGY23hMMZDEcnNFgbII7xGuXgddjKTsPZh3x70AWYpFkTcucdMnvSAfQBBD8kkkfodw+hpLsStHYlZc8jg9jVXKFU5XNAC0gCgAoAKACgAoAa77ADjJzjFVFXYWuA5cmh7AOqQCgBpIYmI4ww5OeRTAqBGdLkRtsUFV3MOCADmrl8KRnD42xsjRMrBiuxMBNp68VmaktgyMrlYyv/As00JkaTmKXy/s5Tc2cljzSQ2ilcBprhf3UnygkFX4z+Vc8tzZbEumoLf5GR0DNwXfdk8j+n61VPcmexoRqIgEaQsSeC1bmQ1hI0oB4VTuyO49KFuBUlX5JPLXfJC/mA9PqKEDLiNsRZMu2/GAe2fakBYx7jPXFOwivL8k8cnY/Kal7iejuT0yhqfcFNgx1IAoAKACgAoAKAGkbnA7DmnsA4AAYFABSAKAK80h8wpEoMmOW/uirjFbszlJ35Y7iWqxvBLDDye5x1JB5ob5iox5VYYYfsMDyXDDZx2zikkymyO2v7dUO6Vem7IXHHH+NCTE2iNrqO6vYlSRWXftUY6nv/KlZjurEWoW8mn2U1wEDHcNo9Mmsa8fcNaUveLaWvmwQZOCq84rVJWVjNvVkk2xUXe7KBxwapkxYtu0ZOEkZiwzhjS0G7lgKq5IUAnrgdaQEKyTl0DoNpJzx09Kdwshk126zlAvAPJx1ouCRNOm+FgOvUUmKSuhqXMRQEuoOORmldCUkIlxDsH7xfzptobkh32mD/nqv50XQcyE+1Qf89U/Oi4XQfarf/nsn50XC6JPn9F/OnoPQMv8A3V/76/8ArUaBoGX/ALq/99f/AFqNA0BQRknqTQwHUgCgBvmLvKZ+YDOKYFRGK25nG4szk4HcelXPsZ0tVfuPWVZLW5McbIwTnIx3qFsaPcpwxSvG3y7g3cnrg0ajdhZ7pg0aJGseJVVyMHIPahMTRJbQSsUlDjbmkhuxQ1mKWKycyyAgsOATk8+lZVvgNKVuY2LeaL7NF+8T7o/iq4fCiJLVhMIJQCzqQPRqta6EO61GpFEjKbfaTkZ+bOBSKuTBNrs24/N2PamIcCMDceaAKtxdGGQoEzxnJNFxpEIv5QBwp45z3pBYs288c/GwBwMkYoE0JPbM0imJYwB1z3oBWFEciwsTFG0g6ADg0BoM/fMpHkRo2OCcUBZDFS4VD+7Rju746UBZF+gAoAKACgAoAQkDqQKYFOa9QyrDCC0rAkEDjjA6/jVqFtZGUp3VokwhaO38tGUYxtJ9aTk3qXGKSSIbWNmivEyuThcgd81KKYtvAyr/AK0MnIwOlCBlOZWh2Rh+k65H50IGS2klxwgT92MjOO9JDdiprrTCyeOXY4wD8owetZVvhNKfxGjaQxrbRny15UdRWlNLlRE27smKRcKRFz0GBzWnKZ8w6NFQ/Kqj3AoaBPoIxyC3JwMgVJRkuzO2XJJ96RRMYpp1WTG7jaPoP/10BdIbskgw7IMHj5hmgC7ZNG+5ljCsMA4oEyaacxyxRqMljz9KbYkiCS6m8lXRcHJzx0Aoux2Q69hjngRpEV2HQkkDnrTvoKxD/Z8LwK3kKXxgDecY/OldhZGhSAKACgAoAbI5RNwUt7CgCsQLyUcHyk/U1p8K8zL43boSNNElq0sYBCMF9PWovpc1StoRksbaQsWPAYdvwFHQfUj/ALRWPgQEh2VSc9Opz+lCE0OF7GEIjQjHOKB2Ks7edFEzIEJnUZHc80ITLogeMAtKSqc4xQgbM+8U36jehEROCR/jWFd+4bUl71i3aTGRPLH3VVQOK0pfCjOa1ZK9qktxHM4O5PujoK6VNpNLqYSpqUlJ9CbPzAe39ah7FdQGVI4yOlSURyW8DnJQg5ycClYdyQEKMLwOnSgQ/AIwQD9aGMRUVM7VAz6UgK320SIJI42P7wp05OOuKbBDrmRFVVfeFYHIUUhoWbyvsilgWjGMY60+gluIt1CIMx7mVeMAUh2LNAgoAKACgCC5chAiHDucD29auC1uzOo3ay6jXWN9PdI2ZVAI3KcHj3pN31LUbaGfbLG6NAbi58zh8CQ9BkdfxqXKyuRVlyK6JxbZ+b7RcjPO3zOlZ+1ZzvESQ26byVts5fY4ALHknB5PHPQ/nWkJcyZtSqOe5Pa3LTvgwxhcckLTTNmrE9xAZxEFYL5cgfp1x2ppiENyFLeYgCg7cjB5pXHYLgKkGFVQCegGKxxD/ds0o/GiKKdFKRiFcsmSQKum/dRM1qxs8ck6SMTJCE+6Yzjd9a0uTYqrG21mNzcD5M4D+49vb9TS5gcSRCsVwge5uWw4ADMCGJ554piNXPsKVwIEn8y6lh2bRGAd2fvZ/wD1U+gE1SMKAKNlI62rtFHvJlfILdOTVMSJmuZAXHlDKqDSuOxUK7pJEW4vDIBuKK33d2Txx9fyp30FYQwMAn7+9X23jnH4UrjsalIAoAKAGu6xqWYgAdzTSb0Qm0ldlZW8yYTSEIgBCBjgkdzVytFcpnG8pcwsse0RLG2F5yag1KY2Q3zu0oIWHqF4I3ev4Gpn8JjiPgJlu4HViJOg9DWCRwpIrXLxzzWzB1aNZMsDnn5T0/OtaWzOrDdS3bTxxoV2MgHPPOatHW0WYrhZJCig8ZzTQmihd7RKyoCOctz1NIpFi5byrINO6jaRuYnAH41nVhKceWKuxwlGMrydkZ1uSypg53Drn2qoJxikwk03dE0E6KHSSQjeuFBPU1SJYyNfMb5mwqj8/akMCxM8bMTkyr0GOapEs1DMwuhEVGCuQaQEEDf8Ta7XHOyPnP1p9BF2kMKAM61HnR7jJtxO/HTPNNgia+RjGHDYC0hohSWOC8nf5j8kY6dsHHNPoLqWppT5Q2AlmGcAdqQE9ABQAjMFUsxwB1NNK4m7FDzBcq0xdVC/6tWPH1NaS9zRGcVzvmexFIzsoa4VJFHAKvj+VZG5dlkjWGPf8qkdPwqk9CbGdZr/AKYxJX/VYA7/AHv5VE/gMsR8DJrm4VIyIz8+fSsoRu9ThlTmo81iGH7RP++BBEDB2B6kYIwMfWt0ktjbCNu9y/KwaPc8gEbDOAvNB2kdo5F28e4MCuQ2MGhDewSOGklVbZSR1Yn9elIDK1a0j1nTjY3M8wSQj7gAwR71th8bPBT9tBXa7mdbCxxMPZSdkx2n2osbaCFCDFCgUbmySAO9TUryxE3Wlu9SqdKNGCpx6Es+0xQyfu0bzCOh546Co6FPclgZV5Y4G9f60hlm+ZGW3dcHMygHnjNUiGWsLvDlcsBjNFhJsrW5U6pd4B3bEJy31xx+dDWg0yzJNHFje2M1IxYpkmBKHIHtigCOeEv5fl4XDZJxTYIjuZXRkRPm/vDA5pDQ1oWjlluWkjxKEARxgLj379ab2EtyeQJNCAJAAe4NICagCKeYQpwMueFX1NVGN2RKXKiBLSWcbrmTPORGOAK05kvhJ5G/iFhsgS7TgZPAA9Kyt3Nb9h/2GDZtAYc5zmiyC7Euvs4SNZd/HTFGgK5TNvIJftNmgkRkEeHbaRyST/KiyasTOPNow+z3CquLONm5zmSlyruTKHMrPYlD3MMFx/oaAYXOHHIzTSSQqdNQ2K0UnmEK8OxQpywfdgUaG2pbtkgSUlZWJ2E/d7UKwO5FGsHmA+e5Oe60KwajGjtxtKzMWB4BXrWGIt7NmtK/OiWKyiMSnzjyPSqpyjyrUwqVoqTTFmtAI02yHbGxZjj8K1TT2FGak9BkSWw6yMfmXjb9aNC9S8LaFWZm5yd2D2NCsIUr5gVklIH060xDHhELSXEQLzOu3aTwcdP50+gupXke5kwzWQYjsXqbIq44T3QyBZAcZHzjB5H9M/lRZCEeWWVoxPbtGucFhIOKbsNFpkhVQXK8d2HNLQNRZY0ngC7uDzkCnpYCFbe3wImbeR2J6UtAuyWaUQpkjJPAUdzTjG7JlLlRUjmVbnMpzIeN3ZfanKXRbCjB/FLctxGQp+9UBs9qgsWUkKMHHNTJ2RUVdmOb+4C79sYYsFx5wxjn3rHnkacqLTpvlTzCXXcTz2raEjOST0J7RwLDKkZBOP1qrqwmtSGK6uC5BUN7Hilcdi1OwNjcHI+6uefeqT0J6massWzagG7YdxpJoqxLbkGc4P8AyyNCEyCMESLwetCGyJ3SMCSR1RFOSzHAH1NZ1ISqR5YK7fYuM4wfNJ2RpW5D20bIQylQQQcg1lySh7slZo8ur71RuOqJHB+zTf7ta09ma4ZNNmfEwX5uoV1PH41odhpJc77gxbCBjOfwzQTYnoAD0X6t/Sq6C6lYwyfbBLkbPTNSVfQiV7iWaQByqqOOOtAGXp2qXqQ/8VBHFbyl2KoMH5RgA8E8ZOM/Sk5JbjSvsatyjSXEW1Qwx/EDimJFhzJHAnlohYdVzgfhT6CIFEvnFhDECRkN7+9IehFM0o/esBuPAA/g/wDr1cmkrIzhFt80hbay3YeUcdl9ag0bLUtxHFx1b0FZzqxhuVCnKWxVluJnRnAVVUE89OneseepPW1kacsI9dTJZENupC2ud3Gckdvf3P5igZYk0u2u5lmlecSumT5UpVeB2FWqUZasl1GtERf2RbNaTyq9wrGQZ2ykdaf1eFg9rK4QaWLdklAuiqjo0pIx9DSeHgxqrJGrHBDJbu6l8Y74/wAKSwsLCdeVygShPyKR68A/0pfVYFe2kW4IYZGIywIU7gQM/wAqawsBOvIp9GGP5D/Cp+qwH7aRBdaZBq0DWU+5Y5SFJTAI/SuvAt4Ouq1PddznxUViKTpz2ZZ0/GkWUVhbgGKEFVLjJP1rbEYideq6k92Z0aEaVNQjsiyupy5GVTB6/KKw5jXlLEV80iTEIo2IGHA600xWIf7Rl/up/wB8ii7HygL+5L7fLXIG77valdhZE4vJGs1l2AneRgD2FVfQTjqQSxC5zcPCfMGMfOcH8BSuwViBLGGRMJbsQrEMPNYc9fX3ouwshI9KsbuYsYZRiPjc5PGQe/0FS4qT1Ku47G1uPqaq5Abm/vH86LsBQzZPzN09TTTAyLPzmmyBkfxE9DUlstS3DO3lQcn1Fc06rk+SnuaQppLmmMaIQRbhteXPTtV06Kjq9WKVRy0WiGIIShllcgyZBGOlatJ7kXa2IGWMSCOEbhjPI68cVPIiuZk63LRxhTAeBjJFUlYl6kV1fW1lpqvKhCzS7AAepwT/ACU0SkorUFFtjrXUlmtkcDCtGGTIPII4oUk1cHGzL6HNoTgcrnAqiepWto41iWXYAzZ5PQUhu4+FEMjzKwb5SD9aaEyoIlaNGVSWYkAZpFC2+0Xca+Xhg3PNCE9gjwRNKY1IXsT6mgCf7LasFYsq5HQNRoF2NjEKrcrGCdqYJzwaaB3EiggaJGc7WboM0g1DO12faGAQrkZx9KAJoJGFkjRxZO9uAfpT6C6j1YTK+9duDhg1FxW6kijYDtAGfTvTt2FfuVJ7l43hTeqsZMMF6dOlCKY8XUu1HIQqxx8vJpPTcFZ7MeLiUj/UN0yKAsOW42sfNAQH5V75J7UIGQlhIRBAMJ3I71yzm6j5IG8YqK55kkbQQSiEBi7dTn/61b06cYKyMpylN3YgitmlaHymyvzZ3etXoTqIVskQ/KdobHXPNGgai+XaxywyAPmQDbzx6elGgaheLLKqpA0IGfnEpPT2xRoGpSurOV7MLKlo8SOGxhjtPIyD9CaGk1qCbuVcyKQqJCEUBVVcjAApaFamxaOP7OzJnIU7tpp6WJ1uECQTW4QByqn+I85/CjQNRLf7PHPJGu8ttOc+woVgdyKNrcvEqeYMHI6UaD1Lkb27TDDKXz2xmhWFqURJaKJI/wB7tc8nAo0HqBjsQeZJARS0DUsQQW7W7lC4VxyTTVhNsb5ds6qwkfbFxmjQepIkULwMisxVjnPFGgtSREjt4VQM3LHG714p6WAoMLpfM3JbjeR1c8/4UtA1HtJfKAgit9+CQu89PrimrCa0K8zzG8hMojiAb5ikhyeOmCOaNALIe1DqTPM23kAjNLQrUsu1vMvlu2Qwzjp/WjQWpWuoIVEGzgecp7/401YTbLUUKwrgde5rKnBQVkXObk7sc0ce/wA0qM9c1oySmAZrmfyz0CjOfxpDEki8q3kMq5zJkYNAFlViMFuzYGEBXcfc0xFB44GkY+bjJ/u0ihXngit/su8kyksGC8cYz/MU+gupNDYJgOzbs8jHFKwXLLokdrIMYTacgU+gupRgnjgkJUsVI6Ed6Q3csW8e+Z7kHKsGwMe1NCfYiVJPtQlMJVAOg+lIY6ARC5QrHKGJ7jihbg9iKWIPMfnUYO0gLQFye7t/MQFSFCjnNFgTEtS4tZcOCFX5eOlNbA9xUlhnQQ8hmHOBjmkA3K2cqonzbzySaA3LVxGZI0w20q+7NPoJEO9GkCbVMh5bigCTBEoLEE4OPWgClKr3EyvEQ0cbbuR2x2p7itYmLMsPmIFTbgNleo9qkoPsyl5XdsKx7jvRYLjLmNEFvGGX5Zg3J+tNCZoUgGyp5lu6ZxkEZ+oNPoHUp6enlyTpnO0qM+vFJDY/UD/o/wBGFDBDJovMtLb5sYjHam9gW5KtpBtGUyceppBcilsg1xG0b+WArDAHrjn9BT6CvqWvKJVAJGG3v60gHunmROhONwxmmBSbT1CkiQ9PSkO5PY/8ew/GmhMkmcxws4GSBSAqwXryTohVQCaaG1oLJG0Tyyq4ycY46c0gCHzWZ90pOQeo4FAEttB5cbqzbg3timhMqWIxcH6UimA3ReYVbnf3GaAJ5t0tpCCxBZuSKb2JW5KYB5HlqxBxjd3pBccYgUAJ+YLgN3FACxRiKIoCTweTTQMFU42sQ34U3qiVoxrQ+ZGyOxIJyPapKKV5AIljbezNu6k00B//2Q==' width='200' height='133' class=\"itemThumbnail\">\n",
       "                       </a>\n",
       "                    </div>\n",
       "\n",
       "                    <div class=\"item_right\"     style=\"float: none; width: auto; overflow: hidden;\">\n",
       "                        <a href='https://esrifederal.maps.arcgis.com/home/item.html?id=e11e73c31f7a4550882eb4df3ed7a028' target='_blank'><b>JHWY_ML_Detection_02</b>\n",
       "                        </a>\n",
       "                        <br/>Object Detection Layer<img src='https://esrifederal.maps.arcgis.com/home/js/jsapi/esri/css/images/item_type_icons/featureshosted16.png' style=\"vertical-align:middle;\">Feature Layer Collection by albe9057@esri.com_esrifederal\n",
       "                        <br/>Last Modified: November 30, 2017\n",
       "                        <br/>0 comments, 44 views\n",
       "                    </div>\n",
       "                </div>\n",
       "                "
      ],
      "text/plain": [
       "<Item title:\"JHWY_ML_Detection_02\" type:Feature Layer Collection owner:albe9057@esri.com_esrifederal>"
      ]
     },
     "execution_count": 23,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "object_point_srvc = gis.content.search(\"JHWY_ML_Detection_02\")[1]\n",
    "object_point_srvc"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style>\n",
       "    .dataframe thead tr:only-child th {\n",
       "        text-align: right;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: left;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>CreationDate</th>\n",
       "      <th>Creator</th>\n",
       "      <th>EditDate</th>\n",
       "      <th>Editor</th>\n",
       "      <th>OBJECTID</th>\n",
       "      <th>RT_Bicycle_Count</th>\n",
       "      <th>RT_Bus_Count</th>\n",
       "      <th>RT_Car_Count</th>\n",
       "      <th>RT_Motorcycle_Count</th>\n",
       "      <th>RT_Object_Count</th>\n",
       "      <th>RT_Pedestrian_Count</th>\n",
       "      <th>RT_Truck_Count</th>\n",
       "      <th>RT_Vehicle_Count</th>\n",
       "      <th>SHAPE</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1512078543076</td>\n",
       "      <td>albe9057@esri.com_esrifederal</td>\n",
       "      <td>1516297658626</td>\n",
       "      <td>albe9057@esri.com_esrifederal</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>{'x': -12330007.8039, 'y': 5385259.123000003}</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "    CreationDate                        Creator       EditDate  \\\n",
       "0  1512078543076  albe9057@esri.com_esrifederal  1516297658626   \n",
       "\n",
       "                          Editor  OBJECTID  RT_Bicycle_Count  RT_Bus_Count  \\\n",
       "0  albe9057@esri.com_esrifederal         1                 0             0   \n",
       "\n",
       "   RT_Car_Count  RT_Motorcycle_Count  RT_Object_Count  RT_Pedestrian_Count  \\\n",
       "0             0                    0                0                    0   \n",
       "\n",
       "   RT_Truck_Count  RT_Vehicle_Count  \\\n",
       "0               0                 0   \n",
       "\n",
       "                                           SHAPE  \n",
       "0  {'x': -12330007.8039, 'y': 5385259.123000003}  "
      ]
     },
     "execution_count": 24,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Convert our existing service into a pandas dataframe\n",
    "object_point_lyr = object_point_srvc.layers[0]\n",
    "obj_fset = object_point_lyr.query()  #querying without any conditions returns all the features\n",
    "obj_df = obj_fset.df\n",
    "obj_df.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[{\"geometry\": {\"x\": -12330007.8039, \"y\": 5385259.123000003}, \"attributes\": {\"OBJECTID\": 1, \"RT_Object_Count\": 0, \"RT_Vehicle_Count\": 0, \"RT_Car_Count\": 0, \"RT_Truck_Count\": 0, \"RT_Pedestrian_Count\": 0, \"RT_Bicycle_Count\": 0, \"RT_Motorcycle_Count\": 0, \"RT_Bus_Count\": 0, \"CreationDate\": 1512078543076, \"Creator\": \"albe9057@esri.com_esrifederal\", \"EditDate\": 1516297658626, \"Editor\": \"albe9057@esri.com_esrifederal\"}}]"
      ]
     },
     "execution_count": 25,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "all_features = obj_fset.features\n",
    "all_features"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{\"geometry\": {\"x\": -12330007.8039, \"y\": 5385259.123000003}, \"attributes\": {\"OBJECTID\": 1, \"RT_Object_Count\": 0, \"RT_Vehicle_Count\": 0, \"RT_Car_Count\": 0, \"RT_Truck_Count\": 0, \"RT_Pedestrian_Count\": 0, \"RT_Bicycle_Count\": 0, \"RT_Motorcycle_Count\": 0, \"RT_Bus_Count\": 0, \"CreationDate\": 1512078543076, \"Creator\": \"albe9057@esri.com_esrifederal\", \"EditDate\": 1516297658626, \"Editor\": \"albe9057@esri.com_esrifederal\"}}"
      ]
     },
     "execution_count": 26,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from copy import deepcopy\n",
    "\n",
    "original_feature = all_features[0]\n",
    "feature_to_be_updated = deepcopy(original_feature)\n",
    "feature_to_be_updated"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Detection"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# logging = \"verbose\"  # Options: verbose | simple | cars\n",
    "# logging = \"simple\"\n",
    "# logging = \"cars\"\n",
    "logging = \"none\""
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# ArcGIS API for Python and TensorFlow Deep Learning Model\n",
    "\n",
    "## Traffic Intersection Object Detection"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Training Dataset Labeled Classes\n",
    "\n",
    "{1: {'id': 1, 'name': 'person'},\n",
    " 2: {'id': 2, 'name': 'bicycle'},\n",
    " 3: {'id': 3, 'name': 'car'},\n",
    " 4: {'id': 4, 'name': 'motorcycle'},\n",
    " 5: {'id': 5, 'name': 'airplane'},\n",
    " 6: {'id': 6, 'name': 'bus'},\n",
    " 7: {'id': 7, 'name': 'train'},\n",
    " 8: {'id': 8, 'name': 'truck'},\n",
    " 9: {'id': 9, 'name': 'boat'},\n",
    " 10: {'id': 10, 'name': 'traffic light'},\n",
    " 11: {'id': 11, 'name': 'fire hydrant'},\n",
    " 13: {'id': 13, 'name': 'stop sign'},\n",
    " 14: {'id': 14, 'name': 'parking meter'},\n",
    " 15: {'id': 15, 'name': 'bench'}}"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div class=\"item_container\" style=\"height: auto; overflow: hidden; border: 1px solid #cfcfcf; border-radius: 2px; background: #f6fafa; line-height: 1.21429em; padding: 10px;\">\n",
       "                    <div class=\"item_left\" style=\"width: 210px; float: left;\">\n",
       "                       <a href='https://esrifederal.maps.arcgis.com/home/item.html?id=e11e73c31f7a4550882eb4df3ed7a028' target='_blank'>\n",
       "                        <img src='data:image/png;base64,/9j/4AAQSkZJRgABAQEAAAAAAAD/2wBDAAgGBgcGBQgHBwcJCQgKDBQNDAsLDBkSEw8UHRofHh0aHBwgJC4nICIsIxwcKDcpLDAxNDQ0Hyc5PTgyPC4zNDL/2wBDAQkJCQwLDBgNDRgyIRwhMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjL/wAARCACFAMgDAREAAhEBAxEB/8QAHwAAAQUBAQEBAQEAAAAAAAAAAAECAwQFBgcICQoL/8QAtRAAAgEDAwIEAwUFBAQAAAF9AQIDAAQRBRIhMUEGE1FhByJxFDKBkaEII0KxwRVS0fAkM2JyggkKFhcYGRolJicoKSo0NTY3ODk6Q0RFRkdISUpTVFVWV1hZWmNkZWZnaGlqc3R1dnd4eXqDhIWGh4iJipKTlJWWl5iZmqKjpKWmp6ipqrKztLW2t7i5usLDxMXGx8jJytLT1NXW19jZ2uHi4+Tl5ufo6erx8vP09fb3+Pn6/8QAHwEAAwEBAQEBAQEBAQAAAAAAAAECAwQFBgcICQoL/8QAtREAAgECBAQDBAcFBAQAAQJ3AAECAxEEBSExBhJBUQdhcRMiMoEIFEKRobHBCSMzUvAVYnLRChYkNOEl8RcYGRomJygpKjU2Nzg5OkNERUZHSElKU1RVVldYWVpjZGVmZ2hpanN0dXZ3eHl6goOEhYaHiImKkpOUlZaXmJmaoqOkpaanqKmqsrO0tba3uLm6wsPExcbHyMnK0tPU1dbX2Nna4uPk5ebn6Onq8vP09fb3+Pn6/9oADAMBAAIRAxEAPwD2+sygoAKADGTj1pgDHIJ7UdQQi8Io9qbAWpAUd/pTQirefMiR93cfl1NXDS7M6uqUe4yMO0olCHb0yzc4qN2aWsi0hRsgYxjkU7Be5lRvOt2W+zoJeflEnHT6dKVkPWxNJNcSACWBETruEgbn0xWGIt7NmtH4x9jM7kRHACpngfStk9EZyWpdx70xCK6uMqQR04pAOBz0oAKAI5k8yFlHXHH1oewmroSM+ZGsg4YjmmnoCd0SK2fY+lAxaQBQAUAFABQAUAFACjr+B/lTQhjc4Ud6a7jHUgCkAvY0+gijKGaWd8j5AAM9gQc1b+BER1qO4yUJDbKykkyDByxrM1JNPUFXbBHbrTiKQpt3+2GTqh46+1G7DZFWVlhdY1ikIc9VGQK56nvLlZtDTUWxDSqfLEkZ+78y4PrmrhJvQmSS1NEpNFbg7Wkce3WtbGY23hMMZDEcnNFgbII7xGuXgddjKTsPZh3x70AWYpFkTcucdMnvSAfQBBD8kkkfodw+hpLsStHYlZc8jg9jVXKFU5XNAC0gCgAoAKACgAoAa77ADjJzjFVFXYWuA5cmh7AOqQCgBpIYmI4ww5OeRTAqBGdLkRtsUFV3MOCADmrl8KRnD42xsjRMrBiuxMBNp68VmaktgyMrlYyv/As00JkaTmKXy/s5Tc2cljzSQ2ilcBprhf3UnygkFX4z+Vc8tzZbEumoLf5GR0DNwXfdk8j+n61VPcmexoRqIgEaQsSeC1bmQ1hI0oB4VTuyO49KFuBUlX5JPLXfJC/mA9PqKEDLiNsRZMu2/GAe2fakBYx7jPXFOwivL8k8cnY/Kal7iejuT0yhqfcFNgx1IAoAKACgAoAKAGkbnA7DmnsA4AAYFABSAKAK80h8wpEoMmOW/uirjFbszlJ35Y7iWqxvBLDDye5x1JB5ob5iox5VYYYfsMDyXDDZx2zikkymyO2v7dUO6Vem7IXHHH+NCTE2iNrqO6vYlSRWXftUY6nv/KlZjurEWoW8mn2U1wEDHcNo9Mmsa8fcNaUveLaWvmwQZOCq84rVJWVjNvVkk2xUXe7KBxwapkxYtu0ZOEkZiwzhjS0G7lgKq5IUAnrgdaQEKyTl0DoNpJzx09Kdwshk126zlAvAPJx1ouCRNOm+FgOvUUmKSuhqXMRQEuoOORmldCUkIlxDsH7xfzptobkh32mD/nqv50XQcyE+1Qf89U/Oi4XQfarf/nsn50XC6JPn9F/OnoPQMv8A3V/76/8ArUaBoGX/ALq/99f/AFqNA0BQRknqTQwHUgCgBvmLvKZ+YDOKYFRGK25nG4szk4HcelXPsZ0tVfuPWVZLW5McbIwTnIx3qFsaPcpwxSvG3y7g3cnrg0ajdhZ7pg0aJGseJVVyMHIPahMTRJbQSsUlDjbmkhuxQ1mKWKycyyAgsOATk8+lZVvgNKVuY2LeaL7NF+8T7o/iq4fCiJLVhMIJQCzqQPRqta6EO61GpFEjKbfaTkZ+bOBSKuTBNrs24/N2PamIcCMDceaAKtxdGGQoEzxnJNFxpEIv5QBwp45z3pBYs288c/GwBwMkYoE0JPbM0imJYwB1z3oBWFEciwsTFG0g6ADg0BoM/fMpHkRo2OCcUBZDFS4VD+7Rju746UBZF+gAoAKACgAoAQkDqQKYFOa9QyrDCC0rAkEDjjA6/jVqFtZGUp3VokwhaO38tGUYxtJ9aTk3qXGKSSIbWNmivEyuThcgd81KKYtvAyr/AK0MnIwOlCBlOZWh2Rh+k65H50IGS2klxwgT92MjOO9JDdiprrTCyeOXY4wD8owetZVvhNKfxGjaQxrbRny15UdRWlNLlRE27smKRcKRFz0GBzWnKZ8w6NFQ/Kqj3AoaBPoIxyC3JwMgVJRkuzO2XJJ96RRMYpp1WTG7jaPoP/10BdIbskgw7IMHj5hmgC7ZNG+5ljCsMA4oEyaacxyxRqMljz9KbYkiCS6m8lXRcHJzx0Aoux2Q69hjngRpEV2HQkkDnrTvoKxD/Z8LwK3kKXxgDecY/OldhZGhSAKACgAoAbI5RNwUt7CgCsQLyUcHyk/U1p8K8zL43boSNNElq0sYBCMF9PWovpc1StoRksbaQsWPAYdvwFHQfUj/ALRWPgQEh2VSc9Opz+lCE0OF7GEIjQjHOKB2Ks7edFEzIEJnUZHc80ITLogeMAtKSqc4xQgbM+8U36jehEROCR/jWFd+4bUl71i3aTGRPLH3VVQOK0pfCjOa1ZK9qktxHM4O5PujoK6VNpNLqYSpqUlJ9CbPzAe39ah7FdQGVI4yOlSURyW8DnJQg5ycClYdyQEKMLwOnSgQ/AIwQD9aGMRUVM7VAz6UgK320SIJI42P7wp05OOuKbBDrmRFVVfeFYHIUUhoWbyvsilgWjGMY60+gluIt1CIMx7mVeMAUh2LNAgoAKACgCC5chAiHDucD29auC1uzOo3ay6jXWN9PdI2ZVAI3KcHj3pN31LUbaGfbLG6NAbi58zh8CQ9BkdfxqXKyuRVlyK6JxbZ+b7RcjPO3zOlZ+1ZzvESQ26byVts5fY4ALHknB5PHPQ/nWkJcyZtSqOe5Pa3LTvgwxhcckLTTNmrE9xAZxEFYL5cgfp1x2ppiENyFLeYgCg7cjB5pXHYLgKkGFVQCegGKxxD/ds0o/GiKKdFKRiFcsmSQKum/dRM1qxs8ck6SMTJCE+6Yzjd9a0uTYqrG21mNzcD5M4D+49vb9TS5gcSRCsVwge5uWw4ADMCGJ554piNXPsKVwIEn8y6lh2bRGAd2fvZ/wD1U+gE1SMKAKNlI62rtFHvJlfILdOTVMSJmuZAXHlDKqDSuOxUK7pJEW4vDIBuKK33d2Txx9fyp30FYQwMAn7+9X23jnH4UrjsalIAoAKAGu6xqWYgAdzTSb0Qm0ldlZW8yYTSEIgBCBjgkdzVytFcpnG8pcwsse0RLG2F5yag1KY2Q3zu0oIWHqF4I3ev4Gpn8JjiPgJlu4HViJOg9DWCRwpIrXLxzzWzB1aNZMsDnn5T0/OtaWzOrDdS3bTxxoV2MgHPPOatHW0WYrhZJCig8ZzTQmihd7RKyoCOctz1NIpFi5byrINO6jaRuYnAH41nVhKceWKuxwlGMrydkZ1uSypg53Drn2qoJxikwk03dE0E6KHSSQjeuFBPU1SJYyNfMb5mwqj8/akMCxM8bMTkyr0GOapEs1DMwuhEVGCuQaQEEDf8Ta7XHOyPnP1p9BF2kMKAM61HnR7jJtxO/HTPNNgia+RjGHDYC0hohSWOC8nf5j8kY6dsHHNPoLqWppT5Q2AlmGcAdqQE9ABQAjMFUsxwB1NNK4m7FDzBcq0xdVC/6tWPH1NaS9zRGcVzvmexFIzsoa4VJFHAKvj+VZG5dlkjWGPf8qkdPwqk9CbGdZr/AKYxJX/VYA7/AHv5VE/gMsR8DJrm4VIyIz8+fSsoRu9ThlTmo81iGH7RP++BBEDB2B6kYIwMfWt0ktjbCNu9y/KwaPc8gEbDOAvNB2kdo5F28e4MCuQ2MGhDewSOGklVbZSR1Yn9elIDK1a0j1nTjY3M8wSQj7gAwR71th8bPBT9tBXa7mdbCxxMPZSdkx2n2osbaCFCDFCgUbmySAO9TUryxE3Wlu9SqdKNGCpx6Es+0xQyfu0bzCOh546Co6FPclgZV5Y4G9f60hlm+ZGW3dcHMygHnjNUiGWsLvDlcsBjNFhJsrW5U6pd4B3bEJy31xx+dDWg0yzJNHFje2M1IxYpkmBKHIHtigCOeEv5fl4XDZJxTYIjuZXRkRPm/vDA5pDQ1oWjlluWkjxKEARxgLj379ab2EtyeQJNCAJAAe4NICagCKeYQpwMueFX1NVGN2RKXKiBLSWcbrmTPORGOAK05kvhJ5G/iFhsgS7TgZPAA9Kyt3Nb9h/2GDZtAYc5zmiyC7Euvs4SNZd/HTFGgK5TNvIJftNmgkRkEeHbaRyST/KiyasTOPNow+z3CquLONm5zmSlyruTKHMrPYlD3MMFx/oaAYXOHHIzTSSQqdNQ2K0UnmEK8OxQpywfdgUaG2pbtkgSUlZWJ2E/d7UKwO5FGsHmA+e5Oe60KwajGjtxtKzMWB4BXrWGIt7NmtK/OiWKyiMSnzjyPSqpyjyrUwqVoqTTFmtAI02yHbGxZjj8K1TT2FGak9BkSWw6yMfmXjb9aNC9S8LaFWZm5yd2D2NCsIUr5gVklIH060xDHhELSXEQLzOu3aTwcdP50+gupXke5kwzWQYjsXqbIq44T3QyBZAcZHzjB5H9M/lRZCEeWWVoxPbtGucFhIOKbsNFpkhVQXK8d2HNLQNRZY0ngC7uDzkCnpYCFbe3wImbeR2J6UtAuyWaUQpkjJPAUdzTjG7JlLlRUjmVbnMpzIeN3ZfanKXRbCjB/FLctxGQp+9UBs9qgsWUkKMHHNTJ2RUVdmOb+4C79sYYsFx5wxjn3rHnkacqLTpvlTzCXXcTz2raEjOST0J7RwLDKkZBOP1qrqwmtSGK6uC5BUN7Hilcdi1OwNjcHI+6uefeqT0J6massWzagG7YdxpJoqxLbkGc4P8AyyNCEyCMESLwetCGyJ3SMCSR1RFOSzHAH1NZ1ISqR5YK7fYuM4wfNJ2RpW5D20bIQylQQQcg1lySh7slZo8ur71RuOqJHB+zTf7ta09ma4ZNNmfEwX5uoV1PH41odhpJc77gxbCBjOfwzQTYnoAD0X6t/Sq6C6lYwyfbBLkbPTNSVfQiV7iWaQByqqOOOtAGXp2qXqQ/8VBHFbyl2KoMH5RgA8E8ZOM/Sk5JbjSvsatyjSXEW1Qwx/EDimJFhzJHAnlohYdVzgfhT6CIFEvnFhDECRkN7+9IehFM0o/esBuPAA/g/wDr1cmkrIzhFt80hbay3YeUcdl9ag0bLUtxHFx1b0FZzqxhuVCnKWxVluJnRnAVVUE89OneseepPW1kacsI9dTJZENupC2ud3Gckdvf3P5igZYk0u2u5lmlecSumT5UpVeB2FWqUZasl1GtERf2RbNaTyq9wrGQZ2ykdaf1eFg9rK4QaWLdklAuiqjo0pIx9DSeHgxqrJGrHBDJbu6l8Y74/wAKSwsLCdeVygShPyKR68A/0pfVYFe2kW4IYZGIywIU7gQM/wAqawsBOvIp9GGP5D/Cp+qwH7aRBdaZBq0DWU+5Y5SFJTAI/SuvAt4Ouq1PddznxUViKTpz2ZZ0/GkWUVhbgGKEFVLjJP1rbEYideq6k92Z0aEaVNQjsiyupy5GVTB6/KKw5jXlLEV80iTEIo2IGHA600xWIf7Rl/up/wB8ii7HygL+5L7fLXIG77valdhZE4vJGs1l2AneRgD2FVfQTjqQSxC5zcPCfMGMfOcH8BSuwViBLGGRMJbsQrEMPNYc9fX3ouwshI9KsbuYsYZRiPjc5PGQe/0FS4qT1Ku47G1uPqaq5Abm/vH86LsBQzZPzN09TTTAyLPzmmyBkfxE9DUlstS3DO3lQcn1Fc06rk+SnuaQppLmmMaIQRbhteXPTtV06Kjq9WKVRy0WiGIIShllcgyZBGOlatJ7kXa2IGWMSCOEbhjPI68cVPIiuZk63LRxhTAeBjJFUlYl6kV1fW1lpqvKhCzS7AAepwT/ACU0SkorUFFtjrXUlmtkcDCtGGTIPII4oUk1cHGzL6HNoTgcrnAqiepWto41iWXYAzZ5PQUhu4+FEMjzKwb5SD9aaEyoIlaNGVSWYkAZpFC2+0Xca+Xhg3PNCE9gjwRNKY1IXsT6mgCf7LasFYsq5HQNRoF2NjEKrcrGCdqYJzwaaB3EiggaJGc7WboM0g1DO12faGAQrkZx9KAJoJGFkjRxZO9uAfpT6C6j1YTK+9duDhg1FxW6kijYDtAGfTvTt2FfuVJ7l43hTeqsZMMF6dOlCKY8XUu1HIQqxx8vJpPTcFZ7MeLiUj/UN0yKAsOW42sfNAQH5V75J7UIGQlhIRBAMJ3I71yzm6j5IG8YqK55kkbQQSiEBi7dTn/61b06cYKyMpylN3YgitmlaHymyvzZ3etXoTqIVskQ/KdobHXPNGgai+XaxywyAPmQDbzx6elGgaheLLKqpA0IGfnEpPT2xRoGpSurOV7MLKlo8SOGxhjtPIyD9CaGk1qCbuVcyKQqJCEUBVVcjAApaFamxaOP7OzJnIU7tpp6WJ1uECQTW4QByqn+I85/CjQNRLf7PHPJGu8ttOc+woVgdyKNrcvEqeYMHI6UaD1Lkb27TDDKXz2xmhWFqURJaKJI/wB7tc8nAo0HqBjsQeZJARS0DUsQQW7W7lC4VxyTTVhNsb5ds6qwkfbFxmjQepIkULwMisxVjnPFGgtSREjt4VQM3LHG714p6WAoMLpfM3JbjeR1c8/4UtA1HtJfKAgit9+CQu89PrimrCa0K8zzG8hMojiAb5ikhyeOmCOaNALIe1DqTPM23kAjNLQrUsu1vMvlu2Qwzjp/WjQWpWuoIVEGzgecp7/401YTbLUUKwrgde5rKnBQVkXObk7sc0ce/wA0qM9c1oySmAZrmfyz0CjOfxpDEki8q3kMq5zJkYNAFlViMFuzYGEBXcfc0xFB44GkY+bjJ/u0ihXngit/su8kyksGC8cYz/MU+gupNDYJgOzbs8jHFKwXLLokdrIMYTacgU+gupRgnjgkJUsVI6Ed6Q3csW8e+Z7kHKsGwMe1NCfYiVJPtQlMJVAOg+lIY6ARC5QrHKGJ7jihbg9iKWIPMfnUYO0gLQFye7t/MQFSFCjnNFgTEtS4tZcOCFX5eOlNbA9xUlhnQQ8hmHOBjmkA3K2cqonzbzySaA3LVxGZI0w20q+7NPoJEO9GkCbVMh5bigCTBEoLEE4OPWgClKr3EyvEQ0cbbuR2x2p7itYmLMsPmIFTbgNleo9qkoPsyl5XdsKx7jvRYLjLmNEFvGGX5Zg3J+tNCZoUgGyp5lu6ZxkEZ+oNPoHUp6enlyTpnO0qM+vFJDY/UD/o/wBGFDBDJovMtLb5sYjHam9gW5KtpBtGUyceppBcilsg1xG0b+WArDAHrjn9BT6CvqWvKJVAJGG3v60gHunmROhONwxmmBSbT1CkiQ9PSkO5PY/8ew/GmhMkmcxws4GSBSAqwXryTohVQCaaG1oLJG0Tyyq4ycY46c0gCHzWZ90pOQeo4FAEttB5cbqzbg3timhMqWIxcH6UimA3ReYVbnf3GaAJ5t0tpCCxBZuSKb2JW5KYB5HlqxBxjd3pBccYgUAJ+YLgN3FACxRiKIoCTweTTQMFU42sQ34U3qiVoxrQ+ZGyOxIJyPapKKV5AIljbezNu6k00B//2Q==' width='200' height='133' class=\"itemThumbnail\">\n",
       "                       </a>\n",
       "                    </div>\n",
       "\n",
       "                    <div class=\"item_right\"     style=\"float: none; width: auto; overflow: hidden;\">\n",
       "                        <a href='https://esrifederal.maps.arcgis.com/home/item.html?id=e11e73c31f7a4550882eb4df3ed7a028' target='_blank'><b>JHWY_ML_Detection_02</b>\n",
       "                        </a>\n",
       "                        <br/>Object Detection Layer<img src='https://esrifederal.maps.arcgis.com/home/js/jsapi/esri/css/images/item_type_icons/featureshosted16.png' style=\"vertical-align:middle;\">Feature Layer Collection by albe9057@esri.com_esrifederal\n",
       "                        <br/>Last Modified: November 30, 2017\n",
       "                        <br/>0 comments, 44 views\n",
       "                    </div>\n",
       "                </div>\n",
       "                "
      ],
      "text/plain": [
       "<Item title:\"JHWY_ML_Detection_02\" type:Feature Layer Collection owner:albe9057@esri.com_esrifederal>"
      ]
     },
     "execution_count": 37,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "object_point_srvc = gis.content.search(\"JHWY_ML_Detection_02\")[1]\n",
    "object_point_srvc"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "metadata": {
    "collapsed": true,
    "scrolled": true
   },
   "outputs": [],
   "source": [
    "# Top left config\n",
    "with detection_graph.as_default():\n",
    "    with tf.Session(graph=detection_graph) as sess:\n",
    "        # Definite input and output Tensors for detection_graph\n",
    "        image_tensor = detection_graph.get_tensor_by_name('image_tensor:0')\n",
    "        # Each box represents a part of the image where a particular object was detected.\n",
    "        detection_boxes = detection_graph.get_tensor_by_name('detection_boxes:0')\n",
    "        # Each score represent how level of confidence for each of the objects.\n",
    "        # Score is shown on the result image, together with the class label.\n",
    "        detection_scores = detection_graph.get_tensor_by_name('detection_scores:0')\n",
    "        detection_classes = detection_graph.get_tensor_by_name('detection_classes:0')\n",
    "        num_detections = detection_graph.get_tensor_by_name('num_detections:0')\n",
    "        while True:\n",
    "            \n",
    "            # Expand dimensions since the model expects images to have shape: [1, None, None, 3]\n",
    "            image_np = np.array(ImageGrab.grab(bbox=(0,160,960,720)))\n",
    "            image_np_expanded = np.expand_dims(image_np, axis=0)\n",
    "            # Actual detection.\n",
    "            (boxes, scores, classes, num) = sess.run(\n",
    "              [detection_boxes, detection_scores, detection_classes, num_detections],\n",
    "              feed_dict={image_tensor: image_np_expanded})\n",
    "            \n",
    "#             print(np.squeeze(classes))\n",
    "            # Visualization of the results of a detection.\n",
    "            vis_util.visualize_boxes_and_labels_on_image_array(\n",
    "              image_np,\n",
    "              np.squeeze(boxes),\n",
    "              np.squeeze(classes).astype(np.int32),\n",
    "              np.squeeze(scores),\n",
    "              category_index,\n",
    "              use_normalized_coordinates=True,\n",
    "              line_thickness=8, min_score_thresh=0.5)\n",
    "            \n",
    "#             cv2.imshow('object detection', cv2.resize(image_np, (960,560)))\n",
    "            cv2.imshow('object detection', cv2.resize(image_np, (960,560), interpolation=cv2.INTER_CUBIC))\n",
    "            if cv2.waitKey(25) & 0xFF == ord('q'):\n",
    "                cv2.destroyAllWindows()\n",
    "                break\n",
    "                \n",
    "            car_count, people_count, bicycle_count, motorcycle_count, bus_count, truck_count = object_counter(np.squeeze(classes).astype(np.int32), np.squeeze(scores))\n",
    "            vehicle_count = car_count + motorcycle_count + bus_count + truck_count\n",
    "            total_count = vehicle_count + bicycle_count + people_count\n",
    "            \n",
    "            if logging == \"verbose\":\n",
    "                print(\"/n\")\n",
    "                print(\"Detected {0} total objects...\".format(str(total_count)))\n",
    "                print(\"Detected {0} total vehicles...\".format(str(vehicle_count)))\n",
    "                print(\"Detected {0} cars...\".format(str(car_count)))\n",
    "                print(\"Detected {0} motorcycles...\".format(str(motorcycle_count)))\n",
    "                print(\"Detected {0} buses...\".format(str(bus_count)))\n",
    "                print(\"Detected {0} trucks...\".format(str(truck_count)))\n",
    "                print(\"Detected {0} pedestrians...\".format(str(people_count)))\n",
    "                print(\"Detected {0} bicycles...\".format(str(bicycle_count)))\n",
    "            \n",
    "            elif logging == \"simple\":\n",
    "                print(\"/n\")\n",
    "                print(\"Detected {0} total objects...\".format(str(total_count)))\n",
    "                print(\"Detected {0} total vehicles...\".format(str(vehicle_count)))\n",
    "                print(\"Detected {0} pedestrians...\".format(str(people_count)))\n",
    "                print(\"Detected {0} bicycles...\".format(str(bicycle_count)))\n",
    "                \n",
    "            elif logging == \"cars\":\n",
    "                print(\"/n\")\n",
    "                print(\"Detected {0} cars...\".format(str(car_count)))\n",
    "                \n",
    "            elif logging == \"none\":\n",
    "                pass\n",
    "            \n",
    "            features_for_update = []\n",
    "            feature_to_be_updated.attributes['RT_Object_Count'] = total_count\n",
    "            feature_to_be_updated.attributes['RT_Vehicle_Count'] = vehicle_count\n",
    "            feature_to_be_updated.attributes['RT_Car_Count'] = car_count\n",
    "            feature_to_be_updated.attributes['RT_Bus_Count'] = bus_count\n",
    "            feature_to_be_updated.attributes['RT_Truck_Count'] = truck_count\n",
    "            feature_to_be_updated.attributes['RT_Motorcycle_Count'] = motorcycle_count\n",
    "            feature_to_be_updated.attributes['RT_Pedestrian_Count'] = people_count\n",
    "            feature_to_be_updated.attributes['RT_Bicycle_Count'] = bicycle_count\n",
    "            \n",
    "#             feature_to_be_updated.attributes['rt_car_count'] = car_count\n",
    "            features_for_update.append(feature_to_be_updated)\n",
    "            object_point_lyr.edit_features(updates=features_for_update)                "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# ArcGIS API for Python and TensorFlow Deep Learning Model\n",
    "\n",
    "## Traffic Intersection Object Detection"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# Top left config\n",
    "with detection_graph.as_default():\n",
    "    with tf.Session(graph=detection_graph) as sess:\n",
    "        # Definite input and output Tensors for detection_graph\n",
    "        image_tensor = detection_graph.get_tensor_by_name('image_tensor:0')\n",
    "        # Each box represents a part of the image where a particular object was detected.\n",
    "        detection_boxes = detection_graph.get_tensor_by_name('detection_boxes:0')\n",
    "        # Each score represent how level of confidence for each of the objects.\n",
    "        # Score is shown on the result image, together with the class label.\n",
    "        detection_scores = detection_graph.get_tensor_by_name('detection_scores:0')\n",
    "        detection_classes = detection_graph.get_tensor_by_name('detection_classes:0')\n",
    "        num_detections = detection_graph.get_tensor_by_name('num_detections:0')\n",
    "        while True:\n",
    "            \n",
    "            # Expand dimensions since the model expects images to have shape: [1, None, None, 3]\n",
    "            image_np = np.array(ImageGrab.grab(bbox=(0,384,683,768)))\n",
    "            image_np_expanded = np.expand_dims(image_np, axis=0)\n",
    "            # Actual detection.\n",
    "            (boxes, scores, classes, num) = sess.run(\n",
    "              [detection_boxes, detection_scores, detection_classes, num_detections],\n",
    "              feed_dict={image_tensor: image_np_expanded})\n",
    "            \n",
    "#             print(np.squeeze(classes))\n",
    "            # Visualization of the results of a detection.\n",
    "            vis_util.visualize_boxes_and_labels_on_image_array(\n",
    "              image_np,\n",
    "              np.squeeze(boxes),\n",
    "              np.squeeze(classes).astype(np.int32),\n",
    "              np.squeeze(scores),\n",
    "              category_index,\n",
    "              use_normalized_coordinates=True,\n",
    "              line_thickness=8, min_score_thresh=0.5)\n",
    "            \n",
    "#             cv2.imshow('object detection', cv2.resize(image_np, (960,560)))\n",
    "            cv2.imshow('object detection', cv2.resize(image_np, (683,383), interpolation=cv2.INTER_CUBIC))\n",
    "            if cv2.waitKey(25) & 0xFF == ord('q'):\n",
    "                cv2.destroyAllWindows()\n",
    "                break\n",
    "                \n",
    "            car_count, people_count, bicycle_count, motorcycle_count, bus_count, truck_count = object_counter(np.squeeze(classes).astype(np.int32), np.squeeze(scores))\n",
    "            vehicle_count = car_count + motorcycle_count + bus_count + truck_count\n",
    "            total_count = vehicle_count + bicycle_count + people_count\n",
    "            \n",
    "            if logging == \"verbose\":\n",
    "                print(\"/n\")\n",
    "                print(\"Detected {0} total objects...\".format(str(total_count)))\n",
    "                print(\"Detected {0} total vehicles...\".format(str(vehicle_count)))\n",
    "                print(\"Detected {0} cars...\".format(str(car_count)))\n",
    "                print(\"Detected {0} motorcycles...\".format(str(motorcycle_count)))\n",
    "                print(\"Detected {0} buses...\".format(str(bus_count)))\n",
    "                print(\"Detected {0} trucks...\".format(str(truck_count)))\n",
    "                print(\"Detected {0} pedestrians...\".format(str(people_count)))\n",
    "                print(\"Detected {0} bicycles...\".format(str(bicycle_count)))\n",
    "            \n",
    "            elif logging == \"simple\":\n",
    "                print(\"/n\")\n",
    "                print(\"Detected {0} total objects...\".format(str(total_count)))\n",
    "                print(\"Detected {0} total vehicles...\".format(str(vehicle_count)))\n",
    "                print(\"Detected {0} pedestrians...\".format(str(people_count)))\n",
    "                print(\"Detected {0} bicycles...\".format(str(bicycle_count)))\n",
    "                \n",
    "            elif logging == \"cars\":\n",
    "                print(\"/n\")\n",
    "                print(\"Detected {0} cars...\".format(str(car_count)))\n",
    "                \n",
    "            elif logging == \"none\":\n",
    "                pass\n",
    "            \n",
    "            features_for_update = []\n",
    "            feature_to_be_updated.attributes['RT_Object_Count'] = total_count\n",
    "            feature_to_be_updated.attributes['RT_Vehicle_Count'] = vehicle_count\n",
    "            feature_to_be_updated.attributes['RT_Car_Count'] = car_count\n",
    "            feature_to_be_updated.attributes['RT_Bus_Count'] = bus_count\n",
    "            feature_to_be_updated.attributes['RT_Truck_Count'] = truck_count\n",
    "            feature_to_be_updated.attributes['RT_Motorcycle_Count'] = motorcycle_count\n",
    "            feature_to_be_updated.attributes['RT_Pedestrian_Count'] = people_count\n",
    "            feature_to_be_updated.attributes['RT_Bicycle_Count'] = bicycle_count\n",
    "            \n",
    "#             feature_to_be_updated.attributes['rt_car_count'] = car_count\n",
    "            features_for_update.append(feature_to_be_updated)\n",
    "            object_point_lyr.edit_features(updates=features_for_update)                "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Start Model Detection"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# Top left config\n",
    "with detection_graph.as_default():\n",
    "    with tf.Session(graph=detection_graph) as sess:\n",
    "        # Definite input and output Tensors for detection_graph\n",
    "        image_tensor = detection_graph.get_tensor_by_name('image_tensor:0')\n",
    "        # Each box represents a part of the image where a particular object was detected.\n",
    "        detection_boxes = detection_graph.get_tensor_by_name('detection_boxes:0')\n",
    "        # Each score represent how level of confidence for each of the objects.\n",
    "        # Score is shown on the result image, together with the class label.\n",
    "        detection_scores = detection_graph.get_tensor_by_name('detection_scores:0')\n",
    "        detection_classes = detection_graph.get_tensor_by_name('detection_classes:0')\n",
    "        num_detections = detection_graph.get_tensor_by_name('num_detections:0')\n",
    "        while True:\n",
    "            \n",
    "            # Expand dimensions since the model expects images to have shape: [1, None, None, 3]\n",
    "            image_np = np.array(ImageGrab.grab(bbox=(0,424,683,768)))\n",
    "            image_np_expanded = np.expand_dims(image_np, axis=0)\n",
    "            # Actual detection.\n",
    "            (boxes, scores, classes, num) = sess.run(\n",
    "              [detection_boxes, detection_scores, detection_classes, num_detections],\n",
    "              feed_dict={image_tensor: image_np_expanded})\n",
    "            \n",
    "#             print(np.squeeze(classes))\n",
    "            # Visualization of the results of a detection.\n",
    "            vis_util.visualize_boxes_and_labels_on_image_array(\n",
    "              image_np,\n",
    "              np.squeeze(boxes),\n",
    "              np.squeeze(classes).astype(np.int32),\n",
    "              np.squeeze(scores),\n",
    "              category_index,\n",
    "              use_normalized_coordinates=True,\n",
    "              line_thickness=8, min_score_thresh=0.5)\n",
    "            \n",
    "#             cv2.imshow('object detection', cv2.resize(image_np, (960,560)))\n",
    "            cv2.imshow('object detection', cv2.resize(image_np, (683,344), interpolation=cv2.INTER_CUBIC))\n",
    "            if cv2.waitKey(25) & 0xFF == ord('q'):\n",
    "                cv2.destroyAllWindows()\n",
    "                break\n",
    "                \n",
    "            car_count, people_count, bicycle_count, motorcycle_count, bus_count, truck_count = object_counter(np.squeeze(classes).astype(np.int32), np.squeeze(scores))\n",
    "            vehicle_count = car_count + motorcycle_count + bus_count + truck_count\n",
    "            total_count = vehicle_count + bicycle_count + people_count\n",
    "            \n",
    "            if logging == \"verbose\":\n",
    "                print(\"/n\")\n",
    "                print(\"Detected {0} total objects...\".format(str(total_count)))\n",
    "                print(\"Detected {0} total vehicles...\".format(str(vehicle_count)))\n",
    "                print(\"Detected {0} cars...\".format(str(car_count)))\n",
    "                print(\"Detected {0} motorcycles...\".format(str(motorcycle_count)))\n",
    "                print(\"Detected {0} buses...\".format(str(bus_count)))\n",
    "                print(\"Detected {0} trucks...\".format(str(truck_count)))\n",
    "                print(\"Detected {0} pedestrians...\".format(str(people_count)))\n",
    "                print(\"Detected {0} bicycles...\".format(str(bicycle_count)))\n",
    "            \n",
    "            elif logging == \"simple\":\n",
    "                print(\"/n\")\n",
    "                print(\"Detected {0} total objects...\".format(str(total_count)))\n",
    "                print(\"Detected {0} total vehicles...\".format(str(vehicle_count)))\n",
    "                print(\"Detected {0} pedestrians...\".format(str(people_count)))\n",
    "                print(\"Detected {0} bicycles...\".format(str(bicycle_count)))\n",
    "                \n",
    "            elif logging == \"cars\":\n",
    "                print(\"/n\")\n",
    "                print(\"Detected {0} cars...\".format(str(car_count)))\n",
    "                \n",
    "            elif logging == \"none\":\n",
    "                pass\n",
    "            \n",
    "            features_for_update = []\n",
    "            feature_to_be_updated.attributes['RT_Object_Count'] = total_count\n",
    "            feature_to_be_updated.attributes['RT_Vehicle_Count'] = vehicle_count\n",
    "            feature_to_be_updated.attributes['RT_Car_Count'] = car_count\n",
    "            feature_to_be_updated.attributes['RT_Bus_Count'] = bus_count\n",
    "            feature_to_be_updated.attributes['RT_Truck_Count'] = truck_count\n",
    "            feature_to_be_updated.attributes['RT_Motorcycle_Count'] = motorcycle_count\n",
    "            feature_to_be_updated.attributes['RT_Pedestrian_Count'] = people_count\n",
    "            feature_to_be_updated.attributes['RT_Bicycle_Count'] = bicycle_count\n",
    "            \n",
    "#             feature_to_be_updated.attributes['rt_car_count'] = car_count\n",
    "            features_for_update.append(feature_to_be_updated)\n",
    "            object_point_lyr.edit_features(updates=features_for_update)                "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true,
    "scrolled": true
   },
   "source": [
    "# Top left config\n",
    "with detection_graph.as_default():\n",
    "    with tf.Session(graph=detection_graph) as sess:\n",
    "        # Definite input and output Tensors for detection_graph\n",
    "        image_tensor = detection_graph.get_tensor_by_name('image_tensor:0')\n",
    "        # Each box represents a part of the image where a particular object was detected.\n",
    "        detection_boxes = detection_graph.get_tensor_by_name('detection_boxes:0')\n",
    "        # Each score represent how level of confidence for each of the objects.\n",
    "        # Score is shown on the result image, together with the class label.\n",
    "        detection_scores = detection_graph.get_tensor_by_name('detection_scores:0')\n",
    "        detection_classes = detection_graph.get_tensor_by_name('detection_classes:0')\n",
    "        num_detections = detection_graph.get_tensor_by_name('num_detections:0')\n",
    "        while True:\n",
    "            \n",
    "            # Expand dimensions since the model expects images to have shape: [1, None, None, 3]\n",
    "            image_np = np.array(ImageGrab.grab(bbox=(0,160,960,720)))\n",
    "            image_np_expanded = np.expand_dims(image_np, axis=0)\n",
    "            # Actual detection.\n",
    "            (boxes, scores, classes, num) = sess.run(\n",
    "              [detection_boxes, detection_scores, detection_classes, num_detections],\n",
    "              feed_dict={image_tensor: image_np_expanded})\n",
    "            \n",
    "#             print(np.squeeze(classes))\n",
    "            # Visualization of the results of a detection.\n",
    "            vis_util.visualize_boxes_and_labels_on_image_array(\n",
    "              image_np,\n",
    "              np.squeeze(boxes),\n",
    "              np.squeeze(classes).astype(np.int32),\n",
    "              np.squeeze(scores),\n",
    "              category_index,\n",
    "              use_normalized_coordinates=True,\n",
    "              line_thickness=8, min_score_thresh=0.5)\n",
    "            \n",
    "            cv2.imshow('object detection', cv2.resize(image_np, (960,560)))\n",
    "            if cv2.waitKey(25) & 0xFF == ord('q'):\n",
    "                cv2.destroyAllWindows()\n",
    "                break\n",
    "                \n",
    "            car_count = car_counter(np.squeeze(classes).astype(np.int32), np.squeeze(scores))\n",
    "            print(\"Detected {0} cars...\".format(str(car_count)))\n",
    "            \n",
    "            features_for_update = []\n",
    "            feature_to_be_updated.attributes['RT_Car_Count'] = car_count\n",
    "#             feature_to_be_updated.attributes['rt_car_count'] = car_count\n",
    "            features_for_update.append(feature_to_be_updated)\n",
    "            object_point_lyr.edit_features(updates=features_for_update)                "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "anaconda-cloud": {},
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.1"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}