The Capabilities And Limitations Of Using Video Analytics In Business.


A powerful tool in understanding the customer journey through a store is video analytics. Here we explored how retailers can use technologies (sensors and analytics in retail) to create a customised shopping experience and gather rich data about a shoppers habits and interests.

While video as a technology is nothing new, the maturity of computer vision algorithms has enabled automated tracking of objects appearing within a video. With the application of parallel processing platforms, these process intensive tasks can be performed at scale. Combined, these tools empower retailers with an understanding of the types of customers who are entering their stores, their precise movements and how they can direct their attention.

Below are just a few of the capabilities retailers could utilise with video analytics:

Dwell times: Determine the effectiveness of an advertisement or end cap display by tracking what percentage of customers stop to notice the ad and what percentage do not.

Demographics: Understand the age and gender breakdown of customers entering a store.

Traffic Flow: Define virtual tripwires to understand conversion rates from sidewalk to store or whether the majority of customers turn left or right upon entering a store.

Heat maps: Develop a visual representation of the activity within a store to optimise store layout and the sale of high margin items.

Security and Safety: Use machine learning algorithms to automatically detect suspicious or out of the ordinary behavior in real time.

Queue Analysis: Determine relative queue size to optimise staffing for both normal and peak shopping periods.

Video Analytics Implementation Considerations

A study by Godphraim Integrated Services of some selected organisations and shopping complex show below some of our lessons learned:

Data Access: Each of the vendors we tested provided access to the data in several formats including online dashboards, configurable reports and downloadable media such as activity heat maps, video clips, and video snapshots for scene analysis.

The tools to define and configure view areas of interest took some level of expertise to do properly as there were many configuration options that are not intuitively obvious without some level of training. The vendors also provided API access but this seemed much less developed than their dashboard interfaces. Our experience with the APIs included frequent stability issues, outdated or missing documentation and a largely reduced set of functions as compared to the dashboards.

These problems may be resolved as these young companies mature, but at this point we suggest relying on the provided vendor dashboards as opposed to the APIs.

Data Accuracy: During our tests of traffic and dwell counts, we found that vendor results produced a high degree of precision but were only able to accurately identify people 70  80% of the time after proper calibration.

Based on these results, we recommend the use of these metrics to identify relative trends and patterns but not for exact counts. For demographics identification, we found that gender detection was highly accurate when provided a clear view of the face while age detection performed poorly, often producing different results for the same person.

It seems age detection is particularly susceptible to slight deviations in lighting conditions and viewing angles. Unless you can expect a photo booth-like environment, we wouldnt rely on it.

Calibration: Video analytics rarely perform well out of the box. Environmental conditions such as variable light conditions from an open window, reflective surfaces, shadows and the relative distance and angle of view must all be carefully considered to reliably and consistently identify a customer.

As a result each camera requires a period of configuration and testing, which must be repeated if the camera is moved or adjusted.

In particular, anomaly detection only works after running multiple-week baseline training periods for the system to learn normal behaviors.

As the Internet of Things (IoT) movement continues to extend the digital domain into the physical world, brick and mortar retailers have an opportunity to reclaim the digital high ground.

By leveraging emerging sensor platforms and advanced analytics they can effectively optimise the customer journey and create customised experiences tailored to the needs and desires of each individual.

Let us know how you are using sensors and analytics to transform your retail environment.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s