• MarTech Today
  • Sections
    • Ads
    • Marketing
    • Content
    • Sales
    • Analytics
    • Management
    • Resources
    • More
    • Home
  • MarTech Today
  • Ads
  • Marketing
  • Content
  • Sales
  • Analytics
  • Mgmt
  • Resources
  • More
  • Events
  • SUBSCRIBE

MarTech Today

MarTech Today
  • Ads
  • Marketing
  • Content
  • Sales
  • Analytics
  • Management
  • Resources
  • More
  • Events
  • Newsletters
  • Home
Martech: Sales

Cloverleaf’s new grocery shelf displays watch shoppers, track their emotions

Retail tech firm launches first shelf-based dynamic display that tracks and analyzes faces for their emotional states and demographics.

Barry Levine on January 12, 2017 at 3:47 pm
  • More
Cloverleaf-featured image

You walk into a grocery store to buy barbeque-flavored potato chips. But you’re disappointed to find that the overflowing shelf of chips — although harboring more than a dozen different types — doesn’t have that flavor.

Within seconds, the LCD digital sign along the shelf edge immediately shows a message: “Don’t worry – BBQ chips will be restocked tomorrow!”

That vision of responsive groceries got closer to reality this week, when retail tech company Cloverleaf announced what it describes as the first digital shelf display with built-in detection of customers’ emotional states and demographics. The system will be presented for the first time at the big National Retail Federation show, starting this weekend in New York City.

The San Diego-based firm, which has focused for 10 years on digital signage for sports stadiums and other venues, had been testing an LED version of its new shelfPoint solution. In the latter part of this year, shelfPoint will be released with displays that instead use LCD because of better resolution and lower cost. This is Cloverleaf’s first shelf-based product.

The dynamic digital displays are placed on the edge of several shelves in a grocery store rack, fed by a 4G-connected media player in the same shelf rack. No special kinds of shelves are needed.

From 10 feet away, Cloverleaf founder and CEO Gordon Davidson told me, a shopper might see animated Coca-Cola bubbles. When five feet away, there might be moving product shots of Coke, and, under five feet, the shopper might see product specifics. The intent is to provide what the company describes as “miniaturized visual marketing campaigns” to attract the shopper.

While other firms offer dynamic displays in store, shelfPoint adds the capability to know something about the person looking at the shelf.

The display along the edge of the top shelf also contains an optical sensor, which visually captures images of the customers standing within five feet and looking at the display. If there are several customers, it picks the one closest to the shelf to characterize the group.

The sensor assesses facial expression points on the face, like the edges of the mouth, the eyes, eyebrows and other points. That data — not the actual image of the person, but a schematic rendition — is then analyzed in Cloverleaf’s cloud by software from facial recognition firm Affectiva.

surprise

Shoppers’ expressions are characterized into such categories as “joy,” “sadness,” “anger,” “fear” or “surprise.” Davidson told me that the emotional assessments can help physical stores determine if, say, the product selection, display or pricing pleases the shopper.

There is, however, no way to determine which of those or other factors led you to suddenly laugh out loud while you’re looking for BBQ potato chips, or to determine if your emotional state is left over from a fight you had this morning with your significant other.

In addition, Affectiva assesses the shopper’s age, gender and major ethnic group.

Davidson assured me that no shopper is identified and actual facial images are not stored — only the points on the face and the resulting aggregate analysis, such as 2,000 shoppers stopped in front of this end cap over the weekend, but only 1,300 showed any responses indicating engagement.

Ethnic groupings, he said, are white, black, Hispanic, northern Asian or southern Asian. This breakdown, he said, is intended to help store owners determine if any ethnic-targeted marketing — such as ads on TV shows popular with Hispanics — has been successful.

The basic idea, Davidson said, is to give brick-and-mortar retailers some of the understanding about its customers that online retailers commonly have.

While the current shelfPoint solution does not change the display automatically because of the emotional state of the nearby shopper (such as in my example above), Davidson said that kind of feedback could be offered in the future. The display’s moving imagery is updated remotely. Also in the works: A/B testing.

Davidson said a 10-week pilot test with a major, unnamed grocer in the northeastern US saw an average 37 percent sales lift. But, he acknowledged, this was because of the digital display, not the feedback about, say, all the people who were saddened by not finding BBQ chips.

No data is yet available on whether emotional or demographic analytics make a difference to sales.



About The Author

Barry Levine
Barry Levine covers marketing technology for Third Door Media. Previously, he covered this space as a Senior Writer for VentureBeat, and he has written about these and other tech subjects for such publications as CMSWire and NewsFactor. He founded and led the web site/unit at PBS station Thirteen/WNET; worked as an online Senior Producer/writer for Viacom; created a successful interactive game, PLAY IT BY EAR: The First CD Game; founded and led an independent film showcase, CENTER SCREEN, based at Harvard and M.I.T.; and served over five years as a consultant to the M.I.T. Media Lab. You can find him at LinkedIn, and on Twitter at xBarryLevine.

Related Topics

Channel: Martech: SalesMarketing ToolsMarketing Tools: AnalyticsVideo

Subscribe to receive daily martech news and expert insights. See terms.

Processing...Please wait.


We're listening.

Have something to say about this article? Share it with us on Facebook and Twitter.

Get the daily newsletter digital marketers rely on.

Processing...Please wait.

See terms.

ATTEND OUR EVENTS

Next Event: Sept. 14-15

Available On-Demand: March 2021

Available On-Demand: October 2020

×

Attend MarTech - Click Here


Learn More About Our MarTech Events

White Papers

  • SEO Wars: How to Resist the Dark Side and Earn Links Organically
  • Data & Organizational Roadblocks? Your Path to Frictionless Revenue Optimization
  • Converting with Conversational AI
  • 4 Ways Chatbot Marketing Can Drive Sales
  • Client Reporting Best Practices Guide
See More Whitepapers

Webinars

  • Drive Customer Engagement with the Power of Personalization
  • 7 Use Cases That Prove Why You Should Implement DAM
  • Accelerate Your SEO & Content Marketing Program with 4 Key Milestones
See More Webinars

Research Reports

  • Local Marketing Solutions for Multi-Location Businesses
  • Enterprise Digital Asset Management Platforms
  • Identity Resolution Platforms
  • Customer Data Platforms
  • B2B Marketing Automation Platforms
  • Call Analytics Platforms
See More Research

On-Demand Free Training

Receive daily martech news and analysis.

Channels

  • Advertising
  • Marketing
  • Content
  • Social
  • Commerce
  • Sales
  • Analytics
  • Management
  • Home

Our Events

  • MarTech
  • SMX

Resources

  • White Papers
  • Research
  • Webinars

About

  • About Us
  • Contact
  • Privacy
  • Marketing Opportunities
  • Staff

Follow Us

  • Facebook
  • Twitter
  • LinkedIn
  • Newsletters
  • RSS

© 2021 Third Door Media, Inc. All rights reserved.