• MarTech Today
  • Sections
    • Advertising
    • Marketing
    • Content
    • Social
    • Commerce
    • Sales
    • Analytics
    • Management
    • All
    • Home
  • Follow Us
    • Follow
  • MarTech Today
  • Ads
  • Marketing
  • Content
  • Social
  • Sales
  • Analytics
  • Mgmt
  • More
  • Events
    • Follow
  • SUBSCRIBE

MarTech Today

MarTech Today
  • Advertising
  • Marketing
  • Content
  • Social
  • Commerce
  • Sales
  • Analytics
  • Management
  • All
  • Events
  • Newsletters
  • Home
Martech: Sales

Subscribe to MarTech Today to receive news and insights of where marketing, technology, and management converge.

Note: By submitting this form, you agree to Third Door Media's terms. We respect your privacy.


Cloverleaf’s new grocery shelf displays watch shoppers, track their emotions

Retail tech firm launches first shelf-based dynamic display that tracks and analyzes faces for their emotional states and demographics.

Barry Levine on January 12, 2017 at 3:47 pm
  • More
Cloverleaf-featured image

You walk into a grocery store to buy barbeque-flavored potato chips. But you’re disappointed to find that the overflowing shelf of chips — although harboring more than a dozen different types — doesn’t have that flavor.

Within seconds, the LCD digital sign along the shelf edge immediately shows a message: “Don’t worry – BBQ chips will be restocked tomorrow!”

That vision of responsive groceries got closer to reality this week, when retail tech company Cloverleaf announced what it describes as the first digital shelf display with built-in detection of customers’ emotional states and demographics. The system will be presented for the first time at the big National Retail Federation show, starting this weekend in New York City.

The San Diego-based firm, which has focused for 10 years on digital signage for sports stadiums and other venues, had been testing an LED version of its new shelfPoint solution. In the latter part of this year, shelfPoint will be released with displays that instead use LCD because of better resolution and lower cost. This is Cloverleaf’s first shelf-based product.

The dynamic digital displays are placed on the edge of several shelves in a grocery store rack, fed by a 4G-connected media player in the same shelf rack. No special kinds of shelves are needed.

From 10 feet away, Cloverleaf founder and CEO Gordon Davidson told me, a shopper might see animated Coca-Cola bubbles. When five feet away, there might be moving product shots of Coke, and, under five feet, the shopper might see product specifics. The intent is to provide what the company describes as “miniaturized visual marketing campaigns” to attract the shopper.

While other firms offer dynamic displays in store, shelfPoint adds the capability to know something about the person looking at the shelf.

The display along the edge of the top shelf also contains an optical sensor, which visually captures images of the customers standing within five feet and looking at the display. If there are several customers, it picks the one closest to the shelf to characterize the group.

The sensor assesses facial expression points on the face, like the edges of the mouth, the eyes, eyebrows and other points. That data — not the actual image of the person, but a schematic rendition — is then analyzed in Cloverleaf’s cloud by software from facial recognition firm Affectiva.

surprise

Shoppers’ expressions are characterized into such categories as “joy,” “sadness,” “anger,” “fear” or “surprise.” Davidson told me that the emotional assessments can help physical stores determine if, say, the product selection, display or pricing pleases the shopper.

There is, however, no way to determine which of those or other factors led you to suddenly laugh out loud while you’re looking for BBQ potato chips, or to determine if your emotional state is left over from a fight you had this morning with your significant other.

In addition, Affectiva assesses the shopper’s age, gender and major ethnic group.

Davidson assured me that no shopper is identified and actual facial images are not stored — only the points on the face and the resulting aggregate analysis, such as 2,000 shoppers stopped in front of this end cap over the weekend, but only 1,300 showed any responses indicating engagement.

Ethnic groupings, he said, are white, black, Hispanic, northern Asian or southern Asian. This breakdown, he said, is intended to help store owners determine if any ethnic-targeted marketing — such as ads on TV shows popular with Hispanics — has been successful.

The basic idea, Davidson said, is to give brick-and-mortar retailers some of the understanding about its customers that online retailers commonly have.

While the current shelfPoint solution does not change the display automatically because of the emotional state of the nearby shopper (such as in my example above), Davidson said that kind of feedback could be offered in the future. The display’s moving imagery is updated remotely. Also in the works: A/B testing.

Davidson said a 10-week pilot test with a major, unnamed grocer in the northeastern US saw an average 37 percent sales lift. But, he acknowledged, this was because of the digital display, not the feedback about, say, all the people who were saddened by not finding BBQ chips.

No data is yet available on whether emotional or demographic analytics make a difference to sales.



About The Author

Barry Levine
Barry Levine covers marketing technology for Third Door Media. Previously, he covered this space as a Senior Writer for VentureBeat, and he has written about these and other tech subjects for such publications as CMSWire and NewsFactor. He founded and led the web site/unit at PBS station Thirteen/WNET; worked as an online Senior Producer/writer for Viacom; created a successful interactive game, PLAY IT BY EAR: The First CD Game; founded and led an independent film showcase, CENTER SCREEN, based at Harvard and M.I.T.; and served over five years as a consultant to the M.I.T. Media Lab. You can find him at LinkedIn, and on Twitter at xBarryLevine.

Related Topics

Channel: Martech: SalesMarketing ToolsMarketing Tools: AnalyticsVideo

Subscribe to MarTech Today to receive news and insights of where marketing, technology, and management converge.

Note: By submitting this form, you agree to Third Door Media's terms. We respect your privacy.


We're listening.

Have something to say about this article? Share it with us on Facebook and Twitter.

ATTEND OUR CONFERENCES

April 15-17, 2020: San Jose

October 6-8, 2020: Boston

×

Attend MarTech - Click Here


Learn More About Our MarTech Events

White Papers

  • How Good Partnerships Should Reduce Your Workflow
  • Digital Insights 2019: How marketers confront the obstacles of digital customer engagement
  • 14 Industry Experts on the Future of Attribution
  • The Essential Guide to Protecting Your Ad Spend from Invalid Traffic
  • How to Turn Leads into Repeat Customers
See More Whitepapers

Webinars

  • The Fantastic 5: Emerging strategies to drive conversions & growth
  • CCPA Goes Live in Weeks: Is your marketing measurement ready?
  • 4 Ways to Get Started With Agile Marketing
See More Webinars

Research Reports

  • Enterprise Digital Asset Management Platforms
  • Identity Resolution Platforms
  • Customer Data Platforms
  • B2B Marketing Automation Platforms
  • Enterprise SEO Platforms
  • Call Analytics Platforms
See More Research
Sidebar Inbox Deliverability 2019
Sign up for the NEW MarTech Today.
Martech Today
Download the Martech Today app on iTunes
Download the Martech Today App on Google Play

Channels

  • Advertising
  • Marketing
  • Content
  • Social
  • Commerce
  • Sales
  • Analytics
  • Management
  • Home

Our Events

  • MarTech West
  • MarTech East

Resources

  • White Papers
  • Research
  • Webinars
  • MarTech Conference

About

  • About Us
  • Contact
  • Privacy
  • Advertise
  • Marketing Services
  • Staff
  • Connect With Us

Follow Us

  • Facebook
  • Twitter
  • LinkedIn
  • Newsletters
  • Instagram
  • RSS
  • iOS App
  • Google Play

© 2019 Third Door Media, Inc. All rights reserved.