Artificial Intelligence Sensor
NOTE:
In compliance with NDA standards, much information, names, and documents have been redacted.
This tool is a multi-modal sensor data analysis application that extracts intelligence and insights based off visual and haptic sensors. I worked closely with Maulie Dass (Director of Engineering) on this project. I presented my work to four potential Tier-1 partners, in which I created use cases that were applicable to each.
BACKGROUND.
With this tool being fairly new, the challenge I was to solve was to brainstorm use cases in which this application could be used, and to create an intuitive user interface from scratch that showcases all that this application has to offer. In order for us to secure partners, the interface had to be appealing and interesting, and demonstrate this new groundbreaking technology.
THE CHALLENGE.
USE CASES.
Live Audience Safety
-
Example Settings:
-
Live Concert
-
Sports Games
-
-
Detects:
-
Drunken disorderly conduct
-
Violent/Angry audience
-
Satisfied VIP audience
-
Social media posts during event
-
Assembly Line Worker Safety & Product Quality
-
Example Settings:
-
Food Factory Plant
-
-
Detects:
-
Proper hygiene protocols
-
Broken glass or other dangers in assembly room
-
NEXT STEPS.
Research
Storyboard
Design
Present
RESEARCH.
Live Audience Use Case: I studied the types of dangers that are present during sports games, live concerts, and other live events. I also read up on past scenarios that have resulted in risking the safety of others during live events, such as fans jumping onstage, fights or riots in the bleachers, or drunken behaviors.
Assembly Line Use Case: I did extensive research into the safety protocols for assembly workers inside factories and the dangers that could be present if protocols were not correctly followed. I also looked into the importance of worker hygiene and example protocols that can ensure a COVID-friendly environment.
STORYBOARD.
Once I had gathered enough research, I began to construct storyboards for each use case. I wanted to create a storyline that was not only realistic, but could also showcase the different scenarios that this technology would able to be used for.
I used Figma to begin designing interfaces that a user of this application would see when monitoring the safety of an individual. Since these mockups were going to be presented to our partners, I wanted to make sure each design and storyline was personalized for them.
DESIGN.
This tool detects an online hate comment during a sports game. The username is tracked to the individual at the game, where the different sensors used by this tool can detect angry behavior. Sensors detect that he is involved in a brawl with another man.
With this tool, we can follow the perpetrator and understand the events that led up to the violent fight.
This tool is used in a factory to ensure that an assembly line worker follows the proper safety and hygiene protocols before entering his work station.
Visual and haptic sensors of this tool are used to ensure he has cleaned himself and worn the correct safety attire. An alert is sent to the factory since he has violated the safety regulations. Because of this, the worker is not granted access to his work station and can ensure the safety of not only the worker, but the quality of the products.
In a live concert setting, this tool can be used to ensure the safety of not only the audience, but the performers as well.
This story begins when the tool detects a suspicious Tweet that was posted under a concert hashtag. Linking the tweet to the spectator, the tool detects drunken disorderly conduct within the man and visually tracks him around the stadium. The stadium is alerted when he is detected near the front stage, and security able to remove him from the premises as he running onstage towards the performer, ensuring the safety of others.
Sample dashboard that allows for security to view the different video sensor feeds placed throughout a sports stadium.
Filters rank the videos from those with no apparent danger to those who require immediate attention.
PRESENT.
Finally, I presented these mockups alongside Maulie Dass at individual meetings with our potential partners.
These mockups allowed for us to open up discussions about future design-thinking sessions and the next steps to implementing this tool in real-world scenarios.