Deep AR Law Enforcement Ecosystem
DARLENE will address two representative law enforcement use cases:
Use Case #1: Rapid visual scene analysis to identify suspicious/dangerous objects and injured people
Augmented reality has lately emerged as the most transformative technology for security functions, closely behind artificial intelligence and video analytics. The current situation in monitoring spaces relies on streams of images taken from security cameras, which feed data to a control room video management software. This provides little to almost no information to the security personnel on the ground, who have to operate solely based on verbal communication received through a Security Operations Centre (SOC). The performance of operational teams in this security domain, however, relies on the fast and adequate exchange of context-related information. In the current case, misinterpreting mission-critical information can often lead to human error, for instance, omissions coming directly from the human SOC operator, resulting in vulnerabilities and jeopardising ground personnel safety.
DARLENE will facilitate one of its pilots in the Larnaca International Airport (LCA/LCLK), located 4 km southwest of the city of Larnaca in Cyprus. LCA is Cyprus’ main international gateway, as well as the largest of the island’s two commercial airports. DARLENE tools will be employed to cover a wide range of security and control issues, in particular the prevention and response to crisis situations, terrorist acts, the management of asymmetric threats (e.g., terrorist attacks) and delivering assistance to the public by first responders.
Through DARLENE, security monitoring in the crowded areas of the airport can benefit from more accurate information exchange between teams of mobile security agents and airport SOC operators, thereby contributing to the team’s improved situational awareness (understanding of one’s environment). This will be achieved by ascertaining the precise location of incidents, objects and people with a miniscule to non-existent tolerance for error. By incorporating powerful activity recognition and visual segmentation capabilities enabled through the DARLENE Machine Learning Cloud, ground personnel can be directly made aware of unattended or dangerous objects, the number of people in a crowded space, each person’s precise positioning and orientation in the scene, and whether they’re engaging in unlawful activity. As such, the augmented reality wearable devices can be configured to highlight specific features after performing image analysis, thus enabling security control teams to more quickly obtain knowledge of the situation, make better decisions based on enhanced Situational Awareness and more efficiently address specific tasks. A variety of scenarios aligned to the mission of the Cyprus Airport Security Directorate include:
- crisis management and healthcare provision after cyber-attack or terrorist incident:g., Aiding ground personnel who are delivering care and assistance to injured civilians after crisis incidents. Smart glasses will highlight silhouettes marked as ’injured’, thus making them more visible in a crowded area where panic ensues, allowing aid to be administered more rapidly;
- criminal/terrorist apprehension:Officers tasked to locate armed perpetrators can benefit from having weapons and armed suspects being highlighted, especially in crowded areas.
- possible explosives threat neutralisation:Powerful routines for illegal or suspicious object recognition will be employed in order to highlight abandoned/unattended baggage and potentially dangerous goods t, enabling LEAs to take action more quickly and in a more decisive manner.
Showcasing LEAs capacities using DARLENE solutions in Use Case#1:
(a) crisis management and healthcare provision after cyber-attack or terrorist incident
(b) criminal/terrorist apprehension
(c) possible explosives threat neutralisation
This scenario involves incidents where armed perpetrators need to be apprehended in internal, crowded spaces (e.g., transit station, hotel, mall, bank). The aim is to facilitate coordinated response and planning of the tactical approach of law enforcement agencies (LEAs) involved in active shooting situations. Perpetrators of such acts (for instance, bank robbers) have usually spent time surveilling (observing) their target, familiarised themselves with the location’s security protocols and procedures, as well as its day-to-day activities, taking notes and devising counter-measures. They probably have a carefully designed plan based on their observations, and have oriented themselves accordingly (e.g., chosen specific weapons to use, identifying entrances to enter through, dealing with security etc.). Based on their plan, they have decided to act, carrying out their plan step-by-step in pursuit of their goals. As such, adversaries are usually already many steps ahead of law enforcement officers in terms of situational awareness.
DARLENE will enable LEAs to take decisive and effective action by providing them with extra information about the location of people and objects in this scenario. DARLENE will utilise an array of sensors pre-installed in the facilities (e.g., CCTV, beacons, etc.) in order to reconstruct and create a miniature 3D model of the area, or each individual floor. Obtaining this data, DARLENE wearable technology will enable LEAs planning their entry to visualise the location of human subjects with high precision, allowing tactical squads to view their movements and orientations in real-time, even behind solid walls. Applying additional filters, each “skeleton” can be highlighted in a different colour, indicating occupants inside a building as either a friend or a foe, or even indicating and preventing unnecessary risk-taking, such as showing whether criminals are currently looking at a designated point of entry, have their weapons raised, are pointing weapons at civilians, etc. This will allow tactical units to tailor and improve their neutralisation strategy and reduce or eliminate friendly fire casualties.
DARLENE solutions will allow the Security Operations Centre to observe real-time developments captured through the AR wearable devices and thus enhance the effectiveness of security establishments. This pilot will take place at the “Markopoulos Training Facility” located in Athens, currently used for training purposes by LEAs and emergency responders since it provides a controlled and safe environment for both testing and validation. The facility’s block of buildings will be used and re-purposed, along with existing infrastructure (e.g., preinstalled CCTV cameras, telephone network and Ethernet cables) for simulation purposes.
Showcasing LEAs capacities using DARLENE solutions in Use Case#2:
(a) demonstrates armed perpetrator holding hostage, occurring on the other side of the wall;
(b) shows how security camera feed is used to determine the pose of the two individuals, the direction the weapon is pointing and a colour-coded skeleton visualisation, with red used for indicating the perpetrator and blue used for the victim;
(c) shows an actual view from the DARLENE AR wearable headset, showcasing data even behind a solid wall.