Deep AR Law Enforcement Ecosystem

Consortium

DARLENE Project

Coordinator

CERTH is the coordinating partner of DARLENE and also leads the development of computation vision and artificial intelligence technologies. Concretely, CERTH works on the development of lightweight yet accurate algorithms for object detection and instance segmentation as well as for 2D and 3D multi-person pose estimation in challenging scenarios as foreseen in DARLENE’s use cases. The goal is to integrate and operate these algorithms in real time on wearable, embedded systems units that will be directly connected to the AR glasses on DARLENE. Simultaneously, CERTH has active role in developing rendering components for the visualization of the generated computer vision analytic results that will be combined with 3D modelling information and data from wearable sensors and distributed IoT devices for the realization of DARLENE’s Augmented Reality ecosystem. CERTH also has a significant role in integration and demonstration activities.

Participants

The Human Computer Interaction (HCI) Laboratory of ICS-FORTH has undertaken the Technical and Scientific Management of the DARLENE project. Accordingly, it will be responsible for the technical development of the DARLENE technologies and the scientific validation of the research activities to be conducted in the context of the project. Furthermore, the HCI Lab of ICS-FORTH will contribute significantly to: the user requirements analysis; the specification of the DARLENE platform; the implementation of the project’s 3D mapping techniques for 3D environments reconstruction; and the DARLENE platform rendering and interaction components featuring AI algorithms for run-time personalization and time adaptation. Moreover, the HCI Lab of ICS-FORTH will lead the DARLENE platform demonstration and the user evaluation activities.

The Centre Tecnològic de Telecomunicacions de Catalunya (CTTC) is a non-profit research institution based in Castelldefels (Barcelona). CTTC’ s main activities in the DARLENE project will focus on leading the WP3 that deals with the 5G network and the collaborative distributed computing tasks required to support the connectivity and computing resources demanded by the Augmented Reality scenario treated in the DARLENE project. The CTTC’s aim will be to demonstrate the efficacy of 5G systems in real-life operational Law Enforcement Agents field trials. CTTC will propose innovative 5G end-to-end (E2E) solutions to guarantee the connectivity and computing requirements demanded by the DARLENE’s AR scenario. CTTC will leverage Network Function Virtualizaiton and Machine Learning technologies to manage efficiently and proactively the computing, networking and storage resources in the 5G E2E system. CTTC will participate in the requirements and in the demonstration of the overall DARLENE platform, from a communications point of view.

During the 3-year period of DARLENE, KUL will identify the legal and ethical requirements relevant to the project, elaborate upon specific legal, ethical and social issues encountered within DARLENE developments, and provide guidance and oversight on these matters. KUL will do so by contributing to, supporting and leading the legal and ethical activities performed during the project. KUL will analyse the current legal and ethical frameworks regarding the development of AR and its implementation in law enforcement practice. It will also keep track of the legal and policy developments in this field to define and update the legal requirements for the DARLENE tools. KUL will monitor the implementation of key ethical and legal principles into the design of the DARLENE technology. KUL will also perform a comprehensive legal and ethical impact assessment to identify potential legal and ethical threats raised by DARLENE and develop mitigation and prevention strategies.

In DARLENE, KEMEA will lead WP1 activities concerning requirements elicitation and use case definition. KEMEA will guide the consortium efforts to capture and analyse practitioner’s needs and define the functional specifications for the DARLENE Augmented Reality ecosystem. Concerning DARLENE’s needs, KEMEA will guide DARLENE partners to survey end users for defining User Requirements and desired functionalities. KEMEA and partners will interview key stakeholders to record and prioritise system requirements, co-design the DARLENE tools and capture additional end user needs KEMEA will also be in the lead of the efforts to define the use cases that will demonstrate DARLENE functionalities and develop KPIs for the evaluation of the DARLENE architecture. KEMEA will further be responsible for the execution of the “X-Ray” pilot, which will be executed at the Markopoulos testbed facility. In WP6, KEMEA will lead the workshop and seminar organization activities for training the trainers and the end users.

THALES is a leading international electronics and systems group, serving defence, aerospace and security markets worldwide, supported by a comprehensive service offering. Thales provides high-grade security solutions for both the public and private sector. From tamper-resistant systems, through soft-loadable algorithms and encryption devices using the strongest cryptography, Thales has a complete portfolio of network security products that provide Host Security Modules to over 80% of the banks around the world. ΤHALES will develop Deep learning algorithm on video streams to automatically detect and to monitor several types of illegal activities. Its cognitive systems are also able to detect suspicious behaviour detecting dangerous objects and human pose estimation. To face new unplanned events, we will develop softwares able to learn new environment features using small dataset and/or without re-train the model optimizing at the same time deep learning algorithms to perform the video analytics on the edge devices.

Trilateral Research (TRI) provides strategic, policy and regulatory advice on new technologies, privacy, risk, ethical and security issues, and effective stakeholder engagement strategies and exploitation. In DARLENE, Trilateral will provide advice and guidance to the consortium on ethical and data protection issues as they arise during the project and will conduct an integrated ethical, data protection and social impact assessment of augmented reality tools in order to build public trust for the lawful use of technology. It will respond to EC ethics requirements, interview partners and stakeholders regarding their requirements and ethical issues, provide ongoing ethical and data protection guidance to the consortium and interact regularly with the project’s Stakeholder Board and Ethics Advisory Board. Trilateral will also build a network of end-users and security stakeholders to enhance project results and pave the way to the field deployment and commercial uptake of the DARLENE solution.

In DARLENE, eBOS will be leading the dissemination and communication activities. eBOS will develop a detailed plan for using and disseminating knowledge, undertake the design of DARLENE’s visual identity through a well-recognised logo and be responsible for the design, development and maintenance of the project’s website, social network accounts and ongoing production of dissemination and communication templates and materials. eBOS will participate in the requirements elicitation, aiming at specifying operators’ requirements, provide inputs for the elaboration of the DARLENE platform’s architectural specifications, support the definition – and later, execution – of the use cases to be validated, contribute to the setup and maintenance of the Network Functions Virtualisation (NFV) infrastructure for the DARLENE solution as well as its management and orchestration, support the deployment of the DARLENE 5G RAN testbed at the Larnaca International airport in Cyprus, where demonstration activities of the DARLENE solution will take place.

In DARLENE, Youbiquo will be leading the Augmented Reality platform integration and technical assessment, firstly specifying and designing the DARLENE Wearable Edge Computing Nodes and the Police Car Edge Note hardware and IoT infrastructure and interfaces. To do so, Youbiquo will deal with any internal development of AR glasses components specifically designed to be affordable, lightweight and inconspicuous and with I/O specifications. Youbiquo will support the iteratively integration of the technical components in order to deliver the successive releases of the DARLENE platform, including the design and development of relevant front-end dashboards, UIs and APIs. Youbiquo will collect the feedback on possible adjustments in component behaviors and will work on the user interface and ergonomics in order to verify the successive releases against functional specifications. Moreover, Youbiquo is in charge of the market analysis needed to deliver a market report.

In DARLENE, Basque Government-Security Department (ERTZAINTZA) as LEA and therefore first responder will be involved and work together with the other members of the Consortium mainly in the following tasks: pilot demonstration, training & evaluation, take an active part in the different use cases putting on disposal of the consortium both our facilities and experts. Participate in the validation process of the project’s solutions in a variety of scenarios. Exploitation and dissemination, using its communication channels to promote the project. Ertzaintza will use its communication channels to promote the project and its benefits to other LEAs and related organizations and to citizens in general. In a few words, ERTZ will participate in the activities regarding the end-user needs, requirements, demonstrations, training and evaluation activities, lessons learned as well as in the dissemination activities.

Polícia Judiciária (PJ) Portuguese Criminal Police is the Portuguese higher criminal police body, hierarchically organized under the aegis of the Ministry of Justice. PJ’s mission consists on assisting the judicial and prosecuting authorities with investigations, by developing and promoting preventive, detection and investigative actions. As a criminal investigation police force, PJ has reserved competence, which cannot be assigned to other criminal police bodies, for the investigation of serious and organized crime in general. As a National LEA, Polícia Judiciária has strict competences of investigation over serious and organized crime while developing and promoting preventive, detection and investigative action. As an end user PJ will work on requirements definition, execution cooperation and validation on results.

Every year about 400 students start their training for the third qualification level of policing in Bavaria. Approximately one quarter of the first-year students are high school graduates who fulfill the general employment conditions and have successfully completed a selection procedure with a sports examination and an aptitude test for social competence. However, the majority of our students are already qualified police officers of the second qualification level who will complete their studies as part of a training qualification. Since 2012, the Department of Policing participates in national and international research projects with a focus on counter-radicalisation, cybersecurity policing and training. HfoeD will support DARLENE by defining user-requirements and use-cases from the German perspective, executing and evaluating the prototypes during the piloting activities, participating in the project’s training and end-user workshops and overviewing that technical progress is aligned with user requirements.

Valencia Local Police (PLV) is a department of the Valencia City Council (Spain). PLV is one of the most active locals polices in Spain, due to its continuous innovation in new technologies. The Centre of Security and Emergencies (CISE) is the best example of innovation in police management thanks to the use of ICTs tools. It is a great test bed for pilot experiences. Moreover, PLV has been the first local police force in Europe to be trained by the OSCE in hate crimes. In the framework of DARLENE, PLV will be leading the LEAs training activities in the use of developed devices and interfaces. To do so, PLV will organize training activities, workshops and demonstration activities. The dissemination among other LEAs is also one of PLV’s strengths thanks to an already stablished network, not only in Spain but also in Europe.

The Cyprus Police (Greek: Αστυνομία Κύπρου) is the National Police Service of the Republic of Cyprus and is under the Ministry of Justice and Public Order since 1993. The primary mission of the National Coordination Centre of Cyprus is: a) to improve situational awareness and to increase reaction capability at the external borders for the purpose of detecting, preventing and combating illegal immigration and cross border crime and contributing to ensuring the protection and saving the lives of migrants, and b) to coordinate P&MP Unit activities in the field of policing and law enforcement within the jurisdiction territory of Cyprus Republic. CP main contribution to DARLENE is related to the elicitation of requirement as an active practitioner in the field, the participation to workshops as well as the execution and planning of a test case in Larnaca International Airport, in collaboration with Cyprus Airport Security Directorate.

LP will participate in the user requirements and platform specification, contributing to the task with practical knowledge of the needs of the officers working on the street and special police forces. LP will provide consortium with legal expertise on personal data protection and related legal framework in Lithuania and data storage/use/sharing policy among Lithuanian Law enforcement institutions. LP will contribute to the development and testing of the hardware and software design, in the primary stages of the development of the products. LP will prepare organize trainings for the law enforcement officers in Lithuania on cooperation with consortium partners. LP will contribute to then External LEA feedback: will report on its action and the feedback received from external end-users and stakeholders after the trainings. LP will participate in the research of ethics principles in order to address the legal and ethical issues arising from the research activities.