Solution Components
Unknown Attachment
Web Zone
Portuno UI
It is a web-based solution built on the microservices architecture that makes use of well-established open-source technologies to provide an administration portal, which allows users to configure the ANJANA DATA ecosystem.
Anjana UI
It is a web-based solution built on the microservices architecture that makes use of well-established open-source technologies, offering a wide range of functionalities focused on catalog management and data self-service, characterized by a very high accessibility standard and simplified, collaborative usage.
Control Zone
Drittesta
This module is the tool for retrieving information about the workings of the ANJANA ecosystem, in order to provide a response and support to ANJANA DATA customers. This data will be sent to an external server in the ANJANA DATA infrastructure.
Integrations Zone
Zeus
Module that provides service authorization. In accordance with OAuth 2.0, the specification defines a delegation protocol that is useful for conveying authorization decisions across a network of web-enabled applications and APIs. OAuth is used in a wide variety of applications, including providing mechanisms for user authentication.
Tot
Module responsible for integration with different technologies to perform the following tasks: Creation of data structures by exporting and loading the required metadata into the corresponding data platform, provisioning of roles and groups to the identity management platform, provisioning of the necessary permissions (grants and acls) in governed dataset locations, basic on-the-fly query execution for data sampling visualization.
It also includes the necessary clients to automatically import and/or infer metadata and static lineage from external information sources and load them into KERNO. In this way, the user is relieved of the manual task of entering metadata in ANJANA DATA for all those sources and technologies for which the corresponding extractor has been developed and integrated.
As it is an external service developed with microservices in Spring Boot, different extractors for different sources and technologies can be added incrementally and independently. Furthermore, since it is integrated with KERNO through the Rest API, third-party developments can be used for this purpose and feed ANJANA CORE as long as the information is provided in the way KERNO expects to receive it. In some cases, the execution of these processes may take too long, so these operations are defined asynchronously to avoid unnecessary waiting for the user in the application. The execution of these processes will be carried out by sending requests to the responsible module, which will connect to the source, and when the extraction and loading of the metadata is complete, the user will be notified.
TOT Plugins
TOT plugins are used to perform the actions that will be carried out through TOT; each plugin operates on a logical partition resolving a connection, can trigger multiple actions depending on the technologies involved, and a technology can have more than one plugin according to its possible uses. The available plugins can be configured and/or modified for specific purposes or ad-hoc implementations, while new plugins can be developed and deployed following the standards recommended by ANJANA DATA.
API Zone
Portuno
It is the module where all ANJANA DATA configuration and the information for the Admin web front-end is centralized. This module handles the management of ANJANA DATA's internal databases, where the instance configuration and the designed workflows that are later executed in Hermes are stored.
Hermes
This module is the validation workflow management tool and is based on the Activiti engine. Activiti is the leading open-source, lightweight, Java-centric BPM engine, supporting real-world process automation needs. Following the BPMN 2.0 standard, it provides an engine for different processes, enabling the configuration of various validation workflows.
Kerno
It is the core module of the functional architecture, where the main functionalities of the solution and the structures common to all modules are included.
Minerva
This module is the tool for centralizing, organizing and indexing all metadata and audit information from the ANJANA DATA ecosystem.
Viator
Based on Spring Cloud Gateway, it is the entry point for any of Anjana's APIs, both for any user and for the web front-ends or internally between microservices.
Orchestration Zone
Horus
It is a central configuration service that serves configurations from the local file repository or from git during microservice startup.
It is also based on Netflix Eureka, where microservices register at startup and from which the status of each one can be known. When a microservice needs to connect to another, Horus provides it with the current hostname and IP, so that the interaction between the microservices in the architecture is self-orchestrated.
Storage Zone
S3
Object store, used by Anjana to store various files such as translations, workflows, etc.
Anjana Data supports AWS S3 and Minio as S3 service providers.
RDB (relational database)
The database used for persistence. Anjana Data is compatible from version 23 onwards with PostgreSQL, SQL Server and Oracle.
SolR
Solr is the search engine.
AI & ML (BETA)
Metis
It is an Anjana module based on AI services that provides the user with recommendations on representative objects, possible new relationships or objects, or detected anomalies. To make basic recommendations, this module works solely with ANJANA DATA information (metadata and audit only), and also works with data profiling to make advanced recommendations and anomaly detection.
The technologies on which this piece is built are the CORE Metamodel and metadata repositories (PostgreSQL and Solr), machine learning on ANJANA DATA, Apache Spark cluster with advanced additional libraries, and Spring Cloud.
Dashboarding
Grafana
Tool for creating custom dashboards and reports, natively integrated with ANJANA DATA.