IDify - Distributed Database System for Digital Identification
DOI:
https://doi.org/10.31357/contre.v1i1.7380Keywords:
Distributed Database System, KUDU, HDFS, HBase, ImpalaAbstract
”IDify” Distributed database system for digital identification is a big data handling system to centralize the important services provided by the government to make the facilities efficient and reliable. It has integrated services such as digital authentication, E-Banking, Personal Information Management, and Government Surveys to provide users with a centralized and digitized platform to make their lives easier. In this system there is a distributed database platform to carry out all the data storing and data processing tasks to facilitate a large user count and to avoid the drawbacks of monolithic systems. The database system has been designed by integrating several modern database technologies to make the system efficient and coherent as the facilities provided by the system are extremely mission-critical. To make the system low latent on data ingestion and data reading tasks a special library is also implemented in collaboration with modern query processing engines. It is proposed to utilize the thread system of a processor to implement parallelism to enhance the performance of data read/write tasks. Apart from that a fault-tolerant framework has been implemented to free the system from any erroneous scenario taking place.