RPC connector implemented for connection APIs between Mumps procedures i.e. legacy application and GT.M. Hbase communica
Calibri, 20, Bold
SaaS Based Enterprise Electronic Health Record System A SaaS based enterprise Big Data application for maintaining Electronic Health Records (EHR)
Situation
Harbinger Solution
Startup ISV in healthcare domain wants to develop a SaaS application for hospitals and medical institutions ISV has acquired a company with huge database of health related records stored using legacy database (GT.M) with size more than 500 GB ISV userbase is growing rapidly. They want to quickly access user details from huge dataset and also cope up with this growth leveraging a big data technology stack.
Challenges Need to develop a SaaS platform that supports both, legacy system features and migration to Big Data technology stack at same time Migration of existing dataset from old DB system into NoSQL database with added flexibility and extensibility Implementing optimized integrated solution to support scalability in both data storage and data look up
Devised a unique approach of storing the data simultaneously in GT.M and Hbase. RPC connector implemented for connection APIs between Mumps procedures i.e. legacy application and GT.M. Hbase communication was achieved using DataNucleas APIs. A migration framework was built using MapReduce job for transferring existing data into Hbase. Framework provides ability for one on one as well as schema level mapping between fields or tables for copying data from source [GT.M] data store into target [Hbase] data store. Multiple technology options were evaluated. Implemented a solution using Zookeeper for distributed coordination among Hbase, Hadoop and Solr cluster to achieve consistent performance and scalability.
NoSQL Database type by means of Hbase and Hadoop was used to address huge data size and unstructured data model. Integration with Solr implemented for faster data retrieval.
Support handling of both Relational and NoSQL schema in parallel on rapidly growing data
Tools & Technologies Hadoop, Hbase , NOSQL DB, Java, Solr, Apache Kafka - messaging system www.harbinger-systems.com
© Harbinger Systems
[email protected]
Calibri, 20, Bold
SaaS Based Enterprise Electronic Health Record System A SaaS based enterprise Big Data application for maintaining Electronic Health Records (EHR)
Benefits Optimal use of legacy system & data store helped client in supporting existing customers. And incremental upgrade to use Big Data technology stack equipped the client to cater to the growing user base and data, effectively. Migration framework implemented using MapReduce Jobs resulted into smooth data migration in very short time. Also generic implementation approach resulted into reusable components, saving overall cost and time needed for development. Integrated solution using Hadoop, Hbase & Solr helped in implementing a scalable & distributed storage system to support faster search and high throughput. This resulted in a smooth user experience, generating complex summary reports easily and increasing user base efficiently. Use of NoSQL DB resulted into additional support for unstructured schema model, enabling system to process billions of records very fast to generate analytical reports on patient records and disease trends which were almost impossible to implement using legacy implementation on commodity hardware.
www.harbinger-systems.com
© Harbinger Systems
[email protected] 