A database migration project benefits from an open data replication solution
In this post I would like to share our experience with SymmetricDS, an open source data replication solution which helped us to deliver a database migration project.
Recently ProIDS finished a database migration project of Oracle RAC powered database to open source MySQL Cluster. Our customer was a leading mobile operator with over 12 million mobile subscribers.
The migrated Oracle RAC served as a data repository (backend) for JAIN-SLEE based Next Generation IN (NGIN) solution, which hosts over twenty mission critical IN services, handling both business customer as well as individual subscribers. Largest database table contained over 13 M records, most tables had between 3.5 – 5 M records.
Migration to the target MySQL DB required re-development of the data access layer of all IN services and adaptation of provisioning applications. Due to the nature of the solution services were migrated in several phases, which led to the situation when both the old and the new databases had to be simultaneously in live operation.
The migration phase including all the interim observation periods span for over a week, and with constant changes introduced by the provisioning applications we had to find a solution for synchronizing data across both databases, and at the same time being ready for a quick rollback in case if any issues would be discovered.
The factors mentioned above led to the conclusion that the best approach would be to use a dual provisioning solution. Our team carefully considered several possibilities, and after analyzing all pros and cons we decided to choose SymmetricDS.
Symmetric DS is an open source data replication engine, which has the advantages of supporting multiple databases out of the box, handles data transfer bi-directionally, and offers required flexibility . The Community Edition was a perfect choice given the scope and duration of migration.
The following diagram provides a high level overview of the data migration architecture.
Symmetric DS allowed us to optimize project duration, as there was no need for custom development of tools for handling data transfer between databases and keeping them in sync after the initial transfer. Therefore there were no service breaks or provisioning freeze – data migration was a smooth & continuous process. The approach also addressed the selective data transfer of phased migration of data partitions.
Summarizing, usage of the SymmetricDS tool, in a large database migration projects, was a real advantage providing effective time and costs savings.
Feel free to contact us in case you would face similar challenges related to database migration, we are available to provide assistance.
If you would have any specific questions regarding usage of the tool – just drop us a message at info@pro-ids.com.