What is data migration?

Put simply, data migration is the process of moving your data from source systems to a target location. Sounds easy right? After all we are all used to moving files and data around in our daily lives. In practice, data migrations are far more complex than that.

Independent research from companies such as Bloor Group and Gartner confirms this:

“83% of data migration projects either fail or exceed their budgets and schedules.” – Gartner 

“More than 80% of data migration projects run over time and/or over budget. Cost overruns average 30%. Time overruns average 41%.” – Bloor Group 

So, what makes data migrations so difficult?

Common data migration issues.

To maximise the likelihood of delivering a successful data migration project, you must first understand the potential challenges you may face. Preparation is key, and having plans in place to mitigate these challenges will pay dividends further down the line.

Data migration challenge #1: Data Quality

Data is growing at an exponential rate and over time it is inevitable that this data will have data quality issues. A data migration represents the ideal time to address any data quality issues before moving the data to a new system.

Data migration challenge #2: Data Complexity

With more an more business systems in use, combined with the increased volumes of data, it’s likely that the data landscape is very complex. There will be multiple ways of storing the same information across these systems. Couple that with your new target system requirements and you will have the perfect recipe for things to go astray.

These varying data types will need to be standardised before loading them in to your target system. 

Data migration challenge #3: Data Security

With huge fines a possibility for data breaches it is vital that data security is at the heart of your migration project. This means that you need to choose your approach, and the tools used, to ensure that only the right people have access to certain data types and that the connection between systems is secure.

Data migration challenge #4: Stakeholder Engagement

Involving key stakeholders, who understand the data, involved at the earliest opportunity will lead to a smoother, and quicker, transition to a new system. Increased involvement from these stakeholders allows you to take a collaborative approach to building the business rules required when transforming the data.