The Company Nigel Wright Tech are delighted to be partnering with a leading financial services business in the North East as they look to hire a Senior Data Engineer.
The Role Key Responsibilities include:
Data Migration Planning: You’ll collaborate with stakeholders to understand the big picture and develop detailed, strategic data migration plans. You’ll take charge of migrating data from M&A into our proprietary Gateway SQL database.
Data Mapping & Transformation: Designing and implementing data mapping and transformation processes will be a major part of your role as you move data from legacy systems to modern platforms.
ETL (Extract, Transform, Load) Processes: You’ll build and optimise ETL scripts and tools to ensure seamless data flow—extracting from the source, transforming to meet business needs, and loading it into target systems.
Data Quality Assurance: Accuracy is key. You’ll perform validation checks to ensure that all data is correct and complete throughout the migration.
Troubleshooting: Got a knack for problem-solving? You’ll identify and fix issues like data corruption or system incompatibility to keep everything running smoothly.
Performance Optimization: Your role will include keeping an eye on the performance of migration processes, optimizing for speed and efficiency, and minimizing any downtime.
Documentation: You’ll document everything—your processes, procedures, and outcomes—so that the migration journey is clear and trackable.
Collaboration: You won’t be doing this alone! You’ll work alongside business analysts, DBAs, developers, and others to make sure every migration project is executed flawlessly.
Compliance and Security: With data at the core, you’ll ensure every migration aligns with data governance policies and security standards, staying compliant with regulations.
Post-Migration Support: Even after migration, you’ll play a critical role in optimizing system performance and resolving any issues that may arise
CI/CD: As part of our endeavour towards creating production-grade software, you will be involved in DevOps activities such as version control and migration of code artefacts to live environments.
The Requirements This is a fantastic opportunity for somebody who is looking for more technical responsibility, who will have space to shape the future platform Key requirements include:
Strong SQL and Python skills
Exposure to ADF, Azure Databricks or Microsoft Fabric
Understanding of Data Modelling and ETL/ELT concepts
Comfortable taking ownership of technical requirements and diagnosing complex data engineering issues
Experience within regulated environments would be desirable