Technical Lead

• We are seeking an experienced Data Lineage Expert to design, implement, and operationalize enterprise-scale data lineage capabilities.
• The role will establish end-to-end technical and business lineage across complex data ecosystems, enabling traceability, impact analysis, root-cause analysis, governance, and regulatory compliance.
• The ideal candidate combines strong metadata engineering skills with hands-on expertise in OpenLineage, OpenMetadata, cloud data platforms, and modern data pipelines.

• Design and implement end-to-end enterprise data lineage across source systems, transformation layers, cloud data platforms, and reporting or analytics environments.
• Implement automated lineage using OpenLineage, OpenMetadata, or comparable enterprise metadata and catalog platforms.
• Capture table-level, column-level, pipeline-level, job-level, and transformation-level lineage.
• Develop lineage ingestion and integration patterns using APIs, connectors, metadata extraction, scanners, and event-based frameworks.
• Integrate lineage across ETL/ELT, data lakes, warehouses, BI platforms, streaming systems, and cloud-native services.
• Enable impact analysis, root-cause analysis, data traceability, dependency analysis, and change-risk assessment.
• Define technical and business lineage standards, operating procedures, controls, and coverage metrics.
• Partner with Data Governance, Data Engineering, Architecture, Risk, and business teams to map critical data elements and business processes.
• Support migration of metadata and lineage from legacy catalog platforms to modern metadata-management solutions.
• Design scalable lineage architecture supporting batch, real-time, and streaming workloads.
• Integrate lineage capabilities with AWS services such as Amazon S3, AWS Glue, Amazon Redshift, Athena, Lambda, and EMR.
• Identify metadata and lineage gaps, improve lineage quality, and provide technical leadership to engineering and governance teams.

• Demonstrated experience in Data Management, Metadata Management, Data Governance, Data Engineering, or a related discipline, with the depth of expertise required to lead enterprise-scale data lineage initiatives.
• Strong hands-on experience with data lineage architecture, metadata engineering, and enterprise-scale implementation.
• Practical expertise with OpenLineage and/or OpenMetadata.
• Experience with enterprise metadata or catalog platforms such as Collibra, Alation, or equivalent solutions.
• Strong understanding of technical, business, and operational metadata models.
• Experience with ETL/ELT technologies, modern data pipelines, data lakes, warehouses, and cloud data architectures.
• Strong SQL skills and the ability to interpret complex data transformations.
• Experience with REST APIs, metadata ingestion frameworks, connector development, and automation.
• Excellent stakeholder communication, problem-solving, and technical leadership skills.

Qualifications

BACHELOR OF COMPUTER SCIENCE