Descrição da vaga
<p>N-iX is looking for a Middle Data engineer for 6 months' engagement. </p>
<p>You will act as the independent hands-on engineer and the technical owner of data readiness. The role combines pipeline and query engineering with investigation of source, mapping, hierarchy, and validation issues; coordination of market and provider validation cycles; reconciliation of outputs; and delivery of technically ready datasets to downstream consumers.</p>
<p>The Data Engineering team builds and maintains pipelines, while mappings and configurations determine cell/model scope; Snowflake extraction jobs run SQL through Databricks, with Blob Storage, validation, Medallion transformations, Power BI review, and Gold delivery to Ekimetrics. The operating model also requires end-to-end triage across MDFA, CDF, WPP, Data Foundation, Redmill, and market stakeholders rather than treating every discrepancy as a coding defect.</p>
<p><strong>Key responsibilities</strong><strong>:</strong></p>
<ul>
<li>Independently design, develop, maintain, test, deploy, and optimize ingestion, validation, transformation, aggregation, data-quality, anomaly-detection, and extraction workflows</li>
<li>Develop and tune Python/PySpark packages, SQL extraction queries, Databricks jobs, ADF pipelines, Delta tables, and source-to-target contracts</li>
<li>Own technical readiness for new cells and refreshes: clarify filters and expected scope, implement or update queries, review mappings/configuration, reconcile outputs, and confirm readiness for business validation</li>
<li>Investigate source, NCID, taxonomy, hierarchy, mapping, naming-convention, aggregation, missing-week, outlier, and performance issues across CDF, MDFA/PFME, APIs, manual files, and specific sources</li>
<li>Coordinate technical validation cycles with Product, CMIA/markets, WPP/MDFA, CDF, other data providers, and Ekimetrics; convert reported discrepancies into actionable owners and technical evidence</li>
<li>Drive complex incident resolution across pipelines, data contracts, access, service principals, secrets, networking, Power BI refreshes, and downstream delivery</li>
<li>Review pull requests and test evidence; guide the Junior engineer and delegate scoped engineering/support work without becoming a people manager</li>
<li>Maintain architecture documentation, interface contracts, repository documentation, runbooks, deployment procedures, and support/escalation guidance</li>
<li>Recommend practical automation, reliability, performance, and maintainability improvements while respecting platform standards and business-validation ownership.</li>
</ul>
<p><strong>Must-have technical competencies</strong><strong>:</strong></p>
<ul>
<li>5–6 years’ professional engineering experience with independent production ownership</li>
<li>Strong Python, PySpark, and SQL, including complex transformations, query optimization, reusable packages, debugging, tests, and reconciliation</li>
<li>Strong ETL/ELT and batch-pipeline engineering across relational warehouses, APIs, object storage, and file-based ingestion</li>
<li>Experience with a cloud data lake/lakehouse, Medallion patterns, schema/interface contracts, data-quality controls, orchestration, observability, and incident recovery</li>
<li>Solid Git engineering practices: branching, pull requests, reviews, automated tests, deployment controls, and documentation</li>
<li>Proven ability to translate business/data requirements into filters, mappings, transformations, validation rules, and operational workflows</li>
<li>Stakeholder-facing problem solving: explain discrepancies, challenge incomplete requirements, establish technical owners, and drive issues to closure.</li>
</ul>
<p><strong>Nice-to-have:</strong></p>
<ul>
<li>Strong preference for Azure Data Factory, Azure Databricks, Databricks Jobs/API, Delta Lake, Snowflake, Azure Blob Storage/Data Lake, Power BI, GitHub, and Azure Key Vault</li>
<li>Valuable experience with Pandera or equivalent schema-validation frameworks, Streamlit, Managed Identity/service principals, Azure Communication Services, Managed VNet/Private Endpoints, and Dev/Prod release practices</li>
<li>Experience with PFME/media data, syndicated sales, marketing hierarchies, MMM inputs, or multi-market data onboarding is preferred but can be learned.</li>
</ul><div class="content-conclusion"><p><strong>We offer*:</strong></p>
<ul>
<li>Flexible working format - remote, office-based or flexible</li>
<li>A competitive salary and good compensation package</li>
<li>Personalized career growth</li>
<li>Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)</li>
<li>Active tech communities with regular knowledge sharing</li>
<li>Education reimbursement</li>
<li>Memorable anniversary presents</li>
<li>Corporate events and team buildings</li>
<li>Other location-specific benefits</li>
</ul>
<p>*not applicable for freelancers</p></div>