Senior Batch Data Engineer (Alibaba Cloud Stack)

<p>OneBullEx is looking for a highly accountable, self-driven Senior Batch Data Engineer to take end-to-end ownership of our enterprise batch data warehouse on Alibaba Cloud. In this role, you will design, maintain, and optimise batch pipelines (T-1) supporting executive dashboards, business analytics, and AI/ML services — leveraging modern AI-assisted engineering techniques to rapidly build data layers (ODS, DWD, DWS, ADS) and enforcing strict data quality, automated validation, and proactive monitoring across the platform.</p> <p><strong>Key Responsibilities</strong></p> <p><em>Pipeline Architecture &amp; Data Warehouse Modelling</em></p> <ul> <li>Design, build, and maintain scalable ETL/ELT batch pipelines using Alibaba Cloud DataWorks and MaxCompute.</li> <li>Rapidly design and build enterprise data warehouse layers (ODS, DWD, DWS, ADS) using modular SQL/Python scripts and AI generation tools.</li> <li>Develop and optimise data ingestion, transformation, and batch processing workflows across Lakehouse and Data Warehouse architectures (MaxCompute, Hologres, DataWorks, DTS).</li> <li>Ensure data reliability, high query performance, schema stability, and cost-effective cloud resource usage.</li> </ul> <p><em>AI-Accelerated Engineering &amp; Testing</em></p> <ul> <li>Integrate modern AI tools and techniques (e.g. Claude, GitHub Copilot, prompt engineering) into daily workflow to accelerate code generation, SQL refactoring, and data validation.</li> <li>Apply new AI testing methodologies to rapidly write unit tests, simulate data scenarios, and audit data accuracy prior to production release.</li> </ul> <p><em>Data Quality, Monitoring &amp; Alerting</em></p> <ul> <li>Implement strict data quality rules, automated reconciliation scripts, and validation checks directly inside DataWorks jobs.</li> <li>Build proactive alerting and monitoring workflows (integrated with Lark) to detect data drift, schema breaks, or pipeline failures before business impact occurs.</li> <li>Support downstream analytics, BI reporting, and AI/LLM services with clean, trusted datasets.</li> </ul> <p><em>End-to-End Ownership &amp; Collaboration</em></p> <ul> <li>Take full ownership of daily T-1 batch pipeline stability, job scheduling, historical backfills, and legacy issue cleanup.</li> <li>Act as a bilingual technical bridge, collaborating fluently in both English and Chinese with cross-functional technical leads, product managers, and developers.</li> </ul> <p><strong>Required Qualifications</strong></p> <ul> <li>5+ years of hands-on expertise with Alibaba Cloud data services: DataWorks, MaxCompute, DTS, Hologres, FC Functions, Data Agents, and MaxCompute Lakehouse architectures.</li> <li>Advanced proficiency in SQL and Python for data engineering, performance tuning, and database optimisation.</li> <li>Proven experience modelling multi-layer enterprise data structures (ODS, DWD, DWS, ADS) and managing batch Lakehouse architectures.</li> <li>Fluent in both English and Chinese, spoken and written, for seamless technical collaboration with regional teams.</li> <li>Strong sense of ownership, high velocity, proactive communication, and a "deliver fast, iterate continuously" attitude.</li> </ul> <p><strong>Preferred</strong></p> <ul> <li>Active experience leveraging AI coding assistants (Copilot, LLMs) to speed up ETL development, code reviews, and query optimisation.</li> <li>Experience building alerting and monitoring integrations with Lark or a similar collaboration platform.</li> <li>Track record applying AI-driven testing methodologies ahead of production release.</li> </ul>