Descrição da vaga
<div class="content-intro"><p><span style="font-size: 10pt; font-family: helvetica, arial, sans-serif;">Arionkoder is an AI consulting firm helping companies build, embed, and own AI systems that drive real business outcomes. We combine Product Development, Artificial Intelligence, and Team Augmentation to craft digital products and solutions that create lasting impact — guided by a human-centric approach and a commitment to pushing the boundaries of what technology can do.</span></p></div><p></p>
<p>Arionkoder is an AI consulting firm helping companies build, embed, and own AI systems that drive real business outcomes. We combine Product Development, Artificial Intelligence, and Team Augmentation to craft digital products and solutions that create lasting impact, guided by a human-centric approach and a commitment to pushing the boundaries of what technology can do.</p>
<p>We’re hiring a Senior Data Engineer to build the structured core of a governed data foundation on <em>Databricks</em>, used by AI agents, applications, and business teams. You own everything that has to be exact: business entities reconciled across systems that use different identifiers, facts with their source and validity period, business definitions turned into certified tables, access control, and the APIs and MCP tools that serve this data with the caller’s permissions.</p>
<p><em>Conflicting definitions and identifiers are business problems as much as joins.</em> The right person has spent years on <em>Databricks</em> making data correct and consistent, has enforced access control in production, and knows where platform controls stop and application-level enforcement has to start. You work autonomously with business stakeholders and ask the uncomfortable questions about definitions and permissions early.</p>
<p>You’ll work in a small team (solution architect, AI engineer, full-stack engineer, data quality lead, product and project managers) alongside the client’s data platform team. You follow their conventions and hand over what you build. The AI engineer owns the parts that need a model: knowledge from documents, retrieval, agent behavior, and evals. You give them the trusted data those parts depend on. AI tools speed up your modeling, SQL, testing, and documentation every day, and you know exactly when to trust the output and when not to.</p>
<p><strong>Required Qualifications</strong></p>
<ul>
<li><strong>6+ years of professional data engineering</strong>, building production-grade pipelines and data models</li>
<li><strong>3+ years hands-on with <em>Databricks</em> in production</strong>, including <em>Unity Catalog</em></li>
<li><strong>Expert SQL and <em>Python</em></strong>: writes, debugs, optimizes, and refactors pipelines unaided. <em>Spark</em>/<em>PySpark</em> a plus</li>
<li><strong>Strong data modeling</strong>, including history-aware techniques (SCD Type 2, effective dating, temporal validity), with provenance and lineage designed in from the start</li>
<li><strong>Data quality and testing discipline</strong>: tests and expectations in pipelines (<em>dbt tests</em>, <em>Great Expectations</em>, or similar) and CI/CD for data</li>
<li><strong>Reconciling data across systems</strong>: entity resolution or master data</li>
<li><strong>Incremental and change-driven processing</strong> (CDC, streaming, or incremental frameworks) against freshness targets</li>
<li><strong>Practical data governance</strong>: has implemented access control in production (row-level security, column masking, or role/attribute-based access) and knows where platform-level controls stop and application-level enforcement has to start</li>
<li><strong>Has built APIs or services that serve data</strong></li>
<li><strong>Senior judgment</strong>: works autonomously, challenges unclear definitions, prioritizes by risk, owns outcomes without micromanagement</li>
<li><strong>Daily use of AI coding tools</strong> (<em>Claude</em>, <em>Cursor</em>, or similar), with the judgment to know when to trust the output</li>
<li>C1 English; comfortable working fully remote and directly with a client team</li>
</ul>
<p><strong>Preferrable:</strong></p>
<ul>
<li>Exposing data to applications through APIs or MCPs</li>
<li>Multi-tenant data isolation for customer-facing products, with security and negative testing</li>
<li>Finance or CRM data (<em>NetSuite</em>, <em>Salesforce</em>)</li>
<li>Consolidating data across acquired companies or business units</li>
<li>Ingesting and governing unstructured content (documents, wikis, contracts) alongside structured data</li>
<li>Turning business definitions into a shared semantic or metrics layer with business or finance stakeholders</li>
<li>FinOps / cost attribution on data platforms</li>
</ul>
<p><strong>What this person will own and do day-to-day</strong></p>
<p><strong>Ingestion and source strategy</strong><br>Build and maintain ingestion and ETL pipelines from business systems (ERP, CRM, product databases), operational tools, and document repositories. Build data lakes in <em>Databricks</em> that software, people, and AI agents can all query. Decide per source whether to ingest, index and link, or query live, based on volatility, volume, and which system is the record. Work with raw data in its source-system shape without waiting on upstream cleanup.</p>
<p><strong>Entities and facts</strong><br>Implement the entity model defined with the solution architect and resolve identity across systems, reusing existing matching work and sending ambiguous matches to the owner who decides. Model facts with source, validity period, validation status, and documented exceptions. Turn business definitions validated by their owners into certified tables, recording who signed off. Implement authority rules per data item and keep unresolved conflicts visible. Deliver finance numbers that are deterministic, reproducible, and traceable to source records.</p>
<p><strong>Access and isolation</strong><br>Implement access policies in <em>Databricks</em> and carry them into derived data. Enforce isolation at the database, tool, and application layers for consumers who aren’t <em>Databricks</em> users, such as external customers. Build isolation tests at the data and API layer, including similarly named customers, and run them as a release gate.</p>
<p><strong>Structured sources and freshness</strong><br>Integrate the structured sources each increment needs (CRM, ERP, payment processors, product data, spreadsheets), starting from what’s already in <em>Databricks</em>. Meet freshness targets and expose freshness with each fact. Track dependencies so facts and certified tables are updated or flagged when a source or definition changes. Own data quality checks, observability, and cost visibility.</p>
<p><strong>Data interfaces</strong><br>Build the APIs, webhooks, and MCP tools that query and filter facts deterministically, carrying the caller’s identity and permissions on every request. Log every access with the sources it used.</p>
<p><strong>Collaboration and handover</strong><br>Give the AI engineer the facts, entity IDs, and access rules that knowledge and agents depend on. Work with the full-stack engineer on the owners’ review interface and with the data quality lead on acceptance criteria. Be the technical voice on data feasibility in discovery and design sessions, and document and hand over your work to the client’s team.</p>
<p><strong>AI-augmented engineering</strong><br>Use AI tools daily for SQL and <em>Python</em>, schema mapping, definition drafting, test generation, and documentation. Review every AI-assisted output with care: a force multiplier, not a shortcut.</p>
<p></p><div class="content-conclusion"><p><span style="font-family: helvetica, arial, sans-serif; font-size: 10pt;"><strong>Perks</strong></span></p>
<p><span style="font-family: helvetica, arial, sans-serif; font-size: 10pt;">💵 Monthly USD Service Fee</span><br><span style="font-family: helvetica, arial, sans-serif; font-size: 10pt;">🌴 20 business days of paid Agreed Time Off—Annual + 6 Local Holidays</span><br><span class="x19la9d6 x1fc57z9 x6ikm8r x10wlt62 x19co3pv x1g5zs5t xfibh0p xiy17q3 x1xsqp64 x1lkfr7t xexx8yu x4uap5 x18d9i69 xkhd6sd" style="font-family: helvetica, arial, sans-serif; font-size: 10pt;"><span class="xrtxmta x1bhl96m">🐣Caregiver Time Off</span></span><br><span style="font-family: helvetica, arial, sans-serif; font-size: 10pt;"><span class="x19la9d6 x1fc57z9 x6ikm8r x10wlt62 x19co3pv x1g5zs5t xfibh0p xiy17q3 x1xsqp64 x1lkfr7t xexx8yu x4uap5 x18d9i69 xkhd6sd"><span class="xrtxmta x1bhl96m">💻</span></span>A dynamic remote work culture. You can work from anywhere!</span><br><span style="font-family: helvetica, arial, sans-serif; font-size: 10pt;">🚀An entrepreneurial environment.</span></p>
<p> </p>
<p><span style="font-family: helvetica, arial, sans-serif; font-size: 10pt;"><span style="font-family: helvetica, arial, sans-serif;"><strong>About us <br></strong></span>In 2010, our founders dreamed up a company that could positively impact the world. Since then, we've been in permanent evolution: from business consulting to innovation and design, and now to building amazing digital products powered by AI. We scaled globally, launched AI Labs and Reshape Studios, and claimed our space as an AI consulting firm — helping organizations move from pilots to production through accountable AI. Today, we're expanding our impact across industries, driving real AI adoption through accountability, governance, and value at scale. Dreamers first, builders always.</span></p></div>