Lead Engineer, Big Data - Databricks

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Lead Engineer, Big Data - Databricks based in United States. This is a senior technical leadership role focused on building enterprise-scale data and analytics solutions in a healthcare environment. You will lead the design and delivery of cloud-based data architectures supporting complex Medicare and Medicaid operations. The role combines hands-on engineering with strategic partnership, translating business challenges into scalable, data-driven solutions. You’ll work extensively with Azure Databricks, Data Factory, Synapse, Data Lake, and machine learning services. A strong emphasis is placed on AI-first development, real-time data processing, automation, data quality, and advanced analytics. You will also mentor engineers, influence technical direction, and collaborate with business and executive stakeholders across a highly matrixed organization. This opportunity is ideal for an experienced data engineer who wants to connect modern cloud technology with meaningful healthcare outcomes.