Databricks AI Lead
Apply or review the details on the original posting.
Apply for this roleOriginal posting on LinkedIn
Title: Databricks AI Lead
Location: Canada – 100% Remote
Duration: Long-Term Contract
Experience: 10+ Years
Job Description
We are looking for an experienced Databricks AI Lead to lead the design and implementation of scalable AI/ML and data engineering solutions using Databricks. The ideal candidate should have strong expertise in Azure Databricks, Python, PySpark, SQL, ML/AI, and cloud data platforms.
Key Responsibilities
Lead the architecture and development of Databricks AI/ML solutions.
Design scalable data pipelines using PySpark, Python, SQL, and Delta Lake.
Develop and deploy machine learning and Generative AI solutions on Databricks.
Work with MLflow, Unity Catalog, Feature Engineering, and MLOps.
Integrate Databricks with Azure cloud services and enterprise data platforms.
Lead data engineering and AI teams and provide technical direction.
Ensure data security, governance, performance, and scalability.
Collaborate with business, data engineering, and architecture teams to deliver AI-driven solutions.
Required Skills
10+ years of experience in Data Engineering, AI/ML, or Cloud Architecture.
Strong hands-on experience with Azure Databricks.
Expert knowledge of PySpark, Python, SQL, Delta Lake, and Lakehouse architecture.
Experience with MLflow, MLOps, and Generative AI/LLMs.
Strong knowledge of Azure cloud services and data platforms.
Experience leading technical teams and enterprise-level AI/data initiatives.
Excellent communication, problem-solving, and stakeholder management skills.