Data Engineering Lead

Job Summary
We are seeking a highly skilled Sr. Developer with 6 to 8 years of experience to join our dynamic team. The ideal candidate will have extensive experience in Databricks Workspace Admin Azure Data Lake Store Databricks SQL Databricks Workflows and PySpark. This role is hybrid with no travel required and operates during day shifts. The candidate will play a crucial role in developing and optimizing data solutions that drive our business forward.
Responsibilities
• Lead the development and optimization of data solutions using Databricks Workspace Admin ensuring efficient and secure data management.
• Oversee the integration and management of Azure Data Lake Store to support scalable data storage solutions.
• Provide expertise in Databricks SQL to develop and maintain complex queries and data models.
• Implement and manage Databricks Workflows to automate data processing and analytics tasks.
• Utilize PySpark to develop and optimize large-scale data processing applications.
• Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
• Ensure data quality and integrity through rigorous testing and validation processes.
• Monitor and troubleshoot data pipelines to ensure seamless data flow and timely availability of data.
• Develop and maintain documentation for data solutions ensuring clarity and accessibility for team members.
• Stay updated with the latest industry trends and technologies to continuously improve data solutions.
• Provide mentorship and guidance to junior developers fostering a culture of continuous learning and improvement.
• Contribute to the overall data strategy of the company aligning solutions with business objectives.
• Communicate effectively with stakeholders to ensure alignment on project goals and deliverables.

Qualifications
• Possess a strong background in Databricks Workspace Admin with proven experience in managing data environments.
• Demonstrate expertise in Azure Data Lake Store with a focus on scalable and secure data storage solutions.
• Have extensive experience in Databricks SQL capable of developing and maintaining complex queries and data models.
• Show proficiency in Databricks Workflows with a track record of automating data processing tasks.
• Exhibit strong skills in PySpark with experience in developing and optimizing large-scale data processing applications.
• Have excellent problem-solving abilities with a focus on ensuring data quality and integrity.
• Possess strong communication skills capable of effectively collaborating with cross-functional teams and stakeholders.
• Demonstrate a commitment to continuous learning and staying updated with industry trends and technologies.
• Show leadership qualities with experience in mentoring and guiding junior developers.
• Have a proactive approach to identifying and addressing potential issues in data pipelines and solutions.
• Be detail-oriented with a focus on developing and maintaining comprehensive documentation.
• Align with the companys data strategy and contribute to achieving business objectives.
• Exhibit a strong understanding of data security and compliance requirements.

Certifications Required
• Databricks Certified Data Engineer Associate Microsoft Certified: Azure Data Engineer Associate

All applications applied through our system will be delivered directly to the advertiser and privacy of personal data of the applicant will be ensured with security.