Pay Rate: $54 - $58/Hour
Lead Databricks Data Engineer
We are seeking a skilled and experienced Lead Data Engineer to join our team and take a pivotal role in building, optimizing, and maintaining our data platform.
As a technical leader, you will leverage your expertise in cloud technologies and data engineering to ensure high performance and scalability of our data solutions.
This position requires a passion for data, a commitment to innovation, and a focus on delivering efficient and effective solutions.
Key Responsibilities:
- Lead a team of data engineers in the development and maintenance of scalable data pipelines for the platform.
- Optimize data capture, ingestion, and processing workflows to enable advanced analytics, data science, and operational intelligence.
- Collaborate with Data Platform Architects and ML Engineers to integrate feature stores, manage model deployment, and implement data preparation workflows.
- Ensure data engineering processes are designed for high performance, scalability, and resource efficiency.
- Provide technical leadership and mentorship to team members, fostering an environment of continuous improvement and innovation.
- Design and maintain data pipelines for streaming data, batch processing, and real-time analytics.
- Implement secure and scalable data capture and ingestion workflows.
- Support data preparation, exploration, and visualization to facilitate data-driven decision-making.
- Work closely with other engineering teams to ensure data pipelines are secure, efficient, and aligned with business requirements.
Qualifications:
- Bachelor s degree in Computer Science, a technical field, or a related business discipline.
Equivalent experience, certifications, or training will be considered.
Master degree preferred - 5+ years of experience in designing and delivering secure cloud solutions.
- 3+ years of experience with Databricks
- 2+ years of experience with Agile Methodology
- Strong problem-solving, analytical, and communication skills.