- Expertini Resume Scoring: Our Semantic Matching Algorithm evaluates your CV/Résumé before you apply for this job role: Principal Software Engineer Ad Platform.
Urgent! Principal Software Engineer - Ad Platform Job Opening In San Francisco – Now Hiring Disney Entertainment and ESPN Product & Technology
Job Summary:
We are seeking a Principal Software Engineer with extensive experience in the Databricks platform and advanced big data engineering practices.
This role involves architecting and implementing scalable, secure, and high-performing data solutions to power the Ad Platforms Data platform and support mission-critical data initiatives, including real-time and batch processing pipelines.
As a hands-on technical leader, you will design data architectures that scale to handle terabytes-per-hour throughput, ensuring optimal performance, compliance, and alignment with business needs.
You will play a pivotal role in guiding teams, collaborating across departments, and driving innovation.
Responsibilities:
Technical Leadership and Architecture
Architect and implement highly scalable, secure, and efficient ETL/ELT pipelines for both real-time and batch data processing.
Design complex, multi-source data ecosystems and ensure seamless integration with tools like Databricks, Delta Lake, and Snowflake.
Optimize data pipelines and workflows for performance, cost, and reliability, leveraging cutting-edge tools like Airflow, Spark, Flink, and Databricks Delta Sharing.
Lead the adoption of best practices in data warehousing, lakehouse architecture, and metadata management.
Champion data security, privacy, and governance, implementing frameworks for lineage tracking, cataloging, and compliance (., SOx, GDPR, CCPA).
Drive implementation of Unity Catalog for data governance and cross-account querying.
Platform Development and Operational Excellence
Able to assist in the set up and manage AWS environments, including S3, IAM Roles, Network Peering, and other infrastructure components.
Oversee Airflow integration with Databricks Spark clusters, manage user access, and implement robust secret management solutions.
Lead the CI/CD process with gated code releases, ensuring code quality and scalable deployment processes.
Implement innovative solutions, from the exciting to the mundane; such as Databricks UniForm (Iceberg, Delta) format integration with Snowflake and basic tools to support cost projection, etc.
Data Engineering and Optimization
Optimize Spark Streaming and ETL workflows, leveraging deep expertise in Spark performance tuning.
Ensure best practices in data ingestion, transformation, and loading, focusing on highly performant and governed data models.
Drive improvements in Delta Lake ecosystems and lakehouse architecture, including Delta Sharing for distributed querying.
Collaboration and Communication
Collaborate closely with cross-functional teams, including Ad Server architects, to align on data strategies and designs.
Foster open communication during architectural discussions, confidently defending decisions while welcoming feedback.
Bridge the gap between diverse team requirements and technical capabilities to deliver cohesive, scalable solutions.
Innovation and Mentorship
Stay ahead of emerging trends in big data technologies, cloud platforms (AWS, Azure, GCP), and distributed computing.
Mentor engineers and architects, fostering a culture of innovation, knowledge sharing, and technical excellence.
Basic Qualifications
Bachelor’s or Master's degree in Computer Science, Software Engineering or related technical discipline is highly desirable
10+ years of experience in software engineering with a focus on big data platforms.
Proven expertise in building scalable systems capable of processing terabytes of data per hour.
Hands-on experience with Databricks, Spark, Flink, Airflow, and Delta Lake ecosystems.
Proficiency in Python (including PySpark), Java, or Scala.
Extensive knowledge of data warehousing, data lakes, and real-time streaming systems.
Hands-on experience with AWS cloud services and data solutions (., S3, Redshift, Athena, IAM).
Deep understanding of data compliance (., SOX, GDPR) and governance.
Strong skills in data lineage, cataloging, and metadata management.
Preferred Qualifications
Experience in the media advertising domain, including linear and digital Ad Sales.
Expertise with tools like ERStudio, ERWin, Alation, or Collibra for metadata management.
Familiarity with Iceberg format integration and other modern data formats.
Certifications in Databricks, AWS, or relevant big data technologies.
Ability to manage/lead a team of high-performing data engineers and architects.
Strong curiosity about how Disney delivers the Magic and a desire to be a part of it
#disneytech
✨ Smart • Intelligent • Private • Secure
Practice for Any Interview Q&A (AI Enabled)
Predict interview Q&A (AI Supported)
Mock interview trainer (AI Supported)
Ace behavioral interviews (AI Powered)
Record interview questions (Confidential)
Master your interviews
Track your answers (Confidential)
Schedule your applications (Confidential)
Create perfect cover letters (AI Supported)
Analyze your resume (NLP Supported)
ATS compatibility check (AI Supported)
Optimize your applications (AI Supported)
O*NET Supported
O*NET Supported
O*NET Supported
O*NET Supported
O*NET Supported
European Union Recommended
Institution Recommended
Institution Recommended
Researcher Recommended
IT Savvy Recommended
Trades Recommended
O*NET Supported
Artist Recommended
Researchers Recommended
Create your account
Access your account
Create your professional profile
Preview your profile
Your saved opportunities
Reviews you've given
Companies you follow
Discover employers
O*NET Supported
Common questions answered
Help for job seekers
How matching works
Customized job suggestions
Fast application process
Manage alert settings
Understanding alerts
How we match resumes
Professional branding guide
Increase your visibility
Get verified status
Learn about our AI
How ATS ranks you
AI-powered matching
Join thousands of professionals who've advanced their careers with our platform
Unlock Your Principal Software Potential: Insight & Career Growth Guide
Real-time Principal Software Jobs Trends in San Francisco, United States (Graphical Representation)
Explore profound insights with Expertini's real-time, in-depth analysis, showcased through the graph below. This graph displays the job market trends for Principal Software in San Francisco, United States using a bar chart to represent the number of jobs available and a trend line to illustrate the trend over time. Specifically, the graph shows 59549 jobs in United States and 2760 jobs in San Francisco. This comprehensive analysis highlights market share and opportunities for professionals in Principal Software roles. These dynamic trends provide a better understanding of the job market landscape in these regions.
Great news! Disney Entertainment and ESPN Product & Technology is currently hiring and seeking a Principal Software Engineer Ad Platform to join their team. Feel free to download the job details.
Wait no longer! Are you also interested in exploring similar jobs? Search now: Principal Software Engineer Ad Platform Jobs San Francisco.
An organization's rules and standards set how people should be treated in the office and how different situations should be handled. The work culture at Disney Entertainment and ESPN Product & Technology adheres to the cultural norms as outlined by Expertini.
The fundamental ethical values are:The average salary range for a Principal Software Engineer Ad Platform Jobs United States varies, but the pay scale is rated "Standard" in San Francisco. Salary levels may vary depending on your industry, experience, and skills. It's essential to research and negotiate effectively. We advise reading the full job specification before proceeding with the application to understand the salary package.
Key qualifications for Principal Software Engineer Ad Platform typically include Computer Occupations and a list of qualifications and expertise as mentioned in the job specification. Be sure to check the specific job listing for detailed requirements and qualifications.
To improve your chances of getting hired for Principal Software Engineer Ad Platform, consider enhancing your skills. Check your CV/Résumé Score with our free Resume Scoring Tool. We have an in-built Resume Scoring tool that gives you the matching score for each job based on your CV/Résumé once it is uploaded. This can help you align your CV/Résumé according to the job requirements and enhance your skills if needed.
Here are some tips to help you prepare for and ace your job interview:
Before the Interview:To prepare for your Principal Software Engineer Ad Platform interview at Disney Entertainment and ESPN Product & Technology, research the company, understand the job requirements, and practice common interview questions.
Highlight your leadership skills, achievements, and strategic thinking abilities. Be prepared to discuss your experience with HR, including your approach to meeting targets as a team player. Additionally, review the Disney Entertainment and ESPN Product & Technology's products or services and be prepared to discuss how you can contribute to their success.
By following these tips, you can increase your chances of making a positive impression and landing the job!
Setting up job alerts for Principal Software Engineer Ad Platform is easy with United States Jobs Expertini. Simply visit our job alerts page here, enter your preferred job title and location, and choose how often you want to receive notifications. You'll get the latest job openings sent directly to your email for FREE!