• Expertini Resume Scoring: Our Semantic Matching Algorithm evaluates your CV/Résumé before you apply for this job role.
United States Jobs Expertini

Databricks and AWS Focused Data Engineer Job Opening In Rosemont Illinois – Now Hiring Expert In Recruitment Solutions


Job description

Overview:

We are seeking an experienced data engineer to deliver high-quality, scalable data solutions on Databricks and AWS for one of our Big Four clients.

You will build and optimize pipelines, implement medallion architecture, integrate streaming and batch sources, and enforce strong governance and access controls to support analytics and ML use cases.


Key Responsibilities:


  • Build and Maintain Data Pipelines: Develop scalable data pipelines using PySpark and Spark within the Databricks environment.

  • Implement Medallion Architecture: Design workflows using raw, trusted, and refined layers to drive reliable data processing.

  • Integrate Diverse Data Sources: Connect data from Kafka streams, extract channels, and APIs.

  • Data Cataloging and Governance: Model and register datasets in enterprise data catalogs, ensuring robust governance and accessibility.

  • Access Control: Manage secure, role-based access patterns to support analytics, AI, and ML needs.

  • Team Collaboration: Work closely with peers to achieve required code coverage and deliver high-quality, well-tested solutions.

  • Optimize and Operationalize: Tune Spark jobs (partitioning, caching, broadcast joins, AQE), manage Delta Lake performance (Z-Ordering, OPTIMIZE, VACUUM), and implement cost and reliability best practices on AWS.

  • Data Quality and Testing: Implement data quality checks and validations (e.g., Great Expectations, custom PySpark checks), unit/integration tests, and CI/CD for Databricks Jobs/Workflows.

  • Infrastructure as Code: Provision and manage Databricks and AWS resources using Terraform (workspaces, clusters, jobs, secret scopes, Unity Catalog objects, S3, IAM).

  • Monitoring and Observability: Set up logging, metrics, and alerts (CloudWatch, Datadog, Databricks audit logs) for pipelines and jobs.

  • Documentation: Produce clear technical documentation, runbooks, and data lineage for governed datasets.





Required Skills & Qualifications:


  • Databricks: 6-9 years of experience with expert-level proficiency

  • PySpark/Spark: 6-9 years of advanced hands-on experience

  • AWS: 6-9 years of experience with strong competency, including S3 and Terraform for infrastructure-as-code

  • Data Architecture: Solid knowledge of the medallion pattern and data warehousing best practices

  • Data Pipelines: Proven ability to build, optimize, and govern enterprise data pipelines

  • Delta Lake and Unity Catalog: Expertise in Delta Lake internals, time travel, schema evolution/enforcement, and Unity Catalog RBAC/ABAC

  • Streaming: Hands-on experience with Spark Structured Streaming, Kafka, checkpointing, exactly-once semantics, and late-arriving data handling

  • CI/CD: Experience with Git-based workflows and CI/CD for Databricks (e.g., Databricks Repos, dbx, GitHub Actions, Azure DevOps, or Jenkins)

  • Security and Compliance: Experience with IAM, KMS, encryption, secrets management, token/credential rotation, and PII governance

  • Performance and Cost: Demonstrated ability to tune Spark jobs and optimize Databricks cluster configurations and AWS usage for cost and throughput

  • Collaboration: Experience working in Agile/Scrum teams, peer reviews, and achieving code coverage targets





Preferred Skills & Qualifications:


  • Certifications: Databricks Data Engineer Professional, AWS Solutions Architect/Developer, HashiCorp Terraform Associate

  • Data Catalogs: Experience with enterprise catalogs such as Collibra or Alation, and lineage tooling such as OpenLineage

  • Orchestration: Databricks Workflows and/or Airflow

  • Additional AWS: Glue, Lambda, Step Functions, CloudWatch, Secrets Manager

  • Testing: pytest, chispa, Great Expectations, dbx test

  • Domain Experience: Analytics and ML feature pipelines, MLOps integrations



Required Skill Profession

Architecture And Engineering


  • Job Details

Related Jobs

JPMorgan Chase hiring Data Engineer, Python, AWS, Databricks Job in Jersey City, NJ, United States
JPMorgan Chase
Jersey City, NJ, United States
Artech LLC hiring AWS Databricks Engineer Job in Plano, Texas, , United States
Artech LLC
Plano, Texas, , United States
Publicis Groupe hiring Senior Databricks/AWS Support Data Engineer Job in , , United States
Publicis Groupe
, , United States
Travelers Insurance Company hiring Data Engineer lI (Python, AWS, Databricks) Job in Hartford, CT, United States
Travelers Insurance Company
Hartford, CT, United States
IPS Technology Services hiring AWS Databricks Lead Engineer Job in Boston, Massachusetts, United States
IPS Technology Services
Boston, Massachusetts, United States
IPS Technology Services hiring AWS Databricks Lead Engineer Job in Boston, Massachusetts, United States
IPS Technology Services
Boston, Massachusetts, United States
IPS Technology Services hiring AWS Databricks Lead Engineer Job in Boston, Massachusetts, United States
IPS Technology Services
Boston, Massachusetts, United States
Epam hiring Senior Data Engineer (Databricks Unity Catalog, AWS) Job in remote, us, remote, us, United States
Epam
remote, us, remote, us, United States
Capital One hiring Senior Data Engineer (Python, Spark, Databricks, AWS) Job in McLean, VA, United States
Capital One
McLean, VA, United States
JPMorgan Chase hiring Lead Software Engineer - AWS/PySpark/Data Engineer/Databricks Job in Columbus, OH, United States
JPMorgan Chase
Columbus, OH, United States
Insight Global hiring Data Engineer (Databricks) Job in Newtown Square, PA, United States
Insight Global
Newtown Square, PA, United States
Steampunk hiring Data Engineer - Databricks Job in McLean, VA, United States
Steampunk
McLean, VA, United States
Expert In Recruitment Solutions hiring Databricks Data Engineer Job in New York County, New York, , United States
Expert In Recruitment Solutions
New York County, New York, , United States
Tekfortune Inc. hiring Databricks Data Engineer Job in San Francisco, California, , United States
Tekfortune Inc.
San Francisco, California, , United States
JPMorgan Chase Bank, N.A. hiring AWS & Databricks Software Engineer III Job in Columbus, Ohio, United States
JPMorgan Chase Bank, N.A.
Columbus, Ohio, United States
JPMorgan Chase & Co. hiring AWS & Databricks Software Engineer III Job in Columbus, Ohio, United States
JPMorgan Chase & Co.
Columbus, Ohio, United States
JPMorgan Chase hiring Databricks / AWS Lead Software Engineer Job in Columbus, OH, United States
JPMorgan Chase
Columbus, OH, United States
Artech LLC hiring AWS Databricks Developer Job in Wilmington, Delaware, United States
Artech LLC
Wilmington, Delaware, United States
Artech LLC hiring AWS Databricks Developer Job in Boston, Massachusetts, , United States
Artech LLC
Boston, Massachusetts, , United States
Artech LLC hiring AWS Databricks Developer Job in Boston, Massachusetts, , United States
Artech LLC
Boston, Massachusetts, , United States
Artech LLC hiring AWS Databricks Developer Job in Wilmington, Delaware, , United States
Artech LLC
Wilmington, Delaware, , United States
Artech LLC hiring AWS Databricks Developer Job in Wilmington, Delaware, , United States
Artech LLC
Wilmington, Delaware, , United States
Capital One hiring Senior Lead Data Engineer (Python, EMR, Databricks, AWS) Job in McLean, Virginia, United States
Capital One
McLean, Virginia, United States
Capital One hiring Senior Lead Data Engineer (Python, EMR, Databricks, AWS) Job in McLean, VA, United States
Capital One
McLean, VA, United States
Capital One hiring Senior Lead Data Engineer (Python, EMR, Databricks, AWS) Job in Plano, TX, Collin County, TX, United States
Capital One
Plano, TX, Collin County, TX, United States
JPMorgan Chase & Co. hiring Lead Data Engineer - Databricks Job in Columbus, Ohio, United States
JPMorgan Chase & Co.
Columbus, Ohio, United States
eTeam Inc hiring Lead Databricks Data Engineer Job in Philadelphia, Pennsylvania, United States
eTeam Inc
Philadelphia, Pennsylvania, United States
Insight Global hiring Databricks Data Engineer - INTL Job in Oak Grove, NC, United States
Insight Global
Oak Grove, NC, United States
Insight Global hiring Senior Data Engineer (Databricks) Job in Newtown Square, PA, United States
Insight Global
Newtown Square, PA, United States
SMBC hiring Senior Data Engineer - Databricks Job in Charlotte, NC, United States
SMBC
Charlotte, NC, United States
Infinitive Inc hiring Senior Data Engineer (Databricks) Job in Ashburn, VA, United States
Infinitive Inc
Ashburn, VA, United States

Unlock Your Databricks and Potential: Insight & Career Growth Guide


Real-time Databricks and Jobs Trends (Graphical Representation)

Explore profound insights with Expertini's real-time, in-depth analysis, showcased through the graph here. Uncover the dynamic job market trends for Databricks and in Rosemont, Illinois, United States, highlighting market share and opportunities for professionals in Databricks and roles.

131486 Jobs in United States
131486
159 Jobs in Rosemont, Illinois
159
Download Databricks And Jobs Trends in Rosemont, Illinois and United States

Are You Looking for Databricks and AWS Focused Data Engineer Job?

Great news! is currently hiring and seeking a Databricks and AWS Focused Data Engineer to join their team. Feel free to download the job details.

Wait no longer! Are you also interested in exploring similar jobs? Search now: .

The Work Culture

An organization's rules and standards set how people should be treated in the office and how different situations should be handled. The work culture at Expert In Recruitment Solutions adheres to the cultural norms as outlined by Expertini.

The fundamental ethical values are:

1. Independence

2. Loyalty

3. Impartiapty

4. Integrity

5. Accountabipty

6. Respect for human rights

7. Obeying United States laws and regulations

What Is the Average Salary Range for Databricks and AWS Focused Data Engineer Positions?

The average salary range for a varies, but the pay scale is rated "Standard" in Rosemont Illinois. Salary levels may vary depending on your industry, experience, and skills. It's essential to research and negotiate effectively. We advise reading the full job specification before proceeding with the application to understand the salary package.

What Are the Key Qualifications for Databricks and AWS Focused Data Engineer ?

Key qualifications for Databricks and AWS Focused Data Engineer typically include Architecture And Engineering and a list of qualifications and expertise as mentioned in the job specification. The generic skills are mostly outlined by the . Be sure to check the specific job listing for detailed requirements and qualifications.

How Can I Improve My Chances of Getting Hired for Databricks and AWS Focused Data Engineer ?

To improve your chances of getting hired for Databricks and AWS Focused Data Engineer , consider enhancing your skills. Check your CV/Résumé Score with our free Tool. We have an in-built Resume Scoring tool that gives you the matching score for each job based on your CV/Résumé once it is uploaded. This can help you align your CV/Résumé according to the job requirements and enhance your skills if needed.

Interview Tips for Databricks and AWS Focused Data Engineer Job Success

Expert In Recruitment Solutions interview tips for Databricks and AWS Focused Data Engineer

Here are some tips to help you prepare for and ace your Databricks and AWS Focused Data Engineer job interview:

Before the Interview:

Research: Learn about the Expert In Recruitment Solutions's mission, values, products, and the specific job requirements and get further information about

Other Openings

Practice: Prepare answers to common interview questions and rehearse using the STAR method (Situation, Task, Action, Result) to showcase your skills and experiences.

Dress Professionally: Choose attire appropriate for the company culture.

Prepare Questions: Show your interest by having thoughtful questions for the interviewer.

Plan Your Commute: Allow ample time to arrive on time and avoid feeling rushed.

During the Interview:

Be Punctual: Arrive on time to demonstrate professionalism and respect.

Make a Great First Impression: Greet the interviewer with a handshake, smile, and eye contact.

Confidence and Enthusiasm: Project a positive attitude and show your genuine interest in the opportunity.

Answer Thoughtfully: Listen carefully, take a moment to formulate clear and concise responses. Highlight relevant skills and experiences using the STAR method.

Ask Prepared Questions: Demonstrate curiosity and engagement with the role and company.

Follow Up: Send a thank-you email to the interviewer within 24 hours.

Additional Tips:

Be Yourself: Let your personality shine through while maintaining professionalism.

Be Honest: Don't exaggerate your skills or experience.

Be Positive: Focus on your strengths and accomplishments.

Body Language: Maintain good posture, avoid fidgeting, and make eye contact.

Turn Off Phone: Avoid distractions during the interview.

Final Thought:

To prepare for your Databricks and AWS Focused Data Engineer interview at Expert In Recruitment Solutions, research the company, understand the job requirements, and practice common interview questions.

Highlight your leadership skills, achievements, and strategic thinking abilities. Be prepared to discuss your experience with HR, including your approach to meeting targets as a team player. Additionally, review the Expert In Recruitment Solutions's products or services and be prepared to discuss how you can contribute to their success.

By following these tips, you can increase your chances of making a positive impression and landing the job!

How to Set Up Job Alerts for Databricks and AWS Focused Data Engineer Positions

Setting up job alerts for Databricks and AWS Focused Data Engineer is easy with United States Jobs Expertini. Simply visit our job alerts page here, enter your preferred job title and location, and choose how often you want to receive notifications. You'll get the latest job openings sent directly to your email for FREE!