Data Engineer II

Job description

Welcome to the intersection of energy and home services.

At NRG, we’re driven by our passion to create a smarter, cleaner and more connected future.

Vivint Smart Home, an NRG owned company, is a leading smart home company in the United States, dedicated to redefining the home experience with intelligent products and services.

We find purpose in proactively protecting and keeping our customers connected to home, no matter where they are.

Join the Smart Home team to create smarter, safer and more sustainable homes.

Summary:

In this role, you will help drive Vivint's data platform.

You will work with a talented team of data scientists and engineers to provide insights across the organization. As a Data Engineer, you will be instrumental in designing, building, and maintaining robust datasets and ETL (Extract, Transform, Load) pipelines that process and integrate large volumes of IoT (Internet of Things) data.

Your work will empower business users by delivering high-quality, actionable insights and facilitating data-driven decision-making across the organization.

Primary Responsibilities:

• Design and Develop ETL Pipelines: Architect, implement, and optimize ETL processes to handle the ingestion, transformation, and storage of large-scale IoT data streams.
  
  Ensure data accuracy, consistency, and availability for analysis.

• Create and Maintain Datasets: Develop and manage comprehensive datasets that aggregate IoT data from various sources.
  
  Ensure datasets are well-structured, accessible, and aligned with business needs.

• Data Integration and Optimization: Integrate disparate data sources and optimize data storage and retrieval processes to support efficient querying and reporting.
  
  Implement best practices for data quality and performance.
• Collaborate with Stakeholders: Work closely with business users, data scientists, and analysts to understand data requirements and translate them into technical solutions.
  
  Provide support and troubleshooting for data-related issues.
• Monitor and Improve Data Systems: Continuously monitor the performance of data pipelines and datasets.
  
  Identify and address potential issues, and implement improvements to enhance efficiency and reliability.
• Documentation and Compliance: Document data processes, pipeline architectures, and system changes.
  
  Ensure compliance with data governance and security policies.

Required Skills:

• Minimum of 4 years of professional experience in data analysis or data engineering

• Experience with Big Data/Hadoop applications.
  
  
• Experience with Spark, Hive, Kafka, and Map Reduce
• SQL experience and strong background in optimizing SQL queries for transforming data

• Experience with different data formats (Parquet, Arvo, Json, XML, etc.)

• Experience bringing in data from multiple Data Sources / API’s

• Building and Debugging Data Pipelines

• Distributed systems (pipelines and databases)

• Proficient in Python development for data pipelines and automation, including debugging, testing, and handling development.
  
  At least 2 years experience preferred.
  
  

• Experience in Linux environments, batch automation, and shell scripts

Nice To Have:

• Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and data warehousing solutions (e.g., Redshift, Snowflake)

Required Education/Experience:

• Graduate Degree in a Quantitative field (Math, Statistics, Engineering, Computer Science) or relevant experience.
• 3+ years work experience.

Learn about the and why it’s a great place to grow your career!

Here are some highlighted perks you should ask us about:

• Free daily lunch and drinks on site
• Paid holidays and flexible paid time away
• Employee/Friends/Family Discounts
• Onsite health clinic, gym, gaming tables
• Medical/dental/vision/life coverage & 24/7 Medical Hotline
• 401(k) + Employer Match
• Employee Resource Groups

WORKING CONDITIONS: 

This job operates in a professional office environment.

This role routinely uses standard office equipment such as computers, phones, photocopiers, filing cabinets and fax machines.

SAFETY:

Vivint enforces a safety culture whereby all employees have the responsibility for continuously developing and maintaining a safe working environment.

Each new employee is responsible for completing all training requirements.

Additionally, the employee must accept they have responsibility for maintaining the safety of themselves, their co-workers, and the public.

Employee must adhere to all written and verbal instructions, promptly report and correct all hazards or unsafe conditions, question non-standard operations or unmitigated hazards, and provide feedback to management on all safety issues.

NRG Energy is committed to a drug and alcohol-free workplace.

To the extent permitted by law and any applicable collective bargaining agreement, employees are subject to periodic random drug testing, and post-accident and reasonable suspicion drug and alcohol testing.

EOE AA M/F/Vet/Disability.

Level, Title and/or Salary may be adjusted based on the applicant's experience or skills.

 

Official description on file with Talent.

Required Skill Profession

Computer Occupations