Sr. Big Data Engineer Data Infrastructure

Job description

ABOUT US:

Headquartered in the United States, TP-Link Systems Inc.

is a global provider of reliable networking devices and smart home products, consistently ranked as the world’s top provider of Wi-Fi devices.

The company is committed to delivering innovative products that enhance people’s lives through faster, more reliable connectivity.

With a commitment to excellence, TP-Link serves customers in over 170 countries and continues to grow its global footprint.



We believe technology changes the world for the better! At TP-Link Systems Inc, we are committed to crafting dependable, high-performance products to connect users worldwide with the wonders of technology.



Embracing professionalism, innovation, excellence, and simplicity, we aim to assist our clients in achieving remarkable global performance and enable consumers to enjoy a seamless, effortless lifestyle.




KEY RESPONSIBILITIES


+ Design and build scalable data pipeline: Develop and maintain high performance and large scale data ingestion and transformation, including ETL/ELT processes, data de-identification, and security management.

+ Data orchestration and automation: Develop and manage automated data workflows using tools like Apache Airflow to schedule pipelines, manage dependencies, and ensure reliable, timely data processing and availability.

+ AWS integration and cloud expertise: Build data pipelines integrated with AWS cloud-native storage and compute services, leveraging scalable cloud infrastructure for data processing.

+ Monitoring and data quality: Implement comprehensive monitoring, logging, and alerting to ensure high availability, fault tolerance and data quality through self healing strategies and robust data validation processes.

+ Technology innovation: Stay current with emerging big data technologies and industry trends, recommending and implementing new tools and approaches to continuously improve data infrastructure.

+ Technical leadership: Provide technical leadership for data infrastructure teams, guide architecture decisions and system design best practices.

Mentor junior engineers through code reviews and knowledge sharing, lead complex projects from concept to production, and help to foster a culture of operational excellence.


Requirements

REQUIRED QUALIFICATIONS


+ Experience requirements: 5+ years in data engineering, software engineering, or data infrastructure with proven experience building and operating large scale data pipelines and distributed systems in production, including terabyte scale big data environments.

+ Programming proficiency: Strong Python skills for building data pipelines and processing jobs, with ability to write clean, maintainable, and efficient code.

Experience with Git version control and collaborative development workflows required.

+ Distributed systems expertise: Deep knowledge of distributed systems and parallel processing concepts.

Proficient in debugging and performance tuning large scale data systems, with understanding of data partitioning, sharding, consistency, and fault tolerance in distributed data processing.

+ Big data frameworks: Strong proficiency in big data processing frameworks such as Apache Spark for batch processing and other relevant batch processing technologies.

+ Database and data warehouse expertise: Strong understanding of relational database concepts and data warehouse principles.

+ Workflow Orchestration: Hands-on experience with data workflow orchestration tools like Apache Airflow or AWS Step Functions for scheduling, coordinating, and monitoring complex data pipelines.

+ Problem solving and collaboration: Excellent problem solving skills with strong attention to detail and ability to work effectively in collaborative team environments.



PREFERRED QUALIFICATIONS


+ Advanced degree: Master's degree in Computer Science or related field providing strong theoretical foundation in large scale distributed systems and data processing algorithms.

+ Modern data technology: Exposure to agentic AI patterns, knowledge base systems, and expert systems is a plus.

Experience with real-time streaming processing frameworks like Apache Kafka, Apache Flink, Apache Beam, or pub/sub real-time messaging systems is a plus.

+ Advance database and data warehouse expertise: Familiar with diverse database technologies in addition to relational, such as NoSQL, NewSQL, key value, columnar, graph, document, time series databases.

Ability to design and optimize schemas/data models for analytics use cases, with experience in modern data storage solutions like data warehouses (Redshift, BigQuery, Databricks, Snowflake).

+ Additional programming languages: Proficiency in additional languages such as Java or Scala is a plus.

+ Cloud and infrastructure expertise: Experience with AWS cloud platforms and hands on skills in infrastructure as code (SDK, CDK, Terraform) and container orchestration (Docker/Kubernetes) for automated environment setup and scaling.


Benefits

Salary Range: $150,000 - $200,000


+ Free snacks and drinks, and provided lunch on Fridays

+ Fully paid medical, dental, and vision insurance (partial coverage for dependents)

+ Contributions to 401k funds

+ Bi-annual reviews, and annual pay increases

+ Health and wellness benefits, including free gym membership

+ Quarterly team-building events


At TP-Link Systems Inc., we are continually searching for ambitious individuals who are passionate about their work.

We believe that diversity fuels innovation, collaboration, and drives our entrepreneurial spirit.

As a global company, we highly value diverse perspectives and are committed to cultivating an environment where all voices are heard, respected, and valued.

We are dedicated to providing equal employment opportunities to all employees and applicants, and we prohibit discrimination and harassment of any kind based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.

Beyond compliance, we strive to create a supportive and growth-oriented workplace for everyone.

If you share our passion and connection to this mission, we welcome you to apply and join us in building a vibrant and inclusive team at TP-Link Systems Inc.

Please, no third-party agency inquiries, and we are unable to offer visa sponsorships at this time.

Required Skill Profession

Other General