Kafka SME

Job description

Mastech Digital provides digital and mainstream technology staff as well as Digital Transformation Services for all American Corporations.

We are currently seeking a Kafka SME for our client in the Consulting domain.

We value our professionals, providing comprehensive benefits and the opportunity for growth.

This is a Contract position, and the client is looking for someone to start immediately.

Duration: 12 Months Contract

Salary: $70.00 - $80.00/Hourly

Role: Kafka SME

Primary Skills: Apache Kafka

Role Description: The Kafka SME must have 2+ years of experience.

Required Skills:

- Hands-on experience designing and implementing Kafka event streaming capabilities in applications and infrastructure across hybrid multi-cloud environments.

- Experience producing IT technical artifacts, with an emphasis on kafka event streams, including design documents, architecture diagrams, architecture assessments, white papers, test plans, requirements mapping, and implementation plans.

- In-depth knowledge of design principles and inner workings of kafka implementations and applicable use cases for migrating applications from legacy style to modern style with the use of Event Streams and Async APIs.

- Demonstrable knowledge of Apache Kafka, Confluent Platform, Confluent Cloud.

- Demonstrable knowledge of Apache Strimzi, Confluent for Kubernetes.

- Demonstrable knowledge of Cloud services with Kafka API compatibility (e.g. Azure Event Hub, Amazon MSK).

- Demonstrable knowledge of Confluent Schema Registry and serialization using JSON and AVRO schemas.

- Demonstrable knowledge of kafka replication options including Mirror Maker, Confluent Cluster Linking and Schema Linking.

- Demonstrable knowledge of Confluent Identity Mgmt and RBAC, integrated/federated with enterprise IDP & role management.

- Demonstrable knowledge of Kafka Client APIs (Producer, Consumer, Streams).

- Demonstrable knowledge of Kafka Connect and Connectors (e.g. JDBC, Cassandra, Google BigQuery, WebSphere MQ, etc.).

- Demonstrable knowledge of sizing and capacity planning for Kafka clusters.

- Demonstrable knowledge of Kafka topic partitioning strategies including partition key design strategies.

Preferred Skills:

- Integrating kafka event streams with Agentic AI workflows.

- Using design patterns for building scalable and maintainable applications/solutions.

- Clearly document code, models, and technical solutions.

- Proficiency in Generative AI and prompt engineering.

- Continuous learning and adaptability in a very large IT organization

- Communicating complex technical concepts to both technical and executive stakeholders.

- Troubleshooting software and technical implementations in large-scale enterprise ecosystems.

- Understanding of concepts like CI/CD, containerization, and deployment strategies for kafka components in large-scale production environments.

- Querying and managing data in both SQL and NoSQL databases.

- Proficiency creating technical diagrams with products like Microsoft Visio or Draw.io.

- Proficiency creating technical design and architecture documents in Microsoft Word.

- Proficiency creating business and technical presentations in Microsoft PowerPoint.

- Proficiency creating data representations, charts and reports in tools such as Microsoft’s Excel worksheets and Power BI.

Day to Day Responsibilities:

- Analysis support to integrate new Kafka cluster and event stream requirements into established large-scale, production enterprise architectures.

- Conduct Design and Architecture assessments and provide written recommendations for integrating kafka event streams within an application domain or enterprise event brokering.

- Troubleshoot production kafka event streams and software integration issues as top tier internal support, including review of performance issues and proposing resolutions.

- Conduct research and provide written reviews of kafka ecosystem best practices and innovative strategies for hybrid multi-cloud high availability.

- Conduct proof of concept activities and build prototypes for kafka technology stack components in sandbox environments to assess new capabilities.

- Define and implement standards and patterns for kafka ecosystem life cycle, test-driven protection schemes, and automated implementation strategies.

- Devise strategies and roadmaps for enterprise expansion of kafka ecosystem capabilities, integrations, and governance.

- Strategy and compliance reviews and recommendations for enterprise kafka ecosystem elements which may include the following: architecture frameworks, databases, network, web and application architecture resources, backup and recovery, high availability, disaster recovery, patch management and analytics.

Education: A degree from an accredited College/University in the applicable field of services is preferred.

Experience: Minimum 2+ years of experience

Travel: No

Local Preferred: Yes

Note: Must be able to work on a W2 basis (No C2C)

Required Skill Profession

Computer Occupations