Job Role: Kafka Architect
Job Location: McLean VA
Key Responsibilities
- Architect and implement enterprise-grade Kafka solutions using Confluent Platform/Cloud.
- Design and manage Kafka clusters, brokers, topics, and partitions for optimal performance and reliability.
- Lead migration efforts from legacy messaging systems (e.g., IBM MQ, TIBCO) to Kafka.
- Develop and optimize Kafka Streams, ksqlDB, Kafka Connect, and Flink-based pipelines.
- Ensure high availability, disaster recovery, and security (RBAC, ACLs) of Kafka infrastructure.
- Collaborate with data engineering, DevOps, and application teams to integrate Kafka into broader enterprise systems.
- Monitor and troubleshoot Kafka environments using tools like Grafana, Prometheus, and Confluent Control Center
Required Skills
- 8–10+ years of experience in Kafka architecture and implementation.
- Deep expertise in:
- Apache Kafka
- Confluent Platform / Confluent Cloud
- Kafka Connect, Kafka Streams, ksqlDB
- Zookeeper/Kraft
- Experience with cloud platforms (AWS, GCP, Azure) and CI/CD pipelines.
- Strong understanding of data integration tools (e.g., Snowflake, Databricks, Hadoop).
- Familiarity with scripting (Shell, Python) and infrastructure-as-code (Terraform).
- Financial services or credit union domain experience is highly preferred.
Certifications (Preferred)
- Confluent Certified Developer for Apache Kafka (CCDAK)
- Confluent Certified Administrator for Apache Kafka
- AWS/GCP Cloud Certifications
- ITIL Foundation