Kafka Engineer

Full Time Posted a month ago
Main Location
New York City, NY, United States
Open jobs
Kafka Engineer

The Corporate Technology team within Millennium is looking for a talented Kafka engineer to help build and manage our Kafka platform. Kafka has become a key piece of technology which underpins the messaging and event steaming platform for which our critical applications interact with one another.

We are looking for an experienced Kafka engineer who will be responsible for the platform’s continued buildout end to end. Part of the role will include day to day support of the platform such as onboarding new producers and consumers, optimizing platform configurations and settings, and educating teams on how best to leverage Kafka for their use cases. The other part of the role will include scaling the platform, building automation, and engineering for optimal performance.

Required Skills:

  • 5+ years of experience in a Platform Engineering / SRE / DevOps role in an enterprise environment

  • Must have at least 2+ years of experience working extensively with Apache Kafka (preferably Confluent Kafka)

    • Deep understanding of the various components in the  Kafka platform

      • Brokers, Zookeepers, Control Center, KSQLDB, etc.

    • Experience tuning and optimizing Kafka for high throughput messaging

    • Strong understanding of Kafka security (SASL, SSL, SCRAM, RBAC)

  • Must have excellent written and verbal communication skills

  • Must have the ability to work under pressure and multi-task

  • Must have prior experience supporting applications on Windows and Unix platforms

    • Strong infrastructure/platform background particularly in storage and networking

  • Must have solid understanding of CI/CD best practices and experience with the following tools

    • GitHub, Jenkins, Artifactory, TeamCity, Datadog, etc.

Desired Skills:

  • Experience running Kafka on the cloud a huge plus

    • AWS Specifically

  • Strong scripting and automation skills – preferably in Python

  • Previous experience building out a support model for a new application from scratch

    • Build support runbooks

    • Define SLAs

    • Wargaming

    • Setup proactive monitoring

    • Automated recovery

We're a community of women leveraging our connections into top companies to help underrepresented women get the roles they've always deserved. Simultaneously, we work to build truly inclusive hiring processes and environments where women can thrive and not just survive.
Are you hiring? Join our platform for diversifiying your team
Kafka Engineer
Millennium Management