Director of Data Engineering

Posted a day ago
Main Location
New York City, NY, United States
Open jobs

The Data Services team is seeking a Director of Data Engineering with a passion for managing technical, data-heavy engineering operations. As an experienced leader, the qualified candidate will have had significant engineering experience with technical depth and breadth. This person will be responsible for overseeing all engineering related activities of the team, ensuring proper execution of duties and alignment with the business’s overall vision. The person will be a seasoned organizational and people leader, with deep understanding and experience of data architectures, information systems deployment and storage techniques and information management.

The Director of Data Engineering will work with cross functional teams across the company to provide advanced data management and analytical systems and services. The ideal candidate will not only have broad data engineering experience, but will be passionate about emerging technologies, engineering and technology best practices. He/She will also be an astute mentor, with the ability to balance appropriate delegation with timely, personalized mentorship. The candidate will be able to report effectively, both upward and downward, across the organization.

Primary Responsibilities
  • Cultivate a customer-centric, results-driven data engineering organization
  • Partner with internal teams and external vendors to ingest, store and enrich data throughout the organization within the enterprise data lake and underlying warehouses/data marts/etc
  • Operate as a thought leader with the ability to guide, influence, and inspire peak performance across the data architecture design and ETL functions
  • Lead large-scale integration and replatforming efforts with CRM, Email Service Provider (ESP), and Customer Engagement Platform (CEP) systems – both internally and externally – to enhance the data and marketing platform infrastructure
  • Collaborate with Data Science, Marketing Science and Data Product teams on implementing machine learning algorithms at scale to facilitate audience intelligence, segmentation and personalization initiatives
  • Collaborate with Business Intelligence and extended analytics groups on data mart optimizations, query tuning, and data model designs with a focus on delivering actionable insights
  • Work strategically to align data assets, storage, and computation/query layers to support long-term data platform goals, help define data models, publish metadata, guide best practice ETL standards
  • Make sound architectural decisions across relational, multi-dimensional, distributed and object-based storage platforms
  • Mentor junior-level engineers and participate in code reviews
  • Execute proof of concepts to assess strategic opportunities and future, next-generation data processing and integration capabilities with a focus on recommending scalable, elastic and extensible solutions that yield positive ROI
Required Skills
  • Proven ability to lead and mentor a highly technical engineering team while also demonstrating the ability to discuss, understand and synthesize solutions for the business needs and data management requirements of other organizational units
  • Ability to collaborate with business unit leadership as well as individual members of the team with strong empathy, and ability to creatively problem solve
  • 8-10 years of experience in data engineering and data management
  • 4-6 years of experience with distributed data frameworks, Hadoop and related architectures (Hive, Spark, Presto, EMR)
  • Absolute fluency in SQL
  • Hands-on experience in designing and managing data lakes, data warehouses and downstream marts
  • Hands-on experience with AWS ecosystem (EMR, EC2, S3, Lambda, Dynamo, Glue, Redshift, EKS, RDS)
  • Exposure to modern development approaches (containerization, microservices, CI/CD)
  • Hands-on experience with relational database platforms (Oracle, SQL Server, Postgres, MySQL)
  • Solid understanding of real time (e.g. Kafka) and batch data processing frameworks, DAG schedulers (Airflow, Luigi, etc)
  • Solid understanding of SOA design and implementation
  • Exceptional analytical, quantitative, problem-solving, and critical thinking skills
  • Have a collaborative work style with strong desire to work in dynamic, fast paced environment that requires flexibility and ability to manage multiple priorities
  • Bachelor’s degree or equivalent experience in Computer Science, Information Science disciplines, or comparable STEM related degree
Desired Skills
  • Experience with Databricks/managed Spark
  • Experience with Snowflake
  • Experience with online media data at scale (web/ad/video/email event streams, identity graphs/maps)
  • Experience with GCP tools (BigQuery, GCS, DataFlow, PubSub, Composer)
  • Exposure to graph processing frameworks (Neo-4j, Neptune, DGraph)

Mission
We're a community of women leveraging our connections into top companies to help underrepresented women get the roles they've always deserved. Simultaneously, we work to build truly inclusive hiring processes and environments where women can thrive and not just survive.
Are you hiring? Join our platform for diversifiying your team
Director of Data Engineering
Conde Nast International Inc.