Position Summary

We are looking for an adept, action-oriented Principal Data Engineer to operationalize our knowledge graph database to enable our soon-to-be-launched digital transformation product which uses advanced NLP, knowledge engineering, and ML to accelerate innovation in engineering, manufacturing, and scientific operations. The perfect candidates will have strong data infrastructure and data architecture skills, a proven track record of collaborating and iteratively implementing data-intensive solutions, strong operational skills to drive efficiency and speed, strong project leadership, and a strong vision for how data engineering can proactively create positive impact for companies. You will be a part of an early-stage team. You will educate stakeholders, mentor team members, and have a significant stake in defining the future of the Data Engineering function for the product.

Job Responsibilities

• Optimize and maintain the deployment of the knowledge graph database and surrounding services in an AWS cloud environment leveraging Kubernetes and IaC
• Work closely with data scientists, micro-service developers, and security experts to build out a big data platform incrementally and securely
• Work closely with the product management and development teams to rapidly translate the understanding of customer data and requirements to product and solutions
• Maintain an excellent understanding of the business’s long-term goals and strategy and ensures that the design and architecture are aligned with these
• Define and manage SLA’s for data sets and processes running in production
• Design for disaster recovery balancing availability and consistency in multi-region scenarios
• Research and experiment with emerging technologies and tools related to big data
• Establish and reinforce disciplined software engineering processes and best-practices

Ideal Qualifications

• Experience working with knowledge graphs stores (Stardog, TigerGraph, Ontotext GraphDB, Neo4j) and surrounding semantic technology (OWL, RDF, SWRL, SPARQL, JSON-LD)
• Comfort and ideally substantial experience operating big data infrastructure in a cloud-based ecosystem (AWS preferred)
• Deep understanding of the theoretical and practical tradeoffs of various data formats in object/file stores (Parquet, Avro, JSON, etc.) in combination with a variety of ETL tools (Spark, Presto, etc.)
• Deep understanding of the theoretical and practical tradeoffs of various NoSQL stores (Cassandra, Elasticsearch, DynamoDB, etc.) with respect to different read/write patterns and availability/consistency requirements
• Mastery of operating and designing stream-based data systems (Kafka, AWS Kinesis, GCP PusSub, etc.) particularly under varying load
• Be proficient in modern big data architectural approaches (Kappa/Lambda architectures, Data Lake Zones, etc.)
• Experience with data pipeline and workflow management tools (AWS Data Pipeline, Apache Airflow, Argo, etc.)
• Experience with stream-processing systems (ksqlDB, Spark Streaming, Apache Beam/Flink, etc.)
• Experience with software engineering standard methodologies (unit testing, code reviews, design document, continuous delivery)
• Develop and deploy production-grade services, SDK’s, and data infrastructure emphasizing performance, scalability, and self-service.
• Ability to conceptualize and articulate ideas clearly and concisely
• Entrepreneurial or intrapreneurial experience where you helped lead the creation of a new product & organization

Nice to Have’s

• Strong algorithms, data structures, and coding background with either Java, Python or Scala programming experience
• Experience working with Snowflake data warehouses and dimensional modeling practices
• BA/BS or Masters in Computer Science, Math, Physics, or other technical fields
• Experience with at least 10+ terabyte datasets, ideally up to multiple petabytes

We’re building a software solution that connects data in revolutionary ways, illuminating answers that were previously impossible to find and empowering our clients to envision the future so they can determine the best course of action in the present. Join us!

-----------------------------------------------

S&P Global states that the anticipated base salary range for this position is $160,000 to $200,000. Base salary ranges may vary by geographic location. In addition to base compensation, this role is eligible for an annual incentive plan.

This role is eligible to receive additional S&P Global benefits. For more information on the benefits we provide to our employees, visit https://www.spgbenefitessentials.com/newhires.

----------------------------------------------

Equal Opportunity Employer:

S&P Global is an equal opportunity employer and all qualified candidates will receive consideration for employment without regard to race/ethnicity, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, marital status, military veteran status, unemployment status, or any other status protected by law. Only electronic job submissions will be considered for employment.

If you need an accommodation during the application process due to a disability, please send an email to: EEO.Compliance@spglobal.com and your request will be forwarded to the appropriate person.

US Candidates Only:

The EEO is the Law Poster http://www.dol.gov/ofccp/regs/compliance/posters/pdf/eeopost.pdf describes discrimination protections under federal law.

-------------------------------------

Diversity, Equity, Inclusion and Belonging (DEIB) are the cornerstone of everything we do at PowerToFly. Together, we build a culture of belonging that guides our mission, values, services, products, employees, clients, and community. This active and intentional foundation fuels our innovation and impact to advance economic equality in underrepresented communities. We are a global team committed to mitigating bias and lifting barriers in our recruitment and hiring processes.

PowerToFly is an equal opportunity employer and ensures individuals seeking employment are considered without regard to race, color, ancestry, age, sex, sexual orientation, religion, physical or mental disability, ethnicity, national origin, citizenship, veteran status, marital status, pregnancy, or any other qualities protected by applicable federal, state, or local laws.