Posted 2 months ago by

Cloud DevOps Sr. Engineer in Big Data & Machine Learning

United States
Employment: Full Time Experience: Mid-Level

Cloud DevOps Sr Engineer in Big Data & Machine Learning

Job Description

We are developing innovative solutions that leverage the latest technologies in open source and the cloud and are building a team of top-notch software engineers to create our next generation Big Data Analytics and Machine Learning platform.
 
You will be working with all levels of technology, from backend data processing technologies like Hadoop and Spark to front-end technologies using Node.js, R, Scala, and Go, delivered through cloud technologies in Azure and Amazon!
 
You should be passionate about technology and love learning new technologies and implementing high quality, high scale global solutions.  We want you to bring your excitement and technical expertise to deliver high quality work and continuously improve the ways we can better leverage Big Data Analytics and Machine Learning. 
 
Most importantly you should bring new thinking, love technology, and be excited to help us take our vision to the next level. 
 
This is just the beginning of Big Data Analytics and Machine Learning and we need you to help us define the future and get us there – a huge opportunity awaits!
 
Responsibilities

Role Specific Responsibilities

  • Automate the environments, infrastructure, builds, verification and deployment of our big data analytics and machine learning platform
  • Develop infrastructure as code for creating environments in the Cloud and on-premise
  • Embed security control design, implementation and testing into the DevOps practices
  • Assist with cloud networking
  • Drive reliable systems engineering design by minimizing manual involvement and leading continuous improvements that includes dynamically monitoring, alerting, and automated self-healing and recovering
  • Identify and/or analyze problems relating to mission critical services and manage the building of automation to prevent problem recurrence
  • Drive improvements for the design, development and delivery of applications to improve the availability, scalability, latency, and efficiency of solutions.
  • Own the day-to-day health, uptime, monitoring, and reliability of services
  • Lead, own, model and drive DevOps culture and behaviors across development teams
  • Practice and enforce Agile and Scrum methodologies 
  • Leverage industry knowledge and stay close to technology developments in the open-source and cloud communities
  • Collaborate with cross-functional teams

Education: Bachelor’s Degree or equivalent

Years of Experience: 5+

Qualifications

  • BS or higher degree in Computer Science/Engineering or related field
  • Strong experience with distributed systems and designing for high availability and performance
  • Strong experience with Linux, Ubuntu, and Azure
  • Strong experience with Kubernetes and Docker
  • Strong experience in infrastructure (databases, Active Directory, DNS, Firewalls, networking) in Azure and on premise
  • Strong experience with networking and security controls
  • Strong experience with linux/unix shell scripting such as bash or other
  • Experience in Java/C# or other programming language
  • Experience with Windows server administration
  • Experience with powershell scripting and automation
  • Strong experience with Puppet and other infrastructure as code tools
  • Strong experience in Team Foundation Server, VSTS/Jenkins or similar ALM tool
  • Experience with automation and continuous integration and daily builds
  • Experience with HDInsight, Spark, (a major plus if experience with Storm, Kafke, etc.)
  • Experience with MongoDB, Redis, and ShareDB
  • Extensive experience with queueing technologies, such as RabbitMQ and JobServer
  • Experience with NodeJS
  • Experience with Informatica and other ETL technologies and tools (Informatica Cloud services is a plus)
  • Experience with many of the following from the Microsoft Azure: Data Lake, Machine Learning, SQL Data Warehouse, SQL Streaming Analytics, Bot Framework, Cognitive Services, Data Catalog, Data Factory, Power BI, KeyVault, Azure AD, Azure SQL, AppInsights
  • Experience with monitoring technologies such as New Relic and Microsoft OMS
  • Experience with other visualization tools is a major plus, such as Tableau
  • Experience with statistical platforms is a major plus, such as R, SAS, and Informatica
  • Outstanding communicator with both business and technology audiences
  • Knows what is possible using latest technologies (open source)
  • Can manage complex activities and competing priorities
  • Extensive experience working across teams and operating in an Agile Scrum culture
  • Experience with continuous delivery and using agile techniques
  • Firm sense of accountability and ownership
  • Passionate for making things better and driving action
  • Desire to understand our businesses and users

The PowerToFly Mission

We're passionate about connecting highly skilled women with leading companies committed to diversity and inclusion.

Are you looking for your dream job? In Office. Flexible. Remote.

Join our Movement

Are you hiring? Join our platform for diversifying your team

Post a job