Staff BigData Hadoop Administrator
Onsite
Dublin, Ireland
Dublin, Ireland
Full Time Posted 28 days ago
Job Type
Full Time
Job Details
Job Description The Big Data team plays a critical and strategic role in ensuring that ServiceNow can exceed the availability and performance SLAs of the ServiceNow Platform powered Customer instances - deployed across the ServiceNow cloud and Azure cloud. Our mission is to: Deliver state-of-the-art Monitoring, Analytics and Actionable Business Insights by employing new tools, Big Data systems, Enterprise Data Lake, AI, and Machine Learning methodologies that improve efficiencies across a variety of functions in the company: Cloud Operations, Customer Support, Product Usage Analytics, Product Upsell Opportunities enabling to have a significant impact both on the top-line and bottom-line growth. The Big Data team is responsible for:
- Collecting, storing, and providing real-time access to large amount of data
- Provide real-time analytic tools and reporting capabilities for various functions including:
- Monitoring, alerting, and troubleshooting
- Machine Learning, Anomaly detection and Prediction of P1s
- Capacity planning
- Data analytics and deriving Actionable Business Insights
- Responsible for deploying, production monitoring, maintaining and supporting of Big Data infrastructure, Applications on ServiceNow Cloud and Azure environments.
- Architect and drive the end-end Big Data deployment automation from vision to delivering the automation of Big Data foundational modules (Cloudera CDP), prerequisite components and Applications leveraging Ansible, Puppet, Terraform, Jenkins, Docker, Kubernetes to deliver end-end deployment automation across all ServiceNow environments.
- Automate Continuous Integration / Continuous Deployment (CI/CD) data pipelines for applications leveraging tools such as Jenkins, Ansible, and Docker.
- Performance tuning and troubleshooting of various Hadoop components and other data analytics tools in the environment: HDFS, YARN, Hive, HBase. Spark, Kafka, RabbitMQ, Impala, Kudu, Redis, Hue, Kerberos, Tableau, Grafana, MariaDB, and Prometheus.
- Provide production support to resolve critical Big Data pipelines and application issues and mitigating or minimizing any impact on Big Data applications. Collaborate closely with Site Reliability Engineers (SRE), Customer Support (CS), Developers, QA and System engineering teams in replicating complex issues leveraging broad experience with UI, SQL, Full-stack and Big Data technologies.
- Responsible for enforcing data governance policies in Commercial and Regulated Big Data environments.
- 6 + years of overall experience with at least 4+ years DevOps experience building and administering Hadoop clusters
- Deep understanding of Hadoop/Big Data Ecosystem. Good knowledge in Querying and analyzing large amount of data on Hadoop HDFS using Hive and Spark Streaming and working on systems like HDFS, YARN, Hive, HBase. Spark, Kafka, RabbitMQ, Impala, Kudu, Redis, Hue.
- Experience securing Hadoop stack with Sentry, Ranger, LDAP, Kerberos KDC
- Good knowledge of Perl, Python, Bash, Groovy and Java.
- In-depth knowledge of Linux internals (Centos 7.x) and shell scripting
- Ability to learn quickly in a fast-paced, dynamic team environment
- Experience using tools like Tableau, Grafana, MariaDB, and Prometheus.
- Experience supporting CI/CD pipelines on Cloudera on Native cloud and Azure/AWS environments
- Demonstrated expert-level experience in delivering end-end deployment automation leveraging Puppet, Ansible, Terraform, Jenkins, Docker, Kubernetes or similar technologies.
- · A good knowledge of Groovy and/or Java
- Flexible working culture to support the balance you need in both work and life.
- Parental leave programs.
- Childcare and caregiving benefits.
- A learning experience platform built using our own technology, to support your learning and development goals as well as a tuition reimbursement program.
- A global, cross-functional mentoring program.
- We also have team building activities, various employee belonging groups, volunteering, and community outreach programs.
Learn more about ServiceNow
Help us maintain the quality of jobs posted on PowerToFly. Let us know if this job is closed.
Mission
We're connecting diverse talent to big career moves. Meeting people who boost your career is hard - yet networking is key to growth and economic empowerment. We’re here to support you - within your current workplace or somewhere new. Upskill, join daily virtual events, apply to roles (it’s free!).
Are you hiring? Join our platform for diversifiying your team