Senior DevOps/MLOps Engineer (AWS, AI/ML Applications, GenAI, Kubernetes)
Job Details
To achieve real outcomes, we know that experience is the most important requirement for networking teams and the people they serve. Delivering an experience-first, AI-Native Network pivots on the creativity and commitment of our people. It requires a consistent and committed practice, something we call the Juniper Way.
DevOps/MLOps Staff engineer
Location: Bangalore, India Juniper Experience and Operations (JXO) organization is incubating a Technology group to transform CX(customer experience) and EX(employee experience). The charter of this group is to discover, evaluate and leverage technology to enhance and simplify the experience of stakeholders. Knowledge and data will be central to this journey of creating a proactive and predictive support experience. The use of automation, AI and other modern technology will enable reduction of time taken to resolve issues or perform tasks. This role is part of Juniper’s strategic future of support team and will involve design of automated solutions. The role requires enabling business transformation projects using technology, review of data to enable process, systems and tool re-engineering in customer support and services. In addition, the role requires to support the enhancement of self-service, automation, omnichannel strategy by seeking solutions and drivers to achieve seamless customer experiences and increased customer loyalty.
Primary Tech skills :
MLOPs in Databricks, AWS, Python, Docker, Kubernetes, Terraform, Ansible, Prometheus, Grafana, ELK.
Secondary Tech skills :
Snowflake, Data Engineering using PySpark
Responsibilities:
Integrate, deploy and maintain key Data Engineering and ML workflows using Databricks and AWS to ensure seamless data movement from raw source to final consumption. Manage the end to end lifecycle DevOps, DataOps and ModelOps. Involve in troubleshooting and resolving integration and data-related issues.
- Set up Databricks Repos to integrate with Git and sync notebooks and source code with Databricks workspaces. Use features in Databricks for Git integration and version control.
- Create and manage CICD pipeline for smooth deployment of codes and workflows between development to stage to production environment.
- Create and manage clusters by setting up access policies as needed by data engineers and data scientists.
- Use Databricks API’s to automate and create reports on Feature Store and MLflow usage and behaviour.
- Create and manage access controls for raw and feature tables stored in Delta tables.
- Enable integration between Databricks and AWS S3 buckets by setting up right IAM policies. Set-up optimised S3 Lifecycles for data retention and storage.
- Enable monitoring of Data Engineering job workflows and automate job failures notification and fallback solutions. Optimise and suggest best practices for usage of clusters and data storage.
- Enable ingestion of streaming data into delta live tables to support realtime time based Anomaly detection models.
- Use Databricks MLflow to track model development, registry and deployment and save model artifacts like code snapshots, model parameters, metrics and other metadata.
- Use Unity Catalog to manage data and model versioning, governance and deployment. Build model drift pipelines and monitor model performance over time and enable workflows to retrain drifted models.
- Build process to automate model movement from Dev to Stage to Production and enabling A/B testing of different model versions.
- Experience in containerization technologies and orchestration frameworks , understanding of microservices architecture and deployment patterns.
- Creating Kubernetes cluster and deploying application on top of it via package manager tools like helm.
- Implement security best practices and ensure compliance with industry standards.
- Collaborate with development teams to optimize application performance and scalability.
Juniper Business Use Only
- Stay updated with emerging technologies and industry trends, and evaluate their potential impact on our infrastructure and development processes.
Qualification and Desired Experiences:
- SRE experience in building CICD pipelines, managing and owning code movements between environments, creating access controls to objects for users based on environments and roles.
- 3+ years of relevant MLOps experience in Databricks : involving GIT integration,
- setting up Access Controls in Databricks and AWS S3,
- setting up CICD pipeline for code\model deployment between environments,
- manage/maintain/monitor data pipelines and ML model performance.
- Bachelors's degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.
- Experience with big data tools: Spark, Kafka, Spark & Kafka Streaming, Python, and Snowflake
- Working knowledge of Databricks API to automate process.
- Experience with Databricks Unity Catalog.
- Experience with Databricks Feature Store and Delta Live Tables
- Experience with Databricks MLFlow, model registry and creating endpoints for inference for realtime\batch\streaming applications.
- Experience with AWS S3 for data storage, creating S3 Lifecycles for data storage and retention.
Personal Skills:
- Ability to collaborate cross-functionally in a fast-paced environment and build sound working relationships within all levels of the organization
- Ability to handle sensitive information with keen attention to detail and accuracy. Passion for data handling ethics.
- Ability to solve complex, technical problems with creative solutions while anticipating stakeholder needs and providing assistance to meet or exceed expectations
- Able to demonstrate perseverance and resilience to overcome obstacles when presented with a complex problem.
- Assist in combining large data sets and data analysis to create optimization strategies
- Comfortable with ambiguity and uncertainty of change when assessing needs for stakeholders
- Have effective time management skills which enable you to work successfully across functions in a dynamic and solution-oriented environment while meeting deadlines
- Self-motivated and innovative; confident when working independently, but an excellent team player with a growth-oriented personality
- Will be required to routinely or customarily troubleshoot items related to applications that require independent judgement, decision-making, and unique approaches
Juniper is an Equal Opportunity workplace and Affirmative Action employer. We do not discriminate in employment decisions on the basis of race, color, religion, gender (including pregnancy), national origin, political affiliation, sexual orientation, gender identity or expression, marital status, disability, genetic information, age, veteran status, or any other applicable legally protected characteristic. All employment decisions are made on the basis of individual qualifications, merit, and business need.
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
ABOUT JUNIPER NETWORKS
Juniper Networks challenges the inherent complexity that comes with networking and security in the multicloud era. We do this with products, solutions and services that transform the way people connect, work and live. We simplify the process of transitioning to a secure and automated multicloud environment to enable secure, AI-driven networks that connect the world. Additional information can be found at Juniper Networks (www.juniper.net) or connect with Juniper on Twitter, LinkedIn and Facebook.
WHERE WILL YOU DO YOUR BEST WORK?
Wherever you are in the world, whether it's downtown Sunnyvale or London, Westford or Bangalore, Juniper is a place that was founded on disruptive thinking - where colleague innovation is not only valued, but expected. We believe that the great task of delivering a new network for the next decade is delivered through the creativity and commitment of our people. The Juniper Way is the commitment to all our colleagues that the culture and company inspire their best work-their life's work. At Juniper we believe this is more than a job - it's an opportunity to help change the world...
INCLUSION AND DIVERSITY AT JUNIPER
At Juniper Networks, we are committed to elevating talent by creating a trust-based environment where we can all thrive together. We know from experience that people from underrepresented groups often do not apply for roles they do not feel they meet all the criteria for. If you think you have what it takes, but do not necessarily check every single box, please consider applying. We’d love to speak with you.
Additional Information for United States jobs:
ELIGIBILITY TO WORK AND E-VERIFY
In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire.
Juniper Networks participates in the E-Verify program. E-Verify is an Internet-based system operated by the Department of Homeland Security (DHS) in partnership with the Social Security Administration (SSA) that allows participating employers to electronically verify the employment eligibility of new hires and the validity of their Social Security Numbers.
● Information for applicants about E-Verify / E-Verify Información en español: This Company Participates in E-Verify / Este Empleador Participa en E-Verify
● Immigrant and Employee Rights Section (IER) - The Right to Work / El Derecho a Trabajar
E-Verify® is a registered trademark of the U.S. Department of Homeland Security.
Juniper is an Equal Opportunity workplace and Affirmative Action employer. We do not discriminate in employment decisions on the basis of race, color, religion, gender (including pregnancy), national origin, political affiliation, sexual orientation, gender identity or expression, marital status, disability, genetic information, age, veteran status, or any other applicable legally protected characteristic. All employment decisions are made on the basis of individual qualifications, merit, and business need.
]]>