Job Details
In a nutshell:
We are seeking a highly skilled and motivated Platform Engineer (gn) with expertise in Databricks and Azure to join our team.
What main responsibilities does this role include?:
- Design, implementation, and maintenance of our data platform infrastructure
- Enabling data-driven decision-making and analytics across the organization
- Ensure our data platform is robust, scalable, and optimized for performance
- Act as the technical contact point for any technical and architectural design and implementation on the data lakehouse platform
What skills will be key in driving the success of our projects?:
- Strong programming skills in languages such as SQL, Python, Scala and/or Spark
- Experience working with Databricks and Azure services
- Experience with CI / CD, IaS, Terraform
- Familiarity with big data technologies and frameworks
- Ability to work Independently, assume ownership and act results oriented
- Self-driven to stay up to date with the latest changes in Databricks, Azure and related data platform technologies
The tasks
- Architect, design and implement data platform infrastructure on Azure, with a strong focus on Databricks
- Implement best practices for Databricks performance and security
- Stay current with Azure security best practices and compliance requirements
The key relationships
- Close collaboration with data scientists, data engineers, Product Owners and other cross-functional teams
The key responsibilities
- Collaborate with Product Owners, Data Engineers and Data Scientists to understand their requirements and provide solutions
- Manage and maintain Databricks clusters, SQL endpoints, workspaces and jobs
- Develop and maintain automation scripts using tools like Terraform, PowerShell or Azure CLI to streamline deployment and management tasks
- Configure, manage, and optimize Azure services such as Azure Data Lake Storage, Azure SQL Data Warehouse and other Azure services
- Implement security measures, data encryption and access controls to ensure the confidentiality and integrity of data stored and processed within the platform
- Monitor platform health and performance, proactively identifying and resolving bottlenecks and issues
- Design and implement solutions for high availability and scalability to meet evolving business needs
- Monitor and control cloud infrastructure costs, identifying opportunities for optimization
- Troubleshoot and resolve issues promptly to minimize downtime
- Stay up-to-date with emerging technologies and trends in cloud computing, data engineering and analytics
- Document infrastructure configurations, deployment procedures and troubleshooting guidelines.
The direct Lead:
Gina Alexa is the Hiring Lead for this role. Gina is located in Munich and an experienced BI leader with strong technical acumen in managing BI projects and teams across diverse business streams. She`s skilled in data modeling, Microsoft BI technologies, and project management and proficient in Databricks, Azure, MSSQL, SSIS, SSRS, SSAS, Power BI, and more. You need more information about Gina?: https://www.linkedin.com/in/ginalexa/
You Might Also Like
Help us maintain the quality of jobs posted on PowerToFly. Let us know if this job is closed.
Mission
We're connecting diverse talent to big career moves. Meeting people who boost your career is hard - yet networking is key to growth and economic empowerment. We’re here to support you - within your current workplace or somewhere new. Upskill, join daily virtual events, apply to roles (it’s free!).
Are you hiring? Join our platform for diversifiying your team