AI team overview We are leaders in technological advancements, using AI to create groundbreaking products and solutions. Our AI Team is committed to exploring AI and machine learning's full potential.
Job Summary As a Data Engineer on our AI Team, you will craft the foundation of our AI models and algorithms. You will build and maintain reliable data pipelines, ensuring data availability, integrity, and quality for our AI projects. Your work will directly influence our AI initiatives, contributing to innovative solutions for complex problems.
Key Responsibilities- Design, develop, and maintain scalable data pipelines using Databricks and Azure services.
- Perform feature set engineering, report preparations, and ML tasks.
- Work with data scientists, ML engineers, and collaborators to deliver high-quality data solutions.
- Collaborate with the Data & Analytics Team on data infrastructure and ingestion.
- Discuss data inputs with Business Development and collaborators, advising on data integration.
- Ensure data accuracy and consistency across sources and systems.
- Optimize data workflows for performance and efficiency.
- Implement best practices for data security and privacy.
- Monitor and troubleshoot data pipelines to resolve issues promptly.
- Stay updated with trends in data engineering, AI, and related technologies.
- Document data processes and standards for repeatability and compliance.
- Test, validate, and verify solutions to ensure quality.