Data Engineer - Sr. Consultant level (8 - 12 Years)

Job Description

We value creative and driven individuals who love to own their products, and design and implement solutions that create a seamless experience for consumers and clients. Our Data engineers work across the stack, and are experts in building data driven business solutions using technologies such as Hadoop, Hive, Spark, Scala, Python, MS SQL, Kafka & Power BI. As we embark on the journey to build a Data Lake, we are looking for a Senior Consultant - Data Engineer who can drive architecture, design and development activities.

The role involves extensive hands-on activities. Here are key job responsibilities –

• Responsible for the architecture, design and development
• Work on development of new products iteratively by building quick POCs and converting ideas into real products
• Develop workflows and ETL/ELT code using Hive scripts, Spark and other utilities on Hadoop.
• Build analytical applications using Hadoop eco system using packaged or open source technologies
• Build resilient data pipelines for reporting and data science/ML use cases
• Interact with both business and technical stakeholders to deliver high quality products and services that meet business requirements and expectations while applying the latest available tools and technology
• Have a passion for delivering zero defect code and be responsible for ensuring the team's deliverables meet or exceed the prescribed defect SLA
• Present technical solutions, capabilities, considerations, and features in business terms. Effectively communicate status, issues, and risks in a precise and timely manner.
• Perform other tasks on R&D, data governance, data security, system infrastructure, and other cross team functions, on an as-needed basis

This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.

Qualifications

Basic Qualifications
9+ years of relevant work experience with a Bachelor’s Degree or at least 7 years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or 2 years of work experience with a PhD, OR 11+ years of relevant work experience.

Preferred Qualifications
Masters or Bachelor degree in Computer science or related fields required.
Minimum of 9 years of experience in building data driven business solutions and solving data problems
Minimum of 4 years of experience in building large-scale data solutions using open source technologies. Design and coding skills with Big Data technologies like Hadoop, Spark, Hive, Kafka
Minimum of 4 years of hands-on expertise with Java or Scala or Python
Experience with highly distributed, scalable, concurrent and low latency systems working with one or more of the following database technologies: DB2, MS SQL, MySQL and NoSQL, data warehouses such as HBase
Experience with Continuous Integration tools such as Jenkins, Artifactory etc desirable
Experience with data visualization and business intelligence tools like Power BI is a plus
Experience with Databricks,clickkhouse or Microsoft Fabric is advantageous

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.