272 Hadoop Jobs

Job Description

What's it all about?

The Data Engineer will be part of an innovative Business Intelligence and Sales Tools Team within the VAS COO organization. The candidate is responsible for designing, building, and maintaining the infrastructure that supports data collection, storage, and processing. Ensures that data is accessible, reliable, and efficiently processed for analysis. Involves working with big data technologies, creating data pipelines, ingesting 3rd party data, and ensuring data quality and security.

Responsibilities

• Build and maintain clean data sets, automate data workflow and integration tasks.
•  Deliver on all code commitments and ensure a complete end-to-end solution that meets and exceeds business expectations.
•  Monitor and support production data warehouse.
• Implement data quality checks and pro-active exception handling and notification systems to ensure consistently high-quality data and resolve inconsistencies.
• Present technical solutions, capabilities, considerations, and features in business terms.
• Build data expertise and own data quality for allocated areas of ownership.
• Effectively communicate status, issues, and risks in a precise and timely manner.
• Support critical data processes running in production

This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.

Qualifications

What we expect of you, day to day.

• 3 or more years of work experience with a Bachelor’s Degree or more than 2 years of work experience with an Advanced Degree (e.g. Masters, MBA, JD, MD)
• Experience managing a data warehouse including partnering with other workgroups globally that may supply and/or use data.
• In depth knowledge of data warehouse design. Big data experience (Hive, Presto, Airflow, or other HDFS based) required. Needs to have experience taking large amounts of data and narrowing them down to more focused data sets.
• Experience with creating data driven business solutions and solving data problems using a wide variety of technologies such as Hadoop, MapReduce, Hive, Spark, as well as traditional data technologies like MySQL, RDBMS
• Strong facilitation and analytical skills with excellent problem-solving ability
• Experience working with Sales and marketing team a plus, but the ability to work with any nontechnical business team is a must.
• Strong interpersonal and leadership skills
• Ability to present complex ideas in a clear, concise way.

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.