Senior Hadoop Engineer

Main Location
New York City, NY, United States
Open jobs
Associate

Responsibilities:

Hadoop Datalake COE engineer to join WMT Datalake Platform COE team. This position provides COE and Engineering assistance to all Datalake applications hosted on Hadoop.


The engineer should be Level-3 point of contact for issues in Hadoop with respect to batches, reports and online Financial Adviser queries coming via various data-marts in datalake. Ownership of maintenance and future road-map for Hadoop datalake plant to help achieve Morgan Stanley its business goals with optimized and cost effective ways. The role also demands the ability to successfully work with global teams in US and India. Person should have necessary soft skills to manage difficult situations involving technical issues, demanding Clients, escalations and being a team player.

Key Responsibilities ?

- Datalake cluster ownership and Technical point of contact for all applications on Hadoop cluster
- Responsible for new application on-boarding in Datalake by reviewing requirement and design.
- Assist existing and new applications to come up with most optimized and suitable solutions for their requirement
- L3 point of contact for issues related to Hadoop platform
- Performance tuning and capacity management
- New technology POC and suitability analysis for Hadoop Datalake
- Process optimization with the help of automation and new utility development
- Work in collaboration with Hadoop vendors for any Hadoop related activity
- Performance review of Hadoop changes going into PROD
- Hadoop workload management review to ensure SLA adherence for online/report queries
- Plan and execute system upgrade and enhancements

Mission
We're a community of women leveraging our connections into top companies to help underrepresented women get the roles they've always deserved. Simultaneously, we work to build truly inclusive hiring processes and environments where women can thrive and not just survive.
Are you hiring? Join our platform for diversifiying your team
Senior Hadoop Engineer
Morgan Stanley Technology