Watch this video to learn more about Deloitte LLP
Job Details
Databricks Test Engineer - Project Delivery Specialist - Customer
Are you an experienced, passionate pioneer in technology who wants to work in a collaborative environment? As an experienced Databricks Test Engineer you will have the ability to share new ideas and collaborate on projects as a consultant without the extensive demands of travel. If so, consider an opportunity with Deloitte under our Project Delivery Talent Model. Project Delivery Model (PDM) is a talent model that is tailored specifically for long-term, onsite client service delivery.
Work you'll do/Responsibilities
The Team
Our Deloitte Customer team empowers organizations to build deeper relationships with customers through innovative strategies, advanced analytics, Generative AI, transformative technologies, and creative design. We can enhance customer experiences and drive sustained growth and customer value creation and capture, through customer and commercial strategies, digital products and innovation, marketing, commerce, sales, and service. We are a team of strategists, data scientists, operators, creatives, designers, engineers, and architects. Our team balances business strategy, technology, creativity, and ongoing managed services to solve the biggest problems that affect customers, partners, constituents, and the workforce.
Our Digital Foundry & Operations works with the Customer group to bring a flexible capability and fluid capacity model to the delivery of small technology projects and enhancements.
Qualifications
Required
Information for applicants with a need for accommodation: https://www2.deloitte.com/us/en/pages/careers/articles/join-deloitte-assistance-for-disabled-applicants.html
Are you an experienced, passionate pioneer in technology who wants to work in a collaborative environment? As an experienced Databricks Test Engineer you will have the ability to share new ideas and collaborate on projects as a consultant without the extensive demands of travel. If so, consider an opportunity with Deloitte under our Project Delivery Talent Model. Project Delivery Model (PDM) is a talent model that is tailored specifically for long-term, onsite client service delivery.
Work you'll do/Responsibilities
- Act as the primary QA engineer for the Finance data domain, validating Databricks Medallion (Bronze/Silver/Gold) pipelines and ensuring delivered data products meet functional and data-quality expectations.
- Design, build, and maintain automated test frameworks (unit/integration/data-quality/regression) using Python to expand coverage across PySpark and Databricks workflows.
- Execute performance benchmarking and scalability testing for PySpark jobs (runtime, cost, and stability), partnering with data engineers to diagnose bottlenecks and verify improvements.
- Communicate regularly with Engagement Managers (Directors), project team members, and representatives from various functional and / or technical teams, including escalating any matters that require additional attention and consideration from engagement management
- Independently and collaboratively lead client engagement workstreams focused on improvement, optimization, and transformation of processes including implementing leading practice workflows, addressing deficits in quality, and driving operational outcomes
The Team
Our Deloitte Customer team empowers organizations to build deeper relationships with customers through innovative strategies, advanced analytics, Generative AI, transformative technologies, and creative design. We can enhance customer experiences and drive sustained growth and customer value creation and capture, through customer and commercial strategies, digital products and innovation, marketing, commerce, sales, and service. We are a team of strategists, data scientists, operators, creatives, designers, engineers, and architects. Our team balances business strategy, technology, creativity, and ongoing managed services to solve the biggest problems that affect customers, partners, constituents, and the workforce.
Our Digital Foundry & Operations works with the Customer group to bring a flexible capability and fluid capacity model to the delivery of small technology projects and enhancements.
Qualifications
Required
- 5+yrs of QA/testing experience for Databricks data platforms, including strong working knowledge of Medallion architecture and PySpark-based pipelines.
- Strong Python development skills, with experience building automated tests and test harnesses for data pipelines (including assertions, fixtures/test data management, and CI integration).
- Deep understanding of data products and data-quality dimensions (completeness, accuracy, timeliness, reconciliation) and the ability to translate requirements into executable test cases.
- Experience performing performance testing/benchmarking for distributed data processing (profiling, metrics/SLAs, and result reporting).
- Bachelor's degree, preferably in Computer Science, Information Technology, Computer Engineering, or related IT discipline; or equivalent experience
- Limited immigration sponsorship may be available
- Ability to travel 10%, on average, based on the work you do and the clients and industries/sectors you serve
Information for applicants with a need for accommodation: https://www2.deloitte.com/us/en/pages/careers/articles/join-deloitte-assistance-for-disabled-applicants.html
Company Details
Deloitte LLP
New York City, NY, United States
Don't imagine what's next. Discover it. We provide industry-leading audit & assurance services, consulting, tax and advisory services to many of... Read more