Lead Data Engineer Job at Disney Entertainment and ESPN Product & Technology, Santa Monica, CA

SXFCOU1ZcWJXUlF6UklhblU3R01BaU5uTkE9PQ==
  • Disney Entertainment and ESPN Product & Technology
  • Santa Monica, CA

Job Description

Job Summary:

Technology is at the heart of Disney’s past, present, and future. Disney Entertainment and ESPN Product & Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more – all working to build and advance the technological backbone for Disney’s media business globally.

The team marries technology with creativity to build world-class products, enhance storytelling, and drive velocity, innovation, and scalability for our businesses. We are Storytellers and Innovators. Creators and Builders. Entertainers and Engineers. We work with every part of The Walt Disney Company’s media portfolio to advance the technological foundation and consumer media touch points serving millions of people around the world. 

Here are a few reasons why we think you’d love working here:

Building the future of Disney’s media: Our Technologists are designing and building the products and platforms that will power our media, advertising, and distribution businesses for years to come. Reach, Scale & Impact: More than ever, Disney’s technology and products serve as a signature doorway for fans' connections with the company’s brands and stories. Disney+. Hulu. ESPN. ABC. ABC News…and many more. These products and brands – and the unmatched stories, storytellers, and events they carry – matter to millions of people globally.  Innovation: We develop and implement groundbreaking products and techniques that shape industry norms, and solve complex and distinctive technical problems.

Product Engineering is a unified team responsible for the engineering of Disney Entertainment & ESPN digital and streaming products and platforms. This includes product engineering, media engineering, quality assurance, engineering behind personalization, commerce, lifecycle, and identity.

Job Summary:

The Search Machine Learning (ML) team powers the ML aspects of search engines for Disney+ platform, in a highly collaborative environment. ML-based services are embedded inside the entire life cycle of search journey, from query understanding , semantic retrieval , and engagement-based re-ranking of contents. Working closely with our product stakeholders, we are constantly testing new ideas, and bringing the proven ones into fruition, through experimentation.

In this role, you will be leading the data operation aspects of our ML services, from data warehousing, building and owning ETL pipelines, and standing up feature stores for low-latency feature access to our ML micro-services. This is a highly collaborative role, where you will be able to own the entire lifecycle of data pipelines, communicate your requirements with upstream DATA teams, bring your data engineering skills and ideas into life by engineering efficient data pipelines, and help supporting the feature requirements by the ML engineers/data scientists.

Responsibilities and Duties of the Role:

  • Design, own, and optimize our offline (Spark) and near-line (Kinesis, Kafka) data pipelines.
  • Stand up scalable and performant online feature stores; build SDKs around both customized and provisioned feature stores.
  • Integrate online feature stores with the ML service layer to enable real-time model inference and data serving.
  • Scope data lineage dependencies and participate in cross-team data model design for upstream and downstream systems.
  • Mentor junior data engineers on best practices for testing, validation, and deployment of ETL jobs, including pipeline and feature set versioning, and promoting code from non-prod to prod environments.

Required Education, Experience/Skills/Training:

Basic Qualifications

  • 7+ years of data engineering experience, with 2+ years of relevant Feature Store experience
  • Experience with design trade-offs for low-latency online feature stores
  • Hands-on experience with sagemaker/Redis or any other equivalent online Feature Stores
  • Experience with large-scale distributed data processing systems, such as Spark, Hadoop, Ray

Preferred Qualifications

  • Familiarity with vector databases such as Faiss, Pinecone, Milvus, mongoDB, Qdrant
  • Experience building streaming pipelines using Kafka, Kinesis

Required Education  

  • Bachelor's (MS or PhD preferred) in Computer Science, Software Engineering, or a related field
The hiring range for this position in Santa Monica, CA is $155,700 - $208,700 per year and in New York City is $163,100 - $218,700 per year and in San Francisco, CA is $170,500 - $228,600 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.

Job Tags

Similar Jobs

Fleet Response

Client Support Coordinator I Job at Fleet Response

 ...seeking qualified candidates to work at our corporate office, for...  ...detailed information through oral communication and making...  ...Days and hours of work are Monday through Friday, typically within the hours...  ...There is an option to work from home 50 % of the time. This eligibility... 

Career Personnel

Client Intake Representative - Remote Job at Career Personnel

 ...possibility of becoming permanent at 514 hours) Remote / Work From Home!! ***IF HIRED PERMANENTLY the job offers BCBS Health...  ...company match, bonus, pay raises and PTO. Schedule: Monday through Friday, 08:00 am to 05:00 pm Pay: $15.00/PH A local Law Firm... 

Dynamics ATS

Warehouse Associate Job at Dynamics ATS

Warehouse Associate JOB-10045619 Anticipated Start Date Jan. 12, 2026 Location Denver, CO Type of Employment Contract Employer Info Our client is a provider of electrical, industrial, communications, maintenance, repair and operating...

Bank of America Corporation

Machine Operator - 2nd Shift Job at Bank of America Corporation

 ...make financial lives better through the power of every connection...  .... Being a Great Place to Work is core to how we drive...  ...Schedule: 2nd Shift Monday through Friday 2:00pm - 10:30pm Responsibilities...  ...participation in a work from home posture does not make you ineligible... 

SCP Health

Hospital Medicine Physician Job at SCP Health

 ...organizations. Our clinical offerings currently span the entire continuum of care, from emergency and hospital-based medicine to telemedicine, intensive care, ambulatory, and in-home clinical care. Together, We Heal. Job Details 140 hospital beds 4-bed open ICU...