Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

SjZCNk1JeVdVUlUwUjRDaVU3YU1BeVZqTkE9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

Spectrum Brands

Regulatory Specialist Job at Spectrum Brands

 ...Start DateAug-04-2025 Division InformationThe Home & Garden business unit of Spectrum Brands is based in St. Louis, Missouri with distribution...  ...federal registration practices (paths outlined below). Work closely with government officials in order to properly... 

DT Professional Services LLC

IT Business/QA Analyst Job at DT Professional Services LLC

Description:IT Business Analyst/W QA Experience~Monitor project costs~Research projects and prepare correcting entries, as necessary~Prepare project cost accruals~Possesses knowledge of industry joint interest and revenue operations~Insurance Industry a must... 

Yale New Haven Health

Kronos System Analyst II Job at Yale New Haven Health

Overview:To be part of our organization, every employee should understand and share in the YNHHS Vision, support our Mission, and live our Values. These values - integrity, patient-centered, respect, accountability, and compassion - must guide what we do, as individuals...

DHD Consulting

Temporary Treasury Team Staff Job at DHD Consulting

 ...motivated Temporary Staff Member to join our Treasury Team. This role will support key treasury functions including daily cash flow monitoring, payment processing, receivables tracking, and risk prevention. The ideal candidate will contribute to the teams financial accuracy... 

IPS Corporate Security

Event Security Officer Job at IPS Corporate Security

 ...IPS Security Inc. is looking for Event Security Officers to join our team. Your role as an Event Security Officer will be to provide exceptional customer service to our clients and guests, monitor equipment and report any activity, and work hand in hand with the other...