Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

SjZCNk1JeVdVUlUwUjRDaVU3YU1BeVZqTkE9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

ProPivotal Staffing

Lifeline Call Taker - Overnight Shifts Available ($20/hr) Job at ProPivotal Staffing

 ...for: High school diploma or GED Previous experience in telephone/call-center roles, especially thoseinvolving emotional...  ...compatible with the computer Must have a quiet workspace for working from home There are no costs for candidates utilizingour... 

NTT DATA Services

Call Center Operator Job at NTT DATA Services

 ...We are currently seeking a Call Center Operator to join our team in Nashville, Tennessee...  ...following: Conducts call intakes for all NCC phone lines and operator call analyses...  ...information into a web-based case management. Work cases to be referred to an ERO Officer/... 

Dynamics ATS

Warehouse Associate Job at Dynamics ATS

Warehouse Associate JOB-10045619 Anticipated Start Date Jan. 12, 2026 Location Denver, CO Type of Employment Contract Employer Info Our client is a provider of electrical, industrial, communications, maintenance, repair and operating...

P.J. DICK INCORPORATED

Class A and B CDL Truck Drivers Job at P.J. DICK INCORPORATED

 ...CLASS A & B CDL TRUCK DRIVERS WANTED THE LINDY GROUP (the Tri-State area's largest and most successful paving contractor and asphalt manufacturer) and its affiliates, CASTLE BUILDERS SUPPLY and PNM TRUCKING , are seeking responsible drivers for the purpose of... 

Golden Nugget

Overnight Security Officer Job at Golden Nugget

Overview: SUMMARY: Protects the assets of the casino, as directed, and responds promptly to requests for security assistance. Performs duties in compliance with local, state, and federal laws and the Colorado Limited Gaming Act. Provides exceptional guest service...