11/03 Rashmi Lumba
Manager - IT Staffing & Recruitment at Engage IT Manpower

Views:1913 Applications:211 Rec. Actions:Recruiter Actions:74

Data Engineer - Big Data/ETL/Perl (3-8 yrs)

Bangalore Job Code: 420912

Position : Data Engineer

Experience: 3 to 7 years.

Candidates with real time Big Data projects will be considered

ETL+ Big Data + Perl/Python Scripting.

Data Engineer Skill set

1. ETL Framework

- Automation

- Alert notification

- Data quality checks

- Autohaeling (restorability)

- Idempotency

- Auditing

2. BI - ETL

- DB Modeling

- Performance tuning

- Logical/ Physiical design

3. Programming

- Scripting

1. Python/ Pearl

2. Data cleansing

3. Validation

- Automation

4. S/w Engineering

- Release Management

- Version control (git/ svn/ others)

5. Big Data (around 20% knowledge)

- Hive programming

- Tuning Hive queries

- Understanding MapReduce logs/ counters

- Hadoop fundamentals

Add a note
Something suspicious? Report this job posting.