Brillio - Data Engineer Lead - SQL/Spark/ETL/Cloudera (8-10 yrs)
Job Description :
- Overall 8-10 year experience in Data lake, Data warehouse, Data modelling, ODS, and ETL design and development
- Minimum 3-4 project implementation experience using following technologies: Cloudera Impala, HIVE, Spark, Oozie, Python scripting, Shell scripting, Any RDBMS (MySQL, SQL Server, Oracle)
- Proficient in Scala or Java programming
- Real time data processing using Kafka & Spark Streaming, Apache Nifi is preferred
- Working knowledge on AWS Services like EC2, EBS, S3, RDS, IAM is an advantage
- Expectation out of this role to lead ETL team deliverables in offshore. Provide technical support to DW & DQ team.