The Hadoop Developer position will provide expertise in a wide range of technical areas, including but not limited to: Cloudera Hadoop ecosystem, Java, collaboration toolsets integration using SSO, configuration management, hardware and software configuration and tuning, software design and development, and application of new technologies and languages that are aligned.
1. Design and development of data ingestion pipelines.
2. Perform data migration and conversion activities.
3. Develop and integrate software applications using suitable development methodologies and standards, applying standard architectural patterns, taking into account critical performance characteristics and security measures.
4. Collaborate with Business Analysts, Architects and Senior Developers to establish the physical application framework (e.g. libraries, modules, execution environments).
5. Perform end to end automation of ETL process for various datasets that are being ingested into the big data platform.
1. Lead technical design sessions, suggest best solution options per industry standards
2. Document and maintain project artifacts.
2. Suggest best practices, and implementation strategies using Hadoop, Java, ETL tools.
3. Maintain comprehensive knowledge of industry standards, methodologies, processes, and best practices.
4. Other duties as assigned.
|Experience||6 - 12 Years|
|Salary||8 Lac To 30 Lac P.A.|
|Industry||IT Software - Application Programming / Maintenance|
|Key Skills||Hadoop SCALA SQL Unix JSON Python Perl Hive Impala Spark Oozie ETL NoSQL Database Design|
|Address||Regus Business Centre, No.136, 3rd Floor, Shyamala Tower, Arcot Rd,|