Guindy, Chennai, Tamil Nadu
Chennai
Design and development of data ingestion pipelines (Databricks background preferred).
- Performance tune and optimize the databricks jobs
- Evaluated new features and refractors existing code
- Mentor junior developers and makes sure all patterns are documented
- Perform data migration and conversion activities.
- Develop and integrate software applications using suitable development methodologies and standards, applying standard architectural patterns, taking into account critical performance characteristics and security measures.
- Collaborate with Business Analysts, Architects and Senior Developers to establish the physical application framework (e.g. libraries, modules, execution environments).
- Perform end to end automation of ETL process for various datasets that are being ingested into the big data platform.
* Maintain and support the application.
* Must be willing to flex work hours accordingly to support application launches and manage production outages if necessary
* Ensures to understand the requirements thoroughly and in detail and identify gaps in requirements
* Ensures that detailed unit testing is done, handles negative scenarios and document the same
* Work with QA and automation team.
* Works on best practices and documenting the process
* code merges and releases (Bitbucket)
* Works with architect and manager on designs and best practices
* Good data analysis skills
Experience | 7 - 13 Years |
Salary | 5 Lac To 25 Lac P.A. |
Industry | IT Software - Application Programming / Maintenance |
Qualification | B.C.A, B.Sc, B.E, B.Tech, M.C.A, M.Sc, M.Tech |
Key Skills | Scala SQL Spark Spark Streaming Big Data Tool Linux Python Pyspark Kafka Databricks Azure Developer |
Hi! Simply click below and type your query.
Our experts will reply you very soon.