- 경험
- 6년 이상
- 샐러리
- —
- 채용 공고
- 1
- 게시됨
- 5시간전
- 작업 모드
- 사무실에서
- 교육
- 졸업생 누구나
- 적임
- Graduates from any discipline can apply.
- 재개하다
- 신청 시 필수 사항
당신이 일하게 될 곳
직무 설명
Overview
Tata Consultancy Services Ltd. is seeking an experienced Data Engineer for locations in Pune, Bengaluru, NCR, Kolkata, and Hyderabad. This role requires over 6 years of professional experience and strong expertise in AWS ecosystem, Python programming, PySpark, and Databricks platforms to develop scalable data processing systems.
Key Duties
- Create and maintain ETL/ELT data pipelines using AWS technologies including Lambda, Step Functions, Glue, and S3 alongside Python scripting.
- Develop and optimize data transformation workflows leveraging PySpark and Databricks.
- Design and implement complex data transformation engines to handle large datasets efficiently.
- Manage PostgreSQL and MongoDB databases ensuring performance and reliability.
- Collaborate with software engineering teams and other stakeholders to align on data solution design.
- Participate actively in code reviews, technical discussions, and planning sessions.
- Drive automation efforts supporting continuous integration and deployment processes.
- Create and maintain technical documentation and follow industry best practices for software development.
Mandatory Expertise
- Advanced programming skills in Python.
- Good command over AWS services such as Lambda, Step Functions, Glue, S3.
- Experience in PySpark and Databricks for data processing.
- Proficient with SQL, PostgreSQL, and MongoDB databases.
- Hands-on development of ETL/ELT pipelines with large-scale data.
- Data modeling and transformation to support analytics and reporting.
Preferred Skills
- Experience with AWS Glue.
- Understanding of CI/CD and DevOps methodologies.
- Knowledge of data quality and monitoring frameworks.
- Version control using Git.
Educational Qualifications
- Bachelor's degree in Computer Science, Information Technology, Engineering, or related fields; however, equivalent experience is also considered.
Certifications
- Optional but preferred AWS certifications including AWS Certified Cloud Practitioner, Developer Associate, and Data Engineer Associate.