仕事内容

Overview

Tata Consultancy Services Ltd. is seeking an experienced Data Engineer for locations in Pune, Bengaluru, NCR, Kolkata, and Hyderabad. This role requires over 6 years of professional experience and strong expertise in AWS ecosystem, Python programming, PySpark, and Databricks platforms to develop scalable data processing systems.

Key Duties

Create and maintain ETL/ELT data pipelines using AWS technologies including Lambda, Step Functions, Glue, and S3 alongside Python scripting.
Develop and optimize data transformation workflows leveraging PySpark and Databricks.
Design and implement complex data transformation engines to handle large datasets efficiently.
Manage PostgreSQL and MongoDB databases ensuring performance and reliability.
Collaborate with software engineering teams and other stakeholders to align on data solution design.
Participate actively in code reviews, technical discussions, and planning sessions.
Drive automation efforts supporting continuous integration and deployment processes.
Create and maintain technical documentation and follow industry best practices for software development.

Mandatory Expertise

Advanced programming skills in Python.
Good command over AWS services such as Lambda, Step Functions, Glue, S3.
Experience in PySpark and Databricks for data processing.
Proficient with SQL, PostgreSQL, and MongoDB databases.
Hands-on development of ETL/ELT pipelines with large-scale data.
Data modeling and transformation to support analytics and reporting.

Preferred Skills

Experience with AWS Glue.
Understanding of CI/CD and DevOps methodologies.
Knowledge of data quality and monitoring frameworks.
Version control using Git.

Educational Qualifications

Bachelor's degree in Computer Science, Information Technology, Engineering, or related fields; however, equivalent experience is also considered.

Certifications

Optional but preferred AWS certifications including AWS Certified Cloud Practitioner, Developer Associate, and Data Engineer Associate.

AWS Data Engineer

勤務地