Chennai, Tamil Nadu
Data Engineer #1065712Position Description:
- Data Engineer will join a Product Team within Global Data Insight & Analytics to design, build, deploy, and support end-to-end data and analytics products.
- This role combines strong cloud, and development capabilities to transform complex business data into secure, reliable, high-performing, and user-friendly solutions.
- The successful candidate will be equally comfortable building modern web applications and APIs, designing scalable data pipelines and data models, developing cloud-native services, and enabling analytics, reporting, and machine learning use cases.
- This engineer will work across the full product lifecycle—from requirements and architecture through development, testing, deployment, operations, and continuous improvement.
- Big Query,, SQL, GCP Cloud Run, TERRAFORM, Google Cloud Platform - Biq Query, Data Flow, Dataproc, Data Fusion, TERRAFORM, Tekton,Cloud SQL, AIRFLOW, POSTGRES, Airflow PySpark, Python, API, Analytical, Problem Solving
- Agile Software Development
- Scripting
- Engineer Exp: 4+ years Data Engineering work experience experience in SQL development and analytics/data product development experience.
- 3+ years of cloud experience (GCP preferred) with solutions designed and implemented at production scale.
- Experience working in GCP native (or equivalent) services like Big Query, Google Cloud Storage, PubSub, Dataflow, Dataproc, Cloud Build, etc.
- Experience working with Airflow for scheduling and orchestration of data pipelines.
- Experience working with Terraform to provision Infrastructure as Code.
- 2 + years professional development experience in Pyspark and Python.
- Bachelor's degree in computer science or related scientific field.
- Experience in analyzing complex data, organizing raw data, and integrating massive datasets from multiple data sources to build analytical domains and reusable data products.
- Experience in working with architects to evaluate and productionalize data pipelines for data ingestion, curation, and consumption.
- Experience in working with stakeholders to formulate business problems as technical data requirements, identify and implement technical solutions while ensuring key business drivers are captured in collaboration with product management.
- In-depth understanding of Google's product technology (or other cloud platform) and underlying architectures especially Gen AI /LLM
- Experience with development eco-system such as Tekton, Git, Jenkins for CI/CD pipelines.
- Experience in working with Agile and Lean methodologies.
- Experience with performance tuning SQL queries.
- Experience in creating and executing detailed test plans.
- GCP Professional Data Engineer Certified - Nice to have
- Associate Degree
- Certification Program
Key Responsibilities:
- Collaborate with business and technology stakeholders to understand current and future data requirements
- Design, build and maintain reliable, efficient and scalable data infrastructure for data collection, storage, transformation, and analysis
- Plan, design, build and maintain scalable data solutions including data pipelines, data models, and applications for efficient and reliable data workflow
- Design, implement and maintain existing and future data platforms like data warehouses, data lakes, data lakehouse etc. for structured and unstructured data
- Design and develop analytical tools, algorithms, and programs to support data engineering activities like writing scripts and automating tasks
- Ensure optimum performance and identify improvement opportunities