Sholinganallur, Chennai
Software Engineer Associate #1011113Job Description:
- This is a Data Engineer/Consultant expert position for the CVDE GDIA team to support Data Products in software development of high priority products.
- The CVDE Data products Team is responsible for building and operationalizing data engineering, software engineering and architecture patterns and best practices for GDIA Teams.
- The successful candidate will work with a variety of technical and business teams at including GDIA and ITO to build, enable, transform and migrate data products, processes and applications.
- Our teams strive for excellence within the PDO structure and agile methodologies.
- We are a team of passionate technologists with broad experience in Cloud and distributed systems, Micro-services, APIs and Machine Learning.
- Our Engineers are involved in all aspects of the product life cycle, Conceptual design, development, deployment, and DevOps.
Skills Required:
- Full Stack Data Engineering Competency in a public cloud – Google Cloud or MS Azure or AWS
- Highly Proficient in SQL, Python, Java, Scala, or Go (or similar) \
- Experience programming engineering transformation in Python or a similar language
- Demonstrated ability to lead data engineering projects, design sessions and deliverables to successful completion
- Deep understanding of data service ecosystems including data warehousing, lakes, metadata, meshes, fabrics and AI/ML use cases.
- Effective Communication both internally (with team members) and externally (with stakeholders)
- Knowledge of Data Warehouse concepts – experience with Data Warehouse/ ETL processes
- Strong process discipline and thorough understating of IT processes (ISP, Data Security).
- Strong in Software Programming/Engineering with a good understanding of DevOps, GitHub etc.
Skills Preferred:
- Excellent communication, collaboration and influence skills; ability to energize a team. ·
- Knowledge of data, software and architecture operations, data engineering and data management standards, governance, and quality
- Hands on experience in Python using libraries like NumPy, Pandas, etc.
- Extensive knowledge and understanding of GCP offerings, bundled services, BigQuery,DataProc, Airflow, Terraform/Tekton, DataFlow, DataFusion, PubSub / Kafka, Looker Studio, VertexAI
- Experience with Teradata, Hadoop, Hive, Spark and other parts of legacy data platform
Experience Required:
- 4+ years of Software development experience in GCP environment
Education Required:
- Bachelor’s or Master’s degree in a Computer Science, Engineering or a related or related field of study