FASTTEK GLOBALpowered by Fast Switch - Great Lakes
Chennai, Tamil Nadu
Data Engineering Engineer 3 #1037012Job Description:
- Employees in this job function are responsible for designing, building, and maintaining data solutions including data infrastructure, pipelines, etc. for collecting, storing, processing and analyzing large volumes of data efficiently and accurately
Key Responsibilities:
- Collaborate with business and technology stakeholders to understand current and future data requirements
- Design, build and maintain reliable, efficient and scalable data infrastructure for data collection, storage, transformation, and analysis
- Plan, design, build and maintain scalable data solutions including data pipelines, data models, and applications for efficient and reliable data workflow
- Design, implement and maintain existing and future data platforms like data warehouses, data lakes, data lakehouse etc. for structured and unstructured data
- Design and develop analytical tools, algorithms, and programs to support data engineering activities like writing scripts and automating tasks
- Ensure optimum performance and identify improvement opportunities
Skills Required:
- Big Query,, GCP
Skills Preferred:
- Big Query,, Artificial Intelligence & Expert Systems, DataForm, Google Cloud Platform - Biq Query, Data Flow, Dataproc, Data Fusion, TERRAFORM, Tekton,Cloud SQL, AIRFLOW, POSTGRES, Airflow PySpark, Python, API
Experience Required:
- Engineer 3 Exp: 7+ years Data Engineering work experience
Experience Preferred:
- Google cloud certification,
Education Required:
- Bachelor's Degree
Additional Information :
Required Skills
- Bachelor's degree in a Technical Field: Computer Science, Data Science, Computational Finance, Statistics, Economics and/or Mathematics: Masters Preferred
- 5+ years of experience in data solution, pipeline, mart and/or warehouse development and delivery using agile development methodology
- Critical thinking skills to propose solutions, test, and make them a reality.
- 2+ years of experience in a Data Engineering Competency on a public cloud - Google
- 2+ years Integration and Configuration Scripting in Tekton and Terraform
- 3+ years of experience writing complex SQL
- 3+ years of experience writing data solutions in Python
- Deep understanding of data service ecosystems including data warehouses, lakes, metadata, meshes, fabrics and analytical use cases
- User experience advocacy through empathetic stakeholder relationship
- Excellent Communication Skills, Verbal and Written, for both internal and external team members Desired Skills
- 5+ years Extensive knowledge and understanding of GCP offerings, bundled services, especially those associated with data operations Cloud Console, AI/ML, Python, Dataform, BigQuery, Data Flow, Data Fusion, PubSub / Kafka,
- Experience with Artificial intelligence concepts /ML
- Experience optimizing data solutions and data science/analytical workflows: re-coding/re-developing/re-factoring
- Data Governance concepts including GDPR (General Data Protection Regulation), CCPA (California Consumer Protection Act), PoLP and how these can impact technical architecture