FASTTEK GLOBALpowered by Fast Switch - Great Lakes
Chennai, Tamil Nadu
Data Engineer #1059018Job Description:
- Work on a Portfolio Engineering Team based in Chennai to play a pivotal role in the development and maintenance of our Enterprise Data Platform and perform end to end Full stack Data engineer role.
- Work effectively with fellow data engineers, product owners, data champions and other technical experts.
- Demonstrate technical knowledge and communication skills with the ability to advocate for well-designed solutions.
- Develop exceptional analytical data products with the guidance from senior data engineers using both streaming and batch ingestion patterns on Google Cloud Platform with solid data warehouse principles.
Skills Required:
- Big Query,, SQL, Communications, Problem Solving, cloud, Airflow PySpark, Python
Skills Preferred:
- Google Cloud Platform - Biq Query, Data Flow, Dataproc, Data Fusion, TERRAFORM, Tekton,Cloud SQL, AIRFLOW, POSTGRES, Airflow PySpark, Python, API
Experience Required:
- Engineer 2 Exp: 4+ years Data Engineering work experience
Education Required:
- Associate Degree
Additional Information :
- Overall 4+ years of experience in SQL development and analytics/data product development experience.
- 3+ years of cloud experience (GCP preferred) with solutions designed and implemented at production scale.
- Experience working in GCP native (or equivalent) services like Big Query, Google Cloud Storage, PubSub, Dataflow, Dataproc, Cloud Build, etc.
- Experience working with Airflow for scheduling and orchestration of data pipelines.
- Experience working with Terraform to provision Infrastructure as Code.
- 2 + years professional development experience in Pyspark and Python.
- Bachelor's degree in computer science or related scientific field.
- Experience in analyzing complex data, organizing raw data, and integrating massive datasets from multiple data sources to build analytical domains and reusable data products.
- Experience in working with architects to evaluate and productionalize data pipelines for data ingestion, curation, and consumption.
- Experience in working with stakeholders to formulate business problems as technical data requirements, identify and implement technical solutions while ensuring key business drivers are captured in collaboration with product management.