FASTTEK GLOBALpowered by Fast Switch - Great Lakes
info@fasttek.com
(734) 744-9373
Dearborn, Michigan
Data Engineer General #786790
Job Description:
Data Engineer Design and build production data engineering solutions to deliver data pipeline patterns using following Google Cloud Platform (GCP) services:
  • In-depth understanding of Google's product technology and underlying architectures
  • BigQuery – Warehouse/ data marts – Through understanding of Big Query internals to write efficient queries for ELT needs, creation of views/materialized views, creation of reusable store procedures etc.
  • DataFlow (Apache Beam) – reusable Flex templates/ data processing frameworks using Java for both batch and stream needs.
  • Pub/Sub, Kafka, Confluent Kafka – Real time streaming of database changes or events.
  • Experience of designing, building, and deploying production-level data pipelines using Kafka; Strong experience working on Event Driven Architecture
  • Strong knowledge of the Kafka Connect framework, with experience using several connector types HTTP REST proxy, JMS, File, SFTP, JDBC etc.
  • Experience in handling huge volumes of streaming messages from Kafka
  • Cloud Composer (Apache Airflow) – to build, monitor and orchestrating the pipeline
  • Knowledge on BigTable
  • Cloud SQL, Compute Engine, Cloud Function, Cloud Run and App Engine, Cloud Storage
  • Experience with open-source distributed storage and processing utilities in the Apache Hadoop family.
  • Extensive knowledge on processing various file formats orc, Avro, csv, json, xml etc. • Knowledge/experience in any ETL tools like DataStage/Informatica – Ability to understand existing on-premises ETL workflows and redesign them in GCP.
  • Experience and expertise on Terraform to deploy the GCP’s in CI/CD.
  • Knowledge/ Experience on connecting to on-prem API’s from google cloud.
 
Skills Required:
  • GCP
  • Big Query
  • Terraform
  • Kafka
  • Cloud run
 
Experience Required:
  • Big Query
  • Terraform
 
Additional Info:
 
At FastTek Global, Our Purpose is Our People and Our Planet. We come to work each day and are reminded we are helping people find their success stories. Also, Doing the right thing is our mantra.  We act responsibly, give back to the communities we serve and have a little fun along the way.
We have been doing this with pride, dedication and plain, old-fashioned hard work for 24 years!
FastTek Global is financially strong, privately held company that is 100% consultant and client focused.
We've differentiated ourselves by being fast, flexible, creative and honest. Throw out everything you've heard, seen, or felt about every other IT Consulting company. We do unique things and we do them for Fortune 10, Fortune 500, and technology start-up companies.
Our benefits are second to none and thanks to our flexible benefit options you can choose the benefits you need or want, options include:
 
  • Medical and Dental (FastTek pays majority of the medical program)
  • Vision
  • Personal Time Off (PTO) Program
  • Long Term Disability (100% paid)
  • Life Insurance (100% paid)
  • 401(k) with immediate vesting and 3% (of salary) dollar-for-dollar match
 
Plus, we have a lucrative employee referral program and an employee recognition culture.
FastTek Global was named one of the Top Work Places in Michigan by the Detroit Free Press in 2013, 2014, 2015, 2016, 2017, 2018, 2019 and 2020!
To view all of our open positions go to: https://www.fasttek.com/fastswitch/findwork
Follow us on Twitter: https://twitter.com/fasttekglobal
Follow us on Instagram: https://www.instagram.com/fasttekglobal
Find us on LinkedIn: https://www.linkedin.com/company/fasttek
You can become a fan of FastTek on Facebook: https://www.facebook.com/fasttekglobal/