Data Warehouse Architect 3 #1067833
Job description:
Data Engineering Lead excels in data modeling, Lakehouse and Medallion Architecture concepts, and data/ML products delivery using an agile DevOps framework with a mastery of distributed data architectures essential for data, analytical and operational ML applications with demonstrated proficiency in frameworks including Spark, Kafka, Kubernetes, SageMaker, DBT, Juniper Notebooks, Docker, SQL, and visualization tools such as Power BI/Tableau with the following track record:
 
Required Education:  Bachelor's Degree
 
Required Skills:

• Minimum 4 years of hand-on experience is required in hydrating the enterprise Data Lake on a Cloud Service Provider (AWS, Azure, or Google) from relational, semi- structured and unstructured data sources by building Extract and Load Data Pipelines.
• Minimum of 4 years hands-on experience is required in Transforming the datasets in a Data Lake on a Cloud Service Provider to deliver Data Products with traceability of their attributes / features to the Critical Data Elements in the systems of record.
• Minimum of 2 years experience is required in enforcing Data Sharing Policies to Data Products to ensure that User get to see only the version of the Data Product the User is entitled to get access to at the time of subscription.

 
Preferred Skills:

• Proficiency desirable in DevOps tools including Github/Jenkins/Terraform/YAML/DAGs/Docker/Databricks/SageMaker etc. for building Data/ML pipelines to extract/store data from multiple sources to parquet destinations.
• Experience desirable in promoting Data Engineering Standards and Best Practices among the community of developers to influence the enterprise towards building scalable and supportable Data/ML Products delivery and their usage by the community of data, analytics, and ML product users.
• Experience desirable in implementing Data Governance and Data Security tools available on a CSP to automate the enforcement of Data Sharing Policies at the point of subscription of a Data Product by a subscriber.

 
Roles and Responsibilities:

• Data Engineering Lead excels in data modeling, Lakehouse, and ML products delivery using an agile DevOps framework with a mastery of distributed data architectures essential for data, analytical and operational ML applications with demonstrated proficiency in frameworks including DataBricks, Sagemaker, Spark, Kafka, Kubernetes, SQL, NoSQL DBs, Graph DBs, and visualization tools such as Power BI/Tableau.
• The Data Engineer Lead serves as our primary technology lead engaging with the UoM proof of concept team to support best practice adoption within the state hosting environment and provides training to DAV data engineers.
• This role's responsibilities include:
  • Oversee the design, development, and maintenance of data pipelines that move, transform, and prepare data for analytics and operational systems.
  • Architect and optimize data infrastructure, including storage solutions, orchestration frameworks, and ETL/ELT processes.
  • Ensure data quality, reliability, and security by establishing standards, monitoring systems, and implementing validation and governance practices.
  • Lead and mentor data engineering staff, providing technical guidance, reviewing designs/code, and supporting professional growth.
  • Collaborate with cross functional partners, such as data scientists, analysts, product teams, and business stakeholders, to ensure data solutions meet organizational needs and strategic goals.

Other Desired Skills:

• Must have a BS in Computer Science / Data Science / Information Systems with an overall 4+ years of experience in designing and implementing data, analytics, and AI solutions for large enterprises by building data pipelines using the available data platform tools of any Cloud Service Provider (CSP) such as AWS/Microsoft/Google.
• Experience of minimum 4 years in modeling and leveraging Relational data services with demonstrated proficiency in Python/Pysparks/SQL programming and tuning SQL queries to extract data from multiple sources ( relational DB, flat files, CSV, HTML, JSON, etc) sources into Lakehouse Medallion architecture in parquet formats
• Demonstrated experience and expertise of minimum 4 years in programming/scripting languages including Python, R, Spark, etc.
• Experience in designing and delivering Star-schema based operational data store is required to enable visualization of program activities and outcomes in a visualization tool such as Power BI.

 
Key Programming Languages:

• SQL, Python, R, Spark, Terraform Scripting, DAGs Scripting, YAML scripting, Docker Other Technologies, Concepts and Frameworks: Juniper Notebooks, NOSQL DB, Graph DB, Parquet DB, Lakehouse and Medallion Architecture concepts, Kafka, Kubernetes, Glue, Databricks, Power BI, Tableau, Redshift Spectrum, Sagemaker, DBT, Datahub, SageMaker, Machine Learning, GitHub, DevOps

 
Additional Info:
 
At FastTek Global, Our Purpose is Our People and Our Planet. We come to work each day and are reminded we are helping people find their success stories. Also, Doing the right thing is our mantra.  We act responsibly, give back to the communities we serve and have a little fun along the way.
We have been doing this with pride, dedication and plain, old-fashioned hard work for 24 years!
FastTek Global is a financially strong, privately held company that is 100% consultant and client focused.
We've differentiated ourselves by being fast, flexible, creative and honest. Throw out everything you've heard, seen, or felt about every other IT Consulting company. We do unique things and we do them for Fortune 10, Fortune 500, and technology start-up companies.
Our benefits are second to none and thanks to our flexible benefit options you can choose the benefits you need or want, options include:
 

• Medical and Dental (FastTek pays majority of the medical program)
• Vision
• Personal Time Off (PTO) Program
• Long Term Disability (100% paid)
• Life Insurance (100% paid)
• 401(k) with immediate vesting and 3% (of salary) dollar-for-dollar match

 
Plus, we have a lucrative employee referral program and an employee recognition culture.
FastTek Global was named one of the Top Work Places in Michigan by the Detroit Free Press in 2013, 2014, 2015, 2016, 2017, 2018, 2019, 2020, 2021, 2022, and 2023!
To view all of our open positions go to: https://www.fasttek.com/fastswitch/findwork
Follow us on Twitter: https://twitter.com/fasttekglobal
Follow us on Instagram: https://www.instagram.com/fasttekglobal
Find us on LinkedIn: https://www.linkedin.com/company/fasttek
You can become a fan of FastTek on Facebook: https://www.facebook.com/fasttekglobal/
AI & Hiring Disclosure
We use AI tools to support parts of our hiring process, such as reviewing applications and identifying potential matches. These tools are designed to promote efficiency, consistency, and fairness, and they are always used under human oversight.
All personal data collected is used solely for recruitment purposes, and you have the right to know, access, or request deletion of your data at any time, subject to legal limits.
If AI will be used in a video interview, you'll be informed in advance and asked for your consent, with the option to opt out.
Our tools are regularly reviewed to detect potential bias and to ensure compliance with all applicable laws and our commitment to inclusive hiring.
To learn more or exercise your rights, please contact us at info@fasttek.com.