Sholinganallur, Chennai
Specialty Development Senior #1028968Job Description:
This position will play a key role to land the data from diverse internal and external source system applications to Enterprise data lake by ensuring data quality, privacy, security, compliance and collaborating with business, data governance and EDP teams.
Skills Required: Python, SQL, Google Cloud Platform, ETL, Tekton
Skills Preferred: LLM, AI
Experience Required: 7+ years of relevant experience
Education Required: Bachelor's Degree
Additional Information:
- Single point of contact for anything related to the data maintained in the data lake
- Work with Application source teams to get necessary approvals (source application owner/business owner) to land data in Data Lake and to collect all the necessary details about the source data as part of grooming once the source is prioritized.
- Work with Engineering teams to develop and deliver business needs in Agile methodology and make the data available in Data Lake for end users and downstream users.
- Perform QA UAT testing for the data which is being landed and also perform post production data quality check
- Ensure that the data landed is secured as per the risk categories (PII/SPII) defined by the Data Governance team and so the right data is accessed by the business users
- Ensure Secret/Confidential data is restricted and access request goes through ‘Restricted Data approval’ process
- Make the data source available in DAP once the Ingestion process gets completed
- Ensure data availability and consistency and make the data easily understandable to the Analytical & Business teams.
- Document and Maintain metadata and business knowledge for all the data sources ingested in EDP Data Lake
- Create a Data Catalog in Data Discovery Hub for every source ingested.
- Provide support to Analytical teams or End users to resolve any issues related to data quality, missing data and business queries
- Adhere to SLAs defined for the Production Support Issues
- Learning attitude and flexibility with project and timings
- Good communication and presentation skills.
- Strong GCP skills with SQL and Python hands on experience