FASTTEK GLOBALpowered by Fast Switch - Great Lakes
Chennai, Tamil Nadu
Software Engineer #1059179Job Description:
- Platform & Job Migration: Lead the migration, compilation, and testing of DataStage Parallel and Server jobs, custom routines, and shared containers from the legacy server to the new target server.
- Environment & Profile Setup: Configure and optimize user profiles and establish all system-level environment variables on the new Unix server to guarantee smooth engine performance.
- Linux Directory & Project Architecture: Design, set up, and provision secure project directories and folder structures on the new Linux server, ensuring correct user permissions, group access, and storage allocations.
- Automation Scripting: Write, refactor, and maintain robust Bash shell scripts to automate pre-migration backups, job deployment, validation checks, and post-migration cleanup.
- Legacy Script Migration (Perl): Analyze, migrate, and troubleshoot existing Perl scripts and custom Perl modules, ensuring compatibility with the new Linux OS and resolve any dependency issues.
- Data Ingestion & Connectivity Setup: Configure and test secure file transfer protocols (SFTP) and network/API utilities (cURL) to ensure seamless data exchange with external systems and endpoints on the new server.
- Testing & Validation: Perform comprehensive parallel-run testing and data-reconciliation checks between the old and new environments to ensure data parity, zero job failures, and zero data loss.
- Documentation & Handover: Document the migration steps, updated environment configurations, and automation scripts to hand over to the operations and support teams.
Required Technical Skills ETL Platform:
- Hands-on experience with IBM InfoSphere DataStage (v17.x preferred), including deep knowledge of both Parallel and Server jobs, routines, and stages.
- Operating Systems: Strong administration experience with Unix/Linux (Suse preferred).
- Scripting Languages: Strong, production-grade knowledge of Bash scripting for task automation and system monitoring.
- Solid proficiency in Perl scripting and managing/troubleshooting Perl modules.
- SQL knowledge for verifying database connections and data validation on the new server Familiarity with scheduling tools (e.g., Control-M, Autosys, or Cron).
- System Configuration: Proven experience setting up Linux user profiles, group permissions, directory paths, and environment variables.
- File Transfer & Networking: Hands-on experience using SFTP and cURL for secure data movement and API testing.
- Problem-Solving: Exceptional troubleshooting skills to resolve compilation errors, library dependency issues, and network connectivity blockers during migration.
Skills Required:
- Extract Transform Load (Etl)
Skills Preferred:
- Unix
Experience Required:
- Senior Engineer Exp: Proficient In 2 coding lang. or adv. Prac. in 1 lang.; guides.
- 10+ years in IT; 8+ years in development
Experience Preferred:
- DataStage, ETL, The ideal candidate possesses a deep understanding of DataStage architecture (Parallel and Server jobs), extensive experience in Unix/Linux system configuration, and strong scripting capabilities (Bash and Perl) to automate and validate the migration process.
Education Required:
- Bachelor's Degree
Education Preferred:
- Bachelor's Degree
Additional Information :
- Production support of DataStage jobs, development and enhancement of key applications Experience: Practical experience in hands-on DataStage Migration Engineering....
- In this role, you will lead the end-to-end migration of our ETL platform, moving IBM InfoSphere DataStage projects, jobs, and configurations from our legacy Unix/Linux servers to a newly provisioned Linux environment 5+ years in development of Datastage ETL