Key Responsibilities
Design, develop, test, and deploy ETL workflows using Ab Initio, Informatica PowerCenter, or IBM DataStage.
Develop and optimize complex SQL queries, stored procedures, and database objects.
Build and maintain data integration processes for large-scale enterprise data warehouses.
Work extensively with Teradata databases for data extraction, transformation, and loading activities.
Develop and maintain PySpark applications for big data processing and data transformation.
Analyze source-to-target mappings and implement data transformation logic.
Perform data validation, reconciliation, and quality checks to ensure data accuracy and consistency.
Troubleshoot ETL job failures, performance bottlenecks, and data issues.
Collaborate with business analysts, data architects, and stakeholders to gather and understand requirements.
Follow best practices for ETL development, coding standards, and documentation.
Participate in code reviews, testing, deployment, and production support activities.
Monitor ETL processes and ensure timely execution of data loads
Technical Skills
Strong experience with at least one ETL tool:
Ab Initio (Preferred)
Informatica PowerCenter
IBM DataStage
Advanced SQL development and query optimization skills.
Hands-on experience with Teradata databases.
Strong knowledge of PySpark and distributed data processing concepts.
Experience with data warehousing concepts, dimensional modeling, and ETL methodologies.
Knowledge of Unix/Linux shell scripting.
Experience with data validation, data quality, and reconciliation processes.
Understanding of performance tuning and optimization techniques.
Requirements
Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
5+ years of experience in ETL/Data Engineering development.
Strong analytical, problem-solving, and troubleshooting skills.
Excellent communication and collaboration abilities.
Originally posted on