Mahendra Varma B

• Monitor, Support and troubleshoot daily ETL batch job operations.
• Handled the requests raised by the business for production data issues and closed it at the earliest by providing the root cause analysis.
• Coordinating with team and raising IR with source system if any issues with source feed.
• DataStage ETL project migration from 11.5 to 11.7
• Developed detailed migration plan, including time lines, resource allocation and contingency plans.
• Document any specific requirements or constraints related to the migration.
• Coordinating with DBAs for environment set up.
• Identify any deprecated features or required code modifications.
• Perform unit testing for each job, captured results and documented for reference.
• Implement data validation and reconciliation processes to identify and correct discrepancies.
• Perform end-to-end data flows to ensure data integrity and performance as part of Integration testing,
• Work with business users to validate reports that the upgraded ETL process meet their expectations as part of UAT.
• Captured elapsed duration of ETL workflows and compared with lower version, optimize the code if needed.
• Extensively worked on code optimization for long running jobs in new environment.
• Extensively worked on enhancement and scratch requirements as per business requirements.

Project: Informatica EDM Conversion Project

The scope of the project is to convert DataStage ETL design (OnPrem) to Informatica Cloud where it includes hive as On-Prem Database and Redshift/Aurora as Cloud databases. As part of storing files in cloud AWS S3 is been used.

• Led software development initiative as subject matter expert and primary point-of-contact for project management staff.
• Worked with project managers, developers, quality assurance and customers to resolve technical issues.
• Worked with development teams to correct problems and run test scenarios.
• Provided technical support using knowledge of complex technology to solve problems and support to other teams.
• Provided guidance and mentored less-experienced staff members and junior developers to improve overall team performance.
• Updated old code bases to modern development standards, improving functionality.
• Code optimization from legacy, implemented reusable jobs to reduce time lapse.
• Provided techinical support in GIT hub activities and implemented code migration in lower environments.
• Reviewed requirements, specifications and technical design documents to provide development techniques.
• Converting IBM Data Stage code into Informatica cloud by recreating design.
• Worked on various transformations and components as per requirement.
• Implemented reusable code by creating mapplets for SCD type 2 flows.
• Extensively worked on code optimization for long running job in IDMC.
• Extensively worked on Advance mode jobs in IDMC which will run on elastic cluster to improve performance which has huge volume of data and long running jobs.
• Extensively worked on SQL queries to convert Hive SQL to Redshift and Aurora equivalent Syntax/functions and optimization of query if needed.
• Worked on AWS S3 Bucket file storage system and implemented recursive read of file using IDMC using wild card process.
• Implemented user defined function to handle Data Stage functions in IDMC to avoid conflicts at Data validation.  I have implemented Expression macros for repetitive logic for huge number columns in IDMC.
• Worked on some basic scripts to delete and archive files according to AWS cli.
• Worked on pushdown optimization and partitioning concepts in IDMC to improve performance of IDMC jobs.
• Worked on reusable jobs to store last run dates etc.
• Extensively worked on Incremental loading designs.
• Extensively developed jobs by using IBM Web Sphere Data Stage that extract data from AWS Redshift database, and transform it as per business requirements for new requirements.
• Involved in preparation of ETL documentation by following the business rule, procedures.
• Preparing UT documents and coordinating with QA team in QA testing.
• Coordinating with Admin team for code migration to higher environments.
• Monitoring Jobs as part of hyper care period for deployed production jobs.
• Handled requests raised by the Business partners for production data issues and closed it at the earliest by providing the root cause analysis.

Projects:

CPQ Integration

CPQ is one of the Salesforce applications in BSCI. SAP would load the data into Athena AWS and Via data services, data has been retrieved and loaded into Salesforce CPQ as per required logic and data manipulation in ETL layer.

RSG Project-POC:

RSG is a second largest bank in Austria, and it needed a huge Data warehouse for the entire business data using IICS.

Hence, started with PoC for the Data warehouse included staging, data vault and Infomart. As the source data comes from a flat file as raw data, we needed lot of data manipulation and logic applied into the ETL.

• Created and designed IICS mapping tasks for dataflow between SQL server and Oracle system.
• Created and designed IPC mappings for dataflow to Salesforce to Salesforce Integration.
• Extensively worked on different task such Synchronization task, Replication task, mapping configuration task and dynamic mapping tasks etc.
• Extensively used IICS data quality assets i.e. data dictionary, verifier and rule specifications and data profiling as a part requirement test.
• Used rest API call via postman to execute, update and status of IICS jobs as part of POC.
• Preparing ETL design and test result documents to migrate code to higher environments.
• Preparing implementation and cut over documents for movement of code to production.
• Analyzed data flow requirements and developed a scalable architecture for staging and loading data and translated business rules and functionality requirements into ETL procedure.
• Configured the mappings to handle the updates to preserve the existing records using Update Strategy Transformation.
• Implemented various components like saved query, file listener, hierarchy schema definition.
• Created Stored procedures for SCD Type1 flows and incorporated in ETL design via respective transformation.

Project: INFORMIX Migration [June2019 - Jul 2021]

The scope of the project is to convert Informatica PowerCenter ETL design (OnPrem) to Informatica Cloud where it includes TeraData as On-Prem Database and GCP Big Query as Cloud databases. As part of storing files in cloud GCS been used.

• Extensively worked on migration part where migrated from IPC to IICS and Teradata to GCP BigQuery.
• Recreation of mappings, sessions and workflows from IPC to IICS CDI.
• Worked on conversion of Teradata views to Snowflake by using equivalent big query functions and optimization of SQL code if needed.
• Coordinating with data pipe line team for any source and target schema/table issues, and resolving as early as possible to avoid blockage.
• Perform unit testing for converted jobs and creating UT documents based on the test cases provided by team.
• Coordinating with QA team for data validation of tables loaded by new Environment.
• Preparing justification documents to get code certified by QA and move code to higher environments.
• After Code migration Implementing the same data validation in all environments for consecutive runs based on the business.
• Worked on day-to-day status updating in JIRA and moving the tickets to review after successful completion of internal peer review.

Project: NextgenERP Data Modernization [Jan 2018 - June 2019]

EDW Data modernization is a comprehensive program to make data easily accessible and useful to business users to drive revenue and optimize the processes. It focuses on the simplification & standardization of COP data. Modern Data platform employing a cloud first approach and data integration tools are designed and optimized for cloud based deployments.

• Involved in gathering requirement from tech leads and create S2T mapping documents and taking approval from architect.
• Involved in creating the technical specifications documents and designed IICS mapping tasks for dataflow in Snowflake.
• Developing IICS tasks as per business requirements and performing Unit Testing to move code higher environments.
• Involved in code review meetings, and resolving the issues as early as possible if any identified by the team.
• Coordinating with QA team while testing and providing justification or code fixes based on the issues raised by team.
• Supporting the Users for any data issues they raise as part of User Acceptance Testing.
• Preparing implementation and cut over documents for movement of code to production.
• Provide production support for deployed jobs as part of hyper care.
• For any Source/Target systems issue we need to inform our business partners respectively.
• Handled the requests raised by the Business partners for production data issues and closed it at the earliest by providing the root cause analysis.

Project: CMDM Project [Apr2017 - Dec2017]

The main objective of this project to deals largely with the customer data and to setup a centralized repository for Customer details which can be referred throughout the business verticals in the organization. It deals with the Renault enterprise customer data which is available with disparate isolated source systems.

• Involved in development phase meetings for Business Analysis and requirement documents reviews.
• Prepared Technical Specification Documents for the Jobs and their reviews.
• Designed and developed Jobs by using IBM Web Sphere Data Stage that extract data from the oracle database, and transform it as per business requirements.
• Used most of the stages such as Sequential file, Aggregator, Sort stage, join stage, Lookup stage, Funnel stage, Copy stage, Filter stage and Transformer stage etc.
• Developed Job Sequencer and have edited the job control to have jobs run in Sequence.
• Involved in the preparation of ETL documentation by following the business rule and procedures.
• Provided hyper care for production jobs and support end user if there are any issues.

Project: Sabah Al Ahmad 49 Building Project [Feb 2013 – Aug 2015]

• Involved in estimating & calculating the quantities from the drawings using Autocad.
• Involved in estimating quantities, costs and time scales for material and labour
• Involved in assigning work to subcontractors.
• Involved in billing preparation for subcontractors as per bill of quantity.
• Valuing completed work, managing budgets and overseeing payments.
• Ensuring projects meet quality standards and submitting monthly invoice reports to client.
• Following building regulations and health and safety.
• Involved in forecast planing using Primavera tool.
• Maintaining all documents for future reference and preparation quotes for new projects.