My involvement in the project was integrate and create analytical reports arround the new Loan tool the bank was developing at the time. Working closely with stakeholders, and developers to flush out requirements and correctly integrate the data with legacy data.

The project involved creating a new platform arround the companies primary pipelines, and migrating any existing pipelines to it. I was in charge of adding Airflow, and doing the main configurations arround the creation of DAGs so it became simple for Data Scientist to use. Also creating Docker images containing all the python and R libraries needed for Machine learning algorithms.

Create using Python a csv report with several sheets and logics, including color coding errors arround the companies text files that were integrated to the Datawarehouse. Allowing Stakeholders to have a simple view of the quality they were sending for Data Engineers to integrate into the system.