Afzal M.

Afzal M.

Big Data

, India

Experience: 11 Years

Afzal

Big Data

30857.2 USD / Year

  • Start Date / Notice Period end date: 2020-02-18

11 Years

Now you can Instantly Chat with Afzal!

About Me

Big data - spark, Kafka,hbase,hive,mapreduce,oozie,sqoop (4 years)

Java j2ee - 6 years

Scala - 1 year

...

Show More

Portfolio Projects

Description

EdgeCache is specifically designed to meet the requirements of Charter Communications LLC, which incorporates lambda architecture. System contains a batch layer to import data from Oracle to Hive and a speed layer for analysing the user information and channel subscription in real time and save the data into HBase.

Show More Show Less

Description

Existing implementation of the system has had performance issues with data retrieval of time sensor data at HBase layer and was unable to meet the SLA timelines. The new approach brought the concept of data aggregation to improve the retrieval time at HBase layer. User will be able to generate the reports for Daily, Weekly, Monthly, Yearly etc. with the data aggregation approach and meet the SLA timelines.

Show More Show Less

Description

Ace Hardware plans to migrate a set of tables in Teradata to HDFS. The Tables migrated to HDFS will be stored in Hive/Impala tables. The migrated tables will be queried and joined together by Webfocus module to produce the required reports. Migration activity includes scheduling mechanism to pull the data at regular intervals. Incremental logic, compression techniques are incorporated to improve the overall performance of the system.

Show More Show Less

Description

Data ingestion framework is a module which is integrated to an existing product of Cognizant. The product is aimed to leverage the capabilities of SparkSQL to migrate the data from various types of source to various types of destinations. The module will also provide flexibility for the user to perform various types of transformations like sorting, aggregation, filters etc in between before the source data is being transferred to destination. The module will optimize the whole pipeline flow by analyzing and merging the intermediate transformation phases together, if possible.

Show More Show Less

Description

Support Project

  • Analyze the existing application and provide support to the clients
  • Providing the on call support for high priority issues and guide it to the resolution
  • Worked as part of ATG, Content Administration modules
  • Daily catch up with the clients for gathering the top priority issues f
  • Mentor the subordinates for the assigned tasks completion
  • Identify the value adds which can be added to the existing production system

Show More Show Less

Description

  • Analyze and gather the requirements for the product implementation
  • Design the proposed solution for the data migration framework
  • Prepare the unit test cases for the workflows
  • Plan and coordinate local and offshore team on design and development
  • Prepare the class and sequence diagrams for the identified use cases
  • Plan and estimate the tasks from the gathered requirements document
  • Mentor the subordinates for the assigned tasks completion

Show More Show Less