Deployment of Openstack cloud on multi node setup( controller,compute,swift ) for bare-metal and VMs are to help developer for the setup and in decision making for future product architecture. This was also part of exploring specifically on opensatck swift and hadoop development & test architecture. This project is aligned with the new product architecture targeted with object storage Active Archive. Project developed from scratch to support ActiveArchive backend h/w with a three node Openstack swit cluster where both front and backend comprises with haproxy load balancer. All three node cluster supports HA and replication for the application and data integrity.

Responsibilities:

• Technical Lead for test team of 9 members responsible for end to end system test and deployment , functional test for the ASI product as a whole .
• Product is completely driven from Bangalore and responsible for POC discussions and experiments.
• Test planning, test development, execution, many POC experiments while product was getting developed and end to test running for swift three node cluster.
• Developed installer tool for the ASI deployment of three node cluster which reduced 8 man hour to 30 minutes time.
• Deployed Multinode openstack cloud setup with Mriantis auto deployment and KILO from ground up with POC experiments.
• Install & execute test from tempest to check deployed setup, Exploring test cases for swift feature on KILO openstack cloud.
• Verifying features such as: instance creation, tenant creation and network isolation, nova, image upload , object creation and replication, iso build, deployment and clustering, HA, service failover, error injection tests, object read/write stress tests.
• Mentored local team on openstack cloud architecture and deployment.
• Travelled to SanJose on 3 months deputation to train onsite system QA team for the Installer and Product feature.
• Works directly with internal development team to provide tangible feedback for architecture decision whenever required. Suggested load balancer.
• Taking to stake holders , reporting , team management and point of contact for all the ASI issues from India.

ActiveScale is a distributed and highly scalable hybrid cloud storage product that offers massive scalability and instant availability of unstructured data in a single global namespace. ActiveScale technology ensures incoming data and distributes it across available drives, systems, and single/multi sites, superior data availability and durability. It continuously monitors the integrity of data, and automatically repairs and rebalances it as needed, providing site-level fault tolerance in multi-site deployments and infrastructures. Complete solution rack includes three management nodes with SSD and 6 storage nodes with HDD to store and manage data read write. It also supports asynchronous replication feature, s3 , rest api calls for command line access. Western Digital are pioneers to offer ASS, a petabyte end-to-end hybrid cloud storage solution to customers for the first time in the Industry.

Role:

• Technical lead & Scrum Master (SAFe) for a 9 member engineering team; PI Planning; Identify dependencies, analyse and arrive at estimations and forecasts, tracking, sprint closure.
• Designed & developed ownedfeatures, code review, ASCLI feature gate keeper; built test strategies, automated and integrated with Jenkins build frame work.
• Key features owned: object notification, bucket limit, log retention, file manager, event management, custom end point, vlan.
• POCs, Automated 80% functionalities. Continuous bug Fix for earlier issues filed by Systems QA per sprint basis.
• Running S3 i/o of simultaneous multipart object writes, reads & deletes over long duration of time (6+ months), leading to better system stability, reliability, availability and data integrity
• Key features owned: object notification, bucket limit, log retention, file manager, event management, custom end point, vlan, multipart upload, delete marker, replication, Kerberos,SSL.
• Designed and developed 2 complex product features; log retention and file manager.
• Running test on various scenarios for disk IOPs: mix (read+write) with 30% and 70% combination, only read, only write, sequential and random read/write, object size combination (1kb to 64MB), 1200 connection, verifying put and get latency.

KVM end to end system testing on Power hardware is to certify KVM features on Power Linux along with OPAL firmware. Test includes Various features of KVM like SLOF, virtio, pci-pasthrough, console, guest boot, libvirt & qemu, live migration, guest scalability, CPU, memory, virtual disk, got tested on Power8 h/w with SAN and different PCI cards. Along with this OPAL firmware also got tested tightly coupled with power8 kvm system for its tremendous capability. Development & testing are being integral part of this process, where testing effort has helped to make Powerkvm product quality better and enterprise ready for the customer. Part of this we also tested community software KIMCHI as a KVM management application.

Responsibilities:

• Technical lead for the team to drive and achive delivery on time.
• Prepared test strategy, test plan, test case design, analysis, coding, testing, and integration test
• Prepared test bed with KVM end -to-end h/w setup, guest creation, executed tests across installation, firmware, kernel, CPU, mem, SAN storage and live migration.
• Designed and developed suitable test cases for hypervisor , multi guest stress test, stress test for, resource isolation, file system, virtio devices, PCI pass through, USB pass through, memory, ballooning, cpu scheduling, cpu hotplug, PCI hotplug, KSM, SCSI disk emulation, device hotplug, file systems(ext4/xfs/NFSv4), kdump and disk dump.
• Able to identify highest 79% of critical issue early in the cycle, helped to get all fixed early
• Demonstrated high level of personal interest, ownership, technical skills and acted as a powerkvm consultant for several teams/people across geos.
• Test automation and test development for the tested feature with a automated test framework, code review & code merge.

This eSAN project was intended to do certification, testing support of Linux on P-Series hardware attached to IBM and third party storage devices. Testing includes verifying support of the in-box DM-MPIO,Native IO,NPIV,KVM guest, card/switch of Qlogic, Emulex, Brocade to certify IBM Storage is well tested and integrated with Linux in SAN environment on power Linux of RHEL and SLES distributions.

Responsibilities:

• Based on the business requirements & strategy, prepared plan, test cases for SAN storage test on RedHat and Suse distribution on IBM Power and X h/w.
• Planning, executing , defect raising and bug follow up for the closure as per plan.
• Testing various scenarios like good/bad path I/O, port bounce, HBA offline, controller and switch reboot, stress I/O, multipath, I/O and kernel stress.
• Test IOps, latency , bandwidth with automated tools, data corruption, data integrity, sequential and random read write, error injection tests.
• Automating existing test cases and test procedures using build forge and cobbler

Validating clustering HA on RedHat distros by testing high availability clustering & clustering solutions on RedHat host & Virtual Servers (KVM guests) to validate several scenarios for external and internal customers. Various scenarios includes application (DB2,WAS & KVM) as a resource to the host clustering running on shared San storage, NFS cluster, HA with the Resilient Storage Add-On in conjunction with LVM for customer to provides high availability solutions by leveraging enterprise system resources with broad support for application HA.

Responsibilities:

• Lead the project work and Testing various scenarios where KVM, DB2 , WAS as service to the cluster solution.
• Active-Passive and Active-Active clustering setup and testing failure of node, quorum failure.
• Testing Distributed lock, lun masking, lun visibility, resource and service failover.
• Three node and two node clustering with rigorous read/write with multipath I/O test.
• Testing distributed lock management, VIP failover, service failover, CLVM and GFS2.

Linux Distribution product releases from Red Hat and Novell being certified onIBM hardwires such as X-series & Blade servers on intel & AMD processors .Different Linux installation methods, different Linux components such as storage SAN, clustering , OCFS2, networking (NFSv4, SAMBA), file systems (ext2, ext3, xfs ,jfs, reiserfs, ext4),memory, RAS features (netdump, diskdump, kdump,lkcd) , serial console and Kernel has been tested on Redhat and Suse Linux of various distribution. During this new/existing automation of various testing-methods/test-cases has been developed/enhanced and used across IBM LTC.

Responsibilities:

• Understanding the business requirements, planning & preparing test plan for release cycle.
• Developed & implemented effective test tools & strategies for memory management, cpu scheduling, cpu power management, device hotplug, filesystems (/etx3/ext4/xfs/NFSv4) , kernel dumps, disk dumps, boot methods, BIOS, system stress, benchmarking.
• Executed test for SAN , kernel stress, kernel build, H/W RAID, Software RAID, multipath IO .
• Certifying three nodes Oracle cluster File system (OCFS2)