About The Client

The Client is on a mission to store the world’s data by making cloud storage simple, affordable, predictable, and secure. The company offers high-performance object storage designed for backups, medical images, surveillance videos, financial data, multimedia, and scientific workloads.

Challenges

Initially, the QA team was not involved in Sprint testing, which resulted in all enhancements and new features being tested only during the Beta phase. This led to discovering more issues late in the cycle. Later, we were involved in Sprint testing and got the opportunity to validate features in the Alpha environment. Identifying defects early in Alpha helped us save significant time during Beta testing and allowed us to test features more efficiently.

They required:

  • Validate all “S3 & IAM” features for every release through Automation & Manual.

  • Ensure data integrity for all objects.

  • Automation helps to find the bugs earlier whenever new build get deployed as part of the release.

  • Increasing the automation coverage for new features/Enhancements for every releases.

Solutions

  • Designed test suites for functional, performance, and security validation

  • Developed an automation framework using boto3 and endpoints – Our current automation framework is gitworkflow; boto3 is one of the python modules used for s3 api automation and covered around 500 test cases using boto3.

  • Tested Object Lock for regulatory data retention – Automation 75% (Console), Manual Testing 25% (Third Party Apps, API and AWSCLI)

  • Executed multi-part upload stress tests for large files

Outcomes

  • Improved Product Quality
    Defects are identified early through continuous testing, resulting in reduced production issues and enhanced application stability.

  • Faster Release Cycles
    Automated regression suites without compromising quality, reducing regression execution time by 60 – 70%.

  • Enhanced Customer Experience
    Comprehensive functional testing ensures a seamless and reliable experience for end-users across devices and geographies.

  • Reduced Operational Costs
    Effective test automation reduces manual effort and lowers overall QA cost by 40-50%.

  • Improved Collaboration Across Teams
    Standardized test processes and tool integrations enhance communication between Development, QA, DevOps, and Product teams.

  • Customer Satisfaction & Trust
    Consistently delivering high-quality software testing builds customer confidence and retention.

Tools and Technologies

  • Kubernetes, docker, Python, pytest, Selenium, Copado for automation scripts

  • Client’s In-House tools for performance/stress testing: Load generator & s3 tester

  • Automation framework: Django web

  • Monitoring dashboards: Grafana, Prometheus

  • Databases: MySQL, Cockroach, Clickhouse

  • Bug Tracking Tool: Jira

  • Test Case Management Tool: KiWi

  • CRM: Salesforce

  • API: Postman

  • 3rd Party s3 apps: aws-cli, s3browser, Cloudbery, s3tester, cyberduck & etc

Related Case Study