In my last engagement, we had to build a framework that tested the product on diverse data sets. This required generating test data on the fly. For this we utilized global setup and custom playwright fixtures to generate randomized test data and then use it where it’s needed using fixtures. To cut the execution times by 60% we implemented sharding using metric strategy in github actions with playwright’s parallelization strategy to run the parametrized tests in parallel. But this came with another challenge that was the authorization among the shards and workers. For this we used storing and sharing the login states using playwright fixtures again for this. Utilized playwright’s project strategy to run the login state storage scripts as a dependency for rest of the tests. Also for cross browser testing. Actively utilizing tags for segregation of smoke, e2e , regression tests and running custom sets of tests on CI/CD. Centralized config management for dev/stg/prd environments . Built an API client layer for scalability. Strict Typescript ES Linting rules, husky rules for PRs , pre commit , post commit scripts . SAST/DAST for code quality and vulnerability checks. Identify and Quarantining flaky tests for preventing release blocks.

Sheeraz Ahmad Khan

In my last engagement, we had to build a framework that tested the product on diverse data sets. This required generating test data on the fly. For this we utilized global setup and custom playwright fixtures to generate randomized test data and then use it where it’s needed using fixtures. To cut the execution times by 60% we implemented sharding using metric strategy in github actions with playwright’s parallelization strategy to run the parametrized tests in parallel. But this came with another challenge that was the authorization among the shards and workers. For this we used storing and sharing the login states using playwright fixtures again for this. Utilized playwright’s project strategy to run the login state storage scripts as a dependency for rest of the tests. Also for cross browser testing. Actively utilizing tags for segregation of smoke, e2e , regression tests and running custom sets of tests on CI/CD. Centralized config management for dev/stg/prd environments . Built an API client layer for scalability. Strict Typescript ES Linting rules, husky rules for PRs , pre commit , post commit scripts . SAST/DAST for code quality and vulnerability checks. Identify and Quarantining flaky tests for preventing release blocks.

Available to hire

In my last engagement, we had to build a framework that tested the product on diverse data sets.

This required generating test data on the fly. For this we utilized global setup and custom playwright fixtures to generate randomized test data and then use it where it’s needed using fixtures.

To cut the execution times by 60% we implemented sharding using metric strategy in github actions with playwright’s parallelization strategy to run the parametrized tests in parallel. But this came with another challenge that was the authorization among the shards and workers.

For this we used storing and sharing the login states using playwright fixtures again for this.

Utilized playwright’s project strategy to run the login state storage scripts as a dependency for rest of the tests. Also for cross browser testing.

Actively utilizing tags for segregation of smoke, e2e , regression tests and running custom sets of tests on CI/CD.

Centralized config management for dev/stg/prd environments . Built an API client layer for scalability.

Strict Typescript ES Linting rules, husky rules for PRs , pre commit , post commit scripts . SAST/DAST for code quality and vulnerability checks. Identify and Quarantining flaky tests for preventing release blocks.

See more

Work Experience

Senior SDET (AI/LLM Quality Specialization) at Cyndx
January 1, 2025 - Present
Designed and shipped a production LLM-as-a-Judge evaluation framework for AI-generated Scholar Reports using DeepEval with GEval and DAG-based metrics, automating ~80% of per-release review and catching regressions in OpenAI- and Claude-powered features. Implemented RAG pipeline testing with citation verification and a pairwise diff pipeline to surface hallucination rates and flag monthly quality regressions. Built FlakyGuard, an AI-powered Playwright reporter for root-cause classification and auto-quarantine of flaky tests, with Slack updates and Allure-linked summaries. Owned end-to-end test strategy and the Playwright + TypeScript automation framework, wrote API contracts for ~120 endpoints, and migrated CI/CD to GitHub Actions on GCP, reducing API regression time from 6 hours to 30 minutes. Led performance testing with k6/JMeter and built BigQuery-backed AI-quality dashboards for continuous health telemetry. Mentored junior QA engineers and SDET interns and collaborated with AI res
SDET at Think Future Technologies (Client: Shutterstock Inc.)
September 1, 2023 - January 1, 2025
Owned functional, exploratory, automation, and regression testing for ~25 Salesforce UI workflows and their backing REST and GraphQL APIs. Built dedicated GraphQL API contract tests, including schema-shape assertions and field-level validation, reducing GraphQL-related production incidents to zero across releases. Expanded automated regression coverage from ~40% to ~80% by extending Jest + Puppeteer with reusable POM components and shared assertions, cutting manual regression effort roughly in half. Led CI/CD migration from Jenkins to GitHub Actions with Azure self-hosted runners, parallelizing test shards and reducing pipeline runtime by ~35%. Mentored two junior QA engineers and defined a layered UI→API→backend test strategy for two major Salesforce releases.
SDET at Think Future Technologies (Client: Dhanuka)
August 1, 2023 - September 1, 2023
Built end-to-end API performance and contract testing for ERP integration: ~50 Postman REST endpoints with JS pre/post-run scripts, JMeter stress suites, and stakeholder reports identifying top latency hotspots. Automated 500+ ERP-to-mobile order syncs across devices using Appium on BrowserStack, surfacing pre-prod defects in the first sprint.
SDET at Think Future Technologies (Client: ThriveDx)
October 1, 2020 - July 1, 2023
Took ThriveDx from zero automated coverage to a CI-gated regression suite of ~250 Playwright tests in JavaScript, designing a Page Object Model framework with shared utilities. Built Postman collections (~80 endpoints) with chained requests and data validation, and embedded automation into Azure DevOps/Jenkins pipelines with per-environment regression suites, leading to greener builds and reduced production defects. Served as embedded QA voice for an 8-engineer Agile team, mentoring 2 manual testers on automation principles and owning defect life-cycle.

Education

Bachelor of Technology in Mechanical Engineering at Rajasthan Technical University, Kota
January 1, 2013 - January 1, 2017

Qualifications

Add your qualifications or awards here.

Industry Experience

Software & Internet, Financial Services, Media & Entertainment, Professional Services

Hire a QA Engineer

We have the best qa engineer experts on Twine. Hire a qa engineer in Ghaziabad today.