IT Quality Assurance Analyst, Senior - Automation & AI Testing

Job Title: IT Quality Assurance Analyst, Senior - Automation & AI Testing

Location: Rockville, MD (Hybrid - Minimum 3 Days Onsite)

Clearance: Ability to Obtain Public Trust

Sponsorship: No sponsorship assistance is available for this position.

Job Overview: We are seeking an experienced IT Quality Assurance Analyst, Senior - Automation & AI Testing to support a federal client's UI Modernization initiatives. This position will play a key role in ensuring the quality, security, reliability, and performance of modernized applications through a combination of manual testing, automated testing, and AI-assisted quality assurance practices.

The ideal candidate will have strong experience with software quality assurance, test automation, Agile/SCRUM delivery, and modern testing technologies. A key focus of this position will be leveraging Subject7, a cloud-based codeless test automation platform, to develop, execute, maintain, and expand automated test coverage.

The Senior QA Analyst will also explore and apply AI-assisted testing capabilities to improve test case development, identify potential defects earlier, increase regression coverage, and improve the efficiency of the overall software testing lifecycle.

This role requires close collaboration with software engineers, developers, federal stakeholders, contractors, and state IT teams throughout the development and release lifecycle.

Key Responsibilities

Test Automation & Subject7

• Develop, execute, maintain, and enhance automated test suites using Subject7, Selenium, Cypress, and other applicable test automation technologies.
• Use Subject7's codeless automation capabilities to increase automated test coverage across UI modernization applications.
• Create reusable automated test cases covering functional, regression, integration, and end-to-end business scenarios.
• Evaluate existing manual test cases and identify opportunities for conversion to automated testing.
• Maintain automation scripts as applications, interfaces, business requirements, and workflows evolve.
• Analyze automated test results, investigate failures, and coordinate defect resolution with development teams.
• Integrate automated testing into CI/CD and DevOps workflows where applicable.

AI-Assisted Testing

• Leverage AI-assisted testing and automation capabilities to improve test design, execution, analysis, and defect identification.
• Use AI-enabled approaches to assist with test case generation, test coverage analysis, regression testing, and identification of potential quality risks.
• Evaluate opportunities to use AI to reduce repetitive manual QA activities and accelerate testing cycles.
• Apply appropriate human validation and QA controls when using AI-generated or AI-assisted test artifacts.
• Identify emerging AI testing tools and techniques that could improve testing accuracy, efficiency, and coverage.

Manual , Functional, & End-to End Testing

• Conduct comprehensive manual and automated testing of UI modernization applications.
• Execute functional, regression, integration, system, security, performance (required), and end-to-end testing.
• Validate application workflows, user interfaces, system integrations, and data processing.
• Perform UI/UX testing to ensure web applications function consistently and meet business requirements.
• Validate secure data transfers and interfaces across on-premises, cloud, and hybrid environments.
• Perform regression testing following releases, enhancements, patches, and configuration changes.

Quality Assurance & Defect Management

• Develop comprehensive test plans, test scenarios, test cases, test scripts, and acceptance criteria.
• Create detailed defect reports documenting expected results, actual results, severity, reproduction steps, and supporting evidence.
• Track defects through resolution and perform retesting after fixes are implemented.
• Peer review test plans and test cases created by QA and development teams.
• Monitor test coverage, defect trends, test execution results, and application readiness.
• Recommend improvements to QA standards, testing methodologies, automation frameworks, and testing processes.

Agile / SCRUM Collaboration

• Participate as an active member of Agile/SCRUM teams alongside federal staff, contractors, developers, and state IT representatives.
• Participate in Sprint Planning, daily SCRUM activities, demonstrations, release activities, and Retrospectives.
• Collaborate with developers and stakeholders to define acceptance criteria and develop effective testing strategies.
• Communicate testing progress, defects, risks, dependencies, and application readiness throughout each Sprint.
• Provide recommendations during Retrospectives to improve quality and integrated team performance.

Performance, Security & Data Validation

• Support testing of system performance, application security, data processing, and secure system-to-system transfers.
• Analyze system interfaces and validate functionality across cloud, on-premises, and hybrid environments.
• Assist with statistical analysis and reporting to identify system discrepancies, performance issues, and quality trends.
• Validate application behavior associated with identity verification and other integrated services where applicable.

• Provide Tier 3 technical support for application performance, functionality, testing, and user acceptance issues.
• Perform root-cause analysis and assist technical teams in resolving complex application defects.
• Identify opportunities to increase automation coverage and reduce repetitive manual testing.
• Evaluate and implement new testing technologies, including codeless automation and AI-assisted QA tools.
• Help mature the client's overall testing strategy, automation framework, and software quality lifecycle.

Required Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• 5 - 7+ years of software quality assurance/testing experience with both manual and automated testing.
• Demonstrated experience developing and executing automated test cases and regression suites.
• Experience with Subject7 or comparable codeless/low-code test automation platforms strongly preferred.
• Experience with automated testing technologies such as Selenium, QTP/UFT, Subject7, or comparable frameworks.
• Experience or demonstrated knowledge of AI-assisted software testing and test automation.
• Strong knowledge of test planning, test case development, regression testing, defect management, and software QA methodologies.
• Experience with defect and test-management technologies such as Jira, TestRail, or comparable tools.
• Experience working in Agile/SCRUM software development environments.
• Familiarity with DevOps and CI/CD testing pipelines.
• Experience testing applications deployed in AWS, Azure, cloud, on-premises, or hybrid environments.
• Understanding of application security testing, performance testing, system integration testing, and data validation.
• Experience with UI/UX and web application testing.
• Knowledge of configuration management, database management, and technical troubleshooting.
• Excellent written and verbal communication skills with demonstrated ability to document and communicate testing results, defects, and technical issues.
• Ability to collaborate effectively within a multi-contractor and multi-stakeholder environment.
• Ability to obtain and maintain a Public Trust clearance.

Preferred Qualifications

• Hands-on experience with Subject7 test automation.
• Experience implementing or expanding AI-assisted testing automation.
• Experience integrating automated test suites into CI/CD pipelines.
• Experience supporting federal government IT modernization initiatives.
• Experience testing User experience, identity verification, or similar government applications.
• Experience working directly with federal and state government stakeholders.
• Experience with application modernization, cloud migration, or digital transformation initiatives.
• Experience developing QA metrics, automation coverage reports, defect dashboards, and release-readiness reporting.
• ISTQB, CSTE, or other recognized software testing certification preferred.