Submit Resume

AI QE Architect

  • Maryland, Bethesda

  • 08/13/2026

  • Full Time

  • Active

Job Description:

  • Job Summary
    We are seeking an AI QE Architect to lead the design, development, and optimization of next-generation AI-powered quality engineering solutions and platforms. This role combines deep technical expertise in automation engineering with hands-on experience in LLMs, agentic AI frameworks, and enterprise-grade AI tooling. The architect will define strategy, design scalable frameworks, guide teams, and drive innovation across QE automation, AI agents, RAG pipelines, and MCP-enabled intelligent workflows.

    Key Responsibilities
    • Design, develop, and optimize AI-powered quality engineering solutions and scalable automation platforms.
    • Apply hands-on experience with LLMs, prompt engineering, RAG, vector databases, and model evaluation.
    • Develop and enhance GenAI-powered QE solutions, AI agents, and autonomous workflows.
    • Implement MCP-driven, context-aware automation and CI/CD decision intelligence.
    • Design and maintain automation frameworks for UI, API, and performance testing.
    • Develop prompt-optimized, AI-generated test assets and validation mechanisms.
    • Build data and embedding pipelines and optimize retrieval capabilities for RAG solutions.
    • Implement CI/CD processes for ML models, including versioning, evaluation, and retraining workflows.
    • Integrate automation pipelines using GitHub Actions, Azure DevOps, Jenkins, and related tools.
    • Ensure AI and automation environments are scalable, secure, and governed.
    • Provide technical leadership and mentor teams on AI adoption and automation engineering best practices.
    • Collaborate with developers, SMEs, and product teams to align architecture and technology roadmaps.
    • Drive feature prioritization, quality strategy, and solution design.
    • Lead defect triage, quality reviews, and compliance with QE and AI governance requirements.
    • Contribute across the full SDLC, including test strategy, design, execution, and analysis.
    • Operate effectively within Agile/Scrum development environments.

    Required Qualifications
    • Strong hands-on experience with LLMs, prompt engineering, RAG, vector databases, and model evaluation.
    • Proficiency with LangChain, HuggingFace, Transformers, and OpenAI/Ollama APIs.
    • Experience with agentic AI frameworks such as LangGraph, AutoGen, or CrewAI.
    • Strong programming skills in Python, TypeScript, or Java.
    • Experience architecting and maintaining automation frameworks.
    • Hands-on experience with UI automation tools such as Playwright and Selenium.
    • Experience with API testing tools and frameworks such as PyTest, Requests, and RestAssured.
    • Experience with performance testing tools such as JMeter and Locust.
    • Experience with PyTorch, TensorFlow, Scikit-Learn, and NLP/CV libraries such as NLTK, BART, or OpenCV.
    • Experience building data and embedding pipelines and optimizing retrieval for RAG.
    • Strong understanding of AWS, Azure, or GCP architectures and AI/ML services.
    • Experience integrating automation and CI/CD pipelines using GitHub Actions, Azure DevOps, Jenkins, or similar tools.
    • Strong understanding of scalable, secure, and governed AI and automation environments.
    • Experience working across the full SDLC in an Agile/Scrum environment.

    Preferred Qualifications
    • Experience designing enterprise-grade AI-powered quality engineering platforms.
    • Experience with MCP-enabled intelligent workflows and context-aware automation.
    • Experience implementing AI-generated testing assets and automated validation mechanisms.
    • Experience with ML model versioning, evaluation, and retraining workflows.
    • Experience providing technical leadership and mentoring engineering teams.
    • Experience driving AI adoption, QE strategy, and automation innovation across enterprise environments.

.

.

.