AI Controls Testing Analyst
The Judge Group Inc.

Location: Malvern, PA
Description: Our client is currently seeking a AI Controls Testing Analyst

Responsibilities:

• Conduct testing of operational controls and ensure compliance with standards and requirements for Gen AI tools in production.
• Analyze, interpret, and report on testing results.
• Perform root cause analysis to identify control gaps and deficiencies.
• Evaluate inherent and residual risks associated with Gen AI technology.
• Provide recommendations for remediation.

Qualifications:

• Strong knowledge of AI/ML concepts, particularly Generative AI (LLMs).
• Understanding of Gen AI risks and familiarity with AI governance standards and ethics principles (bias, fairness, transparency, responsible AI usage).
• Expertise in control frameworks (e.g., NIST).
• Experience in audit and compliance testing, including verifying AI tools' adherence to organizational control policies (access controls, data handling, model explainability).
• Proficiency in data analysis to ensure AI tools perform as expected and to identify potential risks and control gaps.
• Excellent problem-solving and critical thinking skills, including issue identification and root cause analysis.

Contact: chamilton@judge.com

This job and many more are available through The Judge Group. Find us on the web at www.judge.com

---