General Physician (AI Evaluation)

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

Role Overview

We are looking for licensed physicians currently practicing in the United States to support the evaluation and improvement of advanced AI systems in healthcare.

The role involves reviewing AI-generated clinical content for medical accuracy, safety, completeness, and relevance, including diagnoses, treatment plans, summaries, and other case-based outputs. You will apply real-world clinical judgment to identify errors, unsafe recommendations, missing information, and weak reasoning, helping improve the quality and reliability of medical AI systems.

CONTRACT: Contractor assignment, 12 weeks

COMMITMENT: Part-time or Full-time (20-40h/week)

LOCATIONS: Remote - USA

PROCESS: The selection will be made based on an online questionnaire and resume/education/certification

NOTES: Candidates must be fully licensed and actively practicing medicine in the US.

Key Responsibilities

• Review AI-generated medical content for accuracy, safety, and completeness.
• Evaluate diagnoses, treatment plans, case summaries, and clinical reasoning.
• Identify inaccurate, unsafe, misleading, or incomplete medical outputs.
• Apply evidence-based medical standards and professional clinical judgment.
• Provide structured expert feedback to improve model quality.
• Follow detailed evaluation and annotation guidelines.
• Complete structured questionnaires and reviews using web-based tools.
• Collaborate with clinical and AI teams on quality improvement.

Requirements

• Medical Doctor (MD) or equivalent medical qualification such as MBBS, MBChB, or equivalent.
• Fully licensed to practice medicine in the United States.
• Currently actively practicing medicine in the US.
• At least 1 year of post-residency clinical practice experience as a physician.
• Strong general clinical judgment; no specific specialty is required.