This site handles the evaluation of Asclepius, process the submission files and report the evaluation results. Taking Asclepius-Test as an example: users will first conduct inference with their Med-MLLMs based on asclepius_test_20240214.tsv , and then save the inference result in a submission.xlsx . To ensure a smooth process, before submitting, following checks should be conducted for your submission.xlsx :

• The following fields are required for a submission.xlsx : index, question, A, B, C, D, prediction . The contents of all fields (except prediction ) are exactly the same with asclepius_test.tsv , the content of prediciton is the inference results of your Med-MLLMs for each multi-modal QA.
• submission.xlsx should not have a field named image
• Other Sanity Checks:
  1. The content of index are positive integers. For each number num : (num // 1e6) in [0, 1, 2, 3]，(num % 1e6) <= 3000。