Rules
The rules provided to contestants are as follows:
- Contestants are allowed and encouraged to use any datasets for pre-training. However, they must clearly mention and document any additional data sources used in their submission.
- Contestants are allowed to use existing foundation models, but they must clearly mention and document which pre-trained models were used and how they were fine-tuned in their submission.
- Contestants must submit their code during the inference stage; this is a code submission competition.
- Models must be able to run on a single GPU with 20 GB of memory at the inference stage. Contestants are encouraged to validate their models on a similar machine before submitting their code.
- Related members from the organizing team can participate but are ineligible for prizes.
- The top 10 teams will have their code released after the final submission.
Evaluation Criteria
Challenge 1: Cross-Task Transfer Learning
- Mean Absolute Error (MAE) - 40%
- Coefficient of Determination (R²) - 20%
- Area Under ROC Curve (AUC-ROC) - 30%
- Balanced Accuracy - 10%
Challenge 2: Psychopathology Factor Prediction
- Concordance Correlation Coefficient (CCC) - 50%
- Root Mean Square Error (RMSE) - 30%
- Spearman’s Rank Correlation - 20%
Overall Ranking
- Challenge 1 contributes 40% to final score
- Challenge 2 contributes 60% to final score