This repository contains evaluation tools and MIDI files for measuring F1 scores of our automatic music transcription model. The evaluation framework is implemented in Google Colab, providing a cloud-based environment for transparent assessment of model performance and detailed inspection of the evaluation process.
- Cloud-based evaluation environment
- Pre-selected MIDI test files
- F1 score calculation implementation
- Interactive result inspection
- Reproducible evaluation process
- Google account
- Web browser
- Internet connection
- Human being
- Open the Google Colab notebook
- Click "Runtime" in the top menu
- Select "Restart and run all"
- Follow the cell-by-cell execution to view results
We welcome contributions to improve the evaluation framework. Please follow these steps:
- Fork the repository
- Create a feature branch (
git checkout -b feature/improvement
) - Commit your changes (
git commit -am 'Add some improvement'
) - Push to the branch (
git push origin feature/improvement
) - Open a Pull Request
For major changes, please open an issue first to discuss your proposed changes.
This project is licensed under the MIT License - see the LICENSE file for details.