Seeking a musically literate specialist, the contract-based Full Stack Producer (Music Notation, Audio ML) will evaluate the quality of AI models related to music notation and audio, contributing to QA and data labeling efforts across various projects while working remotely.
Key responsibilities: Expert-score every OMR and A2S release each sprint and run deeper quarterly QA cycles with AB-tests Conduct quarterly competitor benchmarking against multiple competitors on the golden dataset and provide fast sanity checks on model candidates between releases Build and label the Autograde golden test set, extending the QA process to adjacent projects as they scale
Required qualifications: Strong musical literacy with the ability to read and evaluate music notation, scores, and audio performances Experience judging OMR and audio-to-score transcription output for accuracy Familiarity with structured/rubric-based QA scoring methodology Comfortable evaluating a range of score types, including multilingual lyrics and various ensemble formats Attention to detail for spot-checking datasets against ground truth

Also on the board Same function, level within a rung

Level

Senior

Location

New York, NY

Occupation

Musicians and Singers

Industry

Custom Computer Programming Services

Posted

8 days ago

Apply for this role →