Guide

Learned search

Optional MuQ and MuQ-MuLan embeddings for audio similarity and natural-language sample retrieval in Sample Explorer.

An optional embedding service adds learned ways to find material in an indexed sample library: audio-to-audio similarity and natural-language retrieval. This page explains the two embedding spaces, how a learned description combines with structured Sample Explorer queries, and how to read the results.

Two embedding spaces

The optional embedding service supplies two spaces:

ModelEmbedding spaceUsed for
MuQAudio embeddingsAudio-to-audio similarity
MuQ-MuLanJoint audio/text embeddingsNatural-language retrieval

Learned search, generation, and compatibility ranking are separate tools. PHALAR stem pairing addresses a different question from similarity: compatibility between recordings.

Natural-language queries in Sample Explorer

Sample Explorer indexes configured sample roots and cached metadata rather than requiring filenames in every composition. Cmd+P opens it in Studio. Structured queries can combine fields such as BPM, duration, kind, and tags:

Text
bpm:120-140 kind:drum
dur:0.1-2 tag:vocals

An Explorer query can also combine structured constraints with a learned description, written after nl::

Text
bpm:120-140 nl:dark ambient pad

Context-aware insertion and the separate audition action are described with the rest of the sample workflow in Samples and slicing.

Reading the results

Zero-shot descriptions, tags, and similarity rankings come from a model. They are not replacements for BPM or key metadata; learned search adds ways to find material alongside the library’s own metadata.

Search without embeddings

Without embeddings, indexed and feature-based search remains available. WAV, AIFF, and FLAC headers supply basic metadata, and optional external analysis adds derived features.

Requirements

These models are optional: patterns, sound output, and many visuals do not need an ML model. The model environment is set up separately from the Lisp dependencies that make deps installs; see Installation and setup.

Model licenses

The MuQ and MuQ-MuLan weights are licensed CC-BY-NC-4.0, as identified on the official MuQ card and MuQ-MuLan card. Mora’s MIT source license does not cover these weights; they keep their own terms.

See Licensing and assets for how Mora’s license relates to dependencies, models, and samples.

Source references

Repository-relative paths in the Mora source where these mechanisms are implemented.

  • scripts/audio-analysis/mora_embeddings_server.py
  • src/samples/

Documentation

Search the documentation

Results update as you type. Use the up and down arrow keys to choose a result and Enter to open it.