Task-Agnostic Compatible Adapter (TaCA)

Upgrade visual foundation models without retraining downstream tasks.

TaCA is a task-agnostic compatible adapter for visual foundation model upgrades. Preprint, 2023.

  • Align the new backbone’s representation with the interface expected by existing downstream modules.
  • Preserve downstream heads while upgrading the visual backbone.
  • Combine compatible adaptation and transfer-oriented training across downstream applications.

The work studies image classification, visual question answering, and cross-modal retrieval.

Preprint