Papers
arxiv:2608.01628

Motion Beyond Morphology: Bootstrapping Cross-Category Motion Transfer from Abstract Motion Representations

Published on Aug 3
ยท Submitted by
Zhimin Zhang
on Aug 4
Authors:
,
,
,
,
,
,
,

Abstract

Video motion transfer aims to animate a target object using dynamics from a reference video. Existing formulations largely rely on fixed structural correspondence, which becomes ill-defined when reference and target objects differ substantially in morphology, articulation, or deformation mechanisms. We introduce Motion Beyond Morphology, a perspective that seeks to transfer motion beyond fixed structural correspondence, by preserving dynamics that remain meaningful across different target morphologies. To realize this, we propose a two-stage framework. Stage~I learns complementary multi-granularity abstract motion views and uses them to bootstrap cross-category video pairs that preserve transferable dynamics across diverse morphologies. Stage~II internalizes this supervision into direct reference-video-conditioned generation, removing the need for explicit motion extraction at inference. We further introduce OpenVMT-Dataset and OpenVMT-Bench for training and evaluating image- and text-conditioned motion transfer across Same, Near, and Far category gaps, and plan to release both upon acceptance. Extensive experiments demonstrate state-of-the-art motion fidelity and target preservation. Project page: https://miniz233.github.io/MotionBeyondMorphology/

Community

Paper author Paper submitter
Paper author Paper submitter

Morphology-Adaptive Motion Transfer (Image2Video)

Paper author Paper submitter

๐Ÿš€ We introduce Motion Beyond Morphology (MBM), a framework for transferring motion across objects with substantially different morphologies, without relying on fixed structural correspondence.

MBM learns complementary multi-granularity abstract motion representations to bootstrap cross-category supervision, and then enables direct reference-video-conditioned generation at inference. Experiments across Same, Near, and Far category gaps demonstrate state-of-the-art motion fidelity and target preservation.

๐ŸŒ Project page: https://miniz233.github.io/MotionBeyondMorphology/
๐Ÿ’ป Code: https://github.com/miniz233/MBM

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2608.01628
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2608.01628 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2608.01628 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2608.01628 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.