| --- |
| license: mit |
| base_model: KwaiVGI/LivePortrait |
| library_name: coreml |
| tags: |
| - coreml |
| - face |
| - portrait-animation |
| --- |
| |
| # LivePortrait (human models), Core ML fp16 |
|
|
| The five human checkpoints of [LivePortrait](https://github.com/KlingTeam/LivePortrait) |
| (KlingTeam / Kuaishou, MIT; weights from |
| [KwaiVGI/LivePortrait](https://huggingface.co/KwaiVGI/LivePortrait), revision `82a4fa6`), |
| converted to Core ML (fp16) for DepthField Photo's Expression Matrix live preview. |
|
|
| `liveportrait-fp16.zip` (STORED, 269,809,870 bytes, sha256 |
| `00ee879e694a2cd6ff6059db431d44a2ecb17cf1ce4c132c2a7ef17133d21129`) holds: |
|
|
| - `lp_F_fp16.mlpackage` appearance feature extractor |
| - `lp_M_fp16.mlpackage` motion extractor |
| - `lp_W1_fp16.mlpackage`, `lp_W2_fp16.mlpackage`, `lp_W3_fp16.mlpackage` the warping module, split in three |
| - `lp_G_fp16.mlpackage` SPADE generator |
| - `lp_stitching.f32`, `lp_lip.f32` stitching and lip-retargeting MLPs as raw little-endian f32 |
|
|
| ## Modifications |
|
|
| The 3D grid sampling is rewritten as one 2D sample over an atlas of depth slices, the 3D |
| convolutions as sums of 2D convolutions with batch norm folded in, spectral norm is baked into |
| the weights, and the warping network is split into three models. None of upstream's InsightFace |
| models, landmark model, animal models or X-Pose are included. |
|
|
| ## License |
|
|
| MIT, Copyright (c) 2024 Kuaishou Visual Generation and Interaction Center. The converted |
| weights are distributed under the same terms. |
|
|
