Skip to content

Commit

Permalink
update
Browse files Browse the repository at this point in the history
  • Loading branch information
AricGamma committed Jun 13, 2024
1 parent 63fb7c3 commit 1acc4d1
Show file tree
Hide file tree
Showing 2 changed files with 29 additions and 20 deletions.
Binary file added src/assets/video/singing/1.mp4
Binary file not shown.
49 changes: 29 additions & 20 deletions src/index.json
Original file line number Diff line number Diff line change
Expand Up @@ -104,58 +104,67 @@
"description": "The overview of the proposed pipeline. Specifically, we integrates a reference image containing a portrait with corresponding audio input to drive portrait animation. Optional visual synthesis weights can be used to balance lip, expression, and pose weights. ReferenceNet encodes global visual texture information for consistent and controllable character animation. Face and audio encoders generate high-fidelity portrait identity features and encode audio as motion information respectively. The module of hierarchical audio-driven visual synthesis establishes relationships between audio and visual components (lips, expression, pose), with a UNet denoiser used in the diffusion process."
}
},
{
"template": "single-video",
"props": {
"title": "Hallo Singing",
"items": [
"assets/video/singing/1.mp4"
]
}
},
{
"template": "video-comparision",
"props": {
"title": "Portrait Style",
"title": "",
"items": [
[
"assets/video/portrait_style/4.mp4",
"assets/video/portrait_style/3.mp4"
],
[
"assets/video/portrait_style/2.mp4",
"assets/video/portrait_style/1.mp4"
"assets/video/opera/1.mp4",
"assets/video/opera/2.mp4"
]
]
}
},
{
"template": "video-comparision",
"props": {
"title": "Cross Actor",
"title": "Speedy Rhythm",
"items": [
[
"assets/video/cross_actor/1.mp4",
"assets/video/cross_actor/2.mp4"
],
[
"assets/video/cross_actor/3.mp4",
"assets/video/cross_actor/4.mp4"
"assets/video/rap/1.mp4",
"assets/video/rap/2.mp4"
]
]
}
},
{
"template": "video-comparision",
"props": {
"title": "Opera Audio",
"title": "Portrait Style",
"items": [
[
"assets/video/opera/1.mp4",
"assets/video/opera/2.mp4"
"assets/video/portrait_style/4.mp4",
"assets/video/portrait_style/3.mp4"
],
[
"assets/video/portrait_style/2.mp4",
"assets/video/portrait_style/1.mp4"
]
]
}
},
{
"template": "video-comparision",
"props": {
"title": "",
"title": "Cross Actor",
"items": [
[
"assets/video/rap/1.mp4",
"assets/video/rap/2.mp4"
"assets/video/cross_actor/1.mp4",
"assets/video/cross_actor/2.mp4"
],
[
"assets/video/cross_actor/3.mp4",
"assets/video/cross_actor/4.mp4"
]
]
}
Expand Down

0 comments on commit 1acc4d1

Please sign in to comment.