Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

修改tracking后生成的视频出现了很多问题 #30

Open
xiaoqidaov2 opened this issue Aug 21, 2024 · 2 comments
Open

修改tracking后生成的视频出现了很多问题 #30

xiaoqidaov2 opened this issue Aug 21, 2024 · 2 comments

Comments

@xiaoqidaov2
Copy link

xiaoqidaov2 commented Aug 21, 2024

1.face_tracking 替换为 synctalk 的 face_tracking
2.在process.py 中添加了 sycntalk 预处理代码中的extract_flow 和 extract_blendshape。修改save_transforms 加载的是 bundle_adjustment.pt 文件,而不是之前的 track_params.pt。修改取消对 trans 进行缩放(即没有 trans / 10.0)。

将tracking 替换为synctalk 的tracking 遇到了很多问题如下视频所示

out.mp4

@Fictionarry 您能看出是什么导致出现这类问题吗,牙齿部分很奇怪

@Fictionarry
Copy link
Owner

头部pose不太对,抖得太厉害,看一下是不是替换过程中哪里有问题吧

@xiaoqidaov2
Copy link
Author

头部pose不太对,抖得太厉害,看一下是不是替换过程中哪里有问题吧

这几天我也在排查,包括换其他人说的办法,也遇到了其他人遇到的问题,但奇怪的是,他们的解决办法我使用后解决不了,让人头疼不解。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants