Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Distance to the Sky is mostly estimated <2km? Instruction appreciated for re-train/ fine-tune, thanks! #70

Open
lattebyte opened this issue Nov 16, 2024 · 0 comments

Comments

@lattebyte
Copy link

lattebyte commented Nov 16, 2024

Greetings,

Please find 2 images below that were generated from a modified DepthPro in point-cloud-and-mapping, it is using original Apple DepthPro AI model,

inferred_1.png (looks no major issues):
inferred_1

road1_3D_1
road1_2d.png:
road1_2d

This "road1_2d.png" is the one that included sky where most of sky-pixel are estimated below 2000m, although max value is ~10km. however chatgpt suggests is 10-50km to Stratosphere.

It would be appreciated if anyone could please advise what is the theory/ referece documentation of how the Apple original model is trained (especially to the sky), and how to fine-tune or re-train.

I dont have much knowledge in depth-related AI model, but some experice with creating mask/ oject detection .pt or .pth model, thanks!

video demo:
https://youtu.be/3Vm2yJsiLZY

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant