Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Questions about Evaluation Pipeline and Metrics #2

Open
colinzhenli opened this issue Dec 30, 2023 · 0 comments
Open

Questions about Evaluation Pipeline and Metrics #2

colinzhenli opened this issue Dec 30, 2023 · 0 comments

Comments

@colinzhenli
Copy link

Great work! I have a question regarding the evaluation metrics, such as the Chamfer Distance and F-score.

  • In baseline methods like SA-ConNet and ConvOcc, meshes were reconstructed from SDF using the marching cubes algorithm. Subsequently, a point cloud was sampled from the predicted mesh to compute the CD and F-score.

  • While in your code, I noticed that you reconstructed a dense point cloud using a gradient-based algorithm similar to NDF's approach. Then, you directly computed the CD and F-score between the predicted point cloud and the ground truth point cloud.

  • You also mentioned using marching cubes for UDF to visualize the meshes.

My question is: In your published quantitative figures, did you use the SDF-to-mesh-to-point cloud and UDF-to-point cloud methods, or did you reimplement the same evaluation pipeline?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant