Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can anyone get the results of scannet in paper? #19

Open
LinZhuoChen opened this issue Sep 9, 2018 · 16 comments
Open

Can anyone get the results of scannet in paper? #19

LinZhuoChen opened this issue Sep 9, 2018 · 16 comments

Comments

@LinZhuoChen
Copy link

I have not changed the code of pointsift and I can't get the result reported in paper,The result in paper is 86.1, I can only get 84.8, Can someone get the results of scannet in paper?Maybe I made some mistake,Thank you!

@sjtuytc
Copy link

sjtuytc commented Sep 9, 2018

Yes, and after some modification I can get 86.3.
You can check in your tensorboard.

@meteorshowers
Copy link

@sjtuytc can you describe your modification? And, how many GPU you use to train the model to get the 86.3? Thanks a lot!

@meteorshowers
Copy link

@sjtuytc my Wechat is 16600286930, thanks a lot!

@WuzhaoLee
Copy link

@sjtuytc Could you please describe your modification? I both use 2 or 4 GPU but I can only get 85.42.

@sjtuytc
Copy link

sjtuytc commented Jan 11, 2019 via email

@WuzhaoLee
Copy link

WuzhaoLee commented Jan 11, 2019

@sjtuytc oh~ Thanks for your reply. But I can't find the attachment everywhere 😂... Could you please send the modified network model again? Thanks a lot~

@sjtuytc
Copy link

sjtuytc commented Jan 11, 2019

dot py isn't supported by Github
pointSIFT_pointnet.zip

@sjtuytc
Copy link

sjtuytc commented Jan 11, 2019

@sjtuytc oh~ Thanks for your reply. But I can't find the attachment everywhere 😂... Could you please send the modified network model again? Thanks a lot~

@WuzhaoLee
Copy link

@sjtuytc Thanks!😁

@iris0329
Copy link

iris0329 commented Apr 29, 2019

@sjtuytc hi, Thanks for your sharing the code.
but I found the loss stopped decreasing at about 11.
Could you tell me how you set the parameters? such as how many epoches you set?

@sjtuytc
Copy link

sjtuytc commented Apr 29, 2019

One year has past and I could not remember those details, sorry. Only learning rate matters, I remember.

@iris0329
Copy link

@sjtuytc thank you !

@liarba
Copy link

liarba commented Aug 12, 2019

I have not changed the code of pointsift and I can't get the result reported in paper,The result in paper is 86.1, I can only get 84.8, Can someone get the results of scannet in paper?Maybe I made some mistake,Thank you!

Hi,I didn't change any code and I got calibrated vox accuracy around 84.6%, for vox accuracy I can only get 83.0%. Do you also get calibrated vox accuracy 84.8% with the original code?

@sjtuytc
Copy link

sjtuytc commented Aug 12, 2019

I have not changed the code of pointsift and I can't get the result reported in paper,The result in paper is 86.1, I can only get 84.8, Can someone get the results of scannet in paper?Maybe I made some mistake,Thank you!

Hi,I didn't change any code and I got calibrated vox accuracy around 84.6%, for vox accuracy I can only get 83.0%. Do you also get calibrated vox accuracy 84.8% with the original code?

Note the reported result is the best acc over all epoches, not the last epoch.

@liarba
Copy link

liarba commented Aug 12, 2019

I have not changed the code of pointsift and I can't get the result reported in paper,The result in paper is 86.1, I can only get 84.8, Can someone get the results of scannet in paper?Maybe I made some mistake,Thank you!

Hi,I didn't change any code and I got calibrated vox accuracy around 84.6%, for vox accuracy I can only get 83.0%. Do you also get calibrated vox accuracy 84.8% with the original code?

Note the reported result is the best acc over all epoches, not the last epoch.

Yes, I've noticed that, but the best vox average accuracy is still 83.0%. The best calibrated vox accuracy can reach to 84.6%. I didn't change any code and run on 4 gpus with 1000 epochs.

@sjtuytc
Copy link

sjtuytc commented Oct 2, 2019

I have not changed the code of pointsift and I can't get the result reported in paper,The result in paper is 86.1, I can only get 84.8, Can someone get the results of scannet in paper?Maybe I made some mistake,Thank you!

Hi,I didn't change any code and I got calibrated vox accuracy around 84.6%, for vox accuracy I can only get 83.0%. Do you also get calibrated vox accuracy 84.8% with the original code?

Note the reported result is the best acc over all epoches, not the last epoch.

Yes, I've noticed that, but the best vox average accuracy is still 83.0%. The best calibrated vox accuracy can reach to 84.6%. I didn't change any code and run on 4 gpus with 1000 epochs.

Yes, you're right. You need to use my modified code.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants