Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Leveraging additional information from nuscenes #38

Closed
dongyang2011 opened this issue Mar 14, 2024 · 9 comments
Closed

Leveraging additional information from nuscenes #38

dongyang2011 opened this issue Mar 14, 2024 · 9 comments
Assignees
Labels
good first issue Good for newcomers

Comments

@dongyang2011
Copy link

Hi there, we're considering if the agent could benefit from more than just keyframe images to generate the right answers. Is that possible to use some extra infomations from nuscenes in this task, like continuous frame images or radar points, which can be used to obtain more precise velocity information?

@ChonghaoSima
Copy link
Contributor

you are free to do so

@ChonghaoSima ChonghaoSima self-assigned this Mar 14, 2024
@ChonghaoSima ChonghaoSima added the good first issue Good for newcomers label Mar 14, 2024
@ChonghaoSima
Copy link
Contributor

you can also consider other modality as long as it's provided by nusc dataset

@dongyang2011
Copy link
Author

So the full nuscenes dataset will be provided at challenge/llama_adapter_v2_multimodal7B/data/nuscene, right? And I guess the annotations, such as map expansion, lidar seg... will not be available.

@ChonghaoSima
Copy link
Contributor

no, we won't provide the "full" nuscenes dataset here. you can refer to bevformer or other repo to download the full dataset.

no, those annotation (bbox, map, lidar seg) should not be used when inference.

@dongyang2011
Copy link
Author

Do you mean that you will not provide the full nuscenes in this repo, but on the test server we can somehow access to the full nuscenes dataset (without any annotation)?

@ChonghaoSima
Copy link
Contributor

not sure what do you mean by "on the test server we can somehow access to the full nuscenes dataset".

we do not restrict the input modality and history frames for the inference of the model, while we don't allow using any human-labelled annotation as well as nusc provided ground truth annotation (including but not limited to bbox, map, lidar seg).

@dongyang2011
Copy link
Author

Thanks !

@dongyang2011
Copy link
Author

dongyang2011 commented Mar 14, 2024

while we don't allow using any human-labelled annotation as well as nusc provided ground truth annotation (including but not limited to bbox, map, lidar seg).

Is it opposite of the Huggingface homepage - Specific Rules?

@dongyang2011 dongyang2011 reopened this Mar 14, 2024
@ChonghaoSima
Copy link
Contributor

typo there. will fix soon.

@ChonghaoSima ChonghaoSima pinned this issue Mar 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

2 participants