Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Coperception - support cooperative perception based on OpenCOOD #187

Draft
wants to merge 15 commits into
base: main
Choose a base branch
from

Conversation

ju40268
Copy link
Contributor

@ju40268 ju40268 commented Feb 25, 2023

Scenario
v2xp_online_carla.py
Run with command

python opencda.py -t v2xp_online_carla -v 0.9.12 --apply_ml 

No Comm

Early:
The Average Precision at IOU 0.3 is 0.41, The Average Precision at IOU 0.5 is 0.37, The Average Precision at IOU 0.7 is 0.29
Intermediate
The Average Precision at IOU 0.3 is 0.48, The Average Precision at IOU 0.5 is 0.40, The Average Precision at IOU 0.7 is 0.28
Late:
The Average Precision at IOU 0.3 is 0.44, The Average Precision at IOU 0.5 is 0.38, The Average Precision at IOU 0.7 is 0.31

@DerrickXuNu
Copy link
Contributor

A quick question: did you change any code in opencood?

# create CAV world
cav_world = CavWorld(apply_ml=opt.apply_ml,
apply_coperception=True,
fusion_method='early')
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

make it intermediate to run with intermediate fusion

…ception prediction on nearby cav (smallest id as the ego id), make plot gt, enable_communicate configurable
@ju40268
Copy link
Contributor Author

ju40268 commented Mar 26, 2023

The parameters relate to cooperative perception is listed with parameters within the yaml file as follows:

coperception:
  models:
    early: 'opencood/logs/pointpillar_early_fusion'
    intermediate_v2xvit: 'opencood/logs/pointpillar_v2xvit_fusion'
    intermediate_attentive: 'opencood/logs/pointpillar_attentive_fusion'
    intermediate_cobevt: 'opencood/logs/pointpillar_cobevt_fusion'
    late: 'opencood/logs/pointpillar_late_fusion'
  fusion_method: 'intermediate_v2xvit'

and whether or not to enable communication across cav, and plotting ground truth is by the config

coperception: true # cooperative perception
enable_communicate: true
enable_show_gt: false

under the perception section.
Example evaluation results for intermediate fusion using v2xvit

Evaluate final average precision results:
  - Fusion method: intermediate_v2xvit
  - The Average Precision at IOU 0.3 is 0.66, The Average Precision at IOU 0.5 is 0.57, The Average Precision at IOU 0.7 is 0.36

@DerrickXuNu
Copy link
Contributor

Is this ready to merge?

@ju40268 ju40268 changed the title Support coperception single vehicle Coperception - support cooperative perception based on OpenCOOD Apr 1, 2023
@ju40268 ju40268 marked this pull request as draft May 11, 2023 15:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants