ACMMM24 Multimedia Drone Satellite Matching Challenge In Multiple-environment

Organized by TingyuWang - Current server time: May 2, 2025, 12:06 p.m. UTC

Current

Test
April 20, 2024, midnight UTC

End

Competition Ends
Never

ACM Multimedia

Workshop on

UAVs in Multimedia: Capturing the World from a New Perspective (UAVM 2024)

Important Dates

Submission of papers:

  • Workshop Papers Submission: 5 July 2024
  • Workshop Papers Notification: 30 July 2024
  • Student Travel Grants Application Deadline: 5 August 2024
  • Camera-ready Submission: 6 August 2024
  • Conference Dates: 28 October 2024 – 1 November 2024

Please note: The submission deadline is at 11:59 p.m. of the stated deadline date Anywhere on Earth

Workshop homepage is at https://www.zdzheng.xyz/ACMMM2024Workshop-UAV

Challenge Overview

We also provide a multi-weather cross-view geo-localization dataset, called University160k-WX, and the workshop audience may consider to participate in the competition. The motivation is to simulate the real-world geo-localization scenario. In particular, University160k extends the current University-1652 dataset [36] with extra 167,486 satellite-view gallery distractors. University160k-WX further introduces weather variants on University160k, including fog, rain, snow and multiple weather compositions. We will release University160k-WX on our website, and make a public leader board. These distractor satellite-view images have a size of 1024 × 1024 and are obtained by cutting orthophoto images of real urban and surrounding areas. Multiple weathers are randomly sampled to increase the difficulty of representation learning (see Figure 3). In our primary evaluation, the distractor is challenging and makes the competitive baseline model, LPN [28], decrease the Recall@1 accuracy from 75.93% to 64.85% and the value of AP from 79.14% to 67.69% in the Drone → Satellite task. If we further introduce extreme weather, the performance further drops from 64.85% to 7.94% (see Table 2). We hope more audiences can be involved to solve this challenge, and consider the robustness problem against extreme weather.

Check challenge details at Section 5 in https://zdzheng.xyz/files/MM24_Workshop_Proposal_Drone.pdf

The challenge dataset contains two part.

  1. The basic dataset (training set) can be download by Request. Usually I will reply the download link in 5 minutes.Please take care that University-1652 test set (query/gallery) can not be used in any way.

  2. The name-masked test-160k-WX dataset (query & gallery+distractor) can be downloaded from Onedrive. Since only drone will meet weather conditions, we only simulate weather on drone-view queries.

The submission example can be found at Baseline Submission. Please zip it as ``answer.zip'' to submit the result.

Please return the top-10 satellite names. For example, the first query is ``Q3JI2tUwDkhcfip.jpeg''. Therefore, the first line of returned result in ``answer.txt'' should be the format as follows from Rank-1 to Rank-10:

e6kXgz36E8nOY2n       ioqKwvSIYYhiW2v       y4VmQPUYOMD8AH4       kpZ2QJlNBHMnbRA       xffJQs2n9DP17fg       IejrFHLQYBfce2y       cH79t5WJMEMZ3VA       W9u0j4N1nlFbI97       zDurtAW4FTJfNJ3       MuvIMNVdofmaRqG

Please return the result following the order of query at Query Name Txt. It will be 37855 lines.

Evaluation Criteria

We will evaluate on the mean score of Recall@1 and Recall@10.

Terms and Conditions

This page enumerated the terms and conditions of the competition.

Test

Start: April 20, 2024, midnight

Competition Ends

Never

You must be logged in to participate in competitions.

Sign In
# Username Score
1 Skyy93 96.3000
2 wangzhiyu918 95.8800
3 Genburten 94.5700