Skip to Content
× You are about to create a new metadata only record. This record does not auto assign a DOI. To allocate a new DOI use the 'Upload data and allocate DOI' option.

Geometric Features Informed Multi-person Human-object Interaction Recognition in Videos : MPHOI-72 [dataset]

Human-Object Interaction (HOI) recognition in videos is important for analyzing human activity. Most existing work focusing on visual features usually suffer from occlusion in the real-world scenarios. Such a problem will be further complicated when multiple people and objects are involved in HOIs. Consider that geometric features such as human pose and object position provide meaningful information to understand HOIs, we argue to combine the benefits of both visual and geometric features in HOI recognition, and propose a novel Two-level Geometric feature-informed Graph Convolutional Network (2G-GCN). The geometric-level graph models the interdependency between geometric features of humans and objects, while the fusion-level graph further fuses them with visual features of humans and objects. To demonstrate the novelty and effectiveness of our method in challenging scenarios, we propose a new multi-person HOI dataset (MPHOI-72). Extensive experiments on MPHOI-72 (multi-person HOI), CAD-120 (single-human HOI) and Bimanual Actions (two-hand HOI) datasets demonstrate our superior performance compared to state-of-the-arts.

Descriptions

Collection icon

Actions

Items in this Collection

Sort the listing of items    
List of items in this collection
  Title Date Uploaded Visibility Action
  27 July 2022 Open Access
File Name:
/files/r38w32r560v
File Format:
Creator:
Depositor:
T. Qiao
Edit Access:
Users: qfmk61, pzvx49
  27 July 2022 Open Access
File Name:
/files/r3q237hr92j
File Format:
Creator:
Depositor:
T. Qiao
Edit Access:
Users: qfmk61, pzvx49
  27 July 2022 Open Access
File Name:
/files/r33484zg88w
File Format:
Creator:
Depositor:
T. Qiao
Edit Access:
Users: pzvx49, qfmk61
  27 July 2022 Open Access
File Name:
/files/r3rb68xb84f
File Format:
Creator:
Depositor:
T. Qiao
Edit Access:
Users: qfmk61, pzvx49
  27 July 2022 Open Access
File Name:
/files/r3h415p952t
File Format:
Creator:
Depositor:
T. Qiao
Edit Access:
Users: qfmk61, pzvx49
  27 July 2022 Open Access
File Name:
/files/r3xs55mc04k
File Format:
Creator:
Depositor:
T. Qiao
Edit Access:
Users: qfmk61, pzvx49
  27 July 2022 Open Access
File Name:
/files/r3sb3978240
File Format:
Creator:
Depositor:
T. Qiao
Edit Access:
Users: qfmk61, pzvx49
  27 July 2022 Open Access
File Name:
/files/r3rx913p886
File Format:
Creator:
Depositor:
T. Qiao
Edit Access:
Users: qfmk61, pzvx49
  27 July 2022 Open Access
File Name:
/files/r3p8418n215
File Format:
Creator:
Depositor:
T. Qiao
Edit Access:
Users: qfmk61, pzvx49