MPHOI rgb.  Part 2 of 4 [dataset]

Shum, Hubert P. H. (Durham University, UK); Qiao, Tanqiu (Durham University, UK); Li, Frederick W. B. (Durham University, UK)

Actions

Collections

This file is in the following collections:

Geometric Features Informed Multi-person Human-object Interaction Recognition in Videos : MPHOI-72 [dataset]

MPHOI rgb. Part 2 of 4 [dataset] Open Access

Human-Object Interaction (HOI) recognition in videos is important for analyzing human activity. Most existing work focusing on visual features usually suffer from occlusion in the real-world scenarios. Such a problem will be further complicated when multiple people and objects are involved in HOIs. Consider that geometric features such as human pose and object position provide meaningful information to understand HOIs, we argue to combine the benefits of both visual and geometric features in HOI recognition, and propose a novel Two-level Geometric feature-informed Graph Convolutional Network (2G-GCN). The geometric-level graph models the interdependency between geometric features of humans and objects, while the fusion-level graph further fuses them with visual features of humans and objects. To demonstrate the novelty and effectiveness of our method in challenging scenarios, we propose a new multi-person HOI dataset (MPHOI-72). Extensive experiments on MPHOI-72 (multi-person HOI), CAD-120 (single-human HOI) and Bimanual Actions (two-hand HOI) datasets demonstrate our superior performance compared to state-of-the-arts.

Descriptions

Resource type: Dataset
Contributors: Creator: Shum, Hubert P. H. ¹
Editor: Shum, Hubert P. H. ¹
Editor: Li, Frederick W. B. ¹
Editor: Qiao, Tanqiu ¹
Creator: Qiao, Tanqiu ¹

¹ Durham University, UK
Funder
Research methods
Other description: Code published on GitHub: https://github.com/tanqiu98/2G-GCN
Keyword: Human-object interaction
Graph convolution neural networks
Feature fusion, multi-person interaction
Multi-person interaction
Subject
Location
Language
Cited in: https://dro.dur.ac.uk/36509/
Identifier: ark:/32150/r3rx913p886
Rights: Creative Commons Attribution 4.0 International (CC BY)
Publisher: Durham University
Date Created

File Details

Depositor: T. Qiao
Date Uploaded: 27 July 2022, 10:07:18
Date Modified: 3 August 2022, 09:08:10
Audit Status: Audits have not yet been run on this file.
Characterization: not yet characterized

Activity of users you follow
User Activity	Date
User N. Syrotiuk has updated MPHOI rgb. Part 2 of 4 [dataset]	over 2 years ago
User N. Syrotiuk has updated MPHOI rgb. Part 2 of 4 [dataset]	over 2 years ago