Skip to content
naulon
Not checkedNot checked for notices yet.

Relatable Clothing: Soft-Attention Mechanism for Detecting Worn/Unworn Objects

Thomas Truong, Svetlana Yanushkevich

IEEE Access · 2021

doi:10.1109/access.2021.3101789 (opens in a new tab)

We email you when a new notice or a question about this paper appears.

Abstract

We have identified a need in visual relationship detection and biometrics related research for a dataset and model which focuses on person-clothing pairs. Previous to our Relatable Clothing dataset, there were no publicly available datasets usable for &#x201C;worn&#x201D; and &#x201C;unworn&#x201D; clothing detection. In this paper we propose a novel visual relationship model architecture for &#x201C;worn&#x201D; and &#x201C;unworn&#x201D; clothing detection that makes use of a soft attention mechanism for feature fusion between a conventional ResNet backbone and our novel person-clothing mask feature extraction architecture. The best proposed model achieves 98.62&#x0025; accuracy, 99.50&#x0025; precision, 98.31&#x0025; recall, and 99.14&#x0025; specificity on the Relatable Clothing dataset, outperforming our previous iterations. We release our models which can be found on the Relatable Clothing GitHub repository (<uri>https://github.com/th-truong/relatable_clothing</uri>) for future research and applications into detecting and analyzing person-clothing pairs.

Abstract licence: CC BY-NC-ND

Reads

Read by people on this page

None yet.

Checked or read by AI through naulon

None yet.

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.

Are you an author?

Is this your paper?

Claim it to add your note and be paid when agents cite it. Free.