基于多标签语义相似性引导的跨模态哈希检索方法
DOI:
CSTR:
作者:
作者单位:

哈尔滨理工大学

作者简介:

通讯作者:

中图分类号:

TP391

基金项目:

国家重点研发计划(2022YFD2000500)、国家自然科学基金(62071157)、黑龙江省自然科学基金优秀青年基金(YQ2019F011)


Cross-modal hashing retrieval method based on multi-label semantic similarity guiding
Author:
Affiliation:

Harbin University of Science and Technology

Fund Project:

The National Key Research and Development Program of China(No. 2022YFD2000500),The National Natural Science Foundation of China(No. 62071157),The Natural Science Foundation of Heilongjiang Province(No. YQ2019F011)

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对现有哈希方法在模态专属信息保持、多标签语义嵌入、哈希函数判别性三方面存在的不足,本文提出基于多标签语义相似性引导的跨模态哈希检索方法。在哈希码学习阶段,该方法通过学习两个模态的独立潜在表示空间保留不同模态的专属信息,然后在语义嵌入过程中引入保护间隔和多标签相似性约束,在建立模态间联系的同时,充分考虑了语义及重叠标签信息对跨模态表示对齐的监督作用。在哈希函数学习阶段,该方法引入语义哈希约束项,同时利用语义相似性和哈希码来指导哈希函数的学习,改善哈希函数的判别性。在3个基准数据集上与9种先进哈希方法的大量对比实验结果验证了所提方法在跨模态检索任务上的有效性和先进性。

    Abstract:

    To address the limitations of existing hashing methods in modality-specific information preservation, multi-label semantic embedding, and the discriminative capability of hash functions, a cross-modal hashing retrieval method based on multi-label semantic similarity guiding is proposed in this paper. The method preserves modality-specific information in the hash codes learning stage by learning independent latent representation spaces for the two modalities. Protective margins and a multi-label similarity constraint are then incorporated into the semantic embedding process, establishing inter-modal relation and considering the supervisory role of semantic information and overlapping label information in aligning cross-modal representations. In the hash functions learning phase, semantic hashing constraints are introduced to guide the learning of hash functions using semantic similarity and hash codes, which enhances the discriminative capability of the hash functions. Extensive comparative experiments on three benchmarks with nine advanced hashing methods validate the effectiveness and superiority of the proposed method for cross-modal retrieval tasks.

    参考文献
    相似文献
    引证文献
引用本文
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2024-07-08
  • 最后修改日期:2024-09-12
  • 录用日期:2024-09-27
  • 在线发布日期:
  • 出版日期:
文章二维码