全网最全的多模态实体识别论文列表-【原文+代码】

news2024/11/19 20:39:54

文章目录

- 写在前面的话
- 【2017年】
- 【2018年】
- 【2019年】
- 【2020年】
- 【2021年】
- 【2022年】
- 【2023年】
- 【写在最后的话】

写在前面的话

近期在梳理多模态NER相关的论文，因此，本篇文章主要是为大家整理了比较全面的聚焦于多模态实体识别任务的论文列表，该论文列表主要是按照论文发表年份进行排列，有需要的小伙伴，可收藏，随时自取~ 后期我也会上传对应的资源，欢迎大家留言索要~

【如果你正在关注多模态NER任务，该任务相关的论文列表几乎都在这里了~】

【2017年】

[1] (2017-NIPS) Multimodal Attribute Extraction 【Paper】【Code】
这篇论文还不是严格意义上的多模态命名实体识别的工作，但是多模态属性抽取任务本质和多模态命名实体识别任务本质相同，因此把该篇论文列为第一篇。

【2018年】

[2] (2018-NAACL) Multimodal Named Entity Recognition for Short Medical Posts 【Paper】【Code:未开源】

[3] (2018-ACL)《Visual Attention Model for Name Tagging in Multimodal Social Media 【Paper】【Code:未开源】

[4] (2018-AAAI)《Adaptive Co-attention Network for Named Entity Recognition in Tweets 【Paper】【Code】

这三篇论文算是多模态实体识别任务的开山之作，并提出了面向该新任务的数据集。

【2019年】

[5] (2019-ICDAR) Aiding Intra-Text Representations with Visual Context for Multimodal Named Entity Recognition 【Paper】【Code:未开源】

【2020年】

[6] (2020-ACL) Improving Multimodal Named Entity Recognition via Entity Span Detection with Unified Multimodal Transformer 【Paper】【Code 】

[7] (2020-COLING) RIVA-A Pre-trained Tweet Multimodal Model Based on Text-image Relation for Multimodal NER 【Paper】【Code:未开源】

[8] (2020-MM) Multimodal Representation with Embedded Visual Guiding Objects for Named Entity Recognition in Social Media Posts 【Paper】【Code 】

【2021年】

[9] (2021-DSFAA) PromptMNER- Prompt-Based Entity-Related Visual Clue Extraction and Integration for Multimodal Named Entity Recognition 【Paper】【Code:未开源】

[10] (2021-DSFAA) Multimodal Named Entity Recognition with Image Attributes and Image Knowledge 【Paper】【Code:未开源】

[11] (2021-AAAI) Multi-modal Graph Fusion for Named Entity Recognition with Targeted Visual Guidance 【Paper】【Code 】

[12] (2021-AAAI) RpBERT- A Text-image Relation Propagation-based BERT Model for Multimodal NER 【Paper】【Code 】

[13] (2021-Neurocomputing) Hierarchical self-adaptation network for multimodal named entity recognition in social media 【Paper】【Code :未开源】

[14] (2021-EMNLP) Can images help recognize entities? A study of the role of images for Multimodal NER 【Paper】【Code 】

[15] (2021-Transactions on Multimedia) Object-Aware Multimodal Named Entity Recognition in Social Media Posts With Adversarial Learning 【Paper】【Code 】

【2022年】

[16] (2022-MM) Query Prior Matters- A MRC Framework for Multimodal Named Entity Recognition 【Paper】【Code :未开源】

[17] (2022- Neural Comput. Appl.) CWI- A multimodal deep learning approach for named entity recognition from social media using character, word and image features 【Paper】【Code :未开源】

[18] (2022-MM) Learning from Different text-image Pairs- A Relation-enhanced Graph Convolutional Network for Multimodal NER 【Paper】【Code 】

[19] (2022-EMNLP) A Span-based Multimodal Variational Autoencoder for Semi-supervised Multimodal Named Entity Recognition 【Paper】【Code 】

[20] (2022-NAACL) ITA- Image-Text Alignments for Multi-Modal Named Entity Recognition 【Paper】【Code 】

[21] (2022-COLING) Flat Multi-modal Interaction Transformer for Named Entity Recognition 【Paper】【Code :未开源】

[22] (2022-ICME) CAT-MNER-Multimodal Named Entity Recognition with Knowledge-Refined Cross-Modal Attention 【Paper】【Code :未开源】

[23] (2022-CORR) Multi-Granularity Cross-Modality Representation Learning for Named Entity Recognition on Social Media 【Paper】【Code :未开源】
【说明：该论文一开始挂在arxiv上，后来撤稿了…有需要的小伙伴可以给我留言评论】

[24] (2022-WSDM) MAF- A General Matching and Alignment Framework for Multimodal Named Entity Recognition 【Paper】【Code 】

[25] (2022- Applied Intelligence) UAMNer-uncertainty-aware multimodal named entity recognition in social media posts 【Paper】【Code ：未开源】

[26] (2022-NAACL) Good Visual Guidance Makes A Better Extractor- Hierarchical Visual Prefix for Multimodal Entity and Relation Extraction 【Paper】【Code 】

【2023年】

[27] （WSDM-2023）Reducing the Bias of Visual Objects in Multimodal Named Entity Recognition 【Paper】【Code 】
【说明：该代码目前作者还没更新完！我也会帮大家持续关注，进行更新】

[28] (2023- Transactions on Information and Systems ) Multimodal Named Entity Recognition with Bottleneck Fusion and Contrastive Learning 【Paper】【Code ：未开源】

[29] （ 2023-AAAI） Joint Multimodal Entity-Relation Extraction Based on Edge-enhanced Graph Alignment Network and Word-pair Relation Tagging 【Paper】【Code 】
【说明：这是一篇关于多模态实体关系联合抽取的论文】

[30] (2023-CoRR)-A Novel Framework for Multimodal Named Entity Recognition with Multi-level Alignments 【Paper】【Code:未开源】