Publications

You can also find my articles on my Google Scholar profile.

Journal Articles

Named Entity Recognition and Relation Extraction Using Enhanced Table Filling by Contextualized Representations

Youmi Ma, Tatsuya Hiraoka, Naoaki Okazaki.
Journal of Natural Language Processing, vol. 29, No. 1, pages 187-223, 2022

単語分割と後段モデルの損失値を用いた同時最適化

English title: Joint Optimization of Word Segmentation and Downstream Model using Downstream Loss

平岡達也, 高瀬翔, 内海慶, 欅惇志, 岡崎直観.
Journal of Natural Language Processing, vol. 29, No. 1, pages 112-143, 2022

Recurrent Neural Hidden Markov Model for High-Order Transition

Tatsuya Hiraoka, Sho Takase, Kei Uchiumi, Atsushi Keyaki, Naoaki Okazaki.
ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP). Volume 21, Issue 2, Article No.: 36, pp: 1-15, 2021

テキストベクトルの重みづけを用いたタスクに対する単語分割の最適化

English title: Optimizing Word Segmentation for Downstream Tasks by Weighting Text Vector

平岡達也, 高瀬翔, 内海慶, 欅惇志, 岡崎直観.
Journal of Natural Language Processing, vol. 28, No. 2, pages 479-507, 2021

最優秀論文賞 / First-place Best Paper Award

Conference/Workshop Papers

Repetition Neurons: How Do Language Models Produce Repetitions?

Tatsuya Hiraoka, Kentaro Inui.
In 2025 Annual Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics (NAACL), 2025

The Geometry of Numerical Reasoning: Language Models Compare Numeric Properties in Linear Subspaces

Ahmed Oumar El-Shangiti, Tatsuya Hiraoka, Hilal AlQuabeh, Benjamin Heinzerling, Kentaro Inui.
In 2025 Annual Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics (NAACL), 2025

SubRegWeigh: Effective and Efficient Annotation Weighing with Subword Regularization

Kohei Tsuji, Tatsuya Hiraoka, Yuchang Cheng, Tomoya Iwakura.
The 31st International Conference on Computational Linguistics, 2025

An Analysis of BPE Vocabulary Trimming in Neural Machine Translation

Marco Cognetta, Tatsuya Hiraoka, Rico Sennrich, Yuval Pinter, Naoaki Okazaki.
In Proceedings of the Fifth Workshop on Insights from Negative Results in NLP, pages 48–50, Mexico City, Mexico, 2024

Vocabulary Replacement in SentencePiece for Domain Adaptation

Teruno Kajiura, Shiho Takano, Tatsuya Hiraoka, Kimio Kuramitsu.
In Proceedings of The 37th Pacific Asia Conference on Language, Information and Computation (PACLIC 37), 2023

MaxMatch-Dropout: Subword Regularization for WordPiece

Tatsuya Hiraoka.
In Proceedings of the 29th International Conference on Computational Linguistics (COLING), pages 4864-4872, Gyeongju, Republic of Korea, 2022

Joint Entity and Relation Extraction Based on Table Labeling Using Convolutional Neural Networks

Youmi Ma, Tatsuya Hiraoka, Naoaki Okazaki.
In 6th Workshop on Structured Prediction for NLP (SPNLP), pages 11-21, 2022

Single Model Ensemble for Subword Regularized Models in Low-Resource Machine Translation

Sho Takase, Tatsuya Hiraoka, Naoaki Okazaki.
In Findings of the Association for Computational Linguistics: ACL 2022, pages 2536–2541, 2022

Word-level Perturbation Considering Word Length and Compositional Subwords

Tatsuya Hiraoka, Sho Takase, Kei Uchiumi, Atsushi Keyaki, Naoaki Okazaki.
In Findings of the Association for Computational Linguistics: ACL 2022, pages 3268-3275, 2022

Joint Optimization of Tokenization and Downstream Model

Tatsuya Hiraoka, Sho Takase, Kei Uchiumi, Atsushi Keyaki, Naoaki Okazaki.
In Findings of the Association for Computational Linguistics: ACL 2021, Association for Computational Linguistics, pages 244–255, 2021

Optimizing Word Segmentation for Downstream Task

Tatsuya Hiraoka, Sho Takase, Kei Uchiumi, Atsushi Keyaki, Naoaki Okazaki.
In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings, pages 1341–1351, 2020

Stochastic Tokenization with a Language Model for Neural Text Classification

Tatsuya Hiraoka, Hiroyuki Shindo, Yuji Matsumoto.
In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 1620–1629, 2019

Non-refereed Papers

思考発話を利用した個人の発話及び性格特性再現

石倉誠也, 山田寛章, 平岡達也, 山田広明, 徳永健伸.
言語処理学会第29回年次大会 (NLP2025), pp. 4155-4160, 2025

大規模言語モデルにおけるペルソナの役割と内部動作の理解

尾崎慎太郎, 平岡達也, 大竹啓永, 大内啓樹, 渡辺太郎, 宮尾祐介, 大関洋平, 高木優.
言語処理学会第29回年次大会 (NLP2025), pp. 2648-2653, 2025

誤字に対するTransformerベースLLMのニューロンおよびヘッドの役割調査

辻航平, 平岡達也, 鄭育昌, 荒牧英治, 岩倉友哉.
言語処理学会第29回年次大会 (NLP2025), pp. 645-650, 2025

Investigating Neurons and Heads in Transformer-based LLMs for Typographical Errors

Kohei Tsuji, Tatsuya Hiraoka, Yuchang Cheng, Eiji Aramaki, Tomoya Iwakura.
arXiv, 2025

RECALL: Library-Like Behavior In Language Models is Enhanced by Self-Referencing Causal Cycles

Munachiso Nwadike, Zangir Iklassov, Toluwani Aremu, Tatsuya Hiraoka, Velibor Bojkovic, Benjamin Heinzerling, Hilal Alqaubeh, Martin Takáč, Kentaro Inui.
arXiv, 2025