Master's Thesis

Transformer Methods and Their Application in Text Analysis

Thesis Info

Supervisor

RNDr. Šimon Horvát, PhD.

Consultant

doc. RNDr. Ľubomír Antoni, PhD.

Documents

🎯 Objectives

  • 1

    Process an overview of new neural network methods, transformers, describe their principles and areas of their current use.

  • 2

    Implement transformer-based neural network methods for training using selected datasets.

  • 3

    Test the trained model in a selected application area.

  • 4

    Compare the achieved results with other available studies.

📚 Recommended Literature

  • Vaswani, Ashish, et al. "Attention is all you need." Advances in neural information processing systems 30 (2017).
  • Tunstall, L., Von Werra, L., & Wolf, T. (2022). Natural language processing with transformers. "O'Reilly Media, Inc.".