The efficiency of the Multi-head Attention (MHA) Mechanism in the computational complexity and the modeling capacity

View Statistics Email Alert RSS Feed

Grant Data
Project Title
The efficiency of the Multi-head Attention (MHA) Mechanism in the computational complexity and the modeling capacity
Principal Investigator
Dr Kong, Lingpeng   (Principal Investigator (PI))
Duration
60
Start Date
2021-09-01
Amount
500000
Conference Title
The efficiency of the Multi-head Attention (MHA) Mechanism in the computational complexity and the modeling capacity
Presentation Title
Keywords
comlexity and the modeling capacity, the Multi-head Attention (MHA) Mechanism
Discipline
Others - Professional and Vocational Studies
Panel
Engineering (E)
HKU Project Code
AR210010
Grant Type
Beijing Zitiao Network Technology Co., Ltd.
Funding Year
2021
Status
On-going
Objectives
Refer to hard copy