本作品来自 MIT 许可的 PPT Master Examples。下方展示全部 15 页;点击页面可放大浏览。
01 / 15Attention Is All You Need02 / 15What this drawing set covers03 / 15Before 2017, models paid for word order with time04 / 15Keep attention, drop everything else05 / 15Six identical layers on each side06 / 15Scaled dot-product attention07 / 15Multi-head attention: eight views at once08 / 15The same block is used in three places09 / 15Injecting order without recurrence10 / 15Three costs, four layer types (Table 1)11 / 15The spec sheet: data, hardware, schedule12 / 15State of the art on both WMT 2014 tasks13 / 15What the ablations taught (Table 3)14 / 15What was built on it15 / 15Attention is all you need — the rest was engineering