Jump to content

File:Multiple attention heads.png

Page contents not supported in other languages.
This is a file from the Wikimedia Commons
From Wikipedia, the free encyclopedia
    Original file (870 × 1,280 pixels, file size: 269 KB, MIME type: image/png)

    Summary

    Description
    English: An illustration of multiple attention heads, each having its own criteria of relevance of other tokens for one of the tokens within the scope of a context window. (For the purpose of illustration, the context window consists of only one sentence.)
    Date
    Source Own work
    Author DancingPhilosopher
    This image could be re-created using vector graphics as an SVG file. This has several advantages; see Commons:Media for cleanup for more information. If an SVG form of this image is available, please upload it and afterwards replace this template with {{vector version available|new image name}}.
    It is recommended to name the SVG file “Multiple attention heads.svg”—then the template Vector version available (or Vva) does not need the new image name parameter.

    Licensing

    I, the copyright holder of this work, hereby publish it under the following license:
    w:en:Creative Commons
    attribution share alike
    This file is licensed under the Creative Commons Attribution-Share Alike 4.0 International license.
    You are free:
    • to share – to copy, distribute and transmit the work
    • to remix – to adapt the work
    Under the following conditions:
    • attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
    • share alike – If you remix, transform, or build upon the material, you must distribute your contributions under the same or compatible license as the original.

    Captions

    An illustration of multiple attention heads

    Items portrayed in this file

    depicts

    29 July 2023

    image/png

    File history

    Click on a date/time to view the file as it appeared at that time.

    Date/TimeThumbnailDimensionsUserComment
    current13:23, 1 August 2023Thumbnail for version as of 13:23, 1 August 2023870 × 1,280 (269 KB)DancingPhilosopheromitted the (in-picture) caption
    12:48, 1 August 2023Thumbnail for version as of 12:48, 1 August 2023870 × 1,280 (365 KB)DancingPhilosopher
    22:35, 29 July 2023Thumbnail for version as of 22:35, 29 July 2023855 × 1,280 (510 KB)DancingPhilosopherUploaded own work with UploadWizard

    The following page uses this file:

    Global file usage

    The following other wikis use this file:

    Metadata