Rotary Embedding NKI Kernel Tutorial

[apatwal72]

Issue #, if available:

N/A

Description of changes:

NKI kernel tutorial for applying rotary embedding to query, key tensors. Included benchmarking, and correctness tests with script

Testing:

Please see detailed unit test requirements in the CONTRIBUTING.md

• The change is covered by numeric check using nki.baremetal
• The change is covered by performance benchmark test using nki.benchmark
• The change is covered by end-to-end integration test

Pull Request Checklist

• I have filled in all the required field in the template
• I have tested locally that all the tests pass
• By submitting this pull request, I confirm that my contribution is made under the terms of the MIT-0 license.

[aws-qieqingy]

We cannot merge this at the moment. The source of the tutorial is now hosted in an internal location and is displayed at https://awsdocs-neuron.readthedocs-hosted.com/en/latest/general/nki/tutorials.html. All of the existing tutorial has a RTD file that is in a certain format. We plan to migrate the tutorial source code to this repo soon and then we can add the RST file for this tutorial as well.

Cannot merge for now due to reason stated in a separate comment.

[aws-zhehongb]

do we need to assert q_tile.shape[-1] % 2 == 0

also could we assign q_tile.shape[-1] to a temp variable such that we dont need to type q_tile.shape[-1] repeatedly?