Add aws-k8s-1.22, vmware-k8s-1.22, aws-k8s-1.22-nvidia, metal-k8s-1.22 variants

[etungsten]

Issue number:
Resolves #1961

Description of changes:
For reference, the addition of k8s-1.21 variants was in #1612

    vmware-k8s-1.22: use unified layout for vmware-k8s-1.22
    
    Having two disks in the OVF template can trigger sporadic issues when
    importing into the vSphere content library. Switching to the unified
    layout should avoid this failure mode.
    
    Signed-off-by: Ben Cressey <bcressey@amazon.com>

    Add metal-k8s-1.22 variant
    
    This change adds an additional variant `metal-k8s-1.22`, which includes
    necessary Kubernetes packages and settings for running Bottlerocket on
    metal in a Kubernetes v1.22 cluster.

    Add aws-k8s-1.22-nvidia variant
    
    Adds aws-k8s-1.22-nvidia variant, create symlinks for previous k8s
    version nvidia variant in models.

    Add vmware-k8s-1.22 variant
    
    Adds vmware-k8s-1.22 variant, relinks symlinks in models

    Add aws-k8s-1.22 variant
    
    Adds aws-k8s-1.22 variant, relinks symlinks in models

    packages: add kubernetes-1.22
    
    Use K8s 1.22 source from EKS-D

Testing done:

• Pods run OK
• Conformance testing with 1.22 control plane and x86_64 aws-k8s-1.22 nodes

      "progress": {
        "name": "e2e",
        "node": "global",
        "timestamp": "2022-02-23T02:59:32.923164651Z",
        "msg": "Test Suite completed",
        "total": 346,
        "completed": 346
      }

• Conformance testing with 1.22 control plane and aarch64 aws-k8s-1.22 nodes
• Conformance testing with 1.22 control plane and x86_64 aws-k8s-1.22 nodes in an IPv6 cluster
• Conformance testing with 1.22 control plane and x86_64 vmware-k8s-1.22 nodes
• Confirm the EBS CSI driver still works.
• Confirm the vSphere CSI driver still works
• Smoke test aws-k8s-1.22-nvidia variant with some GPU workloads
• Metal K8s 1.22 testing
• Check kubelet logs and system logs in general, compared them with the aws-k8s-1.21 variant kubelet logs:

... Others TBD

Terms of contribution:

By submitting this pull request, I agree that this contribution is dual-licensed under the terms of both the Apache License, version 2.0, and the MIT license.

[cbgbt]

This looks good to me, pending testing.

[bcressey]

nit: commit for metal-k8s-1.22 says 1.21 in the subject

[bcressey]

Nice work! I know there's a staggering amount of copy/paste and fiddly edits but it all looks right to me.

[etungsten]

Push above rebases onto develop to pull in latest changes.

[etungsten]

Push above addresses @bcressey 's comments.

[zmrow]

🏷️

[etungsten]

Push above updates the k8s-1.22 package to the latest EKS-D dev release.

[etungsten]

Push above rebases onto develop and fixes conflicts

[etungsten]

Push above flips the kubernetes-1.22 package to use the EKS-D prod release URL for its sources.

[etungsten]

Push above adds a commit for changing the image layout for vmware-k8s-1.22 to unified.

Tested the vmware-k8s-1.22 variant and conformance tests passed.

[etungsten]

Push above removes note about vmware variant's preview status from README and QUICKSTART-VMWARE.

[zmrow]

🌡️