Merge pull request kubernetes#3125 from Jiawei0227/vsphere

KEP-1491: add csi migration kep for vsphere

Author: k8s-ci-robot

keps/prod-readiness/sig-storage/1491.yaml

@@ -0,0 +1,3 @@
+kep-number: 1491
+beta:
+  approver: "@wojtek-t"

keps/sig-storage/1491-csi-migration-vsphere/README.md

@@ -0,0 +1,58 @@
+# In-tree Storage Plugin to CSI Migration - vSphere Design Doc
+
+## Table of Contents
+
+<!-- toc -->
+- [Summary](#summary)
+  - [New Feature Gates](#new-feature-gates)
+- [Production Readiness Review Questionnaire](#production-readiness-review-questionnaire)
+- [Implementation History](#implementation-history)
+<!-- /toc -->
+
+
+## Summary
+
+This document present as a vendor specific KEP for the parent KEP
+[CSI Migration](https://github.com/kubernetes/enhancements/tree/master/keps/sig-storage/625-csi-migration)
+
+This inherits all the contents from its parent KEP. It will introduce two new feature gates to be 
+used as as described in its parent KEP. For all other contents, please refer to the parent KEP.
+
+### New Feature Gates
+
+- CSIMigrationvSphere
+  - As describe in [CSI Migration](https://github.com/kubernetes/enhancements/tree/master/keps/sig-storage/625-csi-migration), 
+  when this feature flag && the `CSIMigration` is enabled at the same time, all operations related to the 
+  in-tree volume plugin `kubernetes.io/vsphere-volume` will be redirect to use the corresponding CSI driver. From a 
+  user perspective, nothing will be noticed.
+- InTreePluginvSphereUnregister
+  - This flag technically is not part of CSI Migration design. But it happens to be related and helps with 
+  CSI Migration. The name speaks for itself, when this flag is enabled, kubernetes will not register the 
+  `kubernetes.io/vsphere-volume` as one of the in-tree storage plugin provisioners. This flag standalone can work out 
+  of CSI Migration features.
+  - However, when all `InTreePluginvSphereUnregister`, `CSIMigrationvSphere` and `CSIMigration` feature 
+  flags are enabled at the same time. The kube-controller-manager will skip the feature flag checking 
+  on kubelet and treat vSphere CSI migration as already complete. And directly redirect traffic to CSI 
+  driver for all vsphere volume related operations.
+
+
+## Production Readiness Review Questionnaire
+
+Please refer to the [CSI Migration Production Readiness Review Questionnaire](https://github.com/kubernetes/enhancements/tree/master/keps/sig-storage/625-csi-migration#production-readiness-review-questionnaire).
+
+## Implementation History
+
+Major milestones in the life cycle of a KEP should be tracked in `Implementation History`.
+
+- 2022-01-11 KEP created
+
+Major milestones for vSphere in-tree plugin CSI migration:
+
+- 1.18
+  - vSphere CSI migration to Alpha
+
+- 1.19
+  - vSphere CSI migration to Beta, off by default
+  
+- 1.24
+  - vSphere CSI migration to Beta, on by default

keps/sig-storage/1491-csi-migration-vsphere/kep.yaml

@@ -0,0 +1,54 @@
+title: In-tree Storage Plugin to CSI Migration - vSphere
+kep-number: 1491
+authors:
+  - "@divyenpatel"
+owning-sig: sig-storage
+participating-sigs:
+  - sig-cluster-lifecycle
+reviewers:
+  - "@Jiawei0227"
+  - "@msau42"
+approvers:
+  - "@msau42"
+editor: "@Jiawei0227"
+creation-date: 2022-01-11
+last-updated: 2022-01-11
+disable-supported: true
+status: implementable
+see-also:
+  - "https://github.com/kubernetes/community/blob/master/contributors/design-proposals/storage/csi-migration.md"
+prr-approvers:
+  - "@wojtek-t"
+replaces:
+
+# The target maturity stage in the current dev cycle for this KEP.
+stage: beta
+
+# The most recent milestone for which work toward delivery of this KEP has been
+# done. This can be the current (upcoming) milestone, if it is being actively
+# worked on.
+latest-milestone: "v1.24"
+
+# The milestone at which this feature was, or is targeted to be, at each stage.
+milestone:
+  alpha: "v1.18"
+  beta: "v1.19"
+
+# The following PRR answers are required at alpha release
+# List the feature gate name and the components for which it must be enabled
+feature-gates:
+  - name: CSIMigrationvSphere
+    components:
+    - kube-controller-manager
+    - kubelet
+    - kube-scheduler
+  - name: InTreePluginvSphereUnregister
+    components:
+    - kube-controller-manager
+    - kubelet
+    - kube-scheduler
+
+# The following PRR answers are required at beta release
+metrics:
+  - csi_sidecar_duration_operation
+  - storage_operation_duration_seconds