Today’s Kubernetes clusters can comprise of 5,000-10,000 nodes, increase by an order of magnitude from original design specs. The default Kubernetes scheduler dates back from earlier more modest deployments. It is queue-based, processing unscheduled pods in a sequential fashion. For a large Kubernetes cluster, such scheduler processing logic can introduce long, even unbounded scheduling latencies, negatively affecting overall throughput for workload deployments.
This talk outlines how Kubernetes is a victim of its own success, scheduling-wise. It lays out the current pod queuing challenges and describes a novel scheduling approach based on Flow Network Graph technique, enabling low workload scheduling latencies at scale. The presentation details the resulting extreme efficiencies and high-quality placement decisions of such an approach and the accompanying pluggable scheduling policies.
CNCF TOC member, Ambassador, Kubernetes emeritus Maintainer, Founder and Maintainer of multiple CNCF projects, Huawei
Kevin Wang has been an outstanding contributor in the CNCF community since its beginning and is the leader of the cloud native open source team at Huawei. Kevin has contributed critical enhancements to Kubernetes, led the incubation of the KubeEdge, Volcano, Karmada projects in CNCF... Read More →
