Repository navigation
Conversation
…imits Add [openshell.gateway.supervisor_pool] max_instances_per_member (16-1024, default 128) and max_members_per_gateway (1-64, default 32). The pool cap is live gateway replicas * members * instances, never above 131072. Placement picks the least-loaded member with room and never charges a member past its cap. Supervisors take the same cap through --pool-max-instances and size their gateway stream buffers from it. Refs #5748 Signed-off-by: divesh <dgude@nvidia.com>
Render supervisor.pool.maxInstancesPerMember and maxMembersPerGateway into the gateway config and supervisor env, validate their ranges, and fail the render when supervisor replicas or HPA maxReplicas exceed gateway replicas * maxMembersPerGateway. Default to two supervisors with configurable resources (250m/768Mi requests, 1.5Gi memory limit) and add values-scale-100k.yaml. Closes #5748 Signed-off-by: divesh <dgude@nvidia.com>
Lower max_instances_per_member and supervisor.pool.maxInstancesPerMember to 1..=1024. Gateway message and status-report bounds keep the floor a cap of 16 gave, since snapshots also carry the pool-wide route directory. Document how to add gateway replicas for more supervisors. Refs #5748 Signed-off-by: divesh <dgude@nvidia.com>
…ool limits plumbing Only sandboxes per supervisor stays bounded (1-1024). Members per gateway accepts any positive value; the 131072 pool ceiling still applies. Placement refusals now say "sandbox capacity reached" and name the limit that was hit. Refs #5748 Signed-off-by: divesh <dgude@nvidia.com>
…imits Refs #5748 Signed-off-by: divesh <dgude@nvidia.com>
|
🌿 Preview your docs: https://nvidia-preview-pr-5756.docs.buildwithfern.com/openshell |
Two gateways with up to 40 supervisors each, at 128 sandboxes per supervisor, hold 10,240 sandboxes. Refs #5748 Signed-off-by: divesh <dgude@nvidia.com>
Collaborator
Author
|
/ok to test c17f546 |
…tion Refs #5748 Signed-off-by: divesh <dgude@nvidia.com>
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Make shared supervisor pool capacity configurable from Helm, so operators can size a cluster by gateways, supervisors, and sandboxes per supervisor.
Related Issue
Closes #5748
Changes
supervisor.pool:maxInstancesPerMember: sandboxes per supervisor, 1–1024, default 128maxMembersPerGateway: supervisors per gateway, 1 or more, default 32sandbox createfails right away withFAILED_PRECONDITION:sandbox capacity reached; add supervisors or gateway replicas, or raise the supervisor pool limits. The gateway log says which limit was hit.supervisor.replicas: 2maxReplicas: 4maxReplicas) exceed gateway replicas ×maxMembersPerGateway.values-scale-10k.yamlprofile: 2 gateways × up to 40 supervisors each × 128 sandboxes = 10,240.Release Notes
Helm users can set shared supervisor capacity with
supervisor.pool.maxInstancesPerMemberandsupervisor.pool.maxMembersPerGateway. Creates beyond capacity fail with "sandbox capacity reached".Testing
openshell-supervisor-control, the shared supervisor host, server config, and placement; clippy cleanhelm unittest(503 tests),mise run helm:lint,test-gateway-config-parser.sh,test-supervisor-pool-scaling.shChecklist