feat(runpod): add inference pod templates, nginx LB, and provisioner script

Infrastructure readiness for RunPod inference workloads:
- runpod-inference.yaml: ConfigMap with pod creation payloads for RTX 4090,
  A40 (single+dual), and custom templates
- runpod-lb-configmap.yaml: nginx least-conn load balancer for inference
  endpoint distribution (Deployment + ClusterIP Service)
- runpod-provision.sh: bash provisioner script — reads RUNPOD_API_KEY/HF_TOKEN,
  creates pods via GraphQL, polls until RUNNING, outputs endpoint URLs.
  Does NOT spin up any pods (dry-run flag available).

This commit is contained in:

Will Anderson

2026-04-25 01:20:55 -05:00

parent c847b22014

commit 8eb88a3116

4 changed files with 566 additions and 0 deletions

									
										servers/legion/k8s/neuron-technologies/prod/kustomization.yaml
									
		+2
		
												View File
												
				@@ -12,3 +12,5 @@ resources:

				  - ingress.yaml

				  - license-ingressroute.yaml

				  - backup-cronjob.yaml

				  - runpod-inference.yaml

				  - runpod-lb-configmap.yaml