Opis stanowiska
WHAT TASKS AWAIT YOU? Design, deploy, and maintain vLLM inference services on OpenShift/Kubernetes running on bare-metal GPU infrastructure. Manage NVIDIA GPU resources, including GPU partitioning and allocation, to maximize utilization across multiple models and tenants. Automate model lifecycle management, including model onboarding, versioning, deployment, hot-swapping, and rollback from private registries such as Hugging Face Enterprise and S3. Implement and manage Horizontal Pod Autoscalin…