Senior DevOps Engineer
About the project
Impressit is seeking a highly skilled and motivated Senior DevOps Engineer to design, implement, and optimize a scalable and secure infrastructure for deploying and operating open-source large language models (LLMs). The role will involve full lifecycle ownership across multiple project phases - from environment setup to production readiness and handover.
You will work closely with engineering and ML teams to ensure robust deployment pipelines, GPU-optimized orchestration, high availability, and secure, observable operations.
What you will do
— Design and deploy a cloud-agnostic, GPU-ready Kubernetes infrastructure from the ground up
— Set up networking, persistent storage, and GPU node pools across cloud providers
— Package and deploy LLM models with robust API endpoints (e.g., FastAPI)
— Implement monitoring/logging/observability (e.g., Prometheus, Grafana, Loki)
— Ensure platform security (RBAC, encryption, IAM, network policies, backups)
— Support autoscaling, CI/CD, cost optimization, and production readiness
— Collaborate closely with ML/AI, backend, and DevOps teams
— Provide documentation, alerts, SLAs, and post-deployment support
What we expect
— 5+ years of experience in DevOps / SRE roles
— Expert-level Kubernetes knowledge (setting up clusters from scratch, managing GPU workloads)
— Experience with multi-cloud or cloud-agnostic environments
— Proficiency with Terraform and infrastructure as code
— Familiarity with CI/CD pipelines, containerization (Docker), and API deployment
— Strong understanding of cloud security, IAM, RBAC, pod/network policies
— Hands-on experience with monitoring/observability stacks
— Solid scripting skills (Bash, Python, etc.)
— Upper-Intermediate or higher English
Employee benefits
We are passionate about everything we do, and with Impressit you will get:
Professional education and training budget
24 working days vacation
WOW team-building events
Paid sick leave
Relocation assistance