About

Our client is an AI startup that builds custom LLMs and AI agents for enterprise use. They currently run their infrastructure in AWS (GPU + CPU workloads on Kubernetes) and need to migrate the solution into their enterprise client’s Azure tenant. The priorities are: Deploying the existing solution in Azure (AKS + related services). Protecting the client’s intellectual property (custom models, code, agent framework). Meeting SOC2 compliance and enterprise security requirements. We are looking for an experienced Azure DevOps / Cloud Engineer (or small team) to lead this migration and work alongside our client’s developers. Responsibilities: Design and implement an Azure-native solution equivalent to current AWS setup. Advise on and configure IP-protection mechanisms (Managed Applications, secured registries, AKS access controls, etc.). Set up AKS clusters across multiple regions/subscriptions (CPU + GPU workloads). Configure deployment automation (Terraform, Helm, ArgoCD, GitHub Runners). Integrate with Azure Active Directory (Entra ID) for authentication. Set up networking and integration with enterprise data pipelines. Implement logging, monitoring, and alerting (Azure Sentinel or equivalent). Establish CI/CD pipelines for containerized workloads. Ensure compliance (SOC2, vulnerability scans, static code analysis). Requirements: Proven experience with Azure DevOps and AKS (GPU + CPU workloads). Experience with Azure Managed Applications or secure multi-tenant deployment models. Cloud migration background (AWS → Azure preferred). Proficiency in Terraform, Helm, GitHub Actions/Runners, CI/CD pipelines. Familiarity with SOC2 compliance, security best practices, vulnerability scanning tools. Clear communication and ability to work with startup + enterprise teams. Nice to Have: Experience publishing/deploying via Azure Marketplace. Familiarity with compliance-heavy environments (SOC2, HIPAA, etc.). Background in AI/ML infrastructure and GPU-based inference. Engagement: One-time migration project, with potential for ongoing consulting. Flexible budget – focus is on success of the enterprise deployment. Remote work, with availability for sync calls during the project. How to Apply: When applying, please share: Relevant Azure migration projects you’ve done. Your experience with Azure Managed Applications and AKS GPU workloads. Estimated timeline and availability. Suggested approach for protecting IP during enterprise Azure deployments.