Eduard Khiaev - Rishon LeZion, Israel

AI Infrastructure Engineer

Production-grade LLM platforms and secure automation

I build the operational layer around AI systems: model-serving APIs, LLM gateways, observability, and Kubernetes-based delivery.

vLLM Hugging Face LiteLLM Langfuse Kubernetes
15+years infrastructure 5+years security K8sOpenShift + Kubernetes AILLM platform focus

Why I fit

AI systems need production engineering.

Moving from DevSecOps into AI engineering with a practical focus on vLLM, Hugging Face, LiteLLM, Langfuse, containers, and Kubernetes.

Bridge AI experiments and production operations with containers, routing, automation, and runtime troubleshooting.

Build toward model serving, AI gateways, prompt observability, and API-driven LLM systems.

Bring regulated financial infrastructure habits: security controls, delivery discipline, and maintainability.

Use Go, Python, Bash, Kubernetes, Terraform, Vault, Jenkins, OpenShift, networking, and security together.

Target stack

AI engineering focus areas

01

Model serving

Running LLMs behind reliable APIs with vLLM, Hugging Face, containers, and Kubernetes-style operational patterns.

02

AI gateways

Using LiteLLM-style routing, provider abstraction, policy controls, and secure access patterns for internal AI services.

03

Observability

Tracking prompts, latency, failures, cost, and behavior with tools such as Langfuse and production logging practices.

04

Secure automation

Applying CI/CD, secrets, scanning, hardening, and infrastructure as code to AI workloads before they become fragile.

Proof from production

Experience that transfers directly to AI platforms

03.2024 - Present Bnei Brak, Israel

DevOps / DevSecOps Engineer

Isracard

Delivering secure, automated, and scalable platform solutions across cloud and on-prem environments.

  • Built resilient CI/CD pipelines using Docker, Jenkins, Artifactory, Kubernetes, and OpenShift.
  • Designed delivery flows aligned with 12-factor principles for microservices infrastructure.
  • Implemented reproducible infrastructure workflows with Terraform, Vault, Vagrant, and Ansible.
04.2019 - 03.2024 Bnei Brak, Israel

Cyber Security - DevSecOps

Isracard

Security-focused engineering with hands-on responsibility for CI/CD security, network hardening, and access control.

  • Integrated Synopsys Black Duck and Coverity into CI/CD pipelines to automate application security checks.
  • Configured and managed F5 ASM and Forescout NAC to strengthen application and network access controls.
  • Performed vulnerability assessments and penetration testing to reduce infrastructure security risk.
03.2017 - 03.2019 Tel Aviv-Yafo, Israel

Network Engineer

Isracard

Managed multi-DC network infrastructure with focus on load balancing, automation, monitoring, and reliability.

  • Designed and maintained network infrastructure using Nortel, Cisco Nexus, F5 Big-IP, Radware Alteon, and PKI.
  • Used CA Spectrum and Python scripting to automate monitoring and troubleshooting workflows.
06.2014 - 02.2017 Petah Tikva, Israel

Communications and Information Security Analyst

Metropolint

Managed enterprise communications, wireless, monitoring, firewall, and load balancing infrastructure.

  • Worked with VPDN, WLC, Cisco Nexus, 3COM, HP switches, Nagios, Fortigate, and F5 LTM.
  • Optimized network performance while improving resilience and security posture.
01.2012 - 05.2014 Rishon LeZion, Israel

Strategic Technical Support

Bezeq

Troubleshot enterprise ISP services across VPNs, CPE devices, routing, switching, and packet analysis.

  • Resolved layer 2 and layer 3 issues and used Wireshark to identify network performance bottlenecks.
05.2010 - 12.2011 Tel Aviv-Yafo, Israel

Operations Team

Bezeq

Supported ISP operations across ATM, PVC, GBE, PTM, DSLAM, MSAG, and BRAS environments.

08.2008 - 04.2010 Tel Aviv-Yafo, Israel

ADSL Technical Support Center

Bezeq

Provided technical support and troubleshooting for ADSL connectivity and customer network issues.

Skills

Toolbox for AI infrastructure work

AI Engineering Focus

vLLMHugging FaceLiteLLMLangfuseLLM APIsmodel servingprompt observabilityAI gateways

Platform & Runtime

KubernetesOpenShiftDockerDocker SwarmLinuxNginxTraefikHAProxyRedisKafka

Secure Delivery

JenkinsGitHub ActionsArgo CDArtifactoryXrayCoverityBlack DuckSonarQubeVault

Automation & Code

GoPythonBashJavaScriptDjangoFlaskFiberCobra CLIJinja

Infrastructure as Code

TerraformVagrantAnsiblePKICertbotLet's EncryptQEMUVMware

Network & Security Foundations

CiscoJuniperNexusF5 LTMF5 ASMFortigateForescout NACWiresharktcpdump

Projects

Selected work

vLLM, Hugging Face, LiteLLM, Langfuse, Kubernetes

AI Platform Lab

Current direction: building hands-on model-serving and LLM gateway labs that connect AI APIs with production-style deployment, routing, observability, and security patterns.

Python

Tufin Cisco Device Updater

Automated Cisco device updates in the Tufin network security platform.

Go, WMI

show, Cisco-like CLI on Windows

Windows application that exposes familiar Cisco-like commands for local system information.

Python, Jinja

Scripter

Cisco IOS configuration generator that reduces repetitive network configuration work.

Go, Git, Bash

Cisco IOS Git Backups

Concurrent Cisco IOS configuration backup workflow that stores current device state in Git.

Django

dj-cfe-tj18 MVP Blog

MVP blog project built with Django.

Education

Certifications and studies

Open University

CS / MBA - 03.2011 - postponed

Tel Aviv-Yafo

Bachelor's studies in Business Administration with a focus on Computer Science.

Cisco

CCNA / CCNP - 05.2009 - 07.2013

Online

Routing and switching, CCNA Security, CCNA, and CCENT foundations.

Microsoft Certifications

MCSA / MCSE 2003 - 03.2008 - 04.2009

Ramat Gan College

Windows Server management, infrastructure, and security settings.

CompTIA

A+ - 07.2007 - 02.2008

Ramat Gan College

IT fundamentals, hardware troubleshooting, operating systems, networking, and customer support.

Languages

Communication

Hebrew

Native

Russian

Native

English

Professional++