Cloud & IT Staffing Solutions in Chicago, Boston, Dallas
1

Job Details

Senior Kong AI Gateway Engineer

Current job openings at Peterson Technology Partners
Current job openings at Peterson Technology Partners
Details
  • Req No : 106244
  • Number of Position : 1
  • Priority : High
Location

Chicago, USA

Employment Type
  • Work Authorization Status : greencard, h1b, h4ead, l2ead, opt, uscitizen
  • Duration : 6 months+
  • Location : Remote
Technical Profile
  • Professional Experience : 7-12 years
  • Primary Skills : Kong Gateway, API Management, AI Gateway, Kubernetes
  • Additional Notes : contract

Contact

Anant N Awatare

Anant N Awatare

anant@ptechpartners.com Anant Nagawatare on LinkedIn

Job Description:

Our client is looking for a skilled Kong Administrator / AI Gateway Engineer with experience in API Gateway management, Kong administration, and knowledge on AI/LLM proxy development.   

Required Skills:

  • Kong Gateway (OSS/Enterprise), Kong Konnect
  • API Management & API Lifecycle Management
  • AI Gateway / LLM Proxy Development
  • OpenAI / Azure OpenAI Integration
  • REST APIs, GraphQL
  • OAuth2, JWT, OIDC, API Security
  • Kubernetes, Docker, Helm
  • CI/CD (Jenkins, GitHub Actions, Azure DevOps)
  • Monitoring: Prometheus, Grafana, ELK/Splunk
  • Cloud Platforms: Azure, AWS, or GCP
  • Kong AI Gateway Configuration & Administration
  • LLM Traffic Routing, Load Balancing and Failover Management
  • Prompt Management, Prompt Security and Guardrails
  • AI Security, Responsible AI and Model Governance
  • Token Usage Monitoring, Rate Limiting and Cost Optimization
  • Multi-LLM Integration (OpenAI, Azure OpenAI, Anthropic Claude, Google Gemini, Mistral, Llama)
  • Retrieval-Augmented Generation (RAG) Architecture Concepts
  • Vector Databases
  • LLMOps, AI Observability and Model Performance Monitoring
  • AI API Governance, Compliance and Data Protection
  • Prompt Caching, Semantic Caching and Response Optimization
  • Model Gateway Policy Development and AI Consumption Controls
  • MCP (Model Context Protocol) and AI Agent Integration Concepts
  • GenAI Platform Engineering and Enterprise AI Enablement

Key Responsibilities:

  • Design and implement enterprise-grade AI Gateway solutions using Kong AI Gateway.
  • Configure AI-specific policies including prompt logging, content filtering, token controls, and guardrails.
  • Enable secure access to multiple LLM providers through a unified gateway architecture.
  • Implement AI observability, token analytics, usage tracking, and cost governance.
  • Develop routing strategies across multiple AI models based on latency, cost, and availability.
  • Integrate RAG-based AI services through secure API management frameworks.
  • Ensure compliance with enterprise AI governance, security, and regulatory requirements.
  • Establish AI platform standards, reusable AI APIs, and best practices for GenAI adoption.
  • Support AI agent and MCP-based integrations within enterprise ecosystems.
  • Drive AI platform reliability, scalability, and operational excellence.
  • Configure, administer, and support Kong Gateway environments.
  • Develop and manage AI Gateway proxies for GenAI/LLM services.
  • Implement API security, authentication, throttling, and governance policies.
  • Integrate AI platforms such as Azure OpenAI and OpenAI through secure API gateways.
  • Deploy and manage Kong in Kubernetes-based environments.
  • Monitor, troubleshoot, and optimize gateway performance and availability.
  • Automate deployments and operational processes using DevOps tools.

Experience:

  • 7-12 years of experience in API Management, Middleware, or Platform Engineering.
  • Minimum 3 to 5 years of hands-on experience with Kong Gateway Administration.
  • Experience with cloud-native and microservices architectures preferred.

Salary/Rate: $70-$85/HR (depends on experience level). This is a contract position with candidates expected to work 40 hours/ week.

About Us

Peterson Technology Partners (PTP) is an Equal Opportunity Employer committed to creating a transparent, inclusive, and human-centered hiring experience.

For more than 28 years, PTP has operated as one of the top IT staffing and recruiting firms in the USA—built on trust, long-term partnerships, and technical excellence.

Based in the Chicago suburb of Park Ridge, IL, our team of more than 500 employees and consultants is dedicated to:

  • Helping every client make the best hiring decisions possible
  • Matching professionals with the right IT jobs and career opportunities

As part of that commitment, we believe in providing clear information about how our hiring technologies work and how your data is used. The following section outlines our AI-assisted interview process and your rights as a candidate.

AI-Assisted Interview Experience (Pete & Gabi – Rebecca):

To provide a consistent, fair, and flexible experience for all candidates, we use AI-assisted tools to support parts of the interview process. This includes our proprietary AI platform Pete & Gabi, which includes AI recruiter Rebecca.

These AI hiring tools help us:

  • Conduct recorded video interviews
  • Transcribe interviews
  • Summarize candidate responses
  • Generate job-related insights
  • Streamline communication and scheduling

Please note that:

  • The AI does NOT make hiring decisions; all decisions are made by our human recruiters, hiring managers, or client partners.
  • The AI does not evaluate facial expressions, emotions, or physical traits; it is used only to support fairness, consistency, and efficiency.

If you prefer a non-AI interview format, we will gladly provide an alternative.

Technical or Case Interviews (Role-Dependent): −

When applying for certain tech jobs, you may participate in:

  • A technical interview
  • A coding challenge
  • A case study
  • A client-specific assessment

We will always explain what to expect in advance so you can prepare with confidence.

Human Review & Selection: +

Every candidate’s profile—including interviews, conversations, and assessments—is reviewed by experienced recruiters and hiring leaders.

AI insights may assist with organization and evaluation, but final decisions are always human-driven.

Your Rights as a Candidate: +

At PTP, every candidate has the right to:

  • Request a non-AI interview path
  • Ask how your data is being used
  • Request access to transcripts or interview recordings
  • Request deletion of your AI-recorded interview
  • Receive clear, timely communication

Our goal is to ensure you feel respected, informed, and supported throughout your experience.

Our Commitment: +

For more than 28 years, PTP has focused on putting people first—candidates, consultants, employees, and clients.

We’re committed to a hiring process that is:

  • Transparent
  • Compliant
  • Equitable
  • Powered by innovative technology that enhances—not replaces—human judgment

Welcome to the future of hiring at Peterson Technology Partners.

We’re excited to learn more about you.

Equal Employment Opportunity: +

Peterson Technology Partners is an Equal Opportunity Employer. All qualified applicants will receive consideration without regard to race, color, religion, national origin, gender identity, sexual orientation, disability, veteran status, or any other protected characteristic.

Senior Kong AI Gateway Engineer

Current job openings at Peterson Technology Partners
Current job openings at Peterson Technology Partners
Details
  • Req No : 106244
  • Number of Position : 1
  • Priority : High
Location

Chicago, USA

Employment Type
  • Work Authorization Status : greencard, h1b, h4ead, l2ead, opt, uscitizen
  • Duration : 6 months+
  • Location : Remote
Technical Profile
  • Professional Experience : 7-12 years
  • Primary Skills : Kong Gateway, API Management, AI Gateway, Kubernetes
  • Additional Notes : contract

Contact

Anant N Awatare

Anant N Awatare

anant@ptechpartners.com Anant Nagawatare on LinkedIn

Job Description:

Our client is looking for a skilled Kong Administrator / AI Gateway Engineer with experience in API Gateway management, Kong administration, and knowledge on AI/LLM proxy development.   

Required Skills:

  • Kong Gateway (OSS/Enterprise), Kong Konnect
  • API Management & API Lifecycle Management
  • AI Gateway / LLM Proxy Development
  • OpenAI / Azure OpenAI Integration
  • REST APIs, GraphQL
  • OAuth2, JWT, OIDC, API Security
  • Kubernetes, Docker, Helm
  • CI/CD (Jenkins, GitHub Actions, Azure DevOps)
  • Monitoring: Prometheus, Grafana, ELK/Splunk
  • Cloud Platforms: Azure, AWS, or GCP
  • Kong AI Gateway Configuration & Administration
  • LLM Traffic Routing, Load Balancing and Failover Management
  • Prompt Management, Prompt Security and Guardrails
  • AI Security, Responsible AI and Model Governance
  • Token Usage Monitoring, Rate Limiting and Cost Optimization
  • Multi-LLM Integration (OpenAI, Azure OpenAI, Anthropic Claude, Google Gemini, Mistral, Llama)
  • Retrieval-Augmented Generation (RAG) Architecture Concepts
  • Vector Databases
  • LLMOps, AI Observability and Model Performance Monitoring
  • AI API Governance, Compliance and Data Protection
  • Prompt Caching, Semantic Caching and Response Optimization
  • Model Gateway Policy Development and AI Consumption Controls
  • MCP (Model Context Protocol) and AI Agent Integration Concepts
  • GenAI Platform Engineering and Enterprise AI Enablement

Key Responsibilities:

  • Design and implement enterprise-grade AI Gateway solutions using Kong AI Gateway.
  • Configure AI-specific policies including prompt logging, content filtering, token controls, and guardrails.
  • Enable secure access to multiple LLM providers through a unified gateway architecture.
  • Implement AI observability, token analytics, usage tracking, and cost governance.
  • Develop routing strategies across multiple AI models based on latency, cost, and availability.
  • Integrate RAG-based AI services through secure API management frameworks.
  • Ensure compliance with enterprise AI governance, security, and regulatory requirements.
  • Establish AI platform standards, reusable AI APIs, and best practices for GenAI adoption.
  • Support AI agent and MCP-based integrations within enterprise ecosystems.
  • Drive AI platform reliability, scalability, and operational excellence.
  • Configure, administer, and support Kong Gateway environments.
  • Develop and manage AI Gateway proxies for GenAI/LLM services.
  • Implement API security, authentication, throttling, and governance policies.
  • Integrate AI platforms such as Azure OpenAI and OpenAI through secure API gateways.
  • Deploy and manage Kong in Kubernetes-based environments.
  • Monitor, troubleshoot, and optimize gateway performance and availability.
  • Automate deployments and operational processes using DevOps tools.

Experience:

  • 7-12 years of experience in API Management, Middleware, or Platform Engineering.
  • Minimum 3 to 5 years of hands-on experience with Kong Gateway Administration.
  • Experience with cloud-native and microservices architectures preferred.

Salary/Rate: $70-$85/HR (depends on experience level). This is a contract position with candidates expected to work 40 hours/ week.

About Us

Peterson Technology Partners (PTP) is an Equal Opportunity Employer committed to creating a transparent, inclusive, and human-centered hiring experience.

For more than 28 years, PTP has operated as one of the top IT staffing and recruiting firms in the USA—built on trust, long-term partnerships, and technical excellence.

Based in the Chicago suburb of Park Ridge, IL, our team of more than 500 employees and consultants is dedicated to:

  • Helping every client make the best hiring decisions possible
  • Matching professionals with the right IT jobs and career opportunities

As part of that commitment, we believe in providing clear information about how our hiring technologies work and how your data is used. The following section outlines our AI-assisted interview process and your rights as a candidate.

AI-Assisted Interview Experience (Pete & Gabi – Rebecca):

To provide a consistent, fair, and flexible experience for all candidates, we use AI-assisted tools to support parts of the interview process. This includes our proprietary AI platform Pete & Gabi, which includes AI recruiter Rebecca.

These AI hiring tools help us:

  • Conduct recorded video interviews
  • Transcribe interviews
  • Summarize candidate responses
  • Generate job-related insights
  • Streamline communication and scheduling

Please note that:

  • The AI does NOT make hiring decisions; all decisions are made by our human recruiters, hiring managers, or client partners.
  • The AI does not evaluate facial expressions, emotions, or physical traits; it is used only to support fairness, consistency, and efficiency.

If you prefer a non-AI interview format, we will gladly provide an alternative.

Technical or Case Interviews (Role-Dependent): −

When applying for certain tech jobs, you may participate in:

  • A technical interview
  • A coding challenge
  • A case study
  • A client-specific assessment

We will always explain what to expect in advance so you can prepare with confidence.

Human Review & Selection: +

Every candidate’s profile—including interviews, conversations, and assessments—is reviewed by experienced recruiters and hiring leaders.

AI insights may assist with organization and evaluation, but final decisions are always human-driven.

Your Rights as a Candidate: +

At PTP, every candidate has the right to:

  • Request a non-AI interview path
  • Ask how your data is being used
  • Request access to transcripts or interview recordings
  • Request deletion of your AI-recorded interview
  • Receive clear, timely communication

Our goal is to ensure you feel respected, informed, and supported throughout your experience.

Our Commitment: +

For more than 28 years, PTP has focused on putting people first—candidates, consultants, employees, and clients.

We’re committed to a hiring process that is:

  • Transparent
  • Compliant
  • Equitable
  • Powered by innovative technology that enhances—not replaces—human judgment

Welcome to the future of hiring at Peterson Technology Partners.

We’re excited to learn more about you.

Equal Employment Opportunity: +

Peterson Technology Partners is an Equal Opportunity Employer. All qualified applicants will receive consideration without regard to race, color, religion, national origin, gender identity, sexual orientation, disability, veteran status, or any other protected characteristic.

IT Staffing Firm - PTP