reverse proxy

A reverse proxy is a server that sits in front of backend servers, accepts client requests on their behalf, and relays the responses.

1 articleLast mentioned

A reverse proxy is a server placed between clients and one or more backend servers. It receives client requests, forwards each one to an appropriate backend, and returns the backend's response to the client. It is a standard component of web services and network infrastructure. Unlike a forward proxy, which acts on behalf of clients reaching out to external sites, a reverse proxy acts on behalf of servers, so clients do not need to know the address of the machine that actually handles the request.

Reverse proxies centralize functions such as load balancing across servers, TLS termination, response caching and compression, authentication, rate limiting, and hiding the addresses of internal servers. Widely used implementations include Nginx, HAProxy, Apache HTTP Server, Envoy, Caddy, and Traefik, and content delivery networks also operate as reverse proxies.

In AI systems, an AI gateway follows the same design: a reverse proxy placed in front of the APIs of several model providers handles authentication, usage limits, caching, logging, and request routing.

This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.

Articles covering this entry

  • GPT-6.2 Astra: Cheaper per Task and Strong in 3D, but Not the Top ModelAI News ·

    In his testing, Astra also designed a reverse proxy, a server that routes requests in front of other servers, that saved an estimated $25,000 per month in that…

    Read article

Found a mistake or missing an entry?

Wiki entries are based on AIPOST articles and widely known facts. If an entry is wrong, send us a correction request and we will check and fix it. Names from new articles are added to the wiki after the article is published.