Network exposure

A model server must not be exposed directly to the Internet: by default it listens locally and accepts any request without authentication. Place it behind a private network or a proxy with authentication, encryption, and rate limiting, and restrict the open ports.

Example

Listen on 127.0.0.1 or a private network, never on 0.0.0.0 open to the Internet.

Related concepts

The whole glossary