Use a reverse proxy (like Nginx) or a cloud load balancer (like AWS ALB) in a public subnet to accept incoming public traffic. The load balancer then routes requests to the private application servers over a secure internal network.

: From Cool Demos to Production-Ready Systems: Challenges in Deploying Foundation Models

If a secret is committed, consider it compromised.