What is the request timeout, and can my service stream responses?

Every request to a service must complete within 120 seconds, measured from when Forte receives it to when your service finishes writing the response; if your service hasn't started responding by then, the caller gets a 504.

Responses stream through as your service produces them, so Server-Sent Events, chunked responses, and token-by-token model output work with no configuration — as long as they finish inside the window.

Read more about this in the documentation

Related questions

Still need help?

If this didn't answer your question, our team is one message away.

Contact support