CreateEndpointRequest: {
    deploymentId: string;
    endpoint: LLMInference.v1beta1.EndpointSpec;
    region?: Region;
}

Type declaration

  • deploymentId: string

    ID of the deployment to create the endpoint for.

  • endpoint: LLMInference.v1beta1.EndpointSpec

    Specification of the endpoint.

  • Optionalregion?: Region

    Region to target. If none is passed will use default region from the config.