Question 1
A team has finished fine-tuning a custom model in the OCI Generative AI service and now wants its application to send inference requests to that custom model. What must the team do to make the custom model callable?
A. Nothing further — custom models become available automatically in the shared on-demand pool alongside the pretrained base models.
Assumes custom models are served like base models on demand. A customer-specific model is served from the customer's own hosting capacity, not the shared pool.
B. Create an endpoint for the custom model on a hosting dedicated AI cluster, and direct application requests to that endpoint.Correct answer
Correct: a custom model is served by creating an endpoint on a hosting dedicated AI cluster, which is the address the application calls for inference.
C. Export the fine-tuned model weights and deploy them onto an OCI Compute GPU instance running an inference server.
Represents the 'you must host the model yourself' misconception. The managed service hosts custom models; weights are not exported for customer-run serving.
D. Send requests to the fine-tuning cluster that produced the model, since that cluster continues to serve it after training completes.
Conflates the two dedicated AI cluster types. A fine-tuning cluster trains the model; serving requires a separate hosting cluster and endpoint.
Explanation
Serving a fine-tuned custom model in the OCI Generative AI service means creating an endpoint on a hosting dedicated AI cluster and pointing the application at that endpoint. Custom models do not appear in the shared on-demand pool that fronts the pretrained base models, so no-action-required is wrong. Exporting weights to self-host on Compute contradicts the managed design of the service, and expecting the fine-tuning cluster to serve traffic conflates the training cluster type with the hosting cluster type.