Question 1
A platform team is writing the operational readiness checklist for an **OCI Generative AI Agents** assistant that is about to serve thousands of employees. During the pilot the team judged the assistant purely on whether its answers were correct. A senior architect argues that answer quality alone is an insufficient bar for a production enterprise deployment, and that the checklist must cover concerns the pilot never had to face. Which TWO concerns become materially more important when this agent moves from pilot to production, as opposed to remaining a small internal demo?
A. Keeping the knowledge base synchronized with the underlying enterprise data sources, so that answers reflect current content instead of a stale snapshot ingested at build timeCorrect answer
Correct. A production agent answers continuously against documents that keep changing, so the ingestion of source data into the knowledge base must be maintained on an ongoing basis; a pilot could tolerate a one-time snapshot because it was only exercised briefly.
B. Operating and scaling the agent endpoint that serves user sessions, including its cost and latency behaviour under sustained real-world loadCorrect answer
Correct. In production the agent is consumed through a hosted endpoint that must sustain many concurrent sessions; throughput, latency, and the cost of that traffic are real operational obligations that a handful of demo conversations never surfaces.
C. Retraining the underlying large language model on the company's documents each time those documents change, because retrieval only works on data the model was trained on
Rests on the misconception that retrieval-augmented generation requires retraining the model. The agent retrieves from a knowledge base at request time; keeping content current is an ingestion concern, and no model retraining is involved.
D. Nothing new — a deployed agent behaves exactly like the pilot, so the checklist only needs to re-measure answer accuracy at a larger sample size
Embodies the misconception that a production enterprise agent is no different from a demo. Scale, real users, live data, and audit obligations introduce operational and governance concerns that accuracy sampling does not measure at all.
E. Disabling response monitoring once the pilot demonstrates good answers, since a trusted model no longer needs observation and logging only adds overhead
Claims observability is unnecessary because the model is trusted. Production behaviour drifts as data, users, and question mixes change, and enterprise deployments need traceable records for audit — removing monitoring is the opposite of production readiness.
Explanation
Moving an agent into production changes the problem from 'does it answer well in a demo' to 'can it be operated'. Because OCI Generative AI Agents grounds answers in a knowledge base built by ingesting enterprise data sources, that ingestion has to be kept current or the assistant confidently serves stale content; and because users reach the agent through a hosted agent endpoint, sustained concurrency, latency, and cost become genuine operational obligations. The idea that changed documents require retraining the model misreads retrieval-augmented generation, which consults the knowledge base at request time. Assuming a deployment behaves exactly like the pilot ignores scale, live data, and audit duties, and switching off monitoring because the model performed well removes precisely the evidence a regulated enterprise needs.