Testing and production readiness
Documentation status: guide. Tests are executable contracts; a single successful request is not a readiness guarantee.
Test at the boundaries
| Boundary | Representative contract test |
|---|---|
| Metadata → APPLICATION | Inheritance, resolved classes, fields, actions and visibility |
| APPLICATION → Objects | Creation, property mutation, action discovery and object identity |
| SEMANTIC → H-Logic | Parse, validation, typed relation, commit, provenance and rejection |
| Providers → Datasets | Filters, sorting, pagination, transactions and posting |
| FPL / ABI | Linker resolution, marshaling subset, error and handle release |
| Services / Remote | Configuration, timeout, retries, channel close and callback lifetime |
| Numerical / LLM | Backend availability, fallback, session reset and stale candidate handling |
Prefer small declared fixtures for unit and boundary tests; use complete application packages for smoke tests. The book treats both valid and forbidden transitions as contracts. An extension that compiles but bypasses a validation gate is not a correct implementation.
Minimum observable runtime state
Identify the deployed Runtime build, activated package/model version, service endpoints, selected provider/database, remote channels, queue health and correlation id. Where numerical execution is present, record backend selection and fallback. Expose the shutdown phase (accepting, draining, stopping, stopped). Avoid performance claims without reproducible workload, hardware and measurements.
Production checklist
- [ ] Match each capability to its versioned interface, manifest and platform evidence.
- [ ] Validate prerequisites, required provider, service and endpoint at startup.
- [ ] Define timeouts, idempotence and distinct business/technical failure handling.
- [ ] Observe queues, channels, callbacks, sessions and error correlation.
- [ ] Exercise retry, duplicate, stale-response, shutdown and restart scenarios.
- [ ] Confirm ownership/release and absence of active workers after stop.
Read next
Engineering tests · Operational diagnostics · Reproduction checklist · Evidence and maturity
LaTeX sources: testing-runtime-modules.tex; production-readiness.tex; engine-validation-and-neurosymbolic-test-contracts.tex.