Inference

Using a trained model to make predictions on new data.

---

Inference is the process of applying a trained AI model to unseen data to generate predictions or classifications.

• Examples: Speech recognition, image labeling, text generation.
• Optimization: Batch inference, quantization, hardware acceleration.