An architectural design for computer systems that break up large aspects of computing functionality into smaller individual functions that can respond individually to requests. These microservices are thereby easier to scale up services as needed, accelerating development of services, making systems more reliable, and allowing features to be added more quickly. Microservices offer a way to operationalize models by providing access to model inference to any user that can query the microservice with the right data, allowing for access to inference on-demand.
Glossary of Artificial Intelligence (AI), Machine Learning (ML), and Big Data Terms
Microservice
