Rate this Page
★ ★ ★ ★ ★
beginner/serving_tutorial

Note

Go to the end to download the full example code.

Serve PyTorch models at scale with Ray Serve#

Author: Ricardo Decal

This tutorial shows how to deploy a PyTorch model using Ray Serve with production-ready features.

What you will learn

  • How to create a production-ready PyTorch model deployment that can scale to thousands of nodes and GPUs

  • How to configure an HTTP endpoint for the deployment using FastAPI

  • Enable dynamic request batching for higher throughput

  • Configure autoscaling and per-replica CPU/GPU resource allocation

  • Load test the service with concurrent requests and monitor it with the Ray dashboard

  • How Ray Serve deployments can self-heal from failures

  • Ray Serve’s advanced features like model multiplexing and model composition.

Prerequisites

  • PyTorch v2.9+ and torchvision

  • Ray Serve (ray[serve]) v2.52.1+

  • A GPU is recommended for higher throughput but is not required

Ray Serve is a scalable framework for serving machine learning models in production. It’s built on top of Ray, which is a unified framework for scaling AI and Python applications that simplifies the complexities of distributed computing. Ray is also open source and part of the PyTorch Foundation.

Setup#

To install the dependencies, run:

pip install "ray[serve]" torch torchvision

Start by importing the required libraries:

import asyncio
import time
from typing import Any

from fastapi import FastAPI
from pydantic import BaseModel
import aiohttp
import numpy as np
import torch
import torch.nn as nn
from ray import serve
from torchvision.transforms import v2

Define a PyTorch model#

Define a simple convolutional neural network for the MNIST digit classification dataset:

class MNISTNet(nn.Module):
    def __init__(self):
        super().__init__()
        self.conv1 = nn.Conv2d(1, 32, 3, 1)
        self.dropout1 = nn.Dropout(0.25)
        self.conv2 = nn.Conv2d(32, 64, 3, 1)
        self.fc1 = nn.Linear(9216, 128)
        self.dropout2 = nn.Dropout(0.5)
        self.fc2 = nn.Linear(128, 10)

    def forward(self, x):
        x = self.conv1(x)
        x = nn.functional.relu(x)
        x = self.conv2(x)
        x = nn.functional.relu(x)
        x = nn.functional.max_pool2d(x, 2)
        x = self.dropout1(x)
        x = torch.flatten(x, 1)
        x = self.fc1(x)
        x = nn.functional.relu(x)
        x = self.dropout2(x)
        x = self.fc2(x)
        return nn.functional.log_softmax(x, dim=1)

Define the Ray Serve deployment#

To deploy this model with Ray Serve, wrap the model in a Python class and decorate it with @serve.deployment.

Processing requests in batches is more efficient than processing requests one by one, especially when using GPUs. Ray Serve provides built-in support for dynamic request batching, where individual incoming requests are opportunistically batched. Enable dynamic batching using the @serve.batch decorator as shown in the following code:

app = FastAPI()

class ImageRequest(BaseModel):  # Used for request validation and generating API documentation
    image: list[list[float]] | list[list[list[float]]]  # 2D or 3D array

@serve.deployment
@serve.ingress(app)
class MNISTClassifier:
    def __init__(self):
        self.device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
        self.model = MNISTNet().to(self.device)
        # Define the transformation pipeline for the input images.
        self.transform = v2.Compose([
            v2.ToImage(),
            v2.ToDtype(torch.float32, scale=True),
            # Mean and standard deviation of the MNIST training subset.
            v2.Normalize(mean=[0.1307], std=[0.3013]),
        ])

        self.model.eval()

    # batch_wait_timeout_s is the maximum time to wait for a full batch,
    # trading off latency for throughput.
    @serve.batch(max_batch_size=128, batch_wait_timeout_s=0.1)
    async def predict_batch(self, images: list[np.ndarray]) -> list[dict[str, Any]]:
        # Stack all images into a single tensor.
        batch_tensor = torch.cat([
            self.transform(img).unsqueeze(0)
            for img in images
        ]).to(self.device).float()

        # Single forward pass on the entire batch at once.
        with torch.no_grad():
            logits = self.model(batch_tensor)
            predictions = torch.argmax(logits, dim=1).cpu().numpy()

        # Unbatch the results and preserve their original order.
        return [
            {
                "predicted_label": int(pred),
                "logits": logit.cpu().numpy().tolist()
            }
            for pred, logit in zip(predictions, logits)
        ]

    @app.post("/")
    async def handle_request(self, request: ImageRequest):
        """Handle an incoming HTTP request using FastAPI.

        Inputs are automatically validated using the Pydantic model.
        """
        # Process the single request.
        image_array = np.array(request.image)

        # Ray Serve's @serve.batch automatically batches requests.
        result = await self.predict_batch(image_array)

        return result

This is a FastAPI app, which extends Ray Serve with features like automatic request validation with Pydantic, auto-generated OpenAPI-style API documentation, and more.

Configure autoscaling and resource allocation#

In production, traffic can vary significantly. Ray Serve’s autoscaling feature automatically adjusts the number of replicas based on traffic load, ensuring you have enough capacity during peaks while saving resources during quiet periods. Ray Serve scales to very large deployments with thousands of nodes and replicas.

You can also specify resource allocation per replica, such as the number of CPUs or GPUs. Ray Serve handles the orchestration of these resources across your cluster. Ray also supports fractional GPUs, allowing multiple replicas to share a single GPU when models are small enough to fit in memory together.

The following is a sample configuration with autoscaling and resource allocation:

num_cpus_per_replica = 1
num_gpus_per_replica = 1  # Set to 0 to run the model on CPUs instead of GPUs.
mnist_app = MNISTClassifier.options(
    autoscaling_config={
        "target_ongoing_requests": 50,  # Target 50 ongoing requests per replica.
        "min_replicas": 1,              # Keep at least 1 replica alive.
        "max_replicas": 80,             # Scale up to 80 replicas to maintain target_ongoing_requests.
        "upscale_delay_s": 5,           # Wait 5s before scaling up.
        "downscale_delay_s": 30,        # Wait 30s before scaling down.
    },
    # Max invocations to handle_request per replica to process simultaneously.
    # Requests exceeding this limit are queued by the router until capacity is available.
    max_ongoing_requests=200,
    # Max queue size for requests that exceed max_ongoing_requests.
    # If the queue is full, future requests are backpressured with errors until space is available.
    # -1 means the queue can grow until cluster memory is exhausted.
    max_queued_requests=-1,
    # Set the resources per replica.
    ray_actor_options={"num_cpus": num_cpus_per_replica, "num_gpus": num_gpus_per_replica}
).bind()

The app is ready to deploy. Suppose you ran this on a cluster of 10 machines, each with 4 GPUs. With num_gpus=0.5, Ray schedules 2 replicas per GPU, giving you 80 replicas across the cluster. This configuration permits the deployment to elastically scale up to 80 replicas as needed to handle traffic spikes and scale back down to 1 replica when traffic subsides.

Test the endpoint with concurrent requests#

To deploy the app, use the serve.run function:

# Start the Ray Serve application.
handle = serve.run(mnist_app, name="mnist_classifier")

2026-02-25 21:18:56,678 WARNING services.py:2137 -- WARNING: The object store is using /tmp instead of /dev/shm because /dev/shm has only 2147471360 bytes available. This will harm performance! You may be able to free up space by deleting files in /dev/shm. If you are inside a Docker container, you can increase /dev/shm size by passing '--shm-size=10.24gb' to 'docker run' (or add it to the run_options list in a Ray cluster config). Make sure to set this to more than 30% of available RAM.
2026-02-25 21:18:56,857 INFO worker.py:2014 -- Started a local Ray instance. View the dashboard at 127.0.0.1:8265
/usr/local/lib/python3.10/dist-packages/ray/_private/worker.py:2062: FutureWarning:

Tip: In future versions of Ray, Ray will no longer override accelerator visible devices env var if num_gpus=0 or num_gpus=None (default). To enable this behavior and turn off this error message, set RAY_ACCEL_ENV_VAR_OVERRIDE_ON_ZERO=0

(ProxyActor pid=4559) INFO 2026-02-25 21:18:59,411 proxy 172.17.0.2 -- Proxy starting on node 02d63a70d2ce4aba475e37b41588b24ed6c8db911dfea1d9d4a3ce6a (HTTP port: 8000).
INFO 2026-02-25 21:18:59,478 serve 3865 -- Started Serve in namespace "serve".
(ServeController pid=4556) INFO 2026-02-25 21:18:59,485 controller 4556 -- Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
(ServeController pid=4556) INFO 2026-02-25 21:18:59,486 controller 4556 -- Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
(ProxyActor pid=4559) INFO 2026-02-25 21:18:59,475 proxy 172.17.0.2 -- Got updated endpoints: {}.
(ProxyActor pid=4559) INFO 2026-02-25 21:18:59,489 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
(ProxyActor pid=4559) INFO 2026-02-25 21:18:59,495 proxy 172.17.0.2 -- Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x7fee9c1200a0>.
(ServeController pid=4556) INFO 2026-02-25 21:18:59,590 controller 4556 -- Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
(ProxyActor pid=4559) INFO 2026-02-25 21:19:03,309 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=['/', '/docs', '/docs/oauth2-redirect', '/openapi.json', '/redoc'])}.
INFO 2026-02-25 21:19:03,500 serve 3865 -- Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

You will see output similar to:

Started Serve in namespace "serve".
Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
Proxy starting on node ... (HTTP port: 8000).
Got updated endpoints: {}.
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x73a53c52c250>.
Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=['/', '/docs', '/docs/oauth2-redirect', '/openapi.json', '/redoc'])}.
Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

The app is now listening for requests on port 8000.

To test the deployment, you can send many requests concurrently using aiohttp. The following code demonstrates how to send 1000 concurrent requests to the app:

async def send_single_request(session, url, data):
    async with session.post(url, json=data) as response:
        return await response.json()

async def send_concurrent_requests(num_requests):
    image = np.random.rand(28, 28).tolist()

    print(f"Sending {num_requests} concurrent requests...")
    async with aiohttp.ClientSession() as session:
        tasks = [
            send_single_request(session, url="http://localhost:8000/", data={"image": image})
            for _ in range(num_requests)
        ]
        responses = await asyncio.gather(*tasks)

    return responses

# Run the concurrent requests.
start_time = time.time()
responses = asyncio.run(send_concurrent_requests(1000))
elapsed = time.time() - start_time

print(f"Processed {len(responses)} requests in {elapsed:.2f} seconds")
print(f"Throughput: {len(responses)/elapsed:.2f} requests/second")

Sending 1000 concurrent requests...
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,708 mnist_classifier_MNISTClassifier jbr5utsh 14355a8a-d077-4337-bedf-d804bb838e4a -- POST / 200 538.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,713 mnist_classifier_MNISTClassifier jbr5utsh e0c6f274-f351-4d14-905c-af56c56b9d35 -- POST / 200 542.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,715 mnist_classifier_MNISTClassifier jbr5utsh 0ce7f119-fba5-453d-b6a6-59dc1a063650 -- POST / 200 560.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,715 mnist_classifier_MNISTClassifier jbr5utsh 10cbc69d-107e-4220-bea9-d0d96f7a7d36 -- POST / 200 547.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,716 mnist_classifier_MNISTClassifier jbr5utsh 596f1206-496d-457b-98d0-622667502511 -- POST / 200 543.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,718 mnist_classifier_MNISTClassifier jbr5utsh cc97aad4-db85-43d3-bac6-99df3aefdd02 -- POST / 200 537.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,719 mnist_classifier_MNISTClassifier jbr5utsh acbc1fe2-3589-492a-ba40-e91eedc96aa8 -- POST / 200 533.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,722 mnist_classifier_MNISTClassifier jbr5utsh 3314f706-ad15-4561-873d-ae0a51a6b1c8 -- POST / 200 534.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,726 mnist_classifier_MNISTClassifier jbr5utsh 35259f2f-da31-4db8-83b8-0a1aa06bbe1f -- POST / 200 535.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,728 mnist_classifier_MNISTClassifier jbr5utsh 95cb4f8b-fc40-4a4b-b021-1ce0eb791af7 -- POST / 200 534.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,730 mnist_classifier_MNISTClassifier jbr5utsh ec45f04a-c8e1-4b03-90a1-df07242c2cb5 -- POST / 200 536.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,730 mnist_classifier_MNISTClassifier jbr5utsh 027238d8-35c9-4904-8ff9-0530922ca149 -- POST / 200 534.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,731 mnist_classifier_MNISTClassifier jbr5utsh 254c5d41-1422-4074-a601-41a6cfc0095f -- POST / 200 534.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,731 mnist_classifier_MNISTClassifier jbr5utsh d294f49a-bc0d-4fdc-ba5b-fc7a71afda60 -- POST / 200 533.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,732 mnist_classifier_MNISTClassifier jbr5utsh a1890cf4-bc8c-4be4-ada1-5971b40b55fe -- POST / 200 533.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,732 mnist_classifier_MNISTClassifier jbr5utsh 2b91b92b-f80e-4a66-86ea-843c8f32cd10 -- POST / 200 529.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,733 mnist_classifier_MNISTClassifier jbr5utsh 8f5a547f-894c-436e-8860-2931b70b06d9 -- POST / 200 530.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,734 mnist_classifier_MNISTClassifier jbr5utsh 34efe93d-bbb1-4dc2-bd94-57ac6478ccf9 -- POST / 200 527.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,734 mnist_classifier_MNISTClassifier jbr5utsh 2b95b766-3925-4b63-833b-707126ab0918 -- POST / 200 528.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,735 mnist_classifier_MNISTClassifier jbr5utsh f64e11c9-2c3e-4594-97fb-296ffb16ef60 -- POST / 200 527.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,736 mnist_classifier_MNISTClassifier jbr5utsh 3385d3a4-faf7-4c2b-ad83-ac4c5335143a -- POST / 200 527.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,737 mnist_classifier_MNISTClassifier jbr5utsh 05fac6ec-0706-4c8f-8bfa-c97fd1f6690d -- POST / 200 528.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,867 mnist_classifier_MNISTClassifier jbr5utsh 37c09f82-b379-44d1-82c9-83548a149251 -- POST / 200 657.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,868 mnist_classifier_MNISTClassifier jbr5utsh 92bb154f-6496-4503-bc57-7393b0701d90 -- POST / 200 654.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,868 mnist_classifier_MNISTClassifier jbr5utsh 35d0b5f8-d7ed-4b2e-b8ad-a7dc13f62a03 -- POST / 200 654.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,868 mnist_classifier_MNISTClassifier jbr5utsh 5ac31603-18f2-468c-abe4-f8a2a9f33ebf -- POST / 200 654.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,869 mnist_classifier_MNISTClassifier jbr5utsh 4293788e-4f0a-453a-8ad3-25d84c41dd06 -- POST / 200 654.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,869 mnist_classifier_MNISTClassifier jbr5utsh c1ee3e8c-fa5d-4bcb-b9b7-8ecb180f4349 -- POST / 200 654.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,869 mnist_classifier_MNISTClassifier jbr5utsh 07c07ba6-0b2a-4a8c-a7df-c1712e80e8af -- POST / 200 653.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,869 mnist_classifier_MNISTClassifier jbr5utsh f59d18cc-b917-4286-9b87-f1833231a751 -- POST / 200 651.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,870 mnist_classifier_MNISTClassifier jbr5utsh 62ea2e90-0250-4f24-a832-46d5bb661ff2 -- POST / 200 650.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,870 mnist_classifier_MNISTClassifier jbr5utsh 9c7fe8a1-40b5-4c9d-bf2f-45027091e2a6 -- POST / 200 647.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,870 mnist_classifier_MNISTClassifier jbr5utsh 9fc1d19b-b549-4de0-ab20-dc98d3e0b26a -- POST / 200 647.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,871 mnist_classifier_MNISTClassifier jbr5utsh cfb83d49-31e9-4ac7-9d7f-e76d27a17c45 -- POST / 200 646.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,871 mnist_classifier_MNISTClassifier jbr5utsh bb4ccf12-14c7-496e-b78e-89285b4fa41d -- POST / 200 645.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,871 mnist_classifier_MNISTClassifier jbr5utsh 1bf36745-f616-4f0a-ba70-e2f95c466dd5 -- POST / 200 645.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,872 mnist_classifier_MNISTClassifier jbr5utsh 7721edab-f6bd-445a-b513-19913d3f5275 -- POST / 200 641.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,872 mnist_classifier_MNISTClassifier jbr5utsh 7b119b37-0e55-4de9-ac63-ec5873c4ec6a -- POST / 200 645.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,872 mnist_classifier_MNISTClassifier jbr5utsh 1fd5aedd-78d1-4c47-be7c-03a41a1890e2 -- POST / 200 639.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,872 mnist_classifier_MNISTClassifier jbr5utsh 47187d52-afb8-438a-b5e3-8fa329389ca9 -- POST / 200 639.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,873 mnist_classifier_MNISTClassifier jbr5utsh aaaafad9-968f-48c1-97cf-6a387e28f916 -- POST / 200 636.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,873 mnist_classifier_MNISTClassifier jbr5utsh 08ea73f5-d9fa-48f9-ba0a-2f30e43086e1 -- POST / 200 639.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,873 mnist_classifier_MNISTClassifier jbr5utsh 2efbfc37-2367-49d3-8e7b-19070851711a -- POST / 200 639.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,874 mnist_classifier_MNISTClassifier jbr5utsh 0a5eba33-c2b5-400e-bc4c-6787dd703bfb -- POST / 200 636.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,874 mnist_classifier_MNISTClassifier jbr5utsh c732081c-7a16-49be-a41c-a762f1b27d8d -- POST / 200 636.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,874 mnist_classifier_MNISTClassifier jbr5utsh 4270831e-c3ac-422c-94ec-6b53d05b9d9f -- POST / 200 639.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,875 mnist_classifier_MNISTClassifier jbr5utsh ecf277e9-da3b-45f8-b15d-e42efae04fb4 -- POST / 200 636.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,875 mnist_classifier_MNISTClassifier jbr5utsh 8daf02aa-6829-4e63-b28c-034119f2da7a -- POST / 200 634.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,875 mnist_classifier_MNISTClassifier jbr5utsh 962022ee-e451-446b-9d2a-5a1b4f22dbe7 -- POST / 200 634.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,876 mnist_classifier_MNISTClassifier jbr5utsh b5a63643-3679-40c9-afa4-5f16e7309fbb -- POST / 200 629.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,877 mnist_classifier_MNISTClassifier jbr5utsh 30b8afa3-b80d-46bf-be60-c877ae425a3e -- POST / 200 630.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,877 mnist_classifier_MNISTClassifier jbr5utsh c5716599-396a-4a61-a3cf-d75eb2cc6e9d -- POST / 200 623.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,878 mnist_classifier_MNISTClassifier jbr5utsh a804a869-0f8a-46d5-a87c-702c36386711 -- POST / 200 630.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,878 mnist_classifier_MNISTClassifier jbr5utsh d3637a7a-e5af-4bb4-97e8-6ac7b64033e7 -- POST / 200 628.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,878 mnist_classifier_MNISTClassifier jbr5utsh 3fc13034-a92a-49e3-af03-3eb321acb124 -- POST / 200 625.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,879 mnist_classifier_MNISTClassifier jbr5utsh 066b7672-46a7-4f91-a1dc-3dcf82a6e16a -- POST / 200 625.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,879 mnist_classifier_MNISTClassifier jbr5utsh 2cf1886b-87fb-4d26-b841-80f654f1d53e -- POST / 200 625.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,882 mnist_classifier_MNISTClassifier jbr5utsh 0d63a9bc-5f76-4de4-8776-aa5687453a26 -- POST / 200 499.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,883 mnist_classifier_MNISTClassifier jbr5utsh f8b981ec-5a5a-43e0-be37-29783a770e68 -- POST / 200 501.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,965 mnist_classifier_MNISTClassifier jbr5utsh be5bf761-9068-4548-a832-da601c1c2c39 -- POST / 200 579.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,969 mnist_classifier_MNISTClassifier jbr5utsh 0cc7f056-063e-4903-93f0-3e91707141e0 -- POST / 200 583.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,969 mnist_classifier_MNISTClassifier jbr5utsh 8b33239b-9783-4e9b-a2dd-be67e2b82dbf -- POST / 200 583.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,970 mnist_classifier_MNISTClassifier jbr5utsh 8c48d45a-8317-458d-9fba-acf4c71ea76d -- POST / 200 584.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,974 mnist_classifier_MNISTClassifier jbr5utsh c7705b0f-c9d3-4e27-95b6-100843e0fcef -- POST / 200 587.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,976 mnist_classifier_MNISTClassifier jbr5utsh a415881d-4412-4144-9a58-667e4d21131c -- POST / 200 587.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,976 mnist_classifier_MNISTClassifier jbr5utsh 2497e5f0-4b57-40b8-ae1f-bef79a31d9fd -- POST / 200 589.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,977 mnist_classifier_MNISTClassifier jbr5utsh e1e155d4-17fd-4193-9a09-58480ede675c -- POST / 200 583.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,978 mnist_classifier_MNISTClassifier jbr5utsh 5ee8c307-5739-4ce0-a7c2-387ad8c81d00 -- POST / 200 588.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,979 mnist_classifier_MNISTClassifier jbr5utsh 55164a42-6a84-46be-b2eb-560c76b69936 -- POST / 200 586.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,985 mnist_classifier_MNISTClassifier jbr5utsh e88194ea-b05d-4cea-b733-c179ef845ba2 -- POST / 200 592.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,987 mnist_classifier_MNISTClassifier jbr5utsh 4e38ba3e-163d-460e-8d75-30c44ca263e0 -- POST / 200 593.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,990 mnist_classifier_MNISTClassifier jbr5utsh e91db8c2-77f2-4b1d-a473-c3e8766f12a2 -- POST / 200 594.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,990 mnist_classifier_MNISTClassifier jbr5utsh 22b59ae7-524b-46e0-9deb-93ec83b92dc3 -- POST / 200 594.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,990 mnist_classifier_MNISTClassifier jbr5utsh b4935b40-fee3-4531-8388-f19d9bf7b65a -- POST / 200 593.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,991 mnist_classifier_MNISTClassifier jbr5utsh dd77a301-6564-4751-b4c2-045e872eeb61 -- POST / 200 593.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,991 mnist_classifier_MNISTClassifier jbr5utsh 227feee3-abb5-4ebd-b452-8be64e8e192b -- POST / 200 593.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,991 mnist_classifier_MNISTClassifier jbr5utsh eb5615e8-3c8a-4f5b-bccb-f57ac73e2391 -- POST / 200 592.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,992 mnist_classifier_MNISTClassifier jbr5utsh 64c21771-b18b-40dc-8ed6-38eb60ea366a -- POST / 200 592.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,993 mnist_classifier_MNISTClassifier jbr5utsh 003d6a68-cd3e-4c83-8168-d2921389ad6c -- POST / 200 592.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,993 mnist_classifier_MNISTClassifier jbr5utsh 25af3074-c790-4b6e-8f74-506f62a01325 -- POST / 200 592.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,994 mnist_classifier_MNISTClassifier jbr5utsh 8eea5ebf-e759-4652-bc4b-478a174bcb20 -- POST / 200 591.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,998 mnist_classifier_MNISTClassifier jbr5utsh b88a22b8-be7b-474f-a163-64a1dc27f0b0 -- POST / 200 595.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,999 mnist_classifier_MNISTClassifier jbr5utsh 17c7a0fd-022d-45b0-a6d6-cd1d336a9025 -- POST / 200 595.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,999 mnist_classifier_MNISTClassifier jbr5utsh 0b7e45e3-ee0c-4c89-845c-2c92c1cfadaa -- POST / 200 594.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:04,999 mnist_classifier_MNISTClassifier jbr5utsh cd6fa323-0cd0-4cfa-aac9-b60d2df83535 -- POST / 200 594.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,000 mnist_classifier_MNISTClassifier jbr5utsh 6c1db297-b115-426c-a1bc-22f84053b1f4 -- POST / 200 594.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,000 mnist_classifier_MNISTClassifier jbr5utsh eeca5337-91f8-4118-83f3-738409f21e15 -- POST / 200 594.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,001 mnist_classifier_MNISTClassifier jbr5utsh a7096721-0f2c-45b0-b8c6-2bb9b8d8c6ed -- POST / 200 594.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,001 mnist_classifier_MNISTClassifier jbr5utsh 977ef292-0ae5-45f3-9a3a-b976c2f040d5 -- POST / 200 594.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,002 mnist_classifier_MNISTClassifier jbr5utsh 510e2ff6-ea91-4e10-a639-639b7b27f039 -- POST / 200 593.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,003 mnist_classifier_MNISTClassifier jbr5utsh ed686f6e-4a4c-474c-9b25-19a8ba5e26ca -- POST / 200 593.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,003 mnist_classifier_MNISTClassifier jbr5utsh 2c7ee9c0-fc85-4c59-ac2a-d39f446293ec -- POST / 200 592.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,003 mnist_classifier_MNISTClassifier jbr5utsh dd5ba530-fc49-435c-8812-95cdf009de4d -- POST / 200 592.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,004 mnist_classifier_MNISTClassifier jbr5utsh 4623cf6b-688e-446b-a600-a5938a8831af -- POST / 200 592.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,005 mnist_classifier_MNISTClassifier jbr5utsh 28e3bcbd-5223-474c-b5c7-36e96ed862c3 -- POST / 200 592.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,005 mnist_classifier_MNISTClassifier jbr5utsh 2a5bde12-c2bb-4566-b829-8f50e758a80b -- POST / 200 592.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,005 mnist_classifier_MNISTClassifier jbr5utsh bbab27e4-38b9-4ec6-a0cb-bfccd98f62e2 -- POST / 200 592.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,006 mnist_classifier_MNISTClassifier jbr5utsh 9230efff-8226-41f7-932c-2addc75e5cac -- POST / 200 592.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,006 mnist_classifier_MNISTClassifier jbr5utsh de60967d-049b-4af9-a96b-fbd5e14465ec -- POST / 200 591.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,006 mnist_classifier_MNISTClassifier jbr5utsh 12315c46-5831-4d9f-8afd-9512f5118ae9 -- POST / 200 590.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,007 mnist_classifier_MNISTClassifier jbr5utsh dc5f6f57-aef1-4f29-a353-0ed812ab1c96 -- POST / 200 280.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,008 mnist_classifier_MNISTClassifier jbr5utsh 4c40c23e-8c43-4ab1-a915-40304eb81491 -- POST / 200 281.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,009 mnist_classifier_MNISTClassifier jbr5utsh b76d59ed-f0d8-4fdc-bfba-663161e62849 -- POST / 200 281.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,010 mnist_classifier_MNISTClassifier jbr5utsh 551cf7b0-67d1-4d17-bbea-901e3c4d3ea3 -- POST / 200 282.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,010 mnist_classifier_MNISTClassifier jbr5utsh 3402c98f-199b-4626-832d-2dfd2746baba -- POST / 200 282.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,012 mnist_classifier_MNISTClassifier jbr5utsh d87b2e32-fce9-4578-b3e8-b3884ad9a429 -- POST / 200 274.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,012 mnist_classifier_MNISTClassifier jbr5utsh 0f4e669f-6297-4742-8189-e08e07f3f415 -- POST / 200 272.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,015 mnist_classifier_MNISTClassifier jbr5utsh fe3a3f1f-980d-4dfa-a94d-29fee2743f98 -- POST / 200 275.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,017 mnist_classifier_MNISTClassifier jbr5utsh 7d30aa58-3d58-4ad9-ac65-6e2baf31270c -- POST / 200 269.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,018 mnist_classifier_MNISTClassifier jbr5utsh c703285e-0019-47c4-b080-844c9a616894 -- POST / 200 268.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,018 mnist_classifier_MNISTClassifier jbr5utsh cd2bbc1e-d951-4237-aece-eea3dece07f9 -- POST / 200 268.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,018 mnist_classifier_MNISTClassifier jbr5utsh 3046b18d-69dc-4d9f-baf4-18721af5f108 -- POST / 200 268.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,020 mnist_classifier_MNISTClassifier jbr5utsh 780a1742-e128-4630-af77-0fb1df21cfad -- POST / 200 269.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,021 mnist_classifier_MNISTClassifier jbr5utsh 64c538a9-b029-4a1c-b8f2-ced205b74c23 -- POST / 200 270.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,021 mnist_classifier_MNISTClassifier jbr5utsh bf36bdb1-8003-4eab-b6cc-043f8894b557 -- POST / 200 269.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,023 mnist_classifier_MNISTClassifier jbr5utsh 72f04bb6-cfda-4e90-97f3-44a1ebabdea6 -- POST / 200 265.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,023 mnist_classifier_MNISTClassifier jbr5utsh 69a0f5f7-e89e-4d4e-b794-88282c5b5fd9 -- POST / 200 264.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,024 mnist_classifier_MNISTClassifier jbr5utsh b39f241d-2df2-432d-8f4d-3c63d79c4eeb -- POST / 200 255.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,024 mnist_classifier_MNISTClassifier jbr5utsh 491ae947-5592-4ea5-af33-a715ccc2a8c8 -- POST / 200 255.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,024 mnist_classifier_MNISTClassifier jbr5utsh e3226263-4a05-4781-8c12-be50093a5b9e -- POST / 200 253.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,024 mnist_classifier_MNISTClassifier jbr5utsh 18f0e010-def0-42d6-9a44-b03fd886d40c -- POST / 200 250.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,025 mnist_classifier_MNISTClassifier jbr5utsh 30556a8d-de6d-45fb-9ee5-853ca3cf3780 -- POST / 200 250.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,025 mnist_classifier_MNISTClassifier jbr5utsh bd180be4-ca92-4de0-a253-9746544b8d60 -- POST / 200 181.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,109 mnist_classifier_MNISTClassifier jbr5utsh 82b7aa13-6a72-4f0f-bb1e-101766e5fb3d -- POST / 200 265.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,125 mnist_classifier_MNISTClassifier jbr5utsh bee028ae-7533-4a30-8d72-74bb4603ff0e -- POST / 200 279.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,125 mnist_classifier_MNISTClassifier jbr5utsh 1fc6ba34-2aa8-4aa4-8e87-3dff55af5a98 -- POST / 200 234.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,127 mnist_classifier_MNISTClassifier jbr5utsh ef5a5f01-edff-4b31-90b8-5f168e9ff084 -- POST / 200 276.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,127 mnist_classifier_MNISTClassifier jbr5utsh 8675482d-d4ca-4cec-8545-37ee162291eb -- POST / 200 260.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,127 mnist_classifier_MNISTClassifier jbr5utsh c7c1a48d-acde-490d-9403-0a93f7439dca -- POST / 200 241.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,128 mnist_classifier_MNISTClassifier jbr5utsh 9b1e47a5-7a78-4ed8-b444-f4486cb1c32d -- POST / 200 240.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,128 mnist_classifier_MNISTClassifier jbr5utsh 547f46ba-fb9e-4239-967b-e98af95b7673 -- POST / 200 240.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,129 mnist_classifier_MNISTClassifier jbr5utsh 8eb8f511-7baf-4990-93b9-eab13efc62cc -- POST / 200 240.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,130 mnist_classifier_MNISTClassifier jbr5utsh 2c2be990-bf06-489e-a882-a892dd1a5494 -- POST / 200 240.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,130 mnist_classifier_MNISTClassifier jbr5utsh 36135742-5c4d-4eb5-b7b9-37b918695230 -- POST / 200 239.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,130 mnist_classifier_MNISTClassifier jbr5utsh 1a4abe2a-a6f6-4d4b-afa2-5d806a1f06f7 -- POST / 200 236.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,130 mnist_classifier_MNISTClassifier jbr5utsh 0c65e52d-16ba-4f34-a76a-792b418db9b8 -- POST / 200 236.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,131 mnist_classifier_MNISTClassifier jbr5utsh fca50317-0bf5-4bf6-8e62-a505cbd6e09a -- POST / 200 236.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,133 mnist_classifier_MNISTClassifier jbr5utsh 57c1d7cf-744c-4b88-a489-df5357a5d56b -- POST / 200 237.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,133 mnist_classifier_MNISTClassifier jbr5utsh b6acc2d2-e641-4b8f-9676-4dbba9b69a5e -- POST / 200 237.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,133 mnist_classifier_MNISTClassifier jbr5utsh d3136684-6f5e-44ec-be27-db27c37d828c -- POST / 200 237.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,134 mnist_classifier_MNISTClassifier jbr5utsh e72df403-885d-4eaf-acf0-6bcfa629bb85 -- POST / 200 229.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,134 mnist_classifier_MNISTClassifier jbr5utsh 91dd0483-fbe3-483b-b97e-8ccd823bc137 -- POST / 200 232.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,134 mnist_classifier_MNISTClassifier jbr5utsh c7182438-7238-4670-9b74-d3def2177e74 -- POST / 200 233.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,135 mnist_classifier_MNISTClassifier jbr5utsh 0cc2d42d-a7cd-42e9-b8c5-f5dc3294dcfb -- POST / 200 231.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,135 mnist_classifier_MNISTClassifier jbr5utsh 771ce574-8090-4c78-aa66-1bd4b9338f1f -- POST / 200 231.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,135 mnist_classifier_MNISTClassifier jbr5utsh f2d1ff34-291a-4a2b-9c6b-a211fb84ca06 -- POST / 200 229.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,135 mnist_classifier_MNISTClassifier jbr5utsh 1ef4bfb7-704e-4054-993a-7378dcb2263b -- POST / 200 229.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,135 mnist_classifier_MNISTClassifier jbr5utsh d3e43b83-4b4b-4175-857d-f21284b39bd0 -- POST / 200 227.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,135 mnist_classifier_MNISTClassifier jbr5utsh ff30d499-96a3-4ec3-9edb-90c327ba43c1 -- POST / 200 227.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,136 mnist_classifier_MNISTClassifier jbr5utsh 78cdbe22-0f2d-4b86-a895-63b5ece69c72 -- POST / 200 227.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,136 mnist_classifier_MNISTClassifier jbr5utsh b2853cdd-dcb1-46c3-a42d-e7b35e8ffcb4 -- POST / 200 222.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,136 mnist_classifier_MNISTClassifier jbr5utsh 0ecd2542-797c-40c9-b890-df892427ac90 -- POST / 200 217.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,137 mnist_classifier_MNISTClassifier jbr5utsh 60d35112-981d-465d-bcc6-8936524f0e37 -- POST / 200 223.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,141 mnist_classifier_MNISTClassifier jbr5utsh b6013c0e-b0d8-45b7-be80-4c7ea247f1b2 -- POST / 200 220.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,142 mnist_classifier_MNISTClassifier jbr5utsh 4fb2f0c7-f4c9-4bfc-8ade-31c3b7f7bddc -- POST / 200 224.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,143 mnist_classifier_MNISTClassifier jbr5utsh 5e84ba20-8df3-4487-8108-912beb75e4c6 -- POST / 200 217.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,143 mnist_classifier_MNISTClassifier jbr5utsh 8de550c6-61e2-441a-a8ec-a2aba5ea9f67 -- POST / 200 216.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,144 mnist_classifier_MNISTClassifier jbr5utsh 86f8c1e3-e2b2-470a-93fd-e1905cca83a2 -- POST / 200 211.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,145 mnist_classifier_MNISTClassifier jbr5utsh 268178c4-877e-4d7a-975a-b78926dcbb33 -- POST / 200 210.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,252 mnist_classifier_MNISTClassifier jbr5utsh 89f65bf3-1a39-4690-b421-f30643275839 -- POST / 200 253.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,254 mnist_classifier_MNISTClassifier jbr5utsh ccda1103-6b37-4d60-ba55-e8bdfc16b7eb -- POST / 200 251.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,255 mnist_classifier_MNISTClassifier jbr5utsh feea82c7-1517-4188-86b6-762e49e4aea3 -- POST / 200 252.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,255 mnist_classifier_MNISTClassifier jbr5utsh 68618a5b-5054-41e7-9d0d-e99b29820124 -- POST / 200 247.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,256 mnist_classifier_MNISTClassifier jbr5utsh 2ba64c47-3e4c-4cd8-a8d5-f3ace470e253 -- POST / 200 228.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,256 mnist_classifier_MNISTClassifier jbr5utsh 8a435683-61f9-4c42-bebe-b5389e32a089 -- POST / 200 241.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,257 mnist_classifier_MNISTClassifier jbr5utsh a0cbd81e-5102-4b5b-b581-68f9a3cbaa81 -- POST / 200 231.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,257 mnist_classifier_MNISTClassifier jbr5utsh 6320a524-7956-4651-b430-44a10da11837 -- POST / 200 225.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,257 mnist_classifier_MNISTClassifier jbr5utsh b35518eb-29cf-4c0b-a7b7-ef5e2f7defeb -- POST / 200 225.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,259 mnist_classifier_MNISTClassifier jbr5utsh f5b1b7c0-5a13-48b4-bb3d-9e2ab457cb62 -- POST / 200 226.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,268 mnist_classifier_MNISTClassifier jbr5utsh 030d9893-e76b-4c56-97ea-9030f7200a93 -- POST / 200 233.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,271 mnist_classifier_MNISTClassifier jbr5utsh 33cecb92-db86-4161-88df-5e8590c619f0 -- POST / 200 235.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,275 mnist_classifier_MNISTClassifier jbr5utsh 3e97613d-c1dc-4780-8ab2-48835b05954d -- POST / 200 237.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,279 mnist_classifier_MNISTClassifier jbr5utsh 5515b5aa-69e7-4db3-971d-5b104c200667 -- POST / 200 241.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,282 mnist_classifier_MNISTClassifier jbr5utsh 07e79eba-35e4-4d83-a149-af076abf4064 -- POST / 200 240.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,286 mnist_classifier_MNISTClassifier jbr5utsh c7b3334d-7c83-4ca1-afbf-b2545bb11901 -- POST / 200 244.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,289 mnist_classifier_MNISTClassifier jbr5utsh adbce82b-738a-41f0-bfdb-0617b591170f -- POST / 200 246.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,289 mnist_classifier_MNISTClassifier jbr5utsh 70aa5cb6-5cdd-4590-9e8d-4a9bfd13797d -- POST / 200 246.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,289 mnist_classifier_MNISTClassifier jbr5utsh fc2dbb7d-bd11-4c9f-84e1-9e57f99afcf0 -- POST / 200 245.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,290 mnist_classifier_MNISTClassifier jbr5utsh e910ff02-e782-48e1-ae5f-81d0366aa5dd -- POST / 200 242.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,290 mnist_classifier_MNISTClassifier jbr5utsh 62fdadf9-ef82-4abc-a23f-baf92d6ce50f -- POST / 200 242.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,291 mnist_classifier_MNISTClassifier jbr5utsh d3b2d563-6e99-413e-afcf-78e20f1b194c -- POST / 200 241.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,291 mnist_classifier_MNISTClassifier jbr5utsh 562c8f76-8016-4ddc-a811-89c74d368195 -- POST / 200 237.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,291 mnist_classifier_MNISTClassifier jbr5utsh 04419d65-e916-4b7b-973c-10fb3aa9fa66 -- POST / 200 243.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,292 mnist_classifier_MNISTClassifier jbr5utsh 3fde5ac7-cc95-4af5-b738-ca3ce7fc190f -- POST / 200 243.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,292 mnist_classifier_MNISTClassifier jbr5utsh 8b81dad3-6997-401f-866e-599c362c6d41 -- POST / 200 238.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,292 mnist_classifier_MNISTClassifier jbr5utsh 2de6885f-7429-4b17-8d0a-f05913308a5d -- POST / 200 239.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,294 mnist_classifier_MNISTClassifier jbr5utsh b833d996-b010-47d2-9e01-a2781142df5e -- POST / 200 243.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,294 mnist_classifier_MNISTClassifier jbr5utsh c50606d5-3dd4-44a9-8f9a-1aeac0d7270a -- POST / 200 243.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,295 mnist_classifier_MNISTClassifier jbr5utsh 764dfc96-5060-4c31-a39f-3204c07b95af -- POST / 200 240.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,296 mnist_classifier_MNISTClassifier jbr5utsh 4b9b15f7-bf02-4e8b-b640-74776a96d2e8 -- POST / 200 240.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,297 mnist_classifier_MNISTClassifier jbr5utsh f5c20352-99d8-4a13-a2fa-3a0fe6ee1880 -- POST / 200 241.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,429 mnist_classifier_MNISTClassifier jbr5utsh d9daa4c5-1213-4175-a450-831f243f4526 -- POST / 200 374.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,575 mnist_classifier_MNISTClassifier jbr5utsh f4c72780-d776-4197-b07d-01d9f0f589ed -- POST / 200 498.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,576 mnist_classifier_MNISTClassifier jbr5utsh 12080b9d-8f09-4ca4-b8d9-40fabdeaa274 -- POST / 200 520.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,576 mnist_classifier_MNISTClassifier jbr5utsh 0df1f553-04aa-4510-b7e0-6acbc1f1e131 -- POST / 200 503.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,577 mnist_classifier_MNISTClassifier jbr5utsh 4b3e9328-c3d4-4bf8-9cbe-2a8c3ca2ba5d -- POST / 200 503.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,577 mnist_classifier_MNISTClassifier jbr5utsh cdbfd0a6-c03e-4e30-a7f2-19c395199ada -- POST / 200 502.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,578 mnist_classifier_MNISTClassifier jbr5utsh 7cd6b1be-0225-47ee-ad3f-6a14e29bcec7 -- POST / 200 501.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,579 mnist_classifier_MNISTClassifier jbr5utsh d58368ef-3193-455f-a6c1-feff7ae871df -- POST / 200 501.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,579 mnist_classifier_MNISTClassifier jbr5utsh 6bc21869-89f3-4ab3-82e2-40ef656bafcc -- POST / 200 498.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,580 mnist_classifier_MNISTClassifier jbr5utsh b09896c7-ca81-45b6-86de-bbda63ea2fe5 -- POST / 200 495.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,580 mnist_classifier_MNISTClassifier jbr5utsh 84f3d9a4-1f98-40e6-ba73-656ca9110463 -- POST / 200 493.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,581 mnist_classifier_MNISTClassifier jbr5utsh f3a5ddb7-fb4e-4ba6-b813-6500d7968c38 -- POST / 200 492.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,581 mnist_classifier_MNISTClassifier jbr5utsh d11bd226-c400-400d-ae97-3dea2dfde7c7 -- POST / 200 492.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,582 mnist_classifier_MNISTClassifier jbr5utsh 3a75011c-02f2-4620-bc83-b6cb4bab2bba -- POST / 200 492.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,582 mnist_classifier_MNISTClassifier jbr5utsh 3b1098ae-536d-4cb2-956a-8fc4c0aa5dc4 -- POST / 200 490.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,582 mnist_classifier_MNISTClassifier jbr5utsh e3348398-e9ad-40e6-864f-4787ce7f734a -- POST / 200 490.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,583 mnist_classifier_MNISTClassifier jbr5utsh c9b42bfc-d505-44b2-ac51-6f3ebea61d81 -- POST / 200 485.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,583 mnist_classifier_MNISTClassifier jbr5utsh 241f7493-f953-4d08-9f7f-aea5cddb67f6 -- POST / 200 484.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,583 mnist_classifier_MNISTClassifier jbr5utsh 3bf69ee1-6dac-4472-9674-bb9ced70c574 -- POST / 200 483.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,584 mnist_classifier_MNISTClassifier jbr5utsh 80a0001a-af7f-47d0-82d2-7f802fedd787 -- POST / 200 435.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,584 mnist_classifier_MNISTClassifier jbr5utsh c69b9033-d27d-417c-a9f8-580e10493d45 -- POST / 200 425.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,584 mnist_classifier_MNISTClassifier jbr5utsh d9bd36a2-1159-4994-b086-7dfa77a1c2b3 -- POST / 200 425.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,585 mnist_classifier_MNISTClassifier jbr5utsh 227efdf0-9da7-4caf-89eb-f898de5be8bf -- POST / 200 420.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,585 mnist_classifier_MNISTClassifier jbr5utsh 66fa9cc4-61e8-45c6-9c73-8ce936bd62fa -- POST / 200 427.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,586 mnist_classifier_MNISTClassifier jbr5utsh 24ef3883-e9ae-4459-bc09-6c0aef47d317 -- POST / 200 418.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,586 mnist_classifier_MNISTClassifier jbr5utsh 133bf971-3fd5-4bef-b9e5-1413c0b10893 -- POST / 200 417.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,586 mnist_classifier_MNISTClassifier jbr5utsh dbd55375-7836-470d-a6de-80946e089408 -- POST / 200 426.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,587 mnist_classifier_MNISTClassifier jbr5utsh c827b17a-9eb2-4f32-8114-12cef97a8371 -- POST / 200 423.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,588 mnist_classifier_MNISTClassifier jbr5utsh d6045ed4-9416-4882-8045-4714c4f1acad -- POST / 200 414.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,592 mnist_classifier_MNISTClassifier jbr5utsh 411f687d-35f5-4995-a0dc-ec8b7b9255e1 -- POST / 200 418.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,593 mnist_classifier_MNISTClassifier jbr5utsh 10dd6f83-118d-47d0-816c-8cefe00d8515 -- POST / 200 418.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,594 mnist_classifier_MNISTClassifier jbr5utsh ec5f3636-d69d-4829-a616-ce57a0b6279e -- POST / 200 418.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,594 mnist_classifier_MNISTClassifier jbr5utsh 5e2bb89b-286b-45dd-af68-d0edef957ff4 -- POST / 200 414.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,595 mnist_classifier_MNISTClassifier jbr5utsh 19ae80f5-977a-42b4-a0a5-eca5576ebabc -- POST / 200 414.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,596 mnist_classifier_MNISTClassifier jbr5utsh 2d2901fe-392e-4517-8894-316a0e288f5d -- POST / 200 415.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,597 mnist_classifier_MNISTClassifier jbr5utsh 4bfce539-4fed-40c8-a6bc-cc64c57a9e20 -- POST / 200 415.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,597 mnist_classifier_MNISTClassifier jbr5utsh 187fc4c4-42d0-4728-87bb-0d32652a5d1b -- POST / 200 407.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,598 mnist_classifier_MNISTClassifier jbr5utsh 98b039dc-cde3-4620-9c44-a13c110074a4 -- POST / 200 403.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,598 mnist_classifier_MNISTClassifier jbr5utsh d97cd355-aea2-4c10-b10c-cfddba3e2a6f -- POST / 200 405.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,599 mnist_classifier_MNISTClassifier jbr5utsh 77bb1d77-d385-46ca-a878-cbbc82722644 -- POST / 200 407.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,599 mnist_classifier_MNISTClassifier jbr5utsh b9673169-7874-4e66-8619-7d16fe1145a5 -- POST / 200 404.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,599 mnist_classifier_MNISTClassifier jbr5utsh 103edc89-06bd-40af-8001-b65d0503af21 -- POST / 200 404.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,600 mnist_classifier_MNISTClassifier jbr5utsh 5fba5f5d-1b5b-4579-9b08-948917fdec17 -- POST / 200 403.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,600 mnist_classifier_MNISTClassifier jbr5utsh 3d799dde-ea37-4b90-88d2-d133116a0678 -- POST / 200 398.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,601 mnist_classifier_MNISTClassifier jbr5utsh d235f27c-f475-4a68-8eb5-66044ddb3594 -- POST / 200 398.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,602 mnist_classifier_MNISTClassifier jbr5utsh 82700bb7-2cb9-48b8-9564-0e7116a25c45 -- POST / 200 400.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,603 mnist_classifier_MNISTClassifier jbr5utsh d9c472f5-5688-4025-9eb3-c10231642bfe -- POST / 200 400.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,603 mnist_classifier_MNISTClassifier jbr5utsh 04a52177-27d6-4bbc-b981-c3b137d55bd9 -- POST / 200 395.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,604 mnist_classifier_MNISTClassifier jbr5utsh 630c2a35-c1ae-4314-b6a0-6da7124edc19 -- POST / 200 395.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,605 mnist_classifier_MNISTClassifier jbr5utsh 8a597baf-f4fd-4e64-83d6-9730f09df521 -- POST / 200 394.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,606 mnist_classifier_MNISTClassifier jbr5utsh 7f79f4b4-e8bf-4012-894d-c98428da8025 -- POST / 200 395.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,607 mnist_classifier_MNISTClassifier jbr5utsh 50dc2fb9-c4bb-48af-bcba-a5a598111659 -- POST / 200 394.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,607 mnist_classifier_MNISTClassifier jbr5utsh f122c654-1bf8-4564-9375-888d95ffd3a0 -- POST / 200 394.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,608 mnist_classifier_MNISTClassifier jbr5utsh 9f6239b4-609a-4bff-8301-060f231e34b3 -- POST / 200 395.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,609 mnist_classifier_MNISTClassifier jbr5utsh 87cfadaa-f76c-4ca2-9514-6d134548160c -- POST / 200 392.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,610 mnist_classifier_MNISTClassifier jbr5utsh 013ebad7-f471-48d2-8193-cc6c6e390b1c -- POST / 200 392.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,610 mnist_classifier_MNISTClassifier jbr5utsh 01f38c21-3f61-493c-8530-dc5dacb36fc7 -- POST / 200 390.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,610 mnist_classifier_MNISTClassifier jbr5utsh 3dd3c47c-5e38-4347-b973-9e37f530e3e4 -- POST / 200 393.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,611 mnist_classifier_MNISTClassifier jbr5utsh 3290d7b5-3b3c-4ee0-b3d7-5e6c083d7a02 -- POST / 200 392.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,611 mnist_classifier_MNISTClassifier jbr5utsh 6becbe18-f2b6-4ef6-9d01-eb750cbaac8b -- POST / 200 390.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,612 mnist_classifier_MNISTClassifier jbr5utsh 4fc633c2-1a7e-49dd-8876-d4f03cfb0cac -- POST / 200 390.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,697 mnist_classifier_MNISTClassifier jbr5utsh 0d7cb1dd-e13d-460c-9687-47d863a98331 -- POST / 200 475.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,698 mnist_classifier_MNISTClassifier jbr5utsh 7ee0afdd-f018-4675-8005-10c7db89401a -- POST / 200 472.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,700 mnist_classifier_MNISTClassifier jbr5utsh d5a3d341-d610-43fd-a672-45ada2271f10 -- POST / 200 474.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,701 mnist_classifier_MNISTClassifier jbr5utsh c63063b4-2dbf-4b3b-9b76-1a47282dae20 -- POST / 200 475.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,702 mnist_classifier_MNISTClassifier jbr5utsh 3337bc6e-3330-4f32-811f-9110ecd88bac -- POST / 200 474.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,702 mnist_classifier_MNISTClassifier jbr5utsh e1b77d24-70bd-4daf-8f0d-5176b68f3e03 -- POST / 200 475.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,703 mnist_classifier_MNISTClassifier jbr5utsh a3fb243c-f1f0-469b-9ee6-cb531cdfcfee -- POST / 200 475.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,703 mnist_classifier_MNISTClassifier jbr5utsh 5a3a9436-17c7-44c3-9265-a9987802d1cf -- POST / 200 406.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,704 mnist_classifier_MNISTClassifier jbr5utsh f6b0a470-da4d-4b88-8f80-8afaf239ba4d -- POST / 200 407.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,705 mnist_classifier_MNISTClassifier jbr5utsh cb299236-643c-4bed-9f49-97d2f28aa94f -- POST / 200 388.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,706 mnist_classifier_MNISTClassifier jbr5utsh 38c1992b-71bf-4ee8-b957-badf626caa97 -- POST / 200 403.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,707 mnist_classifier_MNISTClassifier jbr5utsh b353bfc6-715a-4bf6-8da1-8cdd9a02b418 -- POST / 200 402.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,708 mnist_classifier_MNISTClassifier jbr5utsh 9ce48035-abbb-485f-8b6e-54a44b917783 -- POST / 200 403.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,709 mnist_classifier_MNISTClassifier jbr5utsh f39878c4-2a3a-476e-ba67-d5efa077dda4 -- POST / 200 403.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,709 mnist_classifier_MNISTClassifier jbr5utsh 1cdb782f-f34d-4b70-88b5-7ab7e5a9d12e -- POST / 200 403.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,709 mnist_classifier_MNISTClassifier jbr5utsh cafd7462-1a4b-411c-96ba-dfbfec0c870c -- POST / 200 401.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,711 mnist_classifier_MNISTClassifier jbr5utsh d889d74c-cb9e-49d1-afa5-c9f97e1ad0a3 -- POST / 200 402.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,711 mnist_classifier_MNISTClassifier jbr5utsh 802f7cb5-c473-4e0b-9365-6db8dc240d9f -- POST / 200 401.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,714 mnist_classifier_MNISTClassifier jbr5utsh 6c441eb0-4c7f-468c-b21e-cecfb2fbf028 -- POST / 200 403.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,715 mnist_classifier_MNISTClassifier jbr5utsh 526f1a2a-04b8-4323-952f-98b74df5943c -- POST / 200 403.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,716 mnist_classifier_MNISTClassifier jbr5utsh 365c43d5-a701-4b4b-a091-4868289699cf -- POST / 200 403.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,717 mnist_classifier_MNISTClassifier jbr5utsh 8cce0334-4011-4eae-b731-852bc8b03391 -- POST / 200 403.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,718 mnist_classifier_MNISTClassifier jbr5utsh e4aff0f6-807d-4268-8045-d164fd8e6d16 -- POST / 200 404.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,718 mnist_classifier_MNISTClassifier jbr5utsh 524e1792-c622-403b-87fd-4f7c206a5019 -- POST / 200 404.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,721 mnist_classifier_MNISTClassifier jbr5utsh 61badc17-9984-4b01-923b-6c05ce469b93 -- POST / 200 405.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,724 mnist_classifier_MNISTClassifier jbr5utsh 01389d3d-9cc4-42a3-82f5-dd5b92dde3b3 -- POST / 200 406.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,726 mnist_classifier_MNISTClassifier jbr5utsh f6e7b260-43a6-4d24-8064-2e8c98bf27a0 -- POST / 200 406.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,727 mnist_classifier_MNISTClassifier jbr5utsh eeca5361-bd99-4d38-a7f5-b0094a48e558 -- POST / 200 406.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,728 mnist_classifier_MNISTClassifier jbr5utsh 93acae87-ae87-4d6b-8cec-1cfbd8395c98 -- POST / 200 405.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,728 mnist_classifier_MNISTClassifier jbr5utsh 278f6d7b-0f7c-4564-b4db-6463dd4f3d7c -- POST / 200 405.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,729 mnist_classifier_MNISTClassifier jbr5utsh 531c107d-4bc6-4c3b-822a-666c7a02e19d -- POST / 200 396.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,730 mnist_classifier_MNISTClassifier jbr5utsh 4769a1ed-8dc8-444d-9b9b-1a573a0402cb -- POST / 200 406.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,732 mnist_classifier_MNISTClassifier jbr5utsh 4a320920-c7ce-487b-bd7d-b06fec5be6ba -- POST / 200 397.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,732 mnist_classifier_MNISTClassifier jbr5utsh 2d4024f8-5a86-4d7b-9122-52e771b78696 -- POST / 200 407.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,733 mnist_classifier_MNISTClassifier jbr5utsh 1ac0d8ae-cb99-4917-9545-3ecf9c21226b -- POST / 200 396.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,733 mnist_classifier_MNISTClassifier jbr5utsh b495c162-cf7c-422a-8e86-f277bd420515 -- POST / 200 394.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,734 mnist_classifier_MNISTClassifier jbr5utsh 4e0ff685-0689-4aa4-b82a-1dfffa3525e1 -- POST / 200 395.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,735 mnist_classifier_MNISTClassifier jbr5utsh 37576553-fc7c-448c-9719-4c282725e76f -- POST / 200 395.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,736 mnist_classifier_MNISTClassifier jbr5utsh cddc1127-876d-416c-8c05-f06ebf3d6461 -- POST / 200 396.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,874 mnist_classifier_MNISTClassifier jbr5utsh f33b47a0-db9e-42c8-9285-0b1a09d6e5cd -- POST / 200 459.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,877 mnist_classifier_MNISTClassifier jbr5utsh 339eefc0-a1a6-4809-a836-d80361a72c8d -- POST / 200 461.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,879 mnist_classifier_MNISTClassifier jbr5utsh 45ae9f60-80f4-4daa-b43f-595427d0c11e -- POST / 200 461.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,880 mnist_classifier_MNISTClassifier jbr5utsh 4e5b033d-d09a-47bd-a13e-ac0c5364fd42 -- POST / 200 457.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,880 mnist_classifier_MNISTClassifier jbr5utsh 07e39c8a-8966-4006-a01a-c97caa48bf8a -- POST / 200 263.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,881 mnist_classifier_MNISTClassifier jbr5utsh 668e16a1-4ead-4c65-a73d-91f9e688ead4 -- POST / 200 264.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,881 mnist_classifier_MNISTClassifier jbr5utsh bccd6112-4b09-4645-a30d-dda020d91fea -- POST / 200 264.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,882 mnist_classifier_MNISTClassifier jbr5utsh 6542d2ff-0c5a-4830-b1ff-b99920790f7a -- POST / 200 264.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,882 mnist_classifier_MNISTClassifier jbr5utsh 395c5c0f-718b-47f5-8857-485ca1e1304c -- POST / 200 265.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,883 mnist_classifier_MNISTClassifier jbr5utsh 889bd53b-52d9-4d28-ad41-361cb560e9b0 -- POST / 200 266.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,885 mnist_classifier_MNISTClassifier jbr5utsh 254df6c3-f577-474e-9b09-ae2334ae3ee5 -- POST / 200 268.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,886 mnist_classifier_MNISTClassifier jbr5utsh f72a1214-8b3d-4d74-8003-5f5414c6b35e -- POST / 200 257.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,888 mnist_classifier_MNISTClassifier jbr5utsh 45c85d7f-528f-4e83-8093-d9f6e9bccc8f -- POST / 200 255.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,889 mnist_classifier_MNISTClassifier jbr5utsh cf9dbc0c-ad32-4c9b-b436-c1ef82a6f81a -- POST / 200 259.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,890 mnist_classifier_MNISTClassifier jbr5utsh 0c7df683-b877-4583-9b14-74d9b8539969 -- POST / 200 256.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,891 mnist_classifier_MNISTClassifier jbr5utsh 33656777-d9dd-4553-9f42-c6fac615e262 -- POST / 200 261.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,892 mnist_classifier_MNISTClassifier jbr5utsh 9f2b1b07-4e79-4ac4-9a08-08291707730c -- POST / 200 260.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,906 mnist_classifier_MNISTClassifier jbr5utsh 8f35130a-e662-42f2-9403-1b1cd7af776a -- POST / 200 270.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,907 mnist_classifier_MNISTClassifier jbr5utsh c9281852-8830-4f4a-b09d-6324d34b928f -- POST / 200 271.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,914 mnist_classifier_MNISTClassifier jbr5utsh 6e85cc4a-2ca9-4524-8d2c-a57be2be4f21 -- POST / 200 278.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,917 mnist_classifier_MNISTClassifier jbr5utsh 5eb3a1f1-e93d-4395-ab59-6ce16ff22e7f -- POST / 200 280.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,918 mnist_classifier_MNISTClassifier jbr5utsh 7b44c81c-40fd-4e46-a591-ddeba50d5015 -- POST / 200 281.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,919 mnist_classifier_MNISTClassifier jbr5utsh ec3a60a2-7644-4cfb-bc39-71cc17581e01 -- POST / 200 281.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,920 mnist_classifier_MNISTClassifier jbr5utsh fc2d906c-b6b0-4abb-b72c-9a2e0daac640 -- POST / 200 282.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,921 mnist_classifier_MNISTClassifier jbr5utsh 114991eb-58f9-4485-bb97-6b1b8f0de821 -- POST / 200 282.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,921 mnist_classifier_MNISTClassifier jbr5utsh 21596248-3a26-43f4-b5d9-600381bc5ed0 -- POST / 200 281.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,922 mnist_classifier_MNISTClassifier jbr5utsh d984f710-a69b-4377-8390-1520bfee086b -- POST / 200 280.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,922 mnist_classifier_MNISTClassifier jbr5utsh a78df3b9-3635-4fb2-9cb3-a3eab0cf9687 -- POST / 200 280.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,923 mnist_classifier_MNISTClassifier jbr5utsh afa223d9-0c92-44a5-a611-558b470d8362 -- POST / 200 280.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,923 mnist_classifier_MNISTClassifier jbr5utsh 8cdc038c-fcc7-409c-802b-08c6db4e6353 -- POST / 200 280.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,923 mnist_classifier_MNISTClassifier jbr5utsh 9c3160ef-b1b0-45ee-a285-9717e85f8ff3 -- POST / 200 279.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,924 mnist_classifier_MNISTClassifier jbr5utsh 83439125-70b1-4694-95ab-1a5253577950 -- POST / 200 279.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,924 mnist_classifier_MNISTClassifier jbr5utsh 3bb6b40f-fdb8-430a-9fd8-e2037f7a5dc6 -- POST / 200 280.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,926 mnist_classifier_MNISTClassifier jbr5utsh e86f1fba-9063-4bd2-9cbb-b3ba54421027 -- POST / 200 281.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,926 mnist_classifier_MNISTClassifier jbr5utsh f21866c1-d177-4288-8f21-f2fe508a26c6 -- POST / 200 280.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,927 mnist_classifier_MNISTClassifier jbr5utsh f9d3e358-fca5-438d-a081-e3584f0f8adb -- POST / 200 281.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,927 mnist_classifier_MNISTClassifier jbr5utsh 8feb3f8a-03be-4d5e-9880-b7caebc27437 -- POST / 200 279.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,928 mnist_classifier_MNISTClassifier jbr5utsh 50222362-2ced-4f9d-a294-c926df364215 -- POST / 200 280.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,928 mnist_classifier_MNISTClassifier jbr5utsh 9f060221-102b-4190-94a7-a1e30850fb1f -- POST / 200 281.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,928 mnist_classifier_MNISTClassifier jbr5utsh 9f687c72-598f-43a4-8d6f-1b0d8b8e7947 -- POST / 200 280.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,929 mnist_classifier_MNISTClassifier jbr5utsh d8ccb44f-d381-4f14-9de1-dc8ed7e0701d -- POST / 200 280.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,929 mnist_classifier_MNISTClassifier jbr5utsh 341ef27f-5e21-4053-811e-ba61065eaa1f -- POST / 200 279.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,930 mnist_classifier_MNISTClassifier jbr5utsh d67f9bb8-9c0b-4b29-b07d-06b81385be7c -- POST / 200 279.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,931 mnist_classifier_MNISTClassifier jbr5utsh fa872778-9be2-4411-b4c1-4fb4c50d7247 -- POST / 200 279.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,932 mnist_classifier_MNISTClassifier jbr5utsh 1330a7b7-6941-4f27-950c-c4acfa9741f2 -- POST / 200 279.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,933 mnist_classifier_MNISTClassifier jbr5utsh 48434bd6-4dac-40ec-94f9-142e04c70332 -- POST / 200 279.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,934 mnist_classifier_MNISTClassifier jbr5utsh 99ea3590-a075-45a7-88ed-63e3df8438ed -- POST / 200 279.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,935 mnist_classifier_MNISTClassifier jbr5utsh 3fc9cf88-165a-402e-aac1-c9c4f854ef22 -- POST / 200 278.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,935 mnist_classifier_MNISTClassifier jbr5utsh b56b5618-2b32-4e74-b494-1090fd7e15a2 -- POST / 200 278.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,936 mnist_classifier_MNISTClassifier jbr5utsh b9df96bd-1f28-4d63-9408-3850e0959d15 -- POST / 200 277.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,937 mnist_classifier_MNISTClassifier jbr5utsh 36223f63-cdaa-492c-9aeb-aa47ee08e7db -- POST / 200 277.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,937 mnist_classifier_MNISTClassifier jbr5utsh 06aacbe3-5557-4f11-8cb3-a6979076616f -- POST / 200 278.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,941 mnist_classifier_MNISTClassifier jbr5utsh 14691b22-0e60-4889-ad96-1b5b33352b1c -- POST / 200 281.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,942 mnist_classifier_MNISTClassifier jbr5utsh 85a76a93-72cb-47de-8201-2561020d7aba -- POST / 200 280.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,942 mnist_classifier_MNISTClassifier jbr5utsh d090efad-40b8-445d-b161-cfa7894115bf -- POST / 200 281.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,943 mnist_classifier_MNISTClassifier jbr5utsh 54943e40-3603-4ef4-9f04-24708621fb97 -- POST / 200 280.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,943 mnist_classifier_MNISTClassifier jbr5utsh 3ef0e79c-cbf0-41df-b4ba-2634b9797497 -- POST / 200 279.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,946 mnist_classifier_MNISTClassifier jbr5utsh 40fb61c2-cf88-4650-8d0d-5f6474893c88 -- POST / 200 281.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,946 mnist_classifier_MNISTClassifier jbr5utsh caf9cd53-8904-48e9-adca-10fabfc29186 -- POST / 200 280.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,946 mnist_classifier_MNISTClassifier jbr5utsh ee3bec7f-6639-4264-b0b8-a8692a403a1d -- POST / 200 280.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:05,947 mnist_classifier_MNISTClassifier jbr5utsh e609b4a1-6661-4ea0-a963-6de1b8c14797 -- POST / 200 280.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,008 mnist_classifier_MNISTClassifier jbr5utsh 1ab84bb6-5125-41e6-bbbb-c3ecb572122c -- POST / 200 292.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,022 mnist_classifier_MNISTClassifier jbr5utsh 8ed32fd3-78f1-4fed-be15-5595d65e7f6e -- POST / 200 295.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,023 mnist_classifier_MNISTClassifier jbr5utsh f41f6fee-585b-4916-ac9f-44edd01c4fad -- POST / 200 282.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,023 mnist_classifier_MNISTClassifier jbr5utsh c01178fe-8569-4378-ae9d-4bad368a6b33 -- POST / 200 267.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,023 mnist_classifier_MNISTClassifier jbr5utsh 0d3d2cbc-d519-43ad-b004-782f2c6ce525 -- POST / 200 266.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,024 mnist_classifier_MNISTClassifier jbr5utsh 6db48bb1-6a87-47f4-aca9-8c288842d7eb -- POST / 200 265.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,024 mnist_classifier_MNISTClassifier jbr5utsh 52dee5e4-0762-48d5-90a1-5ac31651467e -- POST / 200 265.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,024 mnist_classifier_MNISTClassifier jbr5utsh b3a726f7-d0f9-4227-be73-36bc58624b46 -- POST / 200 265.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,024 mnist_classifier_MNISTClassifier jbr5utsh e481e360-fb61-462c-80e4-67b1a3d96481 -- POST / 200 265.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,024 mnist_classifier_MNISTClassifier jbr5utsh 52b332e9-816a-41f2-99c7-cb9bb3cc4354 -- POST / 200 262.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,024 mnist_classifier_MNISTClassifier jbr5utsh f0c2f9cd-1114-4e5c-a8db-7dba49162a51 -- POST / 200 262.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,025 mnist_classifier_MNISTClassifier jbr5utsh e5631c44-c6cb-4d88-80a8-adaa219e5882 -- POST / 200 261.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,025 mnist_classifier_MNISTClassifier jbr5utsh 36b30ca5-64ea-49ba-9da1-95aa261207c8 -- POST / 200 260.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,025 mnist_classifier_MNISTClassifier jbr5utsh 0847dd23-251b-4165-a3f5-f00918ed69af -- POST / 200 258.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,025 mnist_classifier_MNISTClassifier jbr5utsh 98ea1eba-8f7b-47c1-bea2-99633d0f2b0b -- POST / 200 258.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,025 mnist_classifier_MNISTClassifier jbr5utsh 90e1a7c6-d467-4cad-868f-62e4a0054d87 -- POST / 200 257.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,025 mnist_classifier_MNISTClassifier jbr5utsh 132f40db-9ce4-4b26-aa3b-0e2731513018 -- POST / 200 255.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,026 mnist_classifier_MNISTClassifier jbr5utsh 6bdc6213-b67e-4de0-9454-5079994ab7f2 -- POST / 200 256.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,026 mnist_classifier_MNISTClassifier jbr5utsh 36d815c8-bc0d-4eb9-a860-0b366aaca306 -- POST / 200 254.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,027 mnist_classifier_MNISTClassifier jbr5utsh 77b741b2-b6d1-41c5-aa69-5933531ed9e3 -- POST / 200 251.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,028 mnist_classifier_MNISTClassifier jbr5utsh 5c32779e-8247-4c85-ae4b-23f18f995d22 -- POST / 200 251.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,028 mnist_classifier_MNISTClassifier jbr5utsh 27a3754d-524d-4942-a586-9f9c1f1a359e -- POST / 200 251.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,029 mnist_classifier_MNISTClassifier jbr5utsh 0476112e-a92c-497a-b0be-0625214392d5 -- POST / 200 251.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,031 mnist_classifier_MNISTClassifier jbr5utsh d2683d0d-d508-4b81-8615-058132583750 -- POST / 200 253.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,032 mnist_classifier_MNISTClassifier jbr5utsh 42f8f3b9-6528-4806-9e6e-737d6d6a728e -- POST / 200 253.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,033 mnist_classifier_MNISTClassifier jbr5utsh b33c96a9-fff2-4032-9b33-e51af5ccbac6 -- POST / 200 250.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,034 mnist_classifier_MNISTClassifier jbr5utsh f4fc0dfd-3c7a-4999-a7f6-bf113fde81b1 -- POST / 200 251.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,034 mnist_classifier_MNISTClassifier jbr5utsh cd1d44de-661f-4780-99ae-3932f7139bfa -- POST / 200 251.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,034 mnist_classifier_MNISTClassifier jbr5utsh 731b3115-61c7-460e-b54e-c1efdb6c58f4 -- POST / 200 239.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,034 mnist_classifier_MNISTClassifier jbr5utsh da459be5-c0ab-48e8-883e-404f0f9d1375 -- POST / 200 238.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,035 mnist_classifier_MNISTClassifier jbr5utsh 59a2a88d-836d-4b87-8a73-7d0c765303c8 -- POST / 200 235.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,036 mnist_classifier_MNISTClassifier jbr5utsh 78442475-f141-4024-9048-c4edcb09f63d -- POST / 200 234.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,036 mnist_classifier_MNISTClassifier jbr5utsh 84a0fca7-a750-4ce9-95ec-ab1146303afa -- POST / 200 234.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,036 mnist_classifier_MNISTClassifier jbr5utsh 4c0974f4-70bd-4d4c-9af8-5be287879a0f -- POST / 200 234.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,037 mnist_classifier_MNISTClassifier jbr5utsh 429decaa-02cf-446d-bf6a-9b1f46790865 -- POST / 200 234.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,037 mnist_classifier_MNISTClassifier jbr5utsh fd5b2e4d-8843-4bc1-b646-9d74b718d58f -- POST / 200 234.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,038 mnist_classifier_MNISTClassifier jbr5utsh c4d00629-c4b5-45e9-ad48-d199c9b18227 -- POST / 200 234.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,039 mnist_classifier_MNISTClassifier jbr5utsh 071c9d8b-e53b-486d-864a-dfe7ddd61767 -- POST / 200 234.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,039 mnist_classifier_MNISTClassifier jbr5utsh 684da9f7-f961-4d7b-b5e9-b9988d1d0451 -- POST / 200 230.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,149 mnist_classifier_MNISTClassifier jbr5utsh db0c9b4a-9e1d-4069-9516-de011de4644e -- POST / 200 195.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,151 mnist_classifier_MNISTClassifier jbr5utsh a65f141f-ca0a-4951-b6b5-d9501042919b -- POST / 200 208.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,151 mnist_classifier_MNISTClassifier jbr5utsh 05dd06dc-feb1-4632-a30a-a04f182c8fce -- POST / 200 234.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,152 mnist_classifier_MNISTClassifier jbr5utsh d2e3d618-fd81-49c3-b0a3-65f2385c29dc -- POST / 200 235.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,154 mnist_classifier_MNISTClassifier jbr5utsh fb32298f-133d-45a2-95db-50eb89047b1d -- POST / 200 237.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,156 mnist_classifier_MNISTClassifier jbr5utsh 0ad23bef-3609-4fdb-8086-d6ca2cfd5880 -- POST / 200 236.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,156 mnist_classifier_MNISTClassifier jbr5utsh d665d55c-09c6-419c-98d9-1b2aac60041d -- POST / 200 230.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,157 mnist_classifier_MNISTClassifier jbr5utsh 3a6c799e-468a-4b77-8b63-491133e2aec5 -- POST / 200 228.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,159 mnist_classifier_MNISTClassifier jbr5utsh 02ca27d2-c202-4e28-80d5-546efff7cd6b -- POST / 200 226.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,160 mnist_classifier_MNISTClassifier jbr5utsh f2fc461f-dd5c-4300-9117-707c62dc94b1 -- POST / 200 204.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,161 mnist_classifier_MNISTClassifier jbr5utsh 38e13585-15ef-4f10-a3b1-0379891b096c -- POST / 200 204.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,162 mnist_classifier_MNISTClassifier jbr5utsh 0b4d7f20-42fb-4953-aaed-9402595bb785 -- POST / 200 204.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,163 mnist_classifier_MNISTClassifier jbr5utsh ecfeb400-a4e0-4af6-b239-aea4cb6f345e -- POST / 200 205.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,163 mnist_classifier_MNISTClassifier jbr5utsh 8af36709-4df0-4905-87f9-1ddc1e17f75b -- POST / 200 204.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,163 mnist_classifier_MNISTClassifier jbr5utsh 8a0bb2b3-733e-4f48-b81f-bca1bee19255 -- POST / 200 204.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,164 mnist_classifier_MNISTClassifier jbr5utsh 78db8c0f-aad4-4cc7-8d7e-d565fb26e2b9 -- POST / 200 204.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,164 mnist_classifier_MNISTClassifier jbr5utsh fc71300c-f5ad-44a1-89a8-cc5f9788a2a9 -- POST / 200 204.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,165 mnist_classifier_MNISTClassifier jbr5utsh c9411f2d-a94f-473e-92be-7c312719b25c -- POST / 200 205.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,166 mnist_classifier_MNISTClassifier jbr5utsh 654ad65d-f4e4-45c4-bbab-420c0f323085 -- POST / 200 205.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,167 mnist_classifier_MNISTClassifier jbr5utsh 06a859c9-39da-4e00-b0b5-4469c02441bd -- POST / 200 207.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,168 mnist_classifier_MNISTClassifier jbr5utsh 1a21e231-b087-4ddd-97a3-cc393557df33 -- POST / 200 207.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,308 mnist_classifier_MNISTClassifier jbr5utsh 2a0e1759-ac54-481c-804a-1e180ed74703 -- POST / 200 346.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,308 mnist_classifier_MNISTClassifier jbr5utsh d3f612af-b512-48d9-a31a-ce382d9e5fef -- POST / 200 345.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,309 mnist_classifier_MNISTClassifier jbr5utsh 6b0eecca-8a11-4abe-8d30-a6be681aca89 -- POST / 200 348.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,310 mnist_classifier_MNISTClassifier jbr5utsh c9414527-f1b4-4f71-b175-be20c0a8c26f -- POST / 200 348.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,310 mnist_classifier_MNISTClassifier jbr5utsh 5d64f067-5afd-4146-aa5e-0a3380af8e0c -- POST / 200 349.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,311 mnist_classifier_MNISTClassifier jbr5utsh 2e7b0aaa-8cb4-4627-88bc-b7d4764ae14d -- POST / 200 341.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,311 mnist_classifier_MNISTClassifier jbr5utsh ba0109c6-b45d-46a3-a07a-177eb644bd21 -- POST / 200 346.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,312 mnist_classifier_MNISTClassifier jbr5utsh ceece6c4-d88e-475c-8d66-2916ce4b60e4 -- POST / 200 324.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,312 mnist_classifier_MNISTClassifier jbr5utsh e571d8e3-4770-4f1b-b26b-39708e2a6f6a -- POST / 200 341.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,312 mnist_classifier_MNISTClassifier jbr5utsh 70cd6670-5b70-49b2-9635-edb4a4b629c3 -- POST / 200 323.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,313 mnist_classifier_MNISTClassifier jbr5utsh 80fde617-b39b-4ff0-ba02-522cfe62fcb9 -- POST / 200 341.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,313 mnist_classifier_MNISTClassifier jbr5utsh 4535b5c2-c900-4207-af6e-ca030f590dff -- POST / 200 341.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,314 mnist_classifier_MNISTClassifier jbr5utsh d5babb64-7b5e-4613-a4ff-ffbfdd5074a4 -- POST / 200 342.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,314 mnist_classifier_MNISTClassifier jbr5utsh 7e286a35-c319-4a81-9a82-1487217bfa4c -- POST / 200 342.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,315 mnist_classifier_MNISTClassifier jbr5utsh cd720976-6814-4dc5-9893-317a411824f0 -- POST / 200 342.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,315 mnist_classifier_MNISTClassifier jbr5utsh 8687feaa-2e45-4abf-ae00-d13a617eca7c -- POST / 200 341.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,318 mnist_classifier_MNISTClassifier jbr5utsh 2fb0cdd6-5594-4028-9623-7d25c7074bd7 -- POST / 200 327.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,319 mnist_classifier_MNISTClassifier jbr5utsh f48be6f6-437e-405e-93fa-bbef4e304941 -- POST / 200 327.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,319 mnist_classifier_MNISTClassifier jbr5utsh af47493c-91a5-4010-8cc4-441d1e8174e6 -- POST / 200 327.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,320 mnist_classifier_MNISTClassifier jbr5utsh c8ec81a3-09bc-40e1-804e-0791977d5ab2 -- POST / 200 303.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,320 mnist_classifier_MNISTClassifier jbr5utsh 246e0ffc-f9b6-4dfd-9d6d-2fc3c98ec90a -- POST / 200 303.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,320 mnist_classifier_MNISTClassifier jbr5utsh ec3a083b-43d6-4612-9b41-edee3f18c412 -- POST / 200 303.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,320 mnist_classifier_MNISTClassifier jbr5utsh 926c28c0-5c18-400c-9d81-2db43e50578c -- POST / 200 304.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,321 mnist_classifier_MNISTClassifier jbr5utsh 330bc953-e5ba-4c5f-9e0d-0b1dc9563985 -- POST / 200 278.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,321 mnist_classifier_MNISTClassifier jbr5utsh a6acfbf2-ad9b-4f85-b2e8-2f7082cb8f25 -- POST / 200 278.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,321 mnist_classifier_MNISTClassifier jbr5utsh 50cdfe7d-fb5f-4151-8666-4b264a1a9886 -- POST / 200 274.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,322 mnist_classifier_MNISTClassifier jbr5utsh e4e9e879-4f33-45cc-ac3a-8c5cfee29f3a -- POST / 200 276.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,322 mnist_classifier_MNISTClassifier jbr5utsh dd325795-7545-4427-9420-75010843f21b -- POST / 200 261.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,322 mnist_classifier_MNISTClassifier jbr5utsh d5d6ae20-9648-437f-9989-f3fef8ad7400 -- POST / 200 275.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,323 mnist_classifier_MNISTClassifier jbr5utsh 525f6e0d-133f-4d17-99ff-5aff19698168 -- POST / 200 261.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,325 mnist_classifier_MNISTClassifier jbr5utsh a86602dc-9a74-4046-9398-e77f6084f643 -- POST / 200 263.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,325 mnist_classifier_MNISTClassifier jbr5utsh 1861c9c0-ffea-4a65-8361-a671208fa888 -- POST / 200 263.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,326 mnist_classifier_MNISTClassifier jbr5utsh d3fe3426-2bd8-4a82-ac0b-40ec38809913 -- POST / 200 264.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,327 mnist_classifier_MNISTClassifier jbr5utsh bd2d0ff8-ced6-45a4-a526-91a7885196dd -- POST / 200 264.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,328 mnist_classifier_MNISTClassifier jbr5utsh 9c374ce5-72fe-4d85-855f-552645c62935 -- POST / 200 265.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,329 mnist_classifier_MNISTClassifier jbr5utsh 13964edc-e92a-4e7f-b1cc-9a3369b9d3f8 -- POST / 200 265.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,330 mnist_classifier_MNISTClassifier jbr5utsh 5a266e82-a43f-4201-9007-8938215d6382 -- POST / 200 265.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,330 mnist_classifier_MNISTClassifier jbr5utsh 46d5d00f-442f-496e-b3dc-57857e79601f -- POST / 200 263.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,331 mnist_classifier_MNISTClassifier jbr5utsh 9007b4b6-c4a1-4821-bfaa-0d3ee75edb5d -- POST / 200 264.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,331 mnist_classifier_MNISTClassifier jbr5utsh 8e4e6b47-ad2c-4585-87bd-77d76c941146 -- POST / 200 262.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,331 mnist_classifier_MNISTClassifier jbr5utsh 3bf87869-0565-42bc-83cc-f960bc40feff -- POST / 200 259.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,332 mnist_classifier_MNISTClassifier jbr5utsh de72e22b-7d67-4b03-a597-2e436fc6cbb7 -- POST / 200 262.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,332 mnist_classifier_MNISTClassifier jbr5utsh 7c61274e-cc74-42c4-850c-961701ebd613 -- POST / 200 262.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,332 mnist_classifier_MNISTClassifier jbr5utsh 617b0edb-4eb6-4f09-afef-98ab20de6c1e -- POST / 200 261.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,333 mnist_classifier_MNISTClassifier jbr5utsh cd2dd0a2-803c-4035-9e10-ce9d05faf566 -- POST / 200 246.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,336 mnist_classifier_MNISTClassifier jbr5utsh 0658bae4-3018-4e3e-beaa-363b0aeea220 -- POST / 200 248.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,337 mnist_classifier_MNISTClassifier jbr5utsh e288de08-afaf-43d9-bb71-b44cab98f810 -- POST / 200 247.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,337 mnist_classifier_MNISTClassifier jbr5utsh 2bedd0ec-bdcb-44dc-8a1a-e8bd92700537 -- POST / 200 247.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,338 mnist_classifier_MNISTClassifier jbr5utsh 83b605c7-c560-4243-8168-6be427aa7903 -- POST / 200 246.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,338 mnist_classifier_MNISTClassifier jbr5utsh 2186526f-7d4d-4c14-bdb6-c151a2d0a0a8 -- POST / 200 246.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,339 mnist_classifier_MNISTClassifier jbr5utsh b816a857-4768-440d-ab5f-39cf88af64bd -- POST / 200 246.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,339 mnist_classifier_MNISTClassifier jbr5utsh 478e4643-9293-43f8-a866-77378b40c5b1 -- POST / 200 245.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,341 mnist_classifier_MNISTClassifier jbr5utsh f6e2484f-fd52-4c9a-8945-9846f714bf12 -- POST / 200 245.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,341 mnist_classifier_MNISTClassifier jbr5utsh 6bd43860-ddde-443d-aa53-7492036a5acb -- POST / 200 244.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,341 mnist_classifier_MNISTClassifier jbr5utsh 4709738d-5a5b-4024-bca8-f5cb914cd409 -- POST / 200 242.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,342 mnist_classifier_MNISTClassifier jbr5utsh afe33616-f7cf-4a5d-81c9-f978837f0df5 -- POST / 200 241.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,342 mnist_classifier_MNISTClassifier jbr5utsh 12aeb126-fcc6-4be0-9ec5-ca858091870a -- POST / 200 238.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,342 mnist_classifier_MNISTClassifier jbr5utsh f642e932-385d-4de5-bf83-362b3d27a702 -- POST / 200 238.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,342 mnist_classifier_MNISTClassifier jbr5utsh 674406ff-c19b-4d03-a918-06dc792c4734 -- POST / 200 238.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,343 mnist_classifier_MNISTClassifier jbr5utsh d2845995-8442-455b-a970-290049362684 -- POST / 200 236.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,343 mnist_classifier_MNISTClassifier jbr5utsh 787e841f-02f9-4eca-9830-91d4aa046d97 -- POST / 200 237.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,343 mnist_classifier_MNISTClassifier jbr5utsh 7038bf03-e1a1-4f9a-b31e-5e710ee2e6c0 -- POST / 200 237.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,344 mnist_classifier_MNISTClassifier jbr5utsh e0c3eeac-180c-437f-929a-41ca8b2961ae -- POST / 200 237.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,345 mnist_classifier_MNISTClassifier jbr5utsh 4ae18ccd-9087-4a89-959d-4909716aae5a -- POST / 200 237.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,345 mnist_classifier_MNISTClassifier jbr5utsh 1675af5d-5791-4941-9846-65f8a61d90f0 -- POST / 200 236.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,346 mnist_classifier_MNISTClassifier jbr5utsh 352ed0e4-b2b5-4576-b63c-f1aefddd0da1 -- POST / 200 235.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,352 mnist_classifier_MNISTClassifier jbr5utsh 17885cb7-ae18-4ddf-a06a-b1b64069d796 -- POST / 200 232.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,355 mnist_classifier_MNISTClassifier jbr5utsh 0e7d3ece-af24-47cf-8419-fa235c667822 -- POST / 200 241.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,360 mnist_classifier_MNISTClassifier jbr5utsh 222bbba0-9207-4ed8-ba3c-67d59eaf3c79 -- POST / 200 234.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,360 mnist_classifier_MNISTClassifier jbr5utsh a6f3dcaa-68c0-4feb-a7eb-4382596ceeed -- POST / 200 244.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,360 mnist_classifier_MNISTClassifier jbr5utsh 80d253b9-5c3d-43e6-a9a4-7f328aa0f8df -- POST / 200 234.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,361 mnist_classifier_MNISTClassifier jbr5utsh 73a5f5b5-9387-4afa-b931-1b7957a8481b -- POST / 200 234.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,361 mnist_classifier_MNISTClassifier jbr5utsh fd34f07f-bc91-4838-8ca9-829d236a5de7 -- POST / 200 233.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,363 mnist_classifier_MNISTClassifier jbr5utsh e67d153a-dbd1-487f-a664-6a64fea1add7 -- POST / 200 235.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,364 mnist_classifier_MNISTClassifier jbr5utsh 1409dbaa-4d7e-4838-943c-e166beaa7863 -- POST / 200 236.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,364 mnist_classifier_MNISTClassifier jbr5utsh 94bce15b-4fa2-466b-8d58-abcd9c3b8843 -- POST / 200 236.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,364 mnist_classifier_MNISTClassifier jbr5utsh 904fe50f-71b4-4e9a-a2cb-070e21221234 -- POST / 200 236.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,365 mnist_classifier_MNISTClassifier jbr5utsh 79e444e6-06df-4894-89f1-54fc25b672e4 -- POST / 200 184.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,365 mnist_classifier_MNISTClassifier jbr5utsh 59e8582e-4a73-4367-b700-1ea43bf12755 -- POST / 200 180.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,365 mnist_classifier_MNISTClassifier jbr5utsh 85b5bbe2-29c5-407b-890b-8d0c1dde1bb6 -- POST / 200 179.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,365 mnist_classifier_MNISTClassifier jbr5utsh 4b054eee-9055-4a79-91cc-0cb7d5e42bb8 -- POST / 200 176.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,365 mnist_classifier_MNISTClassifier jbr5utsh c920a15c-a693-4811-b3b8-acdf5fd023f2 -- POST / 200 176.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,366 mnist_classifier_MNISTClassifier jbr5utsh a34cc27f-60c0-4d50-9398-a08e57af4a14 -- POST / 200 176.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,367 mnist_classifier_MNISTClassifier jbr5utsh 099f02c8-9c1d-4bb9-bd5a-398cd993c863 -- POST / 200 257.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,368 mnist_classifier_MNISTClassifier jbr5utsh fa6048e1-a4e1-42e8-870c-c31d1876950f -- POST / 200 176.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,368 mnist_classifier_MNISTClassifier jbr5utsh b6f500d9-43ee-4661-b270-08ac205ed581 -- POST / 200 176.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,369 mnist_classifier_MNISTClassifier jbr5utsh 275949f1-fb4f-424e-be65-b745ca46d7e1 -- POST / 200 177.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,369 mnist_classifier_MNISTClassifier jbr5utsh 32ff640b-faee-4d96-a783-af9406e8db51 -- POST / 200 176.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,370 mnist_classifier_MNISTClassifier jbr5utsh 3d87be1a-90b4-4a55-b2bf-e145c47f1f0d -- POST / 200 176.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,370 mnist_classifier_MNISTClassifier jbr5utsh 5b8f24c3-e666-46ba-96c2-2c278922928c -- POST / 200 176.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,370 mnist_classifier_MNISTClassifier jbr5utsh 3b5ba4f2-7471-49a2-bafe-77569a707b0f -- POST / 200 176.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,371 mnist_classifier_MNISTClassifier jbr5utsh 4ccb055d-b7ed-4ccb-8ffa-9c41fcd3671f -- POST / 200 261.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,609 mnist_classifier_MNISTClassifier jbr5utsh 9673a7cc-c1b1-42ac-abac-68a004608d74 -- POST / 200 414.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,612 mnist_classifier_MNISTClassifier jbr5utsh d1e4e8b4-1e40-40a1-b12f-4f3caf9c86e5 -- POST / 200 417.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,615 mnist_classifier_MNISTClassifier jbr5utsh 50f65bf3-1968-4d90-9b17-8f1d2fb11394 -- POST / 200 420.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,616 mnist_classifier_MNISTClassifier jbr5utsh f0f7aa55-19e8-4f5b-a3fc-969966c1c875 -- POST / 200 415.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,617 mnist_classifier_MNISTClassifier jbr5utsh 486a8d19-b4d5-46bb-ba95-ff12bdbcb4b3 -- POST / 200 421.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,620 mnist_classifier_MNISTClassifier jbr5utsh e127ab9a-30a6-4753-8d46-42b20428b9bb -- POST / 200 420.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,624 mnist_classifier_MNISTClassifier jbr5utsh 6848e4b5-d5c6-4198-bdd7-6cf20315cf6c -- POST / 200 420.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,624 mnist_classifier_MNISTClassifier jbr5utsh 591dfff5-fdcf-4dbe-b446-fd30da01f529 -- POST / 200 418.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,751 mnist_classifier_MNISTClassifier jbr5utsh cc165875-4d4f-454c-be83-2f22776b79ac -- POST / 200 427.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,752 mnist_classifier_MNISTClassifier jbr5utsh afb3c4fb-c0d3-4d83-9c6e-4a96ed5a2b48 -- POST / 200 390.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,753 mnist_classifier_MNISTClassifier jbr5utsh 918e8463-7265-4f12-9916-8d32e35974a0 -- POST / 200 386.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,754 mnist_classifier_MNISTClassifier jbr5utsh 0bdb9c05-03ac-4fd7-a30e-1352ce81ce7a -- POST / 200 429.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,754 mnist_classifier_MNISTClassifier jbr5utsh 7ac8ae7b-1953-46cd-bca9-b8b684a4f3a5 -- POST / 200 388.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,756 mnist_classifier_MNISTClassifier jbr5utsh b581f574-f06f-481c-88fd-7b5317acafde -- POST / 200 380.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,756 mnist_classifier_MNISTClassifier jbr5utsh ba017734-d333-433b-98fb-b2a76b249f5f -- POST / 200 378.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,757 mnist_classifier_MNISTClassifier jbr5utsh e68d6e1a-b56f-4eb8-8013-e34ebcf20b29 -- POST / 200 375.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,757 mnist_classifier_MNISTClassifier jbr5utsh 4aa20440-6e7b-41a8-8a0b-57ab729a227d -- POST / 200 377.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,758 mnist_classifier_MNISTClassifier jbr5utsh 6e580c9e-1da1-47f4-807d-d906f7eb6a40 -- POST / 200 377.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,758 mnist_classifier_MNISTClassifier jbr5utsh 86c338a3-5a24-4e9d-937f-99e2c0feef45 -- POST / 200 373.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,758 mnist_classifier_MNISTClassifier jbr5utsh ca3c8653-651c-4819-b3be-e7f02fe4c518 -- POST / 200 374.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,760 mnist_classifier_MNISTClassifier jbr5utsh f46bc85b-ab70-4033-8145-8d26774921b4 -- POST / 200 373.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,761 mnist_classifier_MNISTClassifier jbr5utsh 0d21e0b7-8c0d-4875-a82b-6fe588f35ba9 -- POST / 200 373.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,761 mnist_classifier_MNISTClassifier jbr5utsh 16bdd879-9bcb-47b2-b8c8-6d6217334c50 -- POST / 200 373.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,762 mnist_classifier_MNISTClassifier jbr5utsh 28d68fe5-830f-42a1-b702-fdebd577593d -- POST / 200 370.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,762 mnist_classifier_MNISTClassifier jbr5utsh 24ae2edb-e9d9-4b2d-9625-e7a3d4ef65eb -- POST / 200 374.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,763 mnist_classifier_MNISTClassifier jbr5utsh d6fd3d77-03ba-4ece-8ae1-f843479391db -- POST / 200 373.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,763 mnist_classifier_MNISTClassifier jbr5utsh 505c8330-3776-4747-8c17-b437912570a3 -- POST / 200 371.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,764 mnist_classifier_MNISTClassifier jbr5utsh ed8e3d1f-18e8-41de-9dbe-123e59fb9cfa -- POST / 200 372.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,765 mnist_classifier_MNISTClassifier jbr5utsh 7baf684f-f6ab-4a26-81ce-b23724032af4 -- POST / 200 371.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,765 mnist_classifier_MNISTClassifier jbr5utsh 35d1031d-65a7-444e-bd66-48c82adae25d -- POST / 200 369.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,767 mnist_classifier_MNISTClassifier jbr5utsh 302479f4-8c6e-452a-9b89-25e38fc153a2 -- POST / 200 372.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,768 mnist_classifier_MNISTClassifier jbr5utsh 42d37c90-bd84-464b-ab87-e609ca07009a -- POST / 200 370.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,769 mnist_classifier_MNISTClassifier jbr5utsh e98a9381-7d21-48a6-8a6b-acae0d5378b1 -- POST / 200 369.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,769 mnist_classifier_MNISTClassifier jbr5utsh 4768fd8f-8f63-4ab4-b480-7cf20e9faa5b -- POST / 200 368.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,769 mnist_classifier_MNISTClassifier jbr5utsh ff729fee-54a1-494e-9fe4-6945e3571e24 -- POST / 200 368.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,770 mnist_classifier_MNISTClassifier jbr5utsh 4882336d-87f2-4f54-be59-12bfe252b2d2 -- POST / 200 369.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,771 mnist_classifier_MNISTClassifier jbr5utsh f8b764b1-6a15-419f-b3e6-e169375ce5db -- POST / 200 369.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,773 mnist_classifier_MNISTClassifier jbr5utsh d27a1a86-fe0c-4e7d-9bcd-b0cc573272c7 -- POST / 200 371.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,774 mnist_classifier_MNISTClassifier jbr5utsh 8ea65f16-09a9-4520-9779-375750f86b61 -- POST / 200 369.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,774 mnist_classifier_MNISTClassifier jbr5utsh bd278cf5-ab9f-4ebc-8d3f-1116c136836e -- POST / 200 368.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,785 mnist_classifier_MNISTClassifier jbr5utsh cd4f807f-1625-48c0-8049-09e96ea0657a -- POST / 200 374.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,786 mnist_classifier_MNISTClassifier jbr5utsh 528fd805-4bd1-4bf5-8567-c092e1c62b50 -- POST / 200 377.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,787 mnist_classifier_MNISTClassifier jbr5utsh a6a29d35-9067-4139-bbc8-7f13a3edb2e5 -- POST / 200 243.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,787 mnist_classifier_MNISTClassifier jbr5utsh 87d92afa-ca1b-464e-99cc-33bcb665465f -- POST / 200 238.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,787 mnist_classifier_MNISTClassifier jbr5utsh 497f54b2-10aa-4df7-8a3c-36cd5e402ac5 -- POST / 200 238.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,789 mnist_classifier_MNISTClassifier jbr5utsh 83fc71c3-cf63-4200-9216-25f8d1503e4b -- POST / 200 224.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,797 mnist_classifier_MNISTClassifier jbr5utsh 15f410e9-fb11-48f5-92a7-726074b112fd -- POST / 200 231.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,797 mnist_classifier_MNISTClassifier jbr5utsh e5ff32cc-e06a-4ad1-b0ed-b4edcbae7cf3 -- POST / 200 230.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,797 mnist_classifier_MNISTClassifier jbr5utsh efa695d6-6d01-4bad-b10a-bda699bd61a8 -- POST / 200 229.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,797 mnist_classifier_MNISTClassifier jbr5utsh 863c8ca9-9eda-4fbb-b543-8628c5d7e49a -- POST / 200 229.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,800 mnist_classifier_MNISTClassifier jbr5utsh b8f08ffc-a3c2-4970-809e-776e8f0d0c76 -- POST / 200 231.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,803 mnist_classifier_MNISTClassifier jbr5utsh fb47db7c-c7f2-463d-af88-570bb928f704 -- POST / 200 234.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,804 mnist_classifier_MNISTClassifier jbr5utsh 8a78dcd7-a6b5-4b21-ad06-b1f588b26b2e -- POST / 200 233.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,805 mnist_classifier_MNISTClassifier jbr5utsh 9e000104-79cd-4555-9447-8657180189c6 -- POST / 200 233.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,805 mnist_classifier_MNISTClassifier jbr5utsh 40ed19a6-498c-48e9-ab16-d1a87022ff5c -- POST / 200 233.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,805 mnist_classifier_MNISTClassifier jbr5utsh c934b1c5-438f-4e3f-b261-8e30d94256c9 -- POST / 200 232.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,806 mnist_classifier_MNISTClassifier jbr5utsh 9d3cddee-fa10-4cc9-bc2b-b58eea4567ca -- POST / 200 233.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,806 mnist_classifier_MNISTClassifier jbr5utsh 602e2bf9-511f-4ba1-bce7-7bcd2d775c2b -- POST / 200 232.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,806 mnist_classifier_MNISTClassifier jbr5utsh 55912999-3686-44fb-8d96-b0dc74b810cb -- POST / 200 233.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,806 mnist_classifier_MNISTClassifier jbr5utsh f4cf7071-dd11-49d2-8954-82e5473f2321 -- POST / 200 231.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,807 mnist_classifier_MNISTClassifier jbr5utsh 600e755c-6917-4d1a-bedb-8d170b0fec5b -- POST / 200 230.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,807 mnist_classifier_MNISTClassifier jbr5utsh 4339376d-6bc5-4841-82af-91fb7516e449 -- POST / 200 230.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,808 mnist_classifier_MNISTClassifier jbr5utsh 804395d1-f94c-4704-b2b4-4512e1694101 -- POST / 200 231.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,809 mnist_classifier_MNISTClassifier jbr5utsh 4d5cf8d6-7c7b-4ee7-bd35-df846fb93306 -- POST / 200 231.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,810 mnist_classifier_MNISTClassifier jbr5utsh 9f5b7fff-48f2-42c5-bcc1-f337e565eeef -- POST / 200 231.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,810 mnist_classifier_MNISTClassifier jbr5utsh 86bec0fd-5911-4860-913c-1ebff909185c -- POST / 200 230.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,810 mnist_classifier_MNISTClassifier jbr5utsh 936a29e8-939e-459e-8589-ca9e5a94c485 -- POST / 200 224.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,810 mnist_classifier_MNISTClassifier jbr5utsh 155a7f24-0782-47c2-a997-18607c41cf02 -- POST / 200 224.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,810 mnist_classifier_MNISTClassifier jbr5utsh 9c940b5d-5df3-4fd7-8c3f-1063f13692f7 -- POST / 200 222.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,810 mnist_classifier_MNISTClassifier jbr5utsh 6250a4e9-2c37-43f9-81ee-bd800de2177d -- POST / 200 219.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,811 mnist_classifier_MNISTClassifier jbr5utsh 98b4e843-2931-46c4-af6d-43d4a190d871 -- POST / 200 219.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,811 mnist_classifier_MNISTClassifier jbr5utsh 88ce6c00-21e7-4789-a89e-ed9fd734b281 -- POST / 200 218.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,811 mnist_classifier_MNISTClassifier jbr5utsh 4b85e6b1-0c86-4201-b04c-aeb2e20db553 -- POST / 200 183.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,811 mnist_classifier_MNISTClassifier jbr5utsh e0671758-9c0e-45f5-aa43-dfa40650a8d0 -- POST / 200 183.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,811 mnist_classifier_MNISTClassifier jbr5utsh 92f72098-eb89-44ad-82f6-81ec8092e518 -- POST / 200 178.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,811 mnist_classifier_MNISTClassifier jbr5utsh 3a27b60b-e29c-4075-9dec-ebc66b58763c -- POST / 200 178.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,812 mnist_classifier_MNISTClassifier jbr5utsh 086c74dc-d296-46f2-b9f8-12c2abe8d83a -- POST / 200 175.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,812 mnist_classifier_MNISTClassifier jbr5utsh 60127e8d-0923-4980-bd6f-922a94e61f0c -- POST / 200 173.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,812 mnist_classifier_MNISTClassifier jbr5utsh 051412a9-85d9-4ca0-8969-a852f9d5f586 -- POST / 200 172.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,812 mnist_classifier_MNISTClassifier jbr5utsh 089d8621-58c1-4268-aeb4-6d53a1aa2458 -- POST / 200 170.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,814 mnist_classifier_MNISTClassifier jbr5utsh 02dfd42b-4a7a-448f-a97d-26170b9012b3 -- POST / 200 265.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,815 mnist_classifier_MNISTClassifier jbr5utsh 4c9f2bff-17a7-44da-b857-634e2f04183f -- POST / 200 267.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,815 mnist_classifier_MNISTClassifier jbr5utsh 0c5be0b2-35ae-464f-a7cb-88ce2cd5fd86 -- POST / 200 267.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,816 mnist_classifier_MNISTClassifier jbr5utsh 83be2594-229e-4c3a-984d-9586ed6d4bed -- POST / 200 267.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,816 mnist_classifier_MNISTClassifier jbr5utsh f1b6fc34-1412-4d45-af74-5ed129b25642 -- POST / 200 268.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,817 mnist_classifier_MNISTClassifier jbr5utsh 16cf68f9-968f-4944-ad40-057ab87cb1bf -- POST / 200 267.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,817 mnist_classifier_MNISTClassifier jbr5utsh c74d09bf-8eac-4571-9a5a-129ea5df7c3e -- POST / 200 267.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,817 mnist_classifier_MNISTClassifier jbr5utsh 510a36bb-52e7-43be-99ec-839f50ea272c -- POST / 200 267.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,817 mnist_classifier_MNISTClassifier jbr5utsh c5cb0aa3-966f-4f0b-9bea-a947ac0de09a -- POST / 200 267.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,818 mnist_classifier_MNISTClassifier jbr5utsh 2c3c7096-ccf7-4864-be26-e0d53249e1da -- POST / 200 267.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,818 mnist_classifier_MNISTClassifier jbr5utsh 65516e56-79b6-4872-9f71-0afe6f382d2b -- POST / 200 266.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,818 mnist_classifier_MNISTClassifier jbr5utsh 0072637d-25dc-480a-b0ec-0af802bc5dbe -- POST / 200 266.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,819 mnist_classifier_MNISTClassifier jbr5utsh 4f5b1f46-abfa-466a-96d4-8169635feec5 -- POST / 200 266.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,819 mnist_classifier_MNISTClassifier jbr5utsh 608140cf-bd48-47ad-85a0-60c9fdcc41d7 -- POST / 200 265.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,819 mnist_classifier_MNISTClassifier jbr5utsh 81ffb5fc-449f-418a-9e92-e71fde3e5419 -- POST / 200 265.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,820 mnist_classifier_MNISTClassifier jbr5utsh 95b3d89a-9ac2-4fa4-8a12-4d142b1b1431 -- POST / 200 264.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,820 mnist_classifier_MNISTClassifier jbr5utsh 55ea9897-dd28-45cf-b17a-d2258aee2505 -- POST / 200 264.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,820 mnist_classifier_MNISTClassifier jbr5utsh 4c36c7c4-6965-4f86-98be-ece33ba354ec -- POST / 200 261.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,821 mnist_classifier_MNISTClassifier jbr5utsh 3f76e83b-cf96-4787-ba4c-3c53d7a823c1 -- POST / 200 261.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,821 mnist_classifier_MNISTClassifier jbr5utsh 0894f8e5-2c74-435d-9291-03c9c91d3e7e -- POST / 200 261.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,821 mnist_classifier_MNISTClassifier jbr5utsh f7f78635-1774-4022-8c61-f4f420678709 -- POST / 200 260.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,822 mnist_classifier_MNISTClassifier jbr5utsh 9870378c-5465-43c0-a69c-0b7af909df64 -- POST / 200 260.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,822 mnist_classifier_MNISTClassifier jbr5utsh 2ec9fd89-0b9f-48b0-ae6d-b67a7e8bec8c -- POST / 200 258.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,822 mnist_classifier_MNISTClassifier jbr5utsh 3b3c8fa1-7c90-4d63-b505-c01a904b7341 -- POST / 200 260.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,822 mnist_classifier_MNISTClassifier jbr5utsh fc973bed-5083-48db-8c47-e99578fb14be -- POST / 200 260.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,823 mnist_classifier_MNISTClassifier jbr5utsh 944e359c-56ce-4628-baa0-4927ce1dbb12 -- POST / 200 260.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,823 mnist_classifier_MNISTClassifier jbr5utsh 037bbee7-cba0-466a-a162-aa08e8cdb591 -- POST / 200 260.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:06,824 mnist_classifier_MNISTClassifier jbr5utsh 381a5569-c076-4d62-aa01-184a9a867553 -- POST / 200 258.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,012 mnist_classifier_MNISTClassifier jbr5utsh 2acb740f-0d77-4d61-a462-ea4a07f529a8 -- POST / 200 257.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,014 mnist_classifier_MNISTClassifier jbr5utsh 0d5b0d1e-7d52-45f0-a45f-072c733b31a2 -- POST / 200 250.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,018 mnist_classifier_MNISTClassifier jbr5utsh fabd6d91-29ca-4505-a836-baf998d9b893 -- POST / 200 251.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,030 mnist_classifier_MNISTClassifier jbr5utsh 05b50ec7-d7c2-4501-ace7-89b17186f654 -- POST / 200 259.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,032 mnist_classifier_MNISTClassifier jbr5utsh 8ee28bbd-8895-4ffc-b228-d041656d1d06 -- POST / 200 204.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,033 mnist_classifier_MNISTClassifier jbr5utsh f787ac8c-90a3-4129-9788-5bc33a0624ae -- POST / 200 244.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,034 mnist_classifier_MNISTClassifier jbr5utsh a7579dac-7393-4053-a5c5-10432eb931c9 -- POST / 200 209.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,039 mnist_classifier_MNISTClassifier jbr5utsh a0c4027a-fd91-4fd6-9ad8-de00d9e68f4d -- POST / 200 207.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,041 mnist_classifier_MNISTClassifier jbr5utsh d719d0a4-6431-4db4-acb2-bfbf33513829 -- POST / 200 210.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,041 mnist_classifier_MNISTClassifier jbr5utsh 8c114972-6431-4ee2-bb69-10ea6d566c2e -- POST / 200 209.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,042 mnist_classifier_MNISTClassifier jbr5utsh f4841854-f039-4c5c-94e2-35415419f0fb -- POST / 200 209.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,140 mnist_classifier_MNISTClassifier jbr5utsh 16af71eb-b179-46e6-b7eb-ccb81b9e31f9 -- POST / 200 305.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,140 mnist_classifier_MNISTClassifier jbr5utsh d70e683c-729f-412e-8f82-6cfb38fdacbf -- POST / 200 190.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,141 mnist_classifier_MNISTClassifier jbr5utsh 5d9fa28b-4983-4c3e-b138-c69779377cfc -- POST / 200 305.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,142 mnist_classifier_MNISTClassifier jbr5utsh 7a80b939-9e7e-4967-8159-ef7174ae9e62 -- POST / 200 304.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,142 mnist_classifier_MNISTClassifier jbr5utsh 49a10bb1-9398-4d42-b2f9-c22b73246798 -- POST / 200 304.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,143 mnist_classifier_MNISTClassifier jbr5utsh 7b556414-099e-4b7a-8a68-20877f1e53e8 -- POST / 200 305.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,144 mnist_classifier_MNISTClassifier jbr5utsh 9dfe9489-ce6a-4aab-b974-2d51ecb0063a -- POST / 200 305.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,144 mnist_classifier_MNISTClassifier jbr5utsh bde06d6b-7271-41f4-a131-1c12ff1e626a -- POST / 200 304.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,144 mnist_classifier_MNISTClassifier jbr5utsh d68ffd8a-8460-44bc-80cd-8b047fe275f8 -- POST / 200 303.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,145 mnist_classifier_MNISTClassifier jbr5utsh be231c7e-1fd0-4866-9ca4-b2474757be1f -- POST / 200 303.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,145 mnist_classifier_MNISTClassifier jbr5utsh e2385eb2-ce51-474c-8759-7f60731f7e4d -- POST / 200 302.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,145 mnist_classifier_MNISTClassifier jbr5utsh 8bbf95ac-eb27-4c20-8aae-061cd9b0b857 -- POST / 200 302.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,146 mnist_classifier_MNISTClassifier jbr5utsh b2942d58-fc33-4f64-abaa-47d7b56694c2 -- POST / 200 302.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,146 mnist_classifier_MNISTClassifier jbr5utsh ae89f9ba-bc16-4080-a2e4-36535561416d -- POST / 200 302.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,146 mnist_classifier_MNISTClassifier jbr5utsh 1aac590d-5599-4978-b1e1-7b26d77d240e -- POST / 200 302.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,147 mnist_classifier_MNISTClassifier jbr5utsh fec74daa-53da-4cce-a13c-2f84c02da621 -- POST / 200 301.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,149 mnist_classifier_MNISTClassifier jbr5utsh ed8a3686-dad4-4425-b6d7-99b6af1a0f7e -- POST / 200 300.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,149 mnist_classifier_MNISTClassifier jbr5utsh a89895d1-a835-4826-8b8e-9f802bbc5dde -- POST / 200 300.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,150 mnist_classifier_MNISTClassifier jbr5utsh ee6213e2-2fd0-4e83-85cf-e3dfe82e5c08 -- POST / 200 300.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,151 mnist_classifier_MNISTClassifier jbr5utsh cc5df727-7487-467c-9856-08271e1d65a8 -- POST / 200 297.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,152 mnist_classifier_MNISTClassifier jbr5utsh c7857441-9237-4b82-827c-48f2c03b6517 -- POST / 200 298.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,152 mnist_classifier_MNISTClassifier jbr5utsh 41ae093a-8598-4bd0-84eb-14969d0c9967 -- POST / 200 284.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,153 mnist_classifier_MNISTClassifier jbr5utsh 1b0bd464-d4fe-41e1-98d9-5f26762a77b9 -- POST / 200 284.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,153 mnist_classifier_MNISTClassifier jbr5utsh 1e0935e5-b09c-4a90-a49a-52d8cdade210 -- POST / 200 275.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,153 mnist_classifier_MNISTClassifier jbr5utsh 28a8bbef-6f99-4129-ab1f-0965b5170e6d -- POST / 200 273.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,153 mnist_classifier_MNISTClassifier jbr5utsh 9a6f3a6d-6514-472b-add8-4dfa866fadde -- POST / 200 273.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,153 mnist_classifier_MNISTClassifier jbr5utsh eb89e7d2-1c9f-492f-a6e8-d084b351b49f -- POST / 200 271.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,154 mnist_classifier_MNISTClassifier jbr5utsh 477f51e3-f9d6-427c-8e51-f5516a6ce118 -- POST / 200 271.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,154 mnist_classifier_MNISTClassifier jbr5utsh f3d927c9-c282-430f-b227-5e48465ce348 -- POST / 200 264.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,154 mnist_classifier_MNISTClassifier jbr5utsh 81fda4e2-b82b-4505-a7ea-50790a05a140 -- POST / 200 259.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,154 mnist_classifier_MNISTClassifier jbr5utsh 85bc01c6-33ee-44ac-93fc-732681f907b9 -- POST / 200 258.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,155 mnist_classifier_MNISTClassifier jbr5utsh 36a1e1e1-881a-4fa7-b0b0-ef31ac37d409 -- POST / 200 257.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,155 mnist_classifier_MNISTClassifier jbr5utsh 0c0e8f6e-e30f-4932-90cc-ee6c6fd93302 -- POST / 200 256.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,155 mnist_classifier_MNISTClassifier jbr5utsh 3b61bc42-55d9-4c05-a0d9-f7ec00fa664b -- POST / 200 255.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,156 mnist_classifier_MNISTClassifier jbr5utsh 955eac78-1f09-4cf6-b4d6-319947ed32d5 -- POST / 200 253.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,156 mnist_classifier_MNISTClassifier jbr5utsh 2356e605-2f68-46e3-b2ae-428e93e35376 -- POST / 200 251.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,156 mnist_classifier_MNISTClassifier jbr5utsh 2fdb9991-eb2b-4a19-a69d-7f845717f2d7 -- POST / 200 250.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,157 mnist_classifier_MNISTClassifier jbr5utsh 41d38884-c4dc-4697-a964-93aba1851478 -- POST / 200 249.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,157 mnist_classifier_MNISTClassifier jbr5utsh 65977e0c-981d-4cfa-b579-b9d4d858d820 -- POST / 200 246.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,157 mnist_classifier_MNISTClassifier jbr5utsh 5b4812ab-9e55-4fc8-848a-f3df879d6c7a -- POST / 200 243.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,158 mnist_classifier_MNISTClassifier jbr5utsh 01717672-5cd5-4408-b724-47d8e71e7744 -- POST / 200 242.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,158 mnist_classifier_MNISTClassifier jbr5utsh cffbc41f-1510-4fa2-b4f6-8a0125bc3a82 -- POST / 200 241.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,158 mnist_classifier_MNISTClassifier jbr5utsh 684d057b-dd6c-4ae0-aee8-852dc68bed6e -- POST / 200 239.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,159 mnist_classifier_MNISTClassifier jbr5utsh c8e2b18a-7b69-4521-a726-d4dc6c0c5dcc -- POST / 200 239.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,159 mnist_classifier_MNISTClassifier jbr5utsh c5466f7f-f5aa-4a54-9713-c89db05a3908 -- POST / 200 239.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,159 mnist_classifier_MNISTClassifier jbr5utsh f4278f5e-3fa0-46ca-950b-ae727f239990 -- POST / 200 238.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,160 mnist_classifier_MNISTClassifier jbr5utsh 9f0b45cb-b8a9-4efa-b354-45506b9c76fa -- POST / 200 239.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,162 mnist_classifier_MNISTClassifier jbr5utsh 04ca988f-adf5-4760-b736-34309ccc2def -- POST / 200 242.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,162 mnist_classifier_MNISTClassifier jbr5utsh e9274da3-e91a-49e1-8d1b-57bff11565a7 -- POST / 200 212.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,163 mnist_classifier_MNISTClassifier jbr5utsh 6ab6730f-f3eb-44b4-80e2-bef3b1ddeb8d -- POST / 200 241.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,165 mnist_classifier_MNISTClassifier jbr5utsh 21e453ab-e062-43c3-a0ef-1ba7750b37ef -- POST / 200 242.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,165 mnist_classifier_MNISTClassifier jbr5utsh 9ce8e5ec-55f2-44c5-97af-8745c6bf7116 -- POST / 200 242.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,165 mnist_classifier_MNISTClassifier jbr5utsh dc63d2af-ad2a-4b66-8332-3de24332181d -- POST / 200 242.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,165 mnist_classifier_MNISTClassifier jbr5utsh 5e647f01-6301-4407-898d-dead2dfc5cc0 -- POST / 200 240.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,167 mnist_classifier_MNISTClassifier jbr5utsh c34c7a75-a55f-46b1-bd79-a4a584337fff -- POST / 200 240.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,170 mnist_classifier_MNISTClassifier jbr5utsh 9e14de3f-af10-4b14-8f46-965c93cff2ae -- POST / 200 241.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,170 mnist_classifier_MNISTClassifier jbr5utsh 783ddd66-8710-442c-a19a-e5dd7b6aa846 -- POST / 200 242.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,171 mnist_classifier_MNISTClassifier jbr5utsh 1bb3ebb6-f79b-471a-a05e-a957682841b0 -- POST / 200 241.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,171 mnist_classifier_MNISTClassifier jbr5utsh dac087f2-9610-446e-a4fa-83721d176600 -- POST / 200 241.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,171 mnist_classifier_MNISTClassifier jbr5utsh 0fe465ba-a0a5-4d0f-8836-832f0175e069 -- POST / 200 239.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,172 mnist_classifier_MNISTClassifier jbr5utsh 6f2ec567-2cb7-4d9c-ac78-241731c2fbda -- POST / 200 239.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,172 mnist_classifier_MNISTClassifier jbr5utsh 3214743e-81bc-4202-9ce0-847ed5f40b2b -- POST / 200 238.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,172 mnist_classifier_MNISTClassifier jbr5utsh d875962e-29eb-475c-90fa-20f3e747f27b -- POST / 200 238.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,172 mnist_classifier_MNISTClassifier jbr5utsh 25358f1a-17f6-4dd6-9106-ac049ba4b21b -- POST / 200 238.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,173 mnist_classifier_MNISTClassifier jbr5utsh 3baa769b-2acc-4ff7-9449-29bbfe0c0c0e -- POST / 200 237.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,173 mnist_classifier_MNISTClassifier jbr5utsh 684fc5db-ddaf-4661-ac86-84bfd561ae20 -- POST / 200 234.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,173 mnist_classifier_MNISTClassifier jbr5utsh 09831ad3-72d3-4e09-affb-714741450aea -- POST / 200 233.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,174 mnist_classifier_MNISTClassifier jbr5utsh 23216b2c-4c26-44f9-8f9b-e71005622076 -- POST / 200 233.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,174 mnist_classifier_MNISTClassifier jbr5utsh 9b5e6153-6956-43d7-8406-3ad731cf77c5 -- POST / 200 233.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,175 mnist_classifier_MNISTClassifier jbr5utsh e4167192-95da-4008-a69c-f778d1ab3092 -- POST / 200 233.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,175 mnist_classifier_MNISTClassifier jbr5utsh 16e6d50e-9339-4715-bd59-29815167a01a -- POST / 200 229.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,175 mnist_classifier_MNISTClassifier jbr5utsh 19ff9ca3-9e4d-4924-a3c7-cc98171e17ae -- POST / 200 229.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,176 mnist_classifier_MNISTClassifier jbr5utsh 2ff9d73d-f0ce-448d-890d-200d20f40f00 -- POST / 200 229.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,176 mnist_classifier_MNISTClassifier jbr5utsh e4091194-13d2-48e6-abc7-d6d14d9ad459 -- POST / 200 229.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,177 mnist_classifier_MNISTClassifier jbr5utsh b8796550-e071-4245-8a03-bbc5f32e93c3 -- POST / 200 228.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,177 mnist_classifier_MNISTClassifier jbr5utsh 9a43ed5e-d4a2-460a-94f4-ddbd8ed49516 -- POST / 200 228.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,177 mnist_classifier_MNISTClassifier jbr5utsh 51a30b10-ee4b-4d03-93f0-5e16cce5036e -- POST / 200 227.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,177 mnist_classifier_MNISTClassifier jbr5utsh cc4a18e0-7436-4aef-9f38-523f8c41a2c7 -- POST / 200 227.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,177 mnist_classifier_MNISTClassifier jbr5utsh 547fdba2-a87b-4546-9c49-d62605e2aef7 -- POST / 200 222.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,177 mnist_classifier_MNISTClassifier jbr5utsh 2935d827-bec3-471b-b3dc-cd464a8649a9 -- POST / 200 222.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,177 mnist_classifier_MNISTClassifier jbr5utsh c4d13ac7-b339-48a8-bee4-a0f06f4ab5fb -- POST / 200 221.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,178 mnist_classifier_MNISTClassifier jbr5utsh 608d719e-825a-43b6-b303-34aabe62d27c -- POST / 200 221.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,178 mnist_classifier_MNISTClassifier jbr5utsh 0ab257bc-3124-489e-9c3a-5691ac9dfae7 -- POST / 200 220.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,178 mnist_classifier_MNISTClassifier jbr5utsh 2186a800-102c-4f6f-b60a-70a524ba1275 -- POST / 200 219.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,178 mnist_classifier_MNISTClassifier jbr5utsh 02546a96-9882-4924-b837-09468263b622 -- POST / 200 218.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,178 mnist_classifier_MNISTClassifier jbr5utsh 53a5e4ef-ce8f-48e6-8d2f-129ca9142323 -- POST / 200 217.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,178 mnist_classifier_MNISTClassifier jbr5utsh 636c3a07-7e6a-4b80-b7d2-27f561f66d30 -- POST / 200 217.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,178 mnist_classifier_MNISTClassifier jbr5utsh 3f6168e3-3206-4409-bcea-27be86e3abf7 -- POST / 200 216.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,178 mnist_classifier_MNISTClassifier jbr5utsh 52dc75ed-16a2-4635-8039-7be2bbafae85 -- POST / 200 215.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,179 mnist_classifier_MNISTClassifier jbr5utsh aaa4d4c5-386b-4d8c-843f-fffc50fb7693 -- POST / 200 135.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,179 mnist_classifier_MNISTClassifier jbr5utsh 9af49a15-0d1b-4f96-aab1-e5e30e9b3d97 -- POST / 200 135.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,180 mnist_classifier_MNISTClassifier jbr5utsh 0610b7a1-440b-4e11-88c5-b6b9a5ea48b9 -- POST / 200 121.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,180 mnist_classifier_MNISTClassifier jbr5utsh 81c330e2-dd10-4346-9031-d5c13412efd8 -- POST / 200 121.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,181 mnist_classifier_MNISTClassifier jbr5utsh 1476350e-b9f3-478c-a54b-c8cd5c8acde2 -- POST / 200 121.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,182 mnist_classifier_MNISTClassifier jbr5utsh 6dcdc970-f5be-4990-8759-3caab5e20005 -- POST / 200 121.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,182 mnist_classifier_MNISTClassifier jbr5utsh 63298e08-588a-4c2c-b918-38f432503021 -- POST / 200 120.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,182 mnist_classifier_MNISTClassifier jbr5utsh 26163af8-1e18-46cd-a1df-3b5c933f6dab -- POST / 200 121.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,182 mnist_classifier_MNISTClassifier jbr5utsh ab643238-5b4e-42e7-93ea-379d9e1e4d7b -- POST / 200 120.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,183 mnist_classifier_MNISTClassifier jbr5utsh 439cc29a-3792-4c1c-a174-05a1f20c164e -- POST / 200 119.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,183 mnist_classifier_MNISTClassifier jbr5utsh f4406a5d-e896-4265-860b-cec70d162624 -- POST / 200 120.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,473 mnist_classifier_MNISTClassifier jbr5utsh f2e2749d-3567-4e93-b9c5-1ee6306edbdb -- POST / 200 288.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,474 mnist_classifier_MNISTClassifier jbr5utsh b55998ea-2eb7-4b7b-9047-778f01c9ba10 -- POST / 200 289.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,476 mnist_classifier_MNISTClassifier jbr5utsh 7bd50830-3678-4cf2-ace6-c3c58f610eec -- POST / 200 291.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,632 mnist_classifier_MNISTClassifier jbr5utsh a1429d8f-d993-46b7-9201-f86146794468 -- POST / 200 441.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,632 mnist_classifier_MNISTClassifier jbr5utsh e061d543-f1bf-42b7-9a84-61c9f764c335 -- POST / 200 438.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,633 mnist_classifier_MNISTClassifier jbr5utsh e159692f-fab6-4f7e-9b61-eff990b058fe -- POST / 200 439.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,634 mnist_classifier_MNISTClassifier jbr5utsh 2c08ce11-653e-4a65-b475-4bec046648cd -- POST / 200 437.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,635 mnist_classifier_MNISTClassifier jbr5utsh 2cc47749-a003-4460-ae19-c23620bfb477 -- POST / 200 436.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,635 mnist_classifier_MNISTClassifier jbr5utsh 14a4e2eb-6544-4bcd-b250-47320360f78b -- POST / 200 429.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,636 mnist_classifier_MNISTClassifier jbr5utsh e286c533-00e5-4490-90e9-73a3552bfcbb -- POST / 200 429.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,636 mnist_classifier_MNISTClassifier jbr5utsh cc687242-4786-4f50-9cd7-605f5d29a054 -- POST / 200 430.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,637 mnist_classifier_MNISTClassifier jbr5utsh 586bb42b-749d-4dbe-8317-936ee1da2ca4 -- POST / 200 436.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,637 mnist_classifier_MNISTClassifier jbr5utsh 38ed9aeb-c441-42f4-a956-b034c6173613 -- POST / 200 435.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,638 mnist_classifier_MNISTClassifier jbr5utsh bde4a690-f467-4504-9001-5754d69ed266 -- POST / 200 436.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,639 mnist_classifier_MNISTClassifier jbr5utsh d8c13ad8-f77e-4f5a-afab-516b4debb552 -- POST / 200 434.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,639 mnist_classifier_MNISTClassifier jbr5utsh 091bad7d-b303-4db1-83f7-dbf9bbb05735 -- POST / 200 424.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,639 mnist_classifier_MNISTClassifier jbr5utsh a71707f6-ad4e-4d62-8812-26845d913c69 -- POST / 200 424.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,640 mnist_classifier_MNISTClassifier jbr5utsh 22d5b7c3-4305-451b-82f1-435499693cd8 -- POST / 200 389.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,640 mnist_classifier_MNISTClassifier jbr5utsh 449aa86d-7ce4-4596-b730-84333b1e76c8 -- POST / 200 422.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,641 mnist_classifier_MNISTClassifier jbr5utsh 58aa6b2c-c272-4cd8-8846-c5dcd42bc64c -- POST / 200 421.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,641 mnist_classifier_MNISTClassifier jbr5utsh 2314d601-98c2-4381-a847-28a048993cbf -- POST / 200 420.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,641 mnist_classifier_MNISTClassifier jbr5utsh 792bff09-5d33-4d74-86e9-50a9e7548662 -- POST / 200 419.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,642 mnist_classifier_MNISTClassifier jbr5utsh 86a6cc89-4a9a-48a8-a269-4a269a269b46 -- POST / 200 408.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,642 mnist_classifier_MNISTClassifier jbr5utsh ee308a8c-b15b-4370-8d2f-73fbdb262451 -- POST / 200 402.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,642 mnist_classifier_MNISTClassifier jbr5utsh f636d981-1f6a-426e-b0d7-0b8b70b6a51a -- POST / 200 402.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,643 mnist_classifier_MNISTClassifier jbr5utsh 917af68e-23cc-4b37-bf07-8750bfa54c7a -- POST / 200 400.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,643 mnist_classifier_MNISTClassifier jbr5utsh c7ad7c5a-3860-469b-aa46-3f3f3f23c221 -- POST / 200 400.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,644 mnist_classifier_MNISTClassifier jbr5utsh f66b736a-ee10-486f-86f1-7e08e2299388 -- POST / 200 398.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,644 mnist_classifier_MNISTClassifier jbr5utsh 75efa701-fe56-4f6a-b660-e5149de1a3e2 -- POST / 200 397.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,645 mnist_classifier_MNISTClassifier jbr5utsh 98b98cd2-02a4-4490-bc55-81b96ab58497 -- POST / 200 397.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,646 mnist_classifier_MNISTClassifier jbr5utsh 37e0047c-e53f-4436-9090-434b99b25c70 -- POST / 200 395.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,646 mnist_classifier_MNISTClassifier jbr5utsh 43d6df98-6087-4fd7-baeb-c3a5383a0a58 -- POST / 200 386.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,647 mnist_classifier_MNISTClassifier jbr5utsh 02c09168-355a-4460-8855-f135e2388d11 -- POST / 200 381.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,648 mnist_classifier_MNISTClassifier jbr5utsh 585ee9f8-9c70-41d8-8f20-52e92827e20c -- POST / 200 377.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,648 mnist_classifier_MNISTClassifier jbr5utsh fb5a97ec-db9b-47a4-83c4-83f7ec9b5086 -- POST / 200 248.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,648 mnist_classifier_MNISTClassifier jbr5utsh fede2465-a75c-40da-b369-11780b5fa3e2 -- POST / 200 248.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,649 mnist_classifier_MNISTClassifier jbr5utsh 22d2b4bc-7984-49c6-97e4-492065653bd7 -- POST / 200 378.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,650 mnist_classifier_MNISTClassifier jbr5utsh 97dce680-38b4-4641-87a4-792e4aa19ed5 -- POST / 200 248.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,651 mnist_classifier_MNISTClassifier jbr5utsh ab4a4184-13fa-411f-8fab-13f2bb985543 -- POST / 200 249.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,656 mnist_classifier_MNISTClassifier jbr5utsh 832ee949-5e6a-49ca-9765-048af824788b -- POST / 200 252.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,656 mnist_classifier_MNISTClassifier jbr5utsh 668e60d8-9fb3-437f-94b7-c6d66cafd7b3 -- POST / 200 252.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,657 mnist_classifier_MNISTClassifier jbr5utsh a40bf54f-4420-48ad-9b3c-75149e4e4d0b -- POST / 200 253.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,657 mnist_classifier_MNISTClassifier jbr5utsh 7f2a1824-0537-4551-b0cd-3a2be28b93c7 -- POST / 200 252.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,658 mnist_classifier_MNISTClassifier jbr5utsh 09a24764-c503-4015-b130-953759a1990a -- POST / 200 252.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,658 mnist_classifier_MNISTClassifier jbr5utsh 214e4bd5-b972-4e89-ae81-4b8f7aa9cc1b -- POST / 200 251.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,659 mnist_classifier_MNISTClassifier jbr5utsh 6cf1cc26-86e0-49da-b830-290cff002c06 -- POST / 200 251.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,660 mnist_classifier_MNISTClassifier jbr5utsh 12826d6d-2d10-4af2-8b49-4b756d9fcdd7 -- POST / 200 253.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,661 mnist_classifier_MNISTClassifier jbr5utsh 7541b65d-c918-4152-a128-35e7b680c9b4 -- POST / 200 252.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,661 mnist_classifier_MNISTClassifier jbr5utsh 4f4db458-98b5-4d77-9a38-4ae27c70b27b -- POST / 200 252.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,661 mnist_classifier_MNISTClassifier jbr5utsh 4c207ded-3c67-497f-a0ad-31606b09532e -- POST / 200 250.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,662 mnist_classifier_MNISTClassifier jbr5utsh 70c2b76d-9a45-4c30-aa03-d4cdedda105e -- POST / 200 251.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,662 mnist_classifier_MNISTClassifier jbr5utsh c88bc263-699d-419b-819b-1b9a779b37dd -- POST / 200 250.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,662 mnist_classifier_MNISTClassifier jbr5utsh 6f0f0f5b-3c70-4152-86b5-c3f7587c1600 -- POST / 200 250.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,663 mnist_classifier_MNISTClassifier jbr5utsh ce44c2ca-0d6b-4598-86b4-7d337c919ba7 -- POST / 200 250.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,663 mnist_classifier_MNISTClassifier jbr5utsh fe5b033a-7a93-4906-82d8-bc8f2339ec89 -- POST / 200 250.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,663 mnist_classifier_MNISTClassifier jbr5utsh 67191fcf-ecfd-4a5c-b039-157a9077daf2 -- POST / 200 247.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,663 mnist_classifier_MNISTClassifier jbr5utsh 2905b705-e1a6-4bfa-9ee4-c01a1203e5d7 -- POST / 200 250.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,664 mnist_classifier_MNISTClassifier jbr5utsh e8c1587e-a1e7-44d3-826f-afa9decd0171 -- POST / 200 247.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,664 mnist_classifier_MNISTClassifier jbr5utsh a12966e1-9342-46b6-b646-a3721cce3b85 -- POST / 200 250.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,664 mnist_classifier_MNISTClassifier jbr5utsh 325fac88-0424-4f36-992c-ad63f4457caa -- POST / 200 246.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,664 mnist_classifier_MNISTClassifier jbr5utsh 803e3df2-2d91-470e-a371-6003d7b18e8f -- POST / 200 246.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,665 mnist_classifier_MNISTClassifier jbr5utsh 1a2f4916-38df-4d2b-9d4d-3dd9f67c98eb -- POST / 200 246.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,665 mnist_classifier_MNISTClassifier jbr5utsh 66399412-cbbf-45d7-b9c0-cde1685f987a -- POST / 200 246.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,665 mnist_classifier_MNISTClassifier jbr5utsh 8b6521d5-26d3-4ca4-893c-a3a249199e6c -- POST / 200 246.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,665 mnist_classifier_MNISTClassifier jbr5utsh 7faaf44f-6034-4248-9baf-6a606e8bddd2 -- POST / 200 246.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,666 mnist_classifier_MNISTClassifier jbr5utsh de9f62a1-99cb-4b51-b45a-8350e297a7af -- POST / 200 246.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,666 mnist_classifier_MNISTClassifier jbr5utsh 6c9e4e10-10fd-472a-8a1b-8a0a1101a8e7 -- POST / 200 245.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,666 mnist_classifier_MNISTClassifier jbr5utsh 7603c4e8-3f90-4c46-8dfd-3bcce09799d1 -- POST / 200 245.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,666 mnist_classifier_MNISTClassifier jbr5utsh 807db3a7-7e7c-4206-99c6-bebcb84b3158 -- POST / 200 245.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,667 mnist_classifier_MNISTClassifier jbr5utsh 1a3618d0-92b4-4f2a-9ea2-6ea75e227e99 -- POST / 200 244.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,667 mnist_classifier_MNISTClassifier jbr5utsh 2303aaaf-e8b6-473c-b4a4-7b46f2691553 -- POST / 200 243.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,667 mnist_classifier_MNISTClassifier jbr5utsh e1d7e7ee-e9d3-4a6d-a45f-4b8aa4c37fa7 -- POST / 200 242.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,667 mnist_classifier_MNISTClassifier jbr5utsh acfa92b6-83b2-4d2f-95c1-b3fa11a834f9 -- POST / 200 240.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,668 mnist_classifier_MNISTClassifier jbr5utsh acdbb3b5-23d8-40e7-a938-049686cc47e2 -- POST / 200 240.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,668 mnist_classifier_MNISTClassifier jbr5utsh 02373589-eea4-46d1-9679-e6eb27f8d91f -- POST / 200 240.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,669 mnist_classifier_MNISTClassifier jbr5utsh 33758395-75d1-45c7-96cb-f2a6243acbbe -- POST / 200 240.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,670 mnist_classifier_MNISTClassifier jbr5utsh 70d047a2-66b0-4f1c-be79-2729e274f1bf -- POST / 200 240.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,670 mnist_classifier_MNISTClassifier jbr5utsh 7d050b21-9513-4d5e-a28a-00389c58f573 -- POST / 200 239.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,670 mnist_classifier_MNISTClassifier jbr5utsh 1b599441-0acf-434f-9813-6fe9aab93022 -- POST / 200 239.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,674 mnist_classifier_MNISTClassifier jbr5utsh d6a0bfdf-f855-4fe2-bfd0-772369e00c23 -- POST / 200 242.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,675 mnist_classifier_MNISTClassifier jbr5utsh 94b11364-c699-4820-9a53-69ccfac3aed1 -- POST / 200 241.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,675 mnist_classifier_MNISTClassifier jbr5utsh 45b3b7a8-0727-40b1-b6eb-1e053d2057eb -- POST / 200 241.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,675 mnist_classifier_MNISTClassifier jbr5utsh cbe1ee8b-8494-4dc4-ac22-1c8ae62364e1 -- POST / 200 241.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,675 mnist_classifier_MNISTClassifier jbr5utsh c7e168f0-2436-45f0-af37-8cb7a1d47c8d -- POST / 200 241.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,676 mnist_classifier_MNISTClassifier jbr5utsh b220ba9b-18af-4cec-bb9a-c553fdc03483 -- POST / 200 241.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,676 mnist_classifier_MNISTClassifier jbr5utsh f6a9b715-18b7-480d-9199-b168bc25eb3b -- POST / 200 240.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,676 mnist_classifier_MNISTClassifier jbr5utsh aaf4e5fa-8c44-46ce-b9e1-f2d05847270c -- POST / 200 237.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,676 mnist_classifier_MNISTClassifier jbr5utsh f264cbe9-dff0-4aad-a4a8-d335a2513cbe -- POST / 200 237.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,680 mnist_classifier_MNISTClassifier jbr5utsh 8d3bf5f0-81bc-4675-81c2-3282c10d808b -- POST / 200 240.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,681 mnist_classifier_MNISTClassifier jbr5utsh 3c8912d0-fb97-4782-9ff8-922f0f1e505e -- POST / 200 240.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,681 mnist_classifier_MNISTClassifier jbr5utsh 4fa5f2b9-d729-47e7-9ac6-83db464bef64 -- POST / 200 240.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,682 mnist_classifier_MNISTClassifier jbr5utsh b94cc973-ea5c-48a2-90be-b2c3751894df -- POST / 200 240.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,683 mnist_classifier_MNISTClassifier jbr5utsh f8411313-a57d-42d8-a9d1-10f718731fcf -- POST / 200 240.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,687 mnist_classifier_MNISTClassifier jbr5utsh 0eeebd78-6937-4134-88bd-90092c5ab75c -- POST / 200 242.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,688 mnist_classifier_MNISTClassifier jbr5utsh a39d9515-415e-4d37-82d0-382a606cbbb7 -- POST / 200 243.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,689 mnist_classifier_MNISTClassifier jbr5utsh 940eb114-27a7-4d4b-8d3a-46897b3121e0 -- POST / 200 243.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,690 mnist_classifier_MNISTClassifier jbr5utsh 03eb79c4-1b01-45a0-9fb0-4581786ef138 -- POST / 200 242.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,690 mnist_classifier_MNISTClassifier jbr5utsh e65e415d-70b5-48e1-aefc-1d685f29d4a0 -- POST / 200 241.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,690 mnist_classifier_MNISTClassifier jbr5utsh 642d5e06-603b-4264-b2ae-e3cf0d8138cf -- POST / 200 241.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,691 mnist_classifier_MNISTClassifier jbr5utsh 5ae66bf8-47c7-48e8-aad7-7da5adfbf896 -- POST / 200 241.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,691 mnist_classifier_MNISTClassifier jbr5utsh a1a34422-b3c9-4aed-bd24-17e5c54400ae -- POST / 200 206.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,691 mnist_classifier_MNISTClassifier jbr5utsh 6ab17612-e671-47d7-983f-9a6e2e1e2f28 -- POST / 200 206.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,692 mnist_classifier_MNISTClassifier jbr5utsh 30e4ae1c-9b2d-4087-815f-88c0709665b0 -- POST / 200 202.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,986 mnist_classifier_MNISTClassifier jbr5utsh 65a64870-d44e-4ad4-94cc-e25e8dda2914 -- POST / 200 293.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,986 mnist_classifier_MNISTClassifier jbr5utsh 19fc3462-382a-497c-832d-7ae2b2943a34 -- POST / 200 293.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,987 mnist_classifier_MNISTClassifier jbr5utsh 71566c7c-8898-48e4-958c-962e42c68fd6 -- POST / 200 295.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,987 mnist_classifier_MNISTClassifier jbr5utsh bb6c7966-db7c-4c8a-b868-d1c3481373c7 -- POST / 200 343.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,988 mnist_classifier_MNISTClassifier jbr5utsh 4e34fbcc-5ef6-4e8a-9647-fc478c96a2bf -- POST / 200 326.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,988 mnist_classifier_MNISTClassifier jbr5utsh 7de0e321-f807-4dcc-9954-48d93ab8201f -- POST / 200 295.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,989 mnist_classifier_MNISTClassifier jbr5utsh 68303798-354a-4ef2-98ea-06175feee251 -- POST / 200 296.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,991 mnist_classifier_MNISTClassifier jbr5utsh 1d07732e-d8e2-48e2-a15f-7571a9ce8895 -- POST / 200 182.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,992 mnist_classifier_MNISTClassifier jbr5utsh 0874041b-aa0f-408d-9501-384bb88d8360 -- POST / 200 202.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,992 mnist_classifier_MNISTClassifier jbr5utsh 73d8f262-0bc2-4df4-b403-55b4a8020dba -- POST / 200 294.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,993 mnist_classifier_MNISTClassifier jbr5utsh ecfa3ca5-0cff-4298-9a1c-ba31a2499c13 -- POST / 200 292.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,993 mnist_classifier_MNISTClassifier jbr5utsh 01f7dbe1-65ef-4d6d-95bf-8f3e30b3d6d7 -- POST / 200 286.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,993 mnist_classifier_MNISTClassifier jbr5utsh 677aa345-f41a-4e69-8b3f-cbe163c9c410 -- POST / 200 284.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,993 mnist_classifier_MNISTClassifier jbr5utsh adffc74d-7d12-40f3-9fb4-3981c66d6557 -- POST / 200 284.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,994 mnist_classifier_MNISTClassifier jbr5utsh eff7745d-d562-46ae-816f-ba7147a14f79 -- POST / 200 284.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,994 mnist_classifier_MNISTClassifier jbr5utsh 93d41533-d5ed-4774-9cfa-58692a236f5b -- POST / 200 284.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,994 mnist_classifier_MNISTClassifier jbr5utsh 840bd167-fd11-4511-9512-6d4b9c21b1de -- POST / 200 284.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,994 mnist_classifier_MNISTClassifier jbr5utsh 7ec46642-3753-46cc-98b4-5e27225d5e44 -- POST / 200 284.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,995 mnist_classifier_MNISTClassifier jbr5utsh 3c1c0436-2bbc-4009-bf4b-725865c679bb -- POST / 200 284.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,995 mnist_classifier_MNISTClassifier jbr5utsh cb3a8699-31b4-48c6-991c-27ca93ed8b31 -- POST / 200 284.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,995 mnist_classifier_MNISTClassifier jbr5utsh 6a3a153f-3aa6-4598-8dbb-e93ba627a5f2 -- POST / 200 285.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,996 mnist_classifier_MNISTClassifier jbr5utsh 61c1793f-13d9-4eaf-b27f-b86acee996f7 -- POST / 200 285.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,996 mnist_classifier_MNISTClassifier jbr5utsh f8347718-bf24-411d-a1ef-fc4972afd2f2 -- POST / 200 285.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,996 mnist_classifier_MNISTClassifier jbr5utsh e61a7eb4-157f-43ae-a83b-640a9051d418 -- POST / 200 285.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,996 mnist_classifier_MNISTClassifier jbr5utsh 113fdd67-5345-4e27-bd9f-de922b685935 -- POST / 200 285.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,997 mnist_classifier_MNISTClassifier jbr5utsh f8074838-e801-4416-949e-52006b4b1922 -- POST / 200 285.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,997 mnist_classifier_MNISTClassifier jbr5utsh 06ab57d3-f602-4405-a5ba-17b9888c0dbe -- POST / 200 273.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,997 mnist_classifier_MNISTClassifier jbr5utsh 5eb2e25c-c3a8-4e36-8af3-a12d5ecd8c23 -- POST / 200 268.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,998 mnist_classifier_MNISTClassifier jbr5utsh 80d0ba70-039f-4f2a-b851-eee64157697d -- POST / 200 265.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,998 mnist_classifier_MNISTClassifier jbr5utsh 9455df72-c70b-4ad7-84b8-73e314c6999f -- POST / 200 265.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,999 mnist_classifier_MNISTClassifier jbr5utsh 026a05f8-5609-4257-b9ce-8c63c174cdcd -- POST / 200 265.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:07,999 mnist_classifier_MNISTClassifier jbr5utsh e49395cc-aed3-4409-a610-7d3e9784242c -- POST / 200 263.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,000 mnist_classifier_MNISTClassifier jbr5utsh 503b0221-fbe5-4616-9a70-4ebbfab71f1e -- POST / 200 261.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,000 mnist_classifier_MNISTClassifier jbr5utsh d15453b5-3292-4c42-98f5-45fc7e685226 -- POST / 200 259.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,000 mnist_classifier_MNISTClassifier jbr5utsh e16ea347-8b6d-40d2-a72b-316866042b1a -- POST / 200 258.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,001 mnist_classifier_MNISTClassifier jbr5utsh f520f92a-dc86-4b61-a5be-aba1c3ad2e57 -- POST / 200 258.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,001 mnist_classifier_MNISTClassifier jbr5utsh 2be447a9-2bde-45ac-b3a3-b4e8c01486a9 -- POST / 200 254.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,002 mnist_classifier_MNISTClassifier jbr5utsh 93e41bd1-9383-404a-9522-5f7a397cae55 -- POST / 200 236.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,002 mnist_classifier_MNISTClassifier jbr5utsh f4a0a6dc-fcda-4eee-acf4-ab51734baf1c -- POST / 200 236.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,002 mnist_classifier_MNISTClassifier jbr5utsh 9a805144-0680-4919-aef6-034cdbf36a9a -- POST / 200 235.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,003 mnist_classifier_MNISTClassifier jbr5utsh ff4995ec-ce79-4c1b-8a11-efa45ee24734 -- POST / 200 234.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,003 mnist_classifier_MNISTClassifier jbr5utsh 019cac7f-b43d-4b76-8040-e610bf61b6cc -- POST / 200 234.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,005 mnist_classifier_MNISTClassifier jbr5utsh 67f3b620-38bb-4793-b466-995734402d6b -- POST / 200 235.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,006 mnist_classifier_MNISTClassifier jbr5utsh 93a003b4-85ff-477f-99f4-442a27c7b006 -- POST / 200 234.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,006 mnist_classifier_MNISTClassifier jbr5utsh 7c85bf10-7ede-4bb6-976a-d6726fa1dc07 -- POST / 200 234.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,007 mnist_classifier_MNISTClassifier jbr5utsh 2fa6cbad-b667-4161-817c-ffbd36a0ce67 -- POST / 200 232.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,007 mnist_classifier_MNISTClassifier jbr5utsh 59891306-48c3-4a31-a05e-81fe10de0ad0 -- POST / 200 232.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,008 mnist_classifier_MNISTClassifier jbr5utsh a0c3b071-fad3-4211-a7e7-1b119c72bab7 -- POST / 200 231.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,008 mnist_classifier_MNISTClassifier jbr5utsh 1fcdb020-f9b7-439f-80ce-fdb906a76e74 -- POST / 200 228.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,008 mnist_classifier_MNISTClassifier jbr5utsh 997599be-5453-406e-8cca-b7782d29eb0d -- POST / 200 228.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,009 mnist_classifier_MNISTClassifier jbr5utsh c1eabd47-d29a-480a-bd32-ae5241755c95 -- POST / 200 226.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,010 mnist_classifier_MNISTClassifier jbr5utsh 9bbb8313-07a3-4258-a6e1-65d8b971a01b -- POST / 200 226.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,011 mnist_classifier_MNISTClassifier jbr5utsh 141ae64c-d335-4915-a9ac-3859ae9b764a -- POST / 200 227.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,012 mnist_classifier_MNISTClassifier jbr5utsh 8e255679-c248-40b4-a6bd-654c7f87b533 -- POST / 200 228.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,013 mnist_classifier_MNISTClassifier jbr5utsh 926ce795-b058-4c1b-acb2-48fcf54982f2 -- POST / 200 226.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,017 mnist_classifier_MNISTClassifier jbr5utsh ad9cf996-d59e-429d-b191-da56961045a7 -- POST / 200 229.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,018 mnist_classifier_MNISTClassifier jbr5utsh ec6f50d6-2c55-4219-893b-7bb8c9101b1d -- POST / 200 228.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,024 mnist_classifier_MNISTClassifier jbr5utsh 325c6f35-13ea-460a-a96a-6c8f936c84ea -- POST / 200 234.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,024 mnist_classifier_MNISTClassifier jbr5utsh 0a09e2be-c660-46b1-a461-5154b0e8e19c -- POST / 200 212.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,024 mnist_classifier_MNISTClassifier jbr5utsh bf9b0357-c788-4962-ac5b-47cbdc33f6a3 -- POST / 200 233.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,024 mnist_classifier_MNISTClassifier jbr5utsh 80c769c9-f874-4970-bb23-7c14e2b646ed -- POST / 200 230.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,025 mnist_classifier_MNISTClassifier jbr5utsh e25c1e60-2cce-4d02-a4e3-10322b153aeb -- POST / 200 229.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,026 mnist_classifier_MNISTClassifier jbr5utsh 45e8aa22-8bd3-47ec-8bab-adee1c821948 -- POST / 200 230.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,030 mnist_classifier_MNISTClassifier jbr5utsh d8c0e30d-cacd-4239-b669-abbaf70324fe -- POST / 200 233.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,033 mnist_classifier_MNISTClassifier jbr5utsh 64fe7122-49d4-44a6-a7ed-2c3ac299397a -- POST / 200 235.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,033 mnist_classifier_MNISTClassifier jbr5utsh 59f6ffc0-2b30-4bba-98d3-0a523e701f7f -- POST / 200 235.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,274 mnist_classifier_MNISTClassifier jbr5utsh 7f19aec5-09d2-4fc7-b5b0-cb3ddaf6b80d -- POST / 200 474.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,275 mnist_classifier_MNISTClassifier jbr5utsh 57cf7665-b4d2-40a6-a484-c5950a52bc26 -- POST / 200 473.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,276 mnist_classifier_MNISTClassifier jbr5utsh 0d7687b4-20cd-438f-81cf-6e2ea2a7be2a -- POST / 200 473.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,277 mnist_classifier_MNISTClassifier jbr5utsh 59df8cec-ca68-4d0f-8b70-3af56f380848 -- POST / 200 471.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,278 mnist_classifier_MNISTClassifier jbr5utsh 70aa2def-6681-49c2-b833-fb8307129f7b -- POST / 200 471.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,283 mnist_classifier_MNISTClassifier jbr5utsh 250ed9d6-7b4f-4ef5-9e9f-c71b20331b68 -- POST / 200 467.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,290 mnist_classifier_MNISTClassifier jbr5utsh dfaca3e6-c6d4-4396-a4ed-8045c43877b6 -- POST / 200 475.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,300 mnist_classifier_MNISTClassifier jbr5utsh 0d963d7d-8c48-4f0c-829b-74863e0a5392 -- POST / 200 483.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,301 mnist_classifier_MNISTClassifier jbr5utsh e9d4d3ce-05d3-4071-a414-2132143009e0 -- POST / 200 485.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,302 mnist_classifier_MNISTClassifier jbr5utsh 682d5000-70ac-44bd-8740-8f678a665df8 -- POST / 200 478.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,303 mnist_classifier_MNISTClassifier jbr5utsh 03eaf665-4723-4a77-9cf3-8cbe722daa9f -- POST / 200 478.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,303 mnist_classifier_MNISTClassifier jbr5utsh 81154267-87c1-472d-8b48-0b8e333d68a5 -- POST / 200 478.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,304 mnist_classifier_MNISTClassifier jbr5utsh 298f9086-c39c-4d2a-9464-597045f77061 -- POST / 200 477.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,305 mnist_classifier_MNISTClassifier jbr5utsh c86a8904-49bc-4650-8486-c14d3d91ea9c -- POST / 200 478.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,306 mnist_classifier_MNISTClassifier jbr5utsh 8a6e177e-e0ab-4a71-ba97-6cbd49aa569a -- POST / 200 478.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,308 mnist_classifier_MNISTClassifier jbr5utsh 16141a5c-40d8-4d38-94d3-2ec93b03d953 -- POST / 200 479.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,309 mnist_classifier_MNISTClassifier jbr5utsh 499b55ea-a3cc-4c15-b1a5-aedec0160d66 -- POST / 200 478.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,310 mnist_classifier_MNISTClassifier jbr5utsh 0c9a9d13-2e85-4512-87ff-9d205040110b -- POST / 200 480.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,310 mnist_classifier_MNISTClassifier jbr5utsh 37172b03-4ca0-4dd8-8ce2-0962ca32c724 -- POST / 200 466.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,313 mnist_classifier_MNISTClassifier jbr5utsh d8ce2628-3e7d-4a6e-9cca-4239c9abcb0d -- POST / 200 468.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,314 mnist_classifier_MNISTClassifier jbr5utsh c6f72365-3034-4e8e-99c4-ed6f35add469 -- POST / 200 467.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,314 mnist_classifier_MNISTClassifier jbr5utsh 6aa79d9f-ccd0-4630-b779-1349e469bed7 -- POST / 200 467.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,314 mnist_classifier_MNISTClassifier jbr5utsh fe8e1ef9-13c4-4b76-a80c-6b51706cdab2 -- POST / 200 466.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,315 mnist_classifier_MNISTClassifier jbr5utsh f8f3e3d1-5f8b-4b83-837a-f7cc9ce064ff -- POST / 200 465.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,316 mnist_classifier_MNISTClassifier jbr5utsh 0ccc5326-5a96-4c6a-82c9-f65b1e7e2b02 -- POST / 200 464.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,316 mnist_classifier_MNISTClassifier jbr5utsh 838f7dab-8a47-4408-9362-b025866e3ba4 -- POST / 200 463.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,317 mnist_classifier_MNISTClassifier jbr5utsh 90ad1c1f-e5b9-4af7-9dd3-7002d0867209 -- POST / 200 462.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,322 mnist_classifier_MNISTClassifier jbr5utsh 6ab0d1ea-c5a2-4b87-bb1b-b8b4f8458a66 -- POST / 200 466.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,328 mnist_classifier_MNISTClassifier jbr5utsh ecd99310-0208-4e80-a053-577c1bbc23c3 -- POST / 200 470.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,329 mnist_classifier_MNISTClassifier jbr5utsh 5e4e2cef-1d40-4676-a7d1-5979d1478144 -- POST / 200 467.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,329 mnist_classifier_MNISTClassifier jbr5utsh d7f0d230-00d3-4a7c-ba0f-dbd395e433ff -- POST / 200 468.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,330 mnist_classifier_MNISTClassifier jbr5utsh 34a0d7ce-1956-493b-8782-9821e0ceb73a -- POST / 200 468.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,330 mnist_classifier_MNISTClassifier jbr5utsh 4b811991-88a0-4d59-9111-2c7690a5f9d5 -- POST / 200 467.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,331 mnist_classifier_MNISTClassifier jbr5utsh dec1dc1c-abd3-4047-8230-b003390b89cc -- POST / 200 467.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,425 mnist_classifier_MNISTClassifier jbr5utsh 2f4eda25-a296-4bd9-93b5-593c219e9600 -- POST / 200 387.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,426 mnist_classifier_MNISTClassifier jbr5utsh db3651ea-be85-4786-8192-a3f7e651476d -- POST / 200 388.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,426 mnist_classifier_MNISTClassifier jbr5utsh 2558524b-fe29-41af-800f-7eb29c5d493b -- POST / 200 393.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,427 mnist_classifier_MNISTClassifier jbr5utsh 72a192ab-d711-4797-ad10-2e266d1fa10e -- POST / 200 393.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,427 mnist_classifier_MNISTClassifier jbr5utsh 24b10df9-4219-44b9-8c94-6da119f11795 -- POST / 200 388.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,428 mnist_classifier_MNISTClassifier jbr5utsh 4eabf47b-2f10-4b17-bcb2-c65350eb88bd -- POST / 200 388.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,429 mnist_classifier_MNISTClassifier jbr5utsh d7b7330c-8ef0-4f8c-8a9a-228f1151b8ed -- POST / 200 388.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,430 mnist_classifier_MNISTClassifier jbr5utsh 4fd0d9be-4d71-4347-b80c-47d94acdd6c0 -- POST / 200 387.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,431 mnist_classifier_MNISTClassifier jbr5utsh aa9ef706-43b9-4870-acbf-cb7157cfd8fb -- POST / 200 388.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,432 mnist_classifier_MNISTClassifier jbr5utsh 86ac73c9-114a-4c80-ad77-fc83286a77f9 -- POST / 200 389.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,432 mnist_classifier_MNISTClassifier jbr5utsh 8cfe5948-cc2a-422e-b728-81e463b2604a -- POST / 200 387.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,433 mnist_classifier_MNISTClassifier jbr5utsh c1b01907-03db-4dd5-b705-04e9f070b75e -- POST / 200 387.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,433 mnist_classifier_MNISTClassifier jbr5utsh f98eb1e1-ecd8-46d4-8735-98556332625c -- POST / 200 386.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,434 mnist_classifier_MNISTClassifier jbr5utsh e2a827e7-64f8-4483-b540-55b5eb28a016 -- POST / 200 386.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,434 mnist_classifier_MNISTClassifier jbr5utsh 1e4bd3c7-ce5f-4001-a242-9aef9db3dbdb -- POST / 200 387.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,436 mnist_classifier_MNISTClassifier jbr5utsh 13ec30af-456c-42d2-b7d3-24963312691c -- POST / 200 385.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,437 mnist_classifier_MNISTClassifier jbr5utsh f0dff0a6-8c51-4da7-96a2-cbd5df8439c9 -- POST / 200 384.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,438 mnist_classifier_MNISTClassifier jbr5utsh bdfb178c-1f7f-44ee-b8ab-25a0632af8d2 -- POST / 200 385.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4548) INFO 2026-02-25 21:19:08,439 mnist_classifier_MNISTClassifier jbr5utsh ffa2ec9f-6bd0-4eb2-b379-72fbbce6dc1d -- POST / 200 386.2ms
Processed 1000 requests in 5.00 seconds
Throughput: 200.10 requests/second

Ray Serve automatically buffers and load balances requests across the replicas.

Fault tolerance#

In production, process and machine failures are inevitable. Ray Serve is designed so that each major component in the Serve stack (the controller, replicas, and proxies) can fail and recover while your application continues to handle traffic.

Serve can also recover from larger infrastructure failures, such as entire nodes or pods failing. Serve can even recover from head node failures, or the entire head pod if deploying on KubeRay.

For more information about Ray Serve’s fault tolerance, see the Ray Serve fault-tolerance guide.

Monitor the deployment#

Monitoring is critical when running large-scale deployments. The Ray dashboard displays Serve metrics like request throughput, latency, and error rates. It also shows cluster resource usage, replica status, and overall deployment health in real time. The dashboard also lets you inspect logs from individual replicas across the cluster.

For debugging, Ray offers distributed debugging tools that let you attach a debugger to running replicas across the cluster. For more information, see the Ray Serve monitoring documentation.

Conclusion#

In this tutorial, you:

  • Deployed a PyTorch model using Ray Serve with production best practices.

  • Enabled dynamic request batching to optimize performance.

  • Configured autoscaling and fractional GPU allocation to efficiently scale across a cluster.

  • Tested the service with concurrent asynchronous requests.

Further reading#

Ray Serve has more production features that are out of scope for this tutorial but are worth checking out:

For more information, see the Ray Serve documentation and Ray Serve examples.

Total running time of the script: (0 minutes 15.047 seconds)

On this page
PyTorch Libraries