beginner/serving_tutorial

Run in Google Colab

Colab

Download Notebook

Notebook

View on GitHub

GitHub

Serve PyTorch models at scale with Ray Serve

Author: Ricardo Decal

This tutorial shows how to deploy a PyTorch model using Ray Serve with production-ready features.

What you will learn

• How to create a production-ready PyTorch model deployment that can scale to thousands of nodes and GPUs

• How to configure an HTTP endpoint for the deployment using FastAPI

• Enable dynamic request batching for higher throughput

• Configure autoscaling and per-replica CPU/GPU resource allocation

• Load test the service with concurrent requests and monitor it with the Ray dashboard

• How Ray Serve deployments can self-heal from failures

• Ray Serve’s advanced features like model multiplexing and model composition.

Prerequisites

• PyTorch v2.9+ and torchvision

• Ray Serve (ray[serve]) v2.52.1+

• A GPU is recommended for higher throughput but is not required

Ray Serve is a scalable framework for serving machine learning models in production. It’s built on top of Ray, which is a unified framework for scaling AI and Python applications that simplifies the complexities of distributed computing. Ray is also open source and part of the PyTorch Foundation.

Setup

To install the dependencies, run:

pip install "ray[serve]" torch torchvision

Start by importing the required libraries:

import asyncio
import time
from typing import Any

from fastapi import FastAPI
from pydantic import BaseModel
import aiohttp
import numpy as np
import torch
import torch.nn as nn
from ray import serve
from torchvision.transforms import v2

Define a PyTorch model

Define a simple convolutional neural network for the MNIST digit classification dataset:

class MNISTNet(nn.Module):
    def __init__(self):
        super().__init__()
        self.conv1 = nn.Conv2d(1, 32, 3, 1)
        self.dropout1 = nn.Dropout(0.25)
        self.conv2 = nn.Conv2d(32, 64, 3, 1)
        self.fc1 = nn.Linear(9216, 128)
        self.dropout2 = nn.Dropout(0.5)
        self.fc2 = nn.Linear(128, 10)

    def forward(self, x):
        x = self.conv1(x)
        x = nn.functional.relu(x)
        x = self.conv2(x)
        x = nn.functional.relu(x)
        x = nn.functional.max_pool2d(x, 2)
        x = self.dropout1(x)
        x = torch.flatten(x, 1)
        x = self.fc1(x)
        x = nn.functional.relu(x)
        x = self.dropout2(x)
        x = self.fc2(x)
        return nn.functional.log_softmax(x, dim=1)

Define the Ray Serve deployment

To deploy this model with Ray Serve, wrap the model in a Python class and decorate it with @serve.deployment.

Processing requests in batches is more efficient than processing requests one by one, especially when using GPUs. Ray Serve provides built-in support for dynamic request batching, where individual incoming requests are opportunistically batched. Enable dynamic batching using the @serve.batch decorator as shown in the following code:

app = FastAPI()

class ImageRequest(BaseModel):  # Used for request validation and generating API documentation
    image: list[list[float]] | list[list[list[float]]]  # 2D or 3D array

@serve.deployment
@serve.ingress(app)
class MNISTClassifier:
    def __init__(self):
        self.device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
        self.model = MNISTNet().to(self.device)
        # Define the transformation pipeline for the input images.
        self.transform = v2.Compose([
            v2.ToImage(),
            v2.ToDtype(torch.float32, scale=True),
            # Mean and standard deviation of the MNIST training subset.
            v2.Normalize(mean=[0.1307], std=[0.3013]),
        ])

        self.model.eval()

    # batch_wait_timeout_s is the maximum time to wait for a full batch,
    # trading off latency for throughput.
    @serve.batch(max_batch_size=128, batch_wait_timeout_s=0.1)
    async def predict_batch(self, images: list[np.ndarray]) -> list[dict[str, Any]]:
        # Stack all images into a single tensor.
        batch_tensor = torch.cat([
            self.transform(img).unsqueeze(0)
            for img in images
        ]).to(self.device).float()

        # Single forward pass on the entire batch at once.
        with torch.no_grad():
            logits = self.model(batch_tensor)
            predictions = torch.argmax(logits, dim=1).cpu().numpy()

        # Unbatch the results and preserve their original order.
        return [
            {
                "predicted_label": int(pred),
                "logits": logit.cpu().numpy().tolist()
            }
            for pred, logit in zip(predictions, logits)
        ]

    @app.post("/")
    async def handle_request(self, request: ImageRequest):
        """Handle an incoming HTTP request using FastAPI.

        Inputs are automatically validated using the Pydantic model.
        """
        # Process the single request.
        image_array = np.array(request.image)

        # Ray Serve's @serve.batch automatically batches requests.
        result = await self.predict_batch(image_array)

        return result

This is a FastAPI app, which extends Ray Serve with features like automatic request validation with Pydantic, auto-generated OpenAPI-style API documentation, and more.

Configure autoscaling and resource allocation

In production, traffic can vary significantly. Ray Serve’s autoscaling feature automatically adjusts the number of replicas based on traffic load, ensuring you have enough capacity during peaks while saving resources during quiet periods. Ray Serve scales to very large deployments with thousands of nodes and replicas.

You can also specify resource allocation per replica, such as the number of CPUs or GPUs. Ray Serve handles the orchestration of these resources across your cluster. Ray also supports fractional GPUs, allowing multiple replicas to share a single GPU when models are small enough to fit in memory together.

The following is a sample configuration with autoscaling and resource allocation:

num_cpus_per_replica = 1
num_gpus_per_replica = 1  # Set to 0 to run the model on CPUs instead of GPUs.
mnist_app = MNISTClassifier.options(
    autoscaling_config={
        "target_ongoing_requests": 50,  # Target 50 ongoing requests per replica.
        "min_replicas": 1,              # Keep at least 1 replica alive.
        "max_replicas": 80,             # Scale up to 80 replicas to maintain target_ongoing_requests.
        "upscale_delay_s": 5,           # Wait 5s before scaling up.
        "downscale_delay_s": 30,        # Wait 30s before scaling down.
    },
    # Max invocations to handle_request per replica to process simultaneously.
    # Requests exceeding this limit are queued by the router until capacity is available.
    max_ongoing_requests=200,
    # Max queue size for requests that exceed max_ongoing_requests.
    # If the queue is full, future requests are backpressured with errors until space is available.
    # -1 means the queue can grow until cluster memory is exhausted.
    max_queued_requests=-1,
    # Set the resources per replica.
    ray_actor_options={"num_cpus": num_cpus_per_replica, "num_gpus": num_gpus_per_replica}
).bind()

The app is ready to deploy. Suppose you ran this on a cluster of 10 machines, each with 4 GPUs. With num_gpus=0.5, Ray schedules 2 replicas per GPU, giving you 80 replicas across the cluster. This configuration permits the deployment to elastically scale up to 80 replicas as needed to handle traffic spikes and scale back down to 1 replica when traffic subsides.

Test the endpoint with concurrent requests

To deploy the app, use the serve.run function:

# Start the Ray Serve application.
handle = serve.run(mnist_app, name="mnist_classifier")

2026-07-08 22:20:40,748 WARNING services.py:2213 -- WARNING: The object store is using /tmp/ray instead of /dev/shm because /dev/shm has only 2147471360 bytes available. This will harm performance! You may be able to free up space by deleting files in /dev/shm. If you are inside a Docker container, you can increase /dev/shm size by passing '--shm-size=10.24gb' to 'docker run' (or add it to the run_options list in a Ray cluster config). Make sure to set this to more than 30% of available RAM.
2026-07-08 22:20:41,917 INFO worker.py:2003 -- Started a local Ray instance. View the dashboard at 127.0.0.1:8265
/usr/local/lib/python3.10/dist-packages/ray/_private/worker.py:2051: FutureWarning: Tip: In future versions of Ray, Ray will no longer override accelerator visible devices env var if num_gpus=0 or num_gpus=None (default). To enable this behavior and turn off this error message, set RAY_ACCEL_ENV_VAR_OVERRIDE_ON_ZERO=0
  warnings.warn(
INFO 2026-07-08 22:20:44,474 serve 4236 -- Started Serve in namespace "serve".
(ProxyActor pid=5047) INFO 2026-07-08 22:20:44,405 proxy 172.17.0.2 -- Proxy starting on node 813c3445bac7c508994f121462899b54c36680d7ebd2cab1087ba43d (HTTP port: 8000).
(ProxyActor pid=5047) INFO 2026-07-08 22:20:44,471 proxy 172.17.0.2 -- Got updated endpoints: {}.
(ServeController pid=5051) INFO 2026-07-08 22:20:44,566 controller 5051 -- Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
(ServeController pid=5051) INFO 2026-07-08 22:20:44,567 controller 5051 -- Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
(ProxyActor pid=5047) INFO 2026-07-08 22:20:44,571 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
(ProxyActor pid=5047) INFO 2026-07-08 22:20:44,577 proxy 172.17.0.2 -- Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x7fce585ba1a0>.
(ServeController pid=5051) INFO 2026-07-08 22:20:44,671 controller 5051 -- Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
(ProxyActor pid=5047) INFO 2026-07-08 22:20:48,785 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=[])}.
INFO 2026-07-08 22:20:49,599 serve 4236 -- Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

You will see output similar to:

Started Serve in namespace "serve".
Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
Proxy starting on node ... (HTTP port: 8000).
Got updated endpoints: {}.
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x73a53c52c250>.
Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=['/', '/docs', '/docs/oauth2-redirect', '/openapi.json', '/redoc'])}.
Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

The app is now listening for requests on port 8000.

To test the deployment, you can send many requests concurrently using aiohttp. The following code demonstrates how to send 1000 concurrent requests to the app:

async def send_single_request(session, url, data):
    async with session.post(url, json=data) as response:
        return await response.json()

async def send_concurrent_requests(num_requests):
    image = np.random.rand(28, 28).tolist()

    print(f"Sending {num_requests} concurrent requests...")
    async with aiohttp.ClientSession() as session:
        tasks = [
            send_single_request(session, url="http://localhost:8000/", data={"image": image})
            for _ in range(num_requests)
        ]
        responses = await asyncio.gather(*tasks)

    return responses

# Run the concurrent requests.
start_time = time.time()
responses = asyncio.run(send_concurrent_requests(1000))
elapsed = time.time() - start_time

print(f"Processed {len(responses)} requests in {elapsed:.2f} seconds")
print(f"Throughput: {len(responses)/elapsed:.2f} requests/second")

Sending 1000 concurrent requests...
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,668 mnist_classifier_MNISTClassifier 88qanr4a f3728c45-0312-4864-9234-0343db51d41c -- POST / 200 435.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,670 mnist_classifier_MNISTClassifier 88qanr4a 7c8b090a-e626-40a7-b163-652543ec08a9 -- POST / 200 422.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,671 mnist_classifier_MNISTClassifier 88qanr4a eaed1260-850f-446c-bac3-b3d769114162 -- POST / 200 423.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,673 mnist_classifier_MNISTClassifier 88qanr4a f4d89292-bea1-47a7-a32f-301de8034c03 -- POST / 200 423.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,673 mnist_classifier_MNISTClassifier 88qanr4a 64f66fe6-960f-4082-8d83-a086ac560a10 -- POST / 200 419.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,675 mnist_classifier_MNISTClassifier 88qanr4a 272a0777-4fcc-4cf7-9ca1-02e1c1325d95 -- POST / 200 419.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,676 mnist_classifier_MNISTClassifier 88qanr4a 9c13780d-67bf-4623-91d9-2ead9407afc3 -- POST / 200 419.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,676 mnist_classifier_MNISTClassifier 88qanr4a 4789a7a1-72aa-4c8d-8981-0147062f4f0a -- POST / 200 419.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,679 mnist_classifier_MNISTClassifier 88qanr4a bcd13278-2bae-49cd-9b21-ff6b16a6bc28 -- POST / 200 421.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,683 mnist_classifier_MNISTClassifier 88qanr4a a0e56e13-c931-438e-b062-19b452e672b0 -- POST / 200 425.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,684 mnist_classifier_MNISTClassifier 88qanr4a 7fd7197e-45dd-4c73-aea2-e4e37b2e585a -- POST / 200 424.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,684 mnist_classifier_MNISTClassifier 88qanr4a c6514756-0537-47c5-b98e-d7eacffe0afb -- POST / 200 422.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,686 mnist_classifier_MNISTClassifier 88qanr4a 59b0ee7c-8793-4d43-a0cf-6b24af458d41 -- POST / 200 423.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,688 mnist_classifier_MNISTClassifier 88qanr4a cf2507b0-466e-4c71-9628-7133c0682588 -- POST / 200 424.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,691 mnist_classifier_MNISTClassifier 88qanr4a 35287fa1-d509-4172-9aff-69b2ffa1e261 -- POST / 200 423.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,694 mnist_classifier_MNISTClassifier 88qanr4a d72428a9-d8d3-4346-a7a9-565ae2547083 -- POST / 200 426.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,695 mnist_classifier_MNISTClassifier 88qanr4a 4212b585-e4ba-45d1-a119-fcfd821a1307 -- POST / 200 427.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,698 mnist_classifier_MNISTClassifier 88qanr4a b149ee04-532a-4c01-9f41-ccb207a7056a -- POST / 200 428.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,700 mnist_classifier_MNISTClassifier 88qanr4a 90da0fcb-81a1-4b91-ab13-93fb0d20abc9 -- POST / 200 430.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,701 mnist_classifier_MNISTClassifier 88qanr4a afecf0b4-a6d7-4f0e-acba-6a9e33abc111 -- POST / 200 429.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,706 mnist_classifier_MNISTClassifier 88qanr4a b7f95712-d733-44a1-994b-a345be0fe049 -- POST / 200 434.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,707 mnist_classifier_MNISTClassifier 88qanr4a 4a5c6a7a-74d5-4850-ba82-8fbb53070ed9 -- POST / 200 433.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,709 mnist_classifier_MNISTClassifier 88qanr4a 071ba33c-fdc8-446b-9d8b-a203fc67dbce -- POST / 200 434.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,709 mnist_classifier_MNISTClassifier 88qanr4a dcaf8cd0-e4a9-4ccc-b643-327d57749388 -- POST / 200 433.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,710 mnist_classifier_MNISTClassifier 88qanr4a a0149e35-5724-40d5-bea8-5ceec5d53b60 -- POST / 200 434.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,710 mnist_classifier_MNISTClassifier 88qanr4a 74b4305e-3aed-4f12-9010-800ab857ce18 -- POST / 200 432.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,711 mnist_classifier_MNISTClassifier 88qanr4a 4e2b776b-0d96-44f8-b1ac-4b4c8642a9fb -- POST / 200 431.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,714 mnist_classifier_MNISTClassifier 88qanr4a 70001546-35be-4d59-8135-5b8cda6dc201 -- POST / 200 431.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,715 mnist_classifier_MNISTClassifier 88qanr4a ac2ef309-9415-41cf-a4fa-f399a56314e6 -- POST / 200 431.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,932 mnist_classifier_MNISTClassifier 88qanr4a c266a9c1-a491-4df7-b184-ca744f475b97 -- POST / 200 648.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,936 mnist_classifier_MNISTClassifier 88qanr4a 160a3062-29af-4948-a1f1-bcda1455760e -- POST / 200 651.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,937 mnist_classifier_MNISTClassifier 88qanr4a 32e0bbe2-f1c3-4a56-a670-1ea3867de9c4 -- POST / 200 651.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,937 mnist_classifier_MNISTClassifier 88qanr4a 136d5407-f2cd-4c70-8db6-1c06ed7eb432 -- POST / 200 648.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,939 mnist_classifier_MNISTClassifier 88qanr4a 182df848-6542-4f73-b808-9229d1efaee9 -- POST / 200 648.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,939 mnist_classifier_MNISTClassifier 88qanr4a 5d1b4656-352d-43f5-815b-52522546629f -- POST / 200 649.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,940 mnist_classifier_MNISTClassifier 88qanr4a 903aaca7-64a1-4048-9019-0b7508063e43 -- POST / 200 648.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,940 mnist_classifier_MNISTClassifier 88qanr4a 8fde2739-36ea-4ed9-aa49-ecb4cd6ffeab -- POST / 200 647.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,940 mnist_classifier_MNISTClassifier 88qanr4a 5b1bb068-cb8e-4f19-9143-d5b973c3ad6f -- POST / 200 647.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,940 mnist_classifier_MNISTClassifier 88qanr4a dad59cd9-df97-40a7-86bc-3b26b5e092fc -- POST / 200 646.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,942 mnist_classifier_MNISTClassifier 88qanr4a e31f34bd-6615-4a61-abd3-02a764dc689e -- POST / 200 647.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:50,944 mnist_classifier_MNISTClassifier 88qanr4a 403d18fe-0a27-4b09-8a5d-c19fca6ca9ff -- POST / 200 648.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,014 mnist_classifier_MNISTClassifier 88qanr4a 5faf412f-bdca-4c25-9653-961b959a608d -- POST / 200 717.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,017 mnist_classifier_MNISTClassifier 88qanr4a 9f316ace-c099-4b72-aa04-cdc731eee7d2 -- POST / 200 720.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,018 mnist_classifier_MNISTClassifier 88qanr4a fc63d113-34d1-4dc9-a26a-d3bb859207a4 -- POST / 200 720.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,019 mnist_classifier_MNISTClassifier 88qanr4a 7d918295-1e91-40e3-af00-3eaeb9619910 -- POST / 200 718.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,019 mnist_classifier_MNISTClassifier 88qanr4a 7e6ccf47-0cc0-4628-8f80-daa27300c9c7 -- POST / 200 715.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,019 mnist_classifier_MNISTClassifier 88qanr4a 3fe0ae1a-1efc-49f8-a12e-76deb56c09ff -- POST / 200 715.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,020 mnist_classifier_MNISTClassifier 88qanr4a 11b6f074-6c2a-413c-9d65-1ab42d4d134e -- POST / 200 712.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,023 mnist_classifier_MNISTClassifier 88qanr4a 3c0d249b-966d-4e2a-a74a-ef0b6937888d -- POST / 200 714.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,023 mnist_classifier_MNISTClassifier 88qanr4a 16ab2c86-0e27-499a-b909-9de8c67890af -- POST / 200 715.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,024 mnist_classifier_MNISTClassifier 88qanr4a 2267f405-6db1-42f4-9522-d2e0c0b10586 -- POST / 200 713.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,024 mnist_classifier_MNISTClassifier 88qanr4a 0507c816-0df5-4931-9119-130e1d0ca5f6 -- POST / 200 713.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,025 mnist_classifier_MNISTClassifier 88qanr4a a277d5a3-7080-491d-906f-e01104f0a161 -- POST / 200 713.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,034 mnist_classifier_MNISTClassifier 88qanr4a a5178792-82c8-4746-85e8-215343657e28 -- POST / 200 722.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,036 mnist_classifier_MNISTClassifier 88qanr4a 8fac2ee9-0a20-4e2f-8eca-310c831f44b4 -- POST / 200 719.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,036 mnist_classifier_MNISTClassifier 88qanr4a 6dc37cf0-920b-463a-8431-4d58cc7d6c80 -- POST / 200 719.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,037 mnist_classifier_MNISTClassifier 88qanr4a 0e77ac8f-914d-4df4-8d8f-18f402b0244e -- POST / 200 715.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,037 mnist_classifier_MNISTClassifier 88qanr4a 40de7cef-b30d-4791-beb7-c5f8ecf01c80 -- POST / 200 715.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,038 mnist_classifier_MNISTClassifier 88qanr4a 8427944d-9eaa-41e7-ae5b-4ab0ddb0f27b -- POST / 200 715.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,106 mnist_classifier_MNISTClassifier 88qanr4a 9a3bffed-cb16-496f-89f2-38222f71a1db -- POST / 200 783.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,112 mnist_classifier_MNISTClassifier 88qanr4a b19d373a-03eb-4a37-8cb1-30b316c01006 -- POST / 200 787.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,113 mnist_classifier_MNISTClassifier 88qanr4a b2205bf6-2ca3-4c2f-af34-abceb87bdde7 -- POST / 200 786.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,114 mnist_classifier_MNISTClassifier 88qanr4a 3096ea38-01c9-4367-b1b3-17c1cdfa22c8 -- POST / 200 786.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,116 mnist_classifier_MNISTClassifier 88qanr4a 9426c18b-778a-4a5a-8390-eda9d3fc9d58 -- POST / 200 786.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,116 mnist_classifier_MNISTClassifier 88qanr4a 4830ab83-ee3f-4efb-9c04-e20f96d2f7c0 -- POST / 200 786.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,118 mnist_classifier_MNISTClassifier 88qanr4a f625cbdb-9eea-4afc-b1bf-b18bbe2680f2 -- POST / 200 785.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,119 mnist_classifier_MNISTClassifier 88qanr4a b8226927-16ba-4e1a-8fac-7e5e533d280b -- POST / 200 789.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,119 mnist_classifier_MNISTClassifier 88qanr4a f929154a-c55c-4d6a-a12a-da8681737026 -- POST / 200 786.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,121 mnist_classifier_MNISTClassifier 88qanr4a f7f810f4-c959-4183-a2cf-2d5a1d7defb5 -- POST / 200 786.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,122 mnist_classifier_MNISTClassifier 88qanr4a c7970a84-55c9-4013-8702-860b0fc2b82f -- POST / 200 791.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,123 mnist_classifier_MNISTClassifier 88qanr4a ff4f2f96-bc62-4c4a-a1b5-b8f29727ff80 -- POST / 200 787.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,123 mnist_classifier_MNISTClassifier 88qanr4a cede1a84-9d8f-4cfd-b150-6acbec46d15f -- POST / 200 788.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,124 mnist_classifier_MNISTClassifier 88qanr4a ba5d910d-6394-4c69-b9b8-e384748f80f0 -- POST / 200 782.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,128 mnist_classifier_MNISTClassifier 88qanr4a b04d400b-48ae-4394-83b8-1d349b49e0c7 -- POST / 200 790.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,128 mnist_classifier_MNISTClassifier 88qanr4a 2a0dc985-552a-4dd2-9b03-fe9502eeed58 -- POST / 200 787.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,129 mnist_classifier_MNISTClassifier 88qanr4a 416e4766-bfea-40a4-a130-5a074c43c79b -- POST / 200 787.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,129 mnist_classifier_MNISTClassifier 88qanr4a 1ef40c5c-48c5-4374-a584-d2b0689961b3 -- POST / 200 787.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,129 mnist_classifier_MNISTClassifier 88qanr4a b701f019-c806-4b35-9d49-01b48b051470 -- POST / 200 785.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,129 mnist_classifier_MNISTClassifier 88qanr4a 05d390e4-d3ae-4465-a8a2-3ce8271c4d12 -- POST / 200 785.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,130 mnist_classifier_MNISTClassifier 88qanr4a 241e00ce-f235-4d61-867d-14b2b2bd9d44 -- POST / 200 781.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,130 mnist_classifier_MNISTClassifier 88qanr4a 15fae215-2461-4cd0-8276-2603f76bd0f2 -- POST / 200 781.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,130 mnist_classifier_MNISTClassifier 88qanr4a 959b2e90-a484-48ff-b95b-5de1e762a732 -- POST / 200 781.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,130 mnist_classifier_MNISTClassifier 88qanr4a 74e9c6bc-19b4-47e8-870e-35c249b4f173 -- POST / 200 786.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,131 mnist_classifier_MNISTClassifier 88qanr4a 9ab2ca4d-58a7-4451-b16a-ac9c8a7ca61c -- POST / 200 786.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,131 mnist_classifier_MNISTClassifier 88qanr4a 15571925-456e-4c34-93d5-6e2f1480e8fb -- POST / 200 786.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,131 mnist_classifier_MNISTClassifier 88qanr4a bf8a4121-c3c3-43c1-a317-32110a00bf50 -- POST / 200 780.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,132 mnist_classifier_MNISTClassifier 88qanr4a 7009df29-52f2-4a12-8578-de448d9bea3c -- POST / 200 780.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,133 mnist_classifier_MNISTClassifier 88qanr4a 2d76b2a6-14f3-4e07-8d86-6ad4e5384329 -- POST / 200 778.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,133 mnist_classifier_MNISTClassifier 88qanr4a b3534456-aa20-44a6-97a2-9be2feaf7086 -- POST / 200 781.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,134 mnist_classifier_MNISTClassifier 88qanr4a 22e14b9b-d57d-45c0-b26e-ce2403943c2a -- POST / 200 774.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,134 mnist_classifier_MNISTClassifier 88qanr4a 399089c7-2470-4afc-b757-307cbd12fff1 -- POST / 200 779.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,134 mnist_classifier_MNISTClassifier 88qanr4a f04444f4-2a7e-4614-b2e5-49445d78e360 -- POST / 200 777.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,134 mnist_classifier_MNISTClassifier 88qanr4a 70178aeb-1548-4352-8512-0f362b32a967 -- POST / 200 777.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,135 mnist_classifier_MNISTClassifier 88qanr4a f674a8fe-5a19-4295-97c5-438df9cb7e52 -- POST / 200 774.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,135 mnist_classifier_MNISTClassifier 88qanr4a faab3e40-d412-464a-a5d1-56ebd4584a43 -- POST / 200 775.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,136 mnist_classifier_MNISTClassifier 88qanr4a cad64c10-df31-4141-8a2d-8ee653600689 -- POST / 200 775.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,137 mnist_classifier_MNISTClassifier 88qanr4a 44e5aa38-f8cd-490c-8197-b76c967856a2 -- POST / 200 776.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,137 mnist_classifier_MNISTClassifier 88qanr4a 48c6bd8e-43e9-4003-93e1-5d94e3d70f5c -- POST / 200 775.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,138 mnist_classifier_MNISTClassifier 88qanr4a 12d55523-0d2a-4a7f-ba57-109e010c441a -- POST / 200 775.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,140 mnist_classifier_MNISTClassifier 88qanr4a 9149ae96-f4bd-4588-a5a9-123b6835ced1 -- POST / 200 777.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,141 mnist_classifier_MNISTClassifier 88qanr4a a3a9b80b-bf69-47e3-a0c5-3b14f1397ad4 -- POST / 200 466.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,141 mnist_classifier_MNISTClassifier 88qanr4a 594f33b2-adda-4ea2-b572-11228d497fa6 -- POST / 200 466.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,141 mnist_classifier_MNISTClassifier 88qanr4a 5c2229e8-9489-43f8-8d96-7797ae57ee1b -- POST / 200 466.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,142 mnist_classifier_MNISTClassifier 88qanr4a 94be16b9-c3f5-439d-a798-a5ff44fb4d64 -- POST / 200 453.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,142 mnist_classifier_MNISTClassifier 88qanr4a a2af2d65-ec62-456b-a6c5-c780169131f6 -- POST / 200 451.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,143 mnist_classifier_MNISTClassifier 88qanr4a 65bbd90e-2a09-47d8-acf5-ed3395a688be -- POST / 200 445.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,143 mnist_classifier_MNISTClassifier 88qanr4a b047b97d-ec17-4f0a-900d-05e49f5a6fbb -- POST / 200 428.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,143 mnist_classifier_MNISTClassifier 88qanr4a 5653b30b-7197-48a0-981e-1a82a497caad -- POST / 200 425.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,144 mnist_classifier_MNISTClassifier 88qanr4a 65a5a5db-f51e-4da5-9583-cddaf49c3b93 -- POST / 200 423.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,144 mnist_classifier_MNISTClassifier 88qanr4a 2e0f2bb3-0b55-4886-a9b0-08e0a97e9aea -- POST / 200 421.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,145 mnist_classifier_MNISTClassifier 88qanr4a d1dbdc38-5538-4f0c-9a48-0c64655c0aae -- POST / 200 422.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,145 mnist_classifier_MNISTClassifier 88qanr4a de9ba385-80f9-4354-bda5-7c6ab9fb5961 -- POST / 200 420.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,147 mnist_classifier_MNISTClassifier 88qanr4a 494af414-de2b-4663-988d-027b97ba5d60 -- POST / 200 421.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,150 mnist_classifier_MNISTClassifier 88qanr4a e90beec6-468d-409a-bcf0-d28e8df786c8 -- POST / 200 425.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,151 mnist_classifier_MNISTClassifier 88qanr4a 628f7019-7d42-4285-8fef-3e82689d2732 -- POST / 200 424.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,152 mnist_classifier_MNISTClassifier 88qanr4a 458a2856-0d91-4cb8-a5f4-b8a9eddb0db2 -- POST / 200 423.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,155 mnist_classifier_MNISTClassifier 88qanr4a 0fd18cf6-f519-4c9d-a522-fe7ed4030905 -- POST / 200 428.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,158 mnist_classifier_MNISTClassifier 88qanr4a aa4edea0-5d28-447f-a86d-196ba97ecd46 -- POST / 200 429.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,159 mnist_classifier_MNISTClassifier 88qanr4a fa17fa69-a221-468c-b88c-f90b27d844c5 -- POST / 200 431.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,160 mnist_classifier_MNISTClassifier 88qanr4a 9ac62b2b-071b-44f0-b4b7-57dd8808e300 -- POST / 200 430.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,160 mnist_classifier_MNISTClassifier 88qanr4a 5d25df69-c618-42da-8f79-e523c90194bd -- POST / 200 430.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,161 mnist_classifier_MNISTClassifier 88qanr4a 9259656b-45ba-4fb8-8f69-d773f586afce -- POST / 200 413.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,165 mnist_classifier_MNISTClassifier 88qanr4a a4812086-7c56-491a-aacc-5c972bb85cdd -- POST / 200 428.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,165 mnist_classifier_MNISTClassifier 88qanr4a 26692647-59bc-4b44-9f13-2344d09b98a4 -- POST / 200 416.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,165 mnist_classifier_MNISTClassifier 88qanr4a cb03239a-559f-49f8-a236-ce385fb87009 -- POST / 200 419.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,165 mnist_classifier_MNISTClassifier 88qanr4a 0f850b72-13e7-4473-b2ec-07065c67300b -- POST / 200 416.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,165 mnist_classifier_MNISTClassifier 88qanr4a 899614e7-be9b-44f1-a4e2-bc20cc9d554d -- POST / 200 414.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,166 mnist_classifier_MNISTClassifier 88qanr4a 2e456b20-d4a2-4f32-ae94-3ebb2f1a90fe -- POST / 200 412.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,166 mnist_classifier_MNISTClassifier 88qanr4a 904ba370-96d8-47ea-8ee7-cadb753ee41f -- POST / 200 404.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,166 mnist_classifier_MNISTClassifier 88qanr4a b714e2e5-18c3-42bf-ab6e-8d03864ec296 -- POST / 200 246.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,166 mnist_classifier_MNISTClassifier 88qanr4a 2999d2d4-35e2-4d9c-8978-7a76d875833c -- POST / 200 246.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,166 mnist_classifier_MNISTClassifier 88qanr4a 873592aa-b5ba-4553-a895-beaa517c3a0b -- POST / 200 244.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,166 mnist_classifier_MNISTClassifier 88qanr4a 0bbad763-0cb4-4e62-b975-6e2dc943925f -- POST / 200 243.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,167 mnist_classifier_MNISTClassifier 88qanr4a 3d208686-8698-4c96-bacf-2d640b4ebbda -- POST / 200 242.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,167 mnist_classifier_MNISTClassifier 88qanr4a 72f7b46d-86bc-4b04-9a40-44314e0d87ed -- POST / 200 242.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,167 mnist_classifier_MNISTClassifier 88qanr4a dc4bb739-0994-4f57-a720-157556e3ac9b -- POST / 200 234.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,167 mnist_classifier_MNISTClassifier 88qanr4a fd1535a5-944e-4577-8c3c-1bc8702de26d -- POST / 200 209.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,167 mnist_classifier_MNISTClassifier 88qanr4a e227f110-fc66-41b0-a404-81d5cb531550 -- POST / 200 222.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,168 mnist_classifier_MNISTClassifier 88qanr4a ddd396dd-0522-4239-88dc-6d6fc016330a -- POST / 200 209.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,168 mnist_classifier_MNISTClassifier 88qanr4a 4a363e34-1289-4d07-a705-12d65b4342ac -- POST / 200 209.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,168 mnist_classifier_MNISTClassifier 88qanr4a f5793369-cc92-46c1-a99c-58391c4f3740 -- POST / 200 209.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,169 mnist_classifier_MNISTClassifier 88qanr4a 8b2d252c-54ef-41e2-9559-2dbcb0e8f0f1 -- POST / 200 169.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,169 mnist_classifier_MNISTClassifier 88qanr4a 267f0713-336e-4e36-b475-bf241f84496c -- POST / 200 167.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,169 mnist_classifier_MNISTClassifier 88qanr4a aee62c2f-d12b-42d9-8696-20ab5abe9430 -- POST / 200 129.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,170 mnist_classifier_MNISTClassifier 88qanr4a a1b67c86-f449-48d8-ab33-b9adae568b30 -- POST / 200 127.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,170 mnist_classifier_MNISTClassifier 88qanr4a 9160bd5c-d045-43a1-9531-558bf6fffbc0 -- POST / 200 127.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,170 mnist_classifier_MNISTClassifier 88qanr4a 742d217b-2a82-4490-9354-9df6043ddd8b -- POST / 200 127.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,272 mnist_classifier_MNISTClassifier 88qanr4a 5fb603c0-a4c4-4b8f-92e0-f211a6527b5f -- POST / 200 228.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,296 mnist_classifier_MNISTClassifier 88qanr4a c6c058dd-49a6-412c-bee4-99cad289c2d3 -- POST / 200 252.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,296 mnist_classifier_MNISTClassifier 88qanr4a 09ef354a-ea1b-4de5-91ed-2418eb2f03db -- POST / 200 251.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,296 mnist_classifier_MNISTClassifier 88qanr4a f774adc6-0b6a-424f-825a-fb6b514a5ce6 -- POST / 200 244.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,297 mnist_classifier_MNISTClassifier 88qanr4a e0788119-eba1-40fb-9c06-59038bb95c3e -- POST / 200 246.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,297 mnist_classifier_MNISTClassifier 88qanr4a 3eced303-6df3-42d5-8d5b-68ea0177585b -- POST / 200 244.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,298 mnist_classifier_MNISTClassifier 88qanr4a ed01ab32-1fe0-4ed8-9d31-cfd67ce28421 -- POST / 200 244.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,298 mnist_classifier_MNISTClassifier 88qanr4a b38636f1-1789-4e68-b73c-553358ee9e09 -- POST / 200 244.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,301 mnist_classifier_MNISTClassifier 88qanr4a d5d18bcd-8f82-4ce8-99b0-b038586e5f4e -- POST / 200 244.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,302 mnist_classifier_MNISTClassifier 88qanr4a 18ffd8d7-6ff0-445b-9760-f95eb45cf58e -- POST / 200 244.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,304 mnist_classifier_MNISTClassifier 88qanr4a e13a0b48-1feb-4550-92a2-f4658b0eea14 -- POST / 200 246.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,305 mnist_classifier_MNISTClassifier 88qanr4a aa374f56-5023-4e4e-94e4-0212fc62e53c -- POST / 200 247.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,306 mnist_classifier_MNISTClassifier 88qanr4a 91baae28-e50d-433e-9d25-c2cef7ec8dc2 -- POST / 200 185.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,429 mnist_classifier_MNISTClassifier 88qanr4a a061140f-11fd-4dd9-8889-bda53e996ffd -- POST / 200 308.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,431 mnist_classifier_MNISTClassifier 88qanr4a c7f5069b-ee3f-49e3-87ef-b6a38cd97c27 -- POST / 200 310.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,432 mnist_classifier_MNISTClassifier 88qanr4a 51e327ce-4861-4933-a227-728ca6b17e27 -- POST / 200 311.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,433 mnist_classifier_MNISTClassifier 88qanr4a 36819952-7d73-43f3-83ac-d3758289d36a -- POST / 200 310.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,434 mnist_classifier_MNISTClassifier 88qanr4a bc8c50f7-120a-4b15-8be0-2076468f9bf0 -- POST / 200 313.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,435 mnist_classifier_MNISTClassifier 88qanr4a 874e1382-5ec5-4718-abb0-d9f34ee80fd1 -- POST / 200 307.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,435 mnist_classifier_MNISTClassifier 88qanr4a ecf8a367-f381-48d6-8bd6-4d6d3b53e0fa -- POST / 200 303.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,438 mnist_classifier_MNISTClassifier 88qanr4a 153c4a56-1a70-4e62-ac1a-b8a523762e28 -- POST / 200 292.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,439 mnist_classifier_MNISTClassifier 88qanr4a d4bce822-fd5c-4b80-9414-e8802d55834d -- POST / 200 285.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,442 mnist_classifier_MNISTClassifier 88qanr4a 2422bf29-768f-4f76-ac71-504118e2fd84 -- POST / 200 288.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,443 mnist_classifier_MNISTClassifier 88qanr4a b67259b3-2917-45ec-91e7-cfcc7bea9620 -- POST / 200 272.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,444 mnist_classifier_MNISTClassifier 88qanr4a 791c7eab-354b-4410-9373-38e7e464c993 -- POST / 200 268.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,444 mnist_classifier_MNISTClassifier 88qanr4a 814714e1-561a-4b3a-8ddc-0b63c7348865 -- POST / 200 264.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,445 mnist_classifier_MNISTClassifier 88qanr4a f779c799-9bfd-471c-8329-5ba4adbb9789 -- POST / 200 264.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,449 mnist_classifier_MNISTClassifier 88qanr4a 3bf1bc56-fb77-4e17-921b-8d689c5ddfd0 -- POST / 200 267.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,450 mnist_classifier_MNISTClassifier 88qanr4a 8a1fb30c-6b22-458b-8025-509b48f65d1a -- POST / 200 268.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,451 mnist_classifier_MNISTClassifier 88qanr4a e164e769-5957-401b-b6a8-b849118bbd6b -- POST / 200 268.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,452 mnist_classifier_MNISTClassifier 88qanr4a b8991030-532d-4bad-9906-83999b5ebda9 -- POST / 200 265.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,453 mnist_classifier_MNISTClassifier 88qanr4a 00e2fd6d-cde0-489f-88e4-e9afd21c8ade -- POST / 200 265.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,459 mnist_classifier_MNISTClassifier 88qanr4a 3019a5b2-466f-4c05-aa82-637aa6380d97 -- POST / 200 270.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,460 mnist_classifier_MNISTClassifier 88qanr4a 20495acb-de22-4441-b1f6-2ddf0741db21 -- POST / 200 268.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,469 mnist_classifier_MNISTClassifier 88qanr4a 8492ebb3-5200-4f41-ab29-959d75fd3e63 -- POST / 200 257.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,471 mnist_classifier_MNISTClassifier 88qanr4a 47438b9d-d681-443a-bcdd-8072089fdeed -- POST / 200 256.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,471 mnist_classifier_MNISTClassifier 88qanr4a 060b1e6b-f816-49a5-bbb6-6d014e8c6f67 -- POST / 200 250.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,471 mnist_classifier_MNISTClassifier 88qanr4a 0d792346-8f96-41e1-8881-15fdae87fb69 -- POST / 200 256.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,472 mnist_classifier_MNISTClassifier 88qanr4a 604562cb-a440-44e6-8a2e-52e12868380f -- POST / 200 247.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,472 mnist_classifier_MNISTClassifier 88qanr4a 3e191a4c-1378-4d96-b78b-e695fffe243a -- POST / 200 250.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,472 mnist_classifier_MNISTClassifier 88qanr4a ed146fef-8bd7-4b90-a565-1ee6c66b84a2 -- POST / 200 254.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,473 mnist_classifier_MNISTClassifier 88qanr4a c9e60d5b-509f-4c64-a21b-6b88574d0281 -- POST / 200 245.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,473 mnist_classifier_MNISTClassifier 88qanr4a 01bc8ad4-ce32-4e04-8966-8990650f1547 -- POST / 200 247.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,473 mnist_classifier_MNISTClassifier 88qanr4a 0ae16799-e7f6-411f-b02b-915164594f7e -- POST / 200 250.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,474 mnist_classifier_MNISTClassifier 88qanr4a b24fa6c0-4652-44e9-98ae-664aa4bb2af6 -- POST / 200 245.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,476 mnist_classifier_MNISTClassifier 88qanr4a 07d52ab4-3f5f-4597-9b84-c04b0bf15f2b -- POST / 200 250.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,477 mnist_classifier_MNISTClassifier 88qanr4a 47574fdc-c17c-42fa-b75b-bad17ea562f9 -- POST / 200 250.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,477 mnist_classifier_MNISTClassifier 88qanr4a c2cc7048-78aa-4b30-9782-1222e8adca55 -- POST / 200 248.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,478 mnist_classifier_MNISTClassifier 88qanr4a 996cd485-028b-429c-a8af-a4dada41c1bf -- POST / 200 247.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,479 mnist_classifier_MNISTClassifier 88qanr4a 78c78ccc-f09f-4f80-9138-2e3484194424 -- POST / 200 248.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,481 mnist_classifier_MNISTClassifier 88qanr4a 69c0ce49-5396-4d25-8fc9-a1ef2a11b9f9 -- POST / 200 249.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,482 mnist_classifier_MNISTClassifier 88qanr4a e98b513d-2fc7-474b-b2ff-29aff4d5294c -- POST / 200 249.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,483 mnist_classifier_MNISTClassifier 88qanr4a d170bea2-e481-4501-ad69-5b00d15934cb -- POST / 200 248.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,483 mnist_classifier_MNISTClassifier 88qanr4a e4f5ac8c-28a3-4ed6-b9c9-99c7b1bfedc8 -- POST / 200 247.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,483 mnist_classifier_MNISTClassifier 88qanr4a ed9c0657-e110-4bd0-9141-c610834080bd -- POST / 200 247.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,484 mnist_classifier_MNISTClassifier 88qanr4a 64a3d58b-df94-427e-b58b-7e5771858d2e -- POST / 200 247.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,484 mnist_classifier_MNISTClassifier 88qanr4a 16000c99-80f3-4a8a-b921-30fb7ad98b39 -- POST / 200 247.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,485 mnist_classifier_MNISTClassifier 88qanr4a a35eef8e-de4c-49ab-a8e7-06a1b3fe0fa5 -- POST / 200 245.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,580 mnist_classifier_MNISTClassifier 88qanr4a d51806c8-e527-40a5-8a69-a23bc9999f83 -- POST / 200 336.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,582 mnist_classifier_MNISTClassifier 88qanr4a b0690576-db4f-4689-ace7-3d1942906583 -- POST / 200 339.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,586 mnist_classifier_MNISTClassifier 88qanr4a 418f1f3f-6192-47f7-ab85-89dff8712c67 -- POST / 200 339.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,588 mnist_classifier_MNISTClassifier 88qanr4a 632a39b3-aa3d-46bb-81f7-2ccb113f29c2 -- POST / 200 336.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,588 mnist_classifier_MNISTClassifier 88qanr4a 70f56177-233a-4ab7-873c-03413bf7b965 -- POST / 200 336.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,590 mnist_classifier_MNISTClassifier 88qanr4a 02f1ff43-49eb-452a-a194-4254bbe36855 -- POST / 200 337.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,590 mnist_classifier_MNISTClassifier 88qanr4a eef12a14-4360-4198-aebe-79bdc64f08ac -- POST / 200 282.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,591 mnist_classifier_MNISTClassifier 88qanr4a 1aa0bca4-6e94-47f9-94b9-0f0aa737cc76 -- POST / 200 281.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,591 mnist_classifier_MNISTClassifier 88qanr4a c23dc995-aee8-44cf-bbe3-b601f7024685 -- POST / 200 281.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,592 mnist_classifier_MNISTClassifier 88qanr4a 6086bb9b-da8c-4290-bf9e-511e941e0e88 -- POST / 200 282.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,594 mnist_classifier_MNISTClassifier 88qanr4a 9c5ef285-a019-4c72-882b-86089163be62 -- POST / 200 283.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,596 mnist_classifier_MNISTClassifier 88qanr4a a34c1de6-27a1-4006-9d7c-719f6e3c4077 -- POST / 200 284.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,599 mnist_classifier_MNISTClassifier 88qanr4a e0082886-7357-43c9-9c88-b5e14e91d9f8 -- POST / 200 288.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,601 mnist_classifier_MNISTClassifier 88qanr4a be6611b1-bdb8-4959-b812-7fe3acddc721 -- POST / 200 289.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,604 mnist_classifier_MNISTClassifier 88qanr4a 02408c58-0a16-46d9-915c-8d7bef611a1a -- POST / 200 292.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,605 mnist_classifier_MNISTClassifier 88qanr4a 41367c14-a305-4b89-9085-fa517fb8b7f1 -- POST / 200 293.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,606 mnist_classifier_MNISTClassifier 88qanr4a 07f44faa-8ede-4227-b972-a58384a628d5 -- POST / 200 293.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,609 mnist_classifier_MNISTClassifier 88qanr4a fc232493-6a0a-44f4-9fc2-4adb50372b33 -- POST / 200 295.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,610 mnist_classifier_MNISTClassifier 88qanr4a 88cdebfe-91d8-42ce-ace5-893eeeb2c403 -- POST / 200 292.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,617 mnist_classifier_MNISTClassifier 88qanr4a c3a71327-3239-424d-a15b-26ccb29e07a4 -- POST / 200 298.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,622 mnist_classifier_MNISTClassifier 88qanr4a 1bd1ea5a-749d-41c9-be9b-38ce6ca92b8b -- POST / 200 302.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,622 mnist_classifier_MNISTClassifier 88qanr4a 19bfaf18-d720-4a79-8c68-9ed7c199df53 -- POST / 200 306.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,624 mnist_classifier_MNISTClassifier 88qanr4a 8a29f33e-893d-45e5-b69b-44099b8f7e75 -- POST / 200 307.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,624 mnist_classifier_MNISTClassifier 88qanr4a 6e6add76-7ee8-4742-b1f7-3d1eb5edab68 -- POST / 200 303.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,625 mnist_classifier_MNISTClassifier 88qanr4a 6e06e67e-8645-4ef0-a02b-4a6a21af87b9 -- POST / 200 303.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,629 mnist_classifier_MNISTClassifier 88qanr4a e8c4f7e1-b075-445b-84b8-a4b4ea200c43 -- POST / 200 306.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,629 mnist_classifier_MNISTClassifier 88qanr4a c80be2cb-e384-47b1-a834-878fc0f28bf9 -- POST / 200 300.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,630 mnist_classifier_MNISTClassifier 88qanr4a c3994966-1cd8-48b0-a28a-0c731c0898e9 -- POST / 200 305.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,630 mnist_classifier_MNISTClassifier 88qanr4a 57f2ceda-bed5-43b6-85b7-332afbe62eda -- POST / 200 301.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,630 mnist_classifier_MNISTClassifier 88qanr4a 16505fab-6d1e-4468-ba3e-c0e6b9581346 -- POST / 200 301.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,634 mnist_classifier_MNISTClassifier 88qanr4a d56f0c15-9ae1-4796-8b2f-5df834679840 -- POST / 200 303.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,634 mnist_classifier_MNISTClassifier 88qanr4a c1d44265-b3d9-46c2-99e5-60bee9b88a34 -- POST / 200 303.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,635 mnist_classifier_MNISTClassifier 88qanr4a ef2c6b2e-4170-4e69-b512-ef811cb103bf -- POST / 200 304.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,635 mnist_classifier_MNISTClassifier 88qanr4a cec71492-99dd-4502-9c9b-a0ca92af4aa0 -- POST / 200 301.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,636 mnist_classifier_MNISTClassifier 88qanr4a 22ecdaae-04a8-4dde-8113-d5b0ef4e052d -- POST / 200 300.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,636 mnist_classifier_MNISTClassifier 88qanr4a 739c1a39-8802-44d8-8cad-3a4e651ed252 -- POST / 200 298.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,638 mnist_classifier_MNISTClassifier 88qanr4a 901e1304-89cf-47e6-b198-f49aaf59db1c -- POST / 200 299.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,640 mnist_classifier_MNISTClassifier 88qanr4a 5ea47adc-fac1-4516-a326-2b2308b8bcc2 -- POST / 200 301.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,642 mnist_classifier_MNISTClassifier 88qanr4a 31f25e8a-8fe5-4345-97ec-48950dbe25a2 -- POST / 200 302.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,642 mnist_classifier_MNISTClassifier 88qanr4a 70bb3396-65d6-4bef-8daa-020e12a0cca0 -- POST / 200 301.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,643 mnist_classifier_MNISTClassifier 88qanr4a b18b1ec0-5660-4386-a6f2-6a0672a3b18b -- POST / 200 301.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,643 mnist_classifier_MNISTClassifier 88qanr4a e7ecf68e-0d71-401c-9926-b12518ca9a78 -- POST / 200 299.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,644 mnist_classifier_MNISTClassifier 88qanr4a d501ff79-b2e3-4ccd-ab30-18e3e3a9e103 -- POST / 200 271.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,725 mnist_classifier_MNISTClassifier 88qanr4a ff9cfc9d-eade-4db0-9a8a-b61cc86ae696 -- POST / 200 328.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,727 mnist_classifier_MNISTClassifier 88qanr4a 51ed1669-6031-446e-ae5d-43d3a740259e -- POST / 200 329.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,727 mnist_classifier_MNISTClassifier 88qanr4a 0f7c7741-b063-45f6-b23c-21d066fa9b6c -- POST / 200 328.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,729 mnist_classifier_MNISTClassifier 88qanr4a ab9bb18f-9f53-44c9-890c-44b5695a3f76 -- POST / 200 329.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,731 mnist_classifier_MNISTClassifier 88qanr4a 168d537e-3cb1-4a71-b746-8790ff52f500 -- POST / 200 330.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,732 mnist_classifier_MNISTClassifier 88qanr4a 38092cfb-793e-4e5c-83cf-b07a512ed568 -- POST / 200 329.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,733 mnist_classifier_MNISTClassifier 88qanr4a 89a6e7dc-8639-4a22-bcbd-8498172ae882 -- POST / 200 330.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,734 mnist_classifier_MNISTClassifier 88qanr4a 6ac86f3d-5093-492a-8b22-bfeff256b4fb -- POST / 200 330.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,737 mnist_classifier_MNISTClassifier 88qanr4a 6d746bb0-459b-4d50-81a4-4ac1317384a1 -- POST / 200 333.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,741 mnist_classifier_MNISTClassifier 88qanr4a 3a0fb25b-8d30-4a1f-8baf-083ba1edb132 -- POST / 200 336.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,743 mnist_classifier_MNISTClassifier 88qanr4a 23340fec-d424-4b50-b808-3184b0cca27e -- POST / 200 338.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,745 mnist_classifier_MNISTClassifier 88qanr4a 1cf087e2-aba8-4e87-a4f7-b8dddbc3c00c -- POST / 200 339.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,749 mnist_classifier_MNISTClassifier 88qanr4a 1a8de2b9-70ac-4b97-a365-8e3bf3f90ac4 -- POST / 200 281.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,750 mnist_classifier_MNISTClassifier 88qanr4a 176698ab-75ad-42aa-88dc-1c45dc60f46f -- POST / 200 282.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,751 mnist_classifier_MNISTClassifier 88qanr4a 0f671fb7-2288-411e-b2fb-e44a46181da2 -- POST / 200 283.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,752 mnist_classifier_MNISTClassifier 88qanr4a ac90cdd3-e2f2-4827-90af-512deb70eae2 -- POST / 200 284.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,754 mnist_classifier_MNISTClassifier 88qanr4a 7e0b1307-032f-4b21-b442-8fa0efaa7838 -- POST / 200 285.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,754 mnist_classifier_MNISTClassifier 88qanr4a 6d001e6b-9b79-4002-b01c-e39f1a53fb41 -- POST / 200 285.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,756 mnist_classifier_MNISTClassifier 88qanr4a f2267b94-39ba-438d-8558-1454fcae3664 -- POST / 200 276.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,760 mnist_classifier_MNISTClassifier 88qanr4a c0f7a518-4331-4850-8b06-814acb45d765 -- POST / 200 274.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,762 mnist_classifier_MNISTClassifier 88qanr4a 8e57f0c8-a578-4936-989f-8d41c83bd4fd -- POST / 200 270.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,764 mnist_classifier_MNISTClassifier 88qanr4a 41006c6d-2d2a-4737-a95d-22d897f43a38 -- POST / 200 264.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,764 mnist_classifier_MNISTClassifier 88qanr4a 97573ba5-7a38-4be6-b4f6-a2067eaac11a -- POST / 200 264.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,773 mnist_classifier_MNISTClassifier 88qanr4a ef599b2c-e2ea-4151-bf26-5cea0ce4ec15 -- POST / 200 272.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,778 mnist_classifier_MNISTClassifier 88qanr4a e6d8218a-e4ee-4832-a839-306aa99e4bf1 -- POST / 200 276.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,787 mnist_classifier_MNISTClassifier 88qanr4a ea9b1df5-fb34-4ef4-beac-96748d277468 -- POST / 200 284.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,789 mnist_classifier_MNISTClassifier 88qanr4a f3cee51f-4e67-4305-9555-33f45c1b86ca -- POST / 200 285.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,937 mnist_classifier_MNISTClassifier 88qanr4a 83eef389-69be-4732-a9cb-31e349bf65b5 -- POST / 200 431.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,938 mnist_classifier_MNISTClassifier 88qanr4a 2d50b814-8a12-4696-8524-948b4c392cf1 -- POST / 200 431.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,938 mnist_classifier_MNISTClassifier 88qanr4a 1563273b-4bde-405f-b502-375345ea8f07 -- POST / 200 430.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,942 mnist_classifier_MNISTClassifier 88qanr4a ca1adbe5-832d-4312-9a13-f4f71c631c9a -- POST / 200 433.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,948 mnist_classifier_MNISTClassifier 88qanr4a 6e654e1b-b16d-4211-8bc1-dafaa1f06fdd -- POST / 200 439.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,950 mnist_classifier_MNISTClassifier 88qanr4a 745f44ac-eb3f-4e13-991a-265a5526990d -- POST / 200 438.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,951 mnist_classifier_MNISTClassifier 88qanr4a e385f4b7-7406-45c0-a03a-c4b9d187cce9 -- POST / 200 439.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,953 mnist_classifier_MNISTClassifier 88qanr4a 19bb9672-2c7b-4645-817e-56b2f0be19ce -- POST / 200 439.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,954 mnist_classifier_MNISTClassifier 88qanr4a 2d5a2447-b797-45d5-aa28-074cce64e188 -- POST / 200 440.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,957 mnist_classifier_MNISTClassifier 88qanr4a c9d27a03-8c8b-42ed-9855-ba9bd219809b -- POST / 200 443.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,958 mnist_classifier_MNISTClassifier 88qanr4a 9a0b9543-dbfe-4167-82fe-898acf5d1929 -- POST / 200 442.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,958 mnist_classifier_MNISTClassifier 88qanr4a 08486478-468f-44f8-844e-b4021520c440 -- POST / 200 443.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,959 mnist_classifier_MNISTClassifier 88qanr4a eead1fff-95bf-48fe-8f25-420e9f596a6b -- POST / 200 443.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,960 mnist_classifier_MNISTClassifier 88qanr4a 69db4915-2ce8-45b3-86a3-ad5a81976297 -- POST / 200 444.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,962 mnist_classifier_MNISTClassifier 88qanr4a 49e218ab-43ab-4ccd-a368-ed48c73d0e39 -- POST / 200 440.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,963 mnist_classifier_MNISTClassifier 88qanr4a 25519f74-4f25-44ba-af7f-8c71452ea837 -- POST / 200 440.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,964 mnist_classifier_MNISTClassifier 88qanr4a 6529cb4f-80a0-4d72-b3a8-504176753bc6 -- POST / 200 439.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,965 mnist_classifier_MNISTClassifier 88qanr4a 16d8532c-9250-4e69-be4e-63c6a529c5c8 -- POST / 200 438.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,966 mnist_classifier_MNISTClassifier 88qanr4a 5519c555-094d-4045-9ebc-3767af95e997 -- POST / 200 439.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,967 mnist_classifier_MNISTClassifier 88qanr4a 512df0af-7b6a-4b84-b903-ea2c25cfaa45 -- POST / 200 440.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,969 mnist_classifier_MNISTClassifier 88qanr4a 2b684fce-2bb3-4270-bc25-76d6a778d5ae -- POST / 200 440.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,970 mnist_classifier_MNISTClassifier 88qanr4a f7f5c237-69d7-44c1-a2a8-d2564c6d77d3 -- POST / 200 444.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,970 mnist_classifier_MNISTClassifier 88qanr4a b6d23588-0906-49ee-9577-366996b47d0a -- POST / 200 435.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,970 mnist_classifier_MNISTClassifier 88qanr4a 698189da-ec73-46e3-9d68-9c9515f1d265 -- POST / 200 429.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,972 mnist_classifier_MNISTClassifier 88qanr4a ddf1bb2a-5adc-4f8b-b482-7c560941a4ef -- POST / 200 429.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,972 mnist_classifier_MNISTClassifier 88qanr4a babf5a80-0ef7-4b0a-8d66-d96e2f601a74 -- POST / 200 427.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,973 mnist_classifier_MNISTClassifier 88qanr4a 707ff1a6-d1fb-4f8c-987d-21a84dd1af6b -- POST / 200 430.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,973 mnist_classifier_MNISTClassifier 88qanr4a 76694511-a8e8-4816-ab31-18bfa22faddb -- POST / 200 430.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:51,973 mnist_classifier_MNISTClassifier 88qanr4a 13d8d4f8-7e56-4c0c-b85b-5ee9be738844 -- POST / 200 426.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,035 mnist_classifier_MNISTClassifier 88qanr4a 877f548f-66cc-4c5b-887f-bb8a1e02b2df -- POST / 200 488.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,036 mnist_classifier_MNISTClassifier 88qanr4a b49ef860-7f22-42d5-8ab3-8e2b4638e827 -- POST / 200 405.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,037 mnist_classifier_MNISTClassifier 88qanr4a cf6e8926-cdb9-4d07-8d1a-d2b177d2b1cd -- POST / 200 396.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,039 mnist_classifier_MNISTClassifier 88qanr4a 26f21d9c-af79-4fab-9559-27e464d0e31a -- POST / 200 392.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,040 mnist_classifier_MNISTClassifier 88qanr4a fc8ad748-81ff-4435-a6a7-a6e2ac1f98d6 -- POST / 200 385.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,041 mnist_classifier_MNISTClassifier 88qanr4a 59df78ca-b03f-43a0-bbc9-4e7dd4d83c2d -- POST / 200 393.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,046 mnist_classifier_MNISTClassifier 88qanr4a 48618bd7-e53e-47de-a9d7-45a9f536573a -- POST / 200 391.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,049 mnist_classifier_MNISTClassifier 88qanr4a 9214de3e-a952-4e45-bcc8-fcb2c9a478f0 -- POST / 200 392.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,050 mnist_classifier_MNISTClassifier 88qanr4a a9953985-00a2-4c28-a57d-8ee12083e1e6 -- POST / 200 392.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,050 mnist_classifier_MNISTClassifier 88qanr4a c9693745-4bc8-4ee3-893f-09d49ed467fd -- POST / 200 392.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,052 mnist_classifier_MNISTClassifier 88qanr4a 97ea2dcd-540e-4679-b176-9ca4cfcdfd73 -- POST / 200 393.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,053 mnist_classifier_MNISTClassifier 88qanr4a 7d295091-71bc-456a-8562-9906bef45e2b -- POST / 200 394.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,054 mnist_classifier_MNISTClassifier 88qanr4a 2a3aa955-0a1c-4703-9f79-7441709042ca -- POST / 200 394.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,055 mnist_classifier_MNISTClassifier 88qanr4a da13ab02-9995-4145-8787-e42006771965 -- POST / 200 394.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,055 mnist_classifier_MNISTClassifier 88qanr4a 1258d529-bd54-432b-a64d-08af41cd8d5d -- POST / 200 394.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,056 mnist_classifier_MNISTClassifier 88qanr4a 69094e43-5542-4b15-96ae-0b1093386264 -- POST / 200 394.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,057 mnist_classifier_MNISTClassifier 88qanr4a e9e73981-f078-4943-9a21-e79822fbda97 -- POST / 200 394.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,059 mnist_classifier_MNISTClassifier 88qanr4a 7dfa6852-fffc-4df9-beee-712d31b2187e -- POST / 200 396.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,060 mnist_classifier_MNISTClassifier 88qanr4a e83ca4a4-a71c-4b90-b29d-a1c02dd0e795 -- POST / 200 396.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,063 mnist_classifier_MNISTClassifier 88qanr4a 576b4205-2dac-49f7-91fa-a8c38ca6645c -- POST / 200 398.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,064 mnist_classifier_MNISTClassifier 88qanr4a 474c66bb-e119-4c81-8297-d7124e5a5b43 -- POST / 200 397.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,065 mnist_classifier_MNISTClassifier 88qanr4a d8315a94-e468-41c7-8c88-fc5ed79c3876 -- POST / 200 400.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,066 mnist_classifier_MNISTClassifier 88qanr4a 4eefc97c-f34c-43d1-8a9c-ced67db9fc8a -- POST / 200 400.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,068 mnist_classifier_MNISTClassifier 88qanr4a 2b921d58-4277-4341-a358-2129001b27bc -- POST / 200 401.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,070 mnist_classifier_MNISTClassifier 88qanr4a e24b1866-6a16-429f-9097-938159ec40b8 -- POST / 200 402.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,074 mnist_classifier_MNISTClassifier 88qanr4a 3c0183d5-2775-4612-a8ba-0ddd583a9a24 -- POST / 200 400.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,076 mnist_classifier_MNISTClassifier 88qanr4a cfed81a3-52a9-49d1-a4b0-9fc318f66775 -- POST / 200 407.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,078 mnist_classifier_MNISTClassifier 88qanr4a 29841e31-0a75-41d7-943d-484ae79ff3ae -- POST / 200 409.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,123 mnist_classifier_MNISTClassifier 88qanr4a ae08cf17-34ef-4495-bd5b-5850fc368a09 -- POST / 200 433.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,127 mnist_classifier_MNISTClassifier 88qanr4a 70f72420-1c3b-4f24-81bb-f933da768b6a -- POST / 200 447.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,129 mnist_classifier_MNISTClassifier 88qanr4a e04fdd54-08d7-4af8-95f7-e2da5d026702 -- POST / 200 442.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,129 mnist_classifier_MNISTClassifier 88qanr4a 8ced1195-8c56-4786-9520-929a0a9102de -- POST / 200 441.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,131 mnist_classifier_MNISTClassifier 88qanr4a 46ab1e80-956b-45d2-8fe1-9bfcc91e08f9 -- POST / 200 442.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,131 mnist_classifier_MNISTClassifier 88qanr4a 1ea32fec-7ca6-4e72-b363-e917a358a65b -- POST / 200 440.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,132 mnist_classifier_MNISTClassifier 88qanr4a 7c6949ff-946a-4f42-a52b-9bdb9776185e -- POST / 200 439.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,132 mnist_classifier_MNISTClassifier 88qanr4a 0806abfc-641b-48f5-8aba-47a873f9258d -- POST / 200 439.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,133 mnist_classifier_MNISTClassifier 88qanr4a dc9fe777-babf-4090-8bd2-e6f800551d90 -- POST / 200 437.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,133 mnist_classifier_MNISTClassifier 88qanr4a 4eeee4bd-4c79-4fe9-9561-76bad351d8f4 -- POST / 200 430.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,135 mnist_classifier_MNISTClassifier 88qanr4a f621f4ff-4926-4704-8f40-bcf8787a6524 -- POST / 200 434.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,135 mnist_classifier_MNISTClassifier 88qanr4a 8daf42eb-7cf8-41e6-98a5-29f0d7c7f354 -- POST / 200 434.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,253 mnist_classifier_MNISTClassifier 88qanr4a d5267ee8-801b-4195-acf9-148725b125cc -- POST / 200 540.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,260 mnist_classifier_MNISTClassifier 88qanr4a c3d9b7e3-6d01-4d7e-b08f-bb80c3ec147c -- POST / 200 541.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,260 mnist_classifier_MNISTClassifier 88qanr4a 56d10414-a7b9-4e1a-b5f9-9d6cd02017e7 -- POST / 200 541.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,260 mnist_classifier_MNISTClassifier 88qanr4a a27a2e39-cda0-44a7-9016-5c28ed9a4e3a -- POST / 200 541.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,261 mnist_classifier_MNISTClassifier 88qanr4a 51568667-cd52-47fc-811b-541d1f631f34 -- POST / 200 539.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,261 mnist_classifier_MNISTClassifier 88qanr4a 1ef553b0-a062-4d56-9f9a-cdf2359479f3 -- POST / 200 524.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,261 mnist_classifier_MNISTClassifier 88qanr4a 6c9c23fc-850a-4d83-b7a3-5118204d3bc7 -- POST / 200 525.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,262 mnist_classifier_MNISTClassifier 88qanr4a dfa871f0-04f3-4959-99c3-3322af782d88 -- POST / 200 517.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,262 mnist_classifier_MNISTClassifier 88qanr4a dc949893-d0c3-4247-90f0-dd2b354b23e1 -- POST / 200 521.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,262 mnist_classifier_MNISTClassifier 88qanr4a ecfa5ebd-581f-42cc-8235-1af10b590b58 -- POST / 200 511.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,262 mnist_classifier_MNISTClassifier 88qanr4a f348a58b-1ba9-43e6-9712-b02b06af5c20 -- POST / 200 511.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,263 mnist_classifier_MNISTClassifier 88qanr4a abfbcfcd-eb31-4e29-9d4c-44d6fc0e29b5 -- POST / 200 504.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,264 mnist_classifier_MNISTClassifier 88qanr4a ec56832e-a194-4f05-9264-51d5771aecd1 -- POST / 200 505.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,264 mnist_classifier_MNISTClassifier 88qanr4a 38544451-6150-409b-896c-dbcdcb2ea290 -- POST / 200 501.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,267 mnist_classifier_MNISTClassifier 88qanr4a 0c8c2787-9800-4a3a-9f92-b610319522ca -- POST / 200 325.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,268 mnist_classifier_MNISTClassifier 88qanr4a 7f6ee831-e456-4f46-aff9-fd4932e2f114 -- POST / 200 490.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,268 mnist_classifier_MNISTClassifier 88qanr4a f70f7ab7-a1f9-4f77-a106-2104250a5897 -- POST / 200 482.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,268 mnist_classifier_MNISTClassifier 88qanr4a b389c098-9aa1-44ab-9a76-0d4a151e3f50 -- POST / 200 329.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,269 mnist_classifier_MNISTClassifier 88qanr4a 43928b59-a209-4809-a7a6-4348f5e13535 -- POST / 200 327.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,270 mnist_classifier_MNISTClassifier 88qanr4a 2757e6d7-e9ed-450e-8c2e-7cd0e895145c -- POST / 200 314.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,270 mnist_classifier_MNISTClassifier 88qanr4a 826009b5-85b4-4474-84cd-958e851a3f0b -- POST / 200 314.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,270 mnist_classifier_MNISTClassifier 88qanr4a 66314456-cd81-42e1-82e6-40c5542e5611 -- POST / 200 314.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,271 mnist_classifier_MNISTClassifier 88qanr4a c3a7241b-49b9-4d6b-94ed-108b37e7f888 -- POST / 200 314.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,271 mnist_classifier_MNISTClassifier 88qanr4a e11a1566-40bf-4552-831f-c36ecefd53a0 -- POST / 200 314.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,272 mnist_classifier_MNISTClassifier 88qanr4a 878e3040-661a-4e9a-854b-82ce2b2e4f50 -- POST / 200 314.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,275 mnist_classifier_MNISTClassifier 88qanr4a 66cda498-df52-4dfb-9375-dd463857cb91 -- POST / 200 309.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,276 mnist_classifier_MNISTClassifier 88qanr4a 9156d379-2a87-418e-a96b-a23d35c620a4 -- POST / 200 310.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,277 mnist_classifier_MNISTClassifier 88qanr4a bf2c7132-3b6a-4517-95f0-3cfb9155e1bf -- POST / 200 309.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,278 mnist_classifier_MNISTClassifier 88qanr4a c921f969-8309-429e-922f-f58a7132f9b2 -- POST / 200 302.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,278 mnist_classifier_MNISTClassifier 88qanr4a bb0f5bc2-e95b-4c06-8e14-55a2313c6774 -- POST / 200 301.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,278 mnist_classifier_MNISTClassifier 88qanr4a a347db59-57fa-4166-b248-dcf3a70c1ef7 -- POST / 200 295.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,278 mnist_classifier_MNISTClassifier 88qanr4a 00207e43-f011-4285-a25f-0ba4e98426d5 -- POST / 200 298.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,279 mnist_classifier_MNISTClassifier 88qanr4a 73c83122-933a-4f3c-a6db-5fbdfb7f7e28 -- POST / 200 289.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,279 mnist_classifier_MNISTClassifier 88qanr4a faf8d81b-7eb8-45cf-996f-8b818ef6863f -- POST / 200 292.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,280 mnist_classifier_MNISTClassifier 88qanr4a 7a23679f-48ab-4f7f-a08e-5e8081b82b54 -- POST / 200 295.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,282 mnist_classifier_MNISTClassifier 88qanr4a 12149120-5156-4665-8a8c-dd174e4d3104 -- POST / 200 296.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,282 mnist_classifier_MNISTClassifier 88qanr4a 93954e88-0577-4455-b8a9-d2602ca8d7e1 -- POST / 200 296.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,283 mnist_classifier_MNISTClassifier 88qanr4a c57558d1-f7a5-4fb0-a8f5-5da4390c09ac -- POST / 200 293.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,284 mnist_classifier_MNISTClassifier 88qanr4a fb6f3beb-d89d-4618-9ccd-57550d6308fe -- POST / 200 293.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,284 mnist_classifier_MNISTClassifier 88qanr4a 84f0da21-7cae-4dd0-acd9-074b899cf84a -- POST / 200 293.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,284 mnist_classifier_MNISTClassifier 88qanr4a e55e570e-e367-4a2c-b80c-3e76b58b8ecf -- POST / 200 293.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,284 mnist_classifier_MNISTClassifier 88qanr4a 26b0921a-c62e-409e-a8b7-f9c41d39cc52 -- POST / 200 292.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,285 mnist_classifier_MNISTClassifier 88qanr4a ef725ceb-3f8c-4ef4-8898-e88e0fbceca1 -- POST / 200 292.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,285 mnist_classifier_MNISTClassifier 88qanr4a 0655b07c-27ea-4a31-941b-8e0cc98a6068 -- POST / 200 292.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,289 mnist_classifier_MNISTClassifier 88qanr4a c46e5ce1-f30f-491d-ade0-cb1cfa1c2daf -- POST / 200 296.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,291 mnist_classifier_MNISTClassifier 88qanr4a 589a069c-b9b4-4633-9f32-44c675535688 -- POST / 200 298.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,292 mnist_classifier_MNISTClassifier 88qanr4a 57333fb0-08c0-4af3-87a5-f44b84b0ea53 -- POST / 200 298.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,292 mnist_classifier_MNISTClassifier 88qanr4a 61e50264-d003-41f4-b67e-280dcf6094b7 -- POST / 200 297.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,292 mnist_classifier_MNISTClassifier 88qanr4a 2281e4ea-ae73-4708-957c-cf95b1f38eff -- POST / 200 297.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,292 mnist_classifier_MNISTClassifier 88qanr4a ef678d1e-c6ad-46dc-a930-1c3d97900648 -- POST / 200 297.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,292 mnist_classifier_MNISTClassifier 88qanr4a a2e58d02-0657-46a5-9e94-cf8b99d512d2 -- POST / 200 296.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,293 mnist_classifier_MNISTClassifier 88qanr4a c0f7a72d-1a47-44c2-937d-9ae3ecbace68 -- POST / 200 295.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,293 mnist_classifier_MNISTClassifier 88qanr4a 3f8678df-8e32-45d1-bfe0-e1167c5690c7 -- POST / 200 295.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,293 mnist_classifier_MNISTClassifier 88qanr4a 1e95bbc1-f76e-4abc-b9ab-628a5dd3af6d -- POST / 200 294.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,293 mnist_classifier_MNISTClassifier 88qanr4a 24a910ae-c291-4055-9add-421ec765ea63 -- POST / 200 294.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,293 mnist_classifier_MNISTClassifier 88qanr4a 190b44f9-a819-4ddb-9c13-e7bf8470d951 -- POST / 200 292.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,293 mnist_classifier_MNISTClassifier 88qanr4a ccac956c-6340-4b63-b052-821be8587998 -- POST / 200 292.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,294 mnist_classifier_MNISTClassifier 88qanr4a 3a5abae7-c12c-4416-aeb9-1f2c2b025506 -- POST / 200 292.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,294 mnist_classifier_MNISTClassifier 88qanr4a 541b78bd-93d3-454c-a782-edd30cd513b4 -- POST / 200 292.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,294 mnist_classifier_MNISTClassifier 88qanr4a 1b3368f8-fab7-4b4d-a794-eb8ef11b2784 -- POST / 200 292.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,296 mnist_classifier_MNISTClassifier 88qanr4a b9bcb62b-78d5-4851-9a87-65519ea9a7c0 -- POST / 200 255.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,298 mnist_classifier_MNISTClassifier 88qanr4a c67360a1-fd63-4f07-9ffa-99a657a8c6b9 -- POST / 200 258.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,299 mnist_classifier_MNISTClassifier 88qanr4a 31f2c3fd-aa88-4d50-8553-73af23b82e93 -- POST / 200 245.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,299 mnist_classifier_MNISTClassifier 88qanr4a 304b2b5e-0293-497c-af8a-8fd527dc2c7b -- POST / 200 237.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,301 mnist_classifier_MNISTClassifier 88qanr4a 01c87d13-057d-47db-941b-ebb4b5941bd2 -- POST / 200 238.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,301 mnist_classifier_MNISTClassifier 88qanr4a 4eeaf9b8-2618-4c34-bd42-77ceb2062122 -- POST / 200 233.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,302 mnist_classifier_MNISTClassifier 88qanr4a 72d6d59d-b6b8-45c6-9090-6517b712030c -- POST / 200 228.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,302 mnist_classifier_MNISTClassifier 88qanr4a dbf9f70c-168a-4cd3-9b3e-e202c3b1658d -- POST / 200 228.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,302 mnist_classifier_MNISTClassifier 88qanr4a d02c441e-cb3c-42a3-9e2b-683f5f6a1fad -- POST / 200 223.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,303 mnist_classifier_MNISTClassifier 88qanr4a d74374c8-120f-4e5d-98a4-31a6a13fd61f -- POST / 200 219.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,303 mnist_classifier_MNISTClassifier 88qanr4a af3a54a1-b0d0-482e-a3af-ffd982df1f7c -- POST / 200 219.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,304 mnist_classifier_MNISTClassifier 88qanr4a 0044e8e8-9e69-49f7-a139-fa3a9a7b2ece -- POST / 200 217.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,304 mnist_classifier_MNISTClassifier 88qanr4a c018f2c0-7da5-424a-a676-feb3dd8e06b4 -- POST / 200 221.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,304 mnist_classifier_MNISTClassifier 88qanr4a 090b5332-b5e5-4b3c-9f31-d62ba9c33cbe -- POST / 200 217.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,304 mnist_classifier_MNISTClassifier 88qanr4a de28b987-51b0-443c-9a5c-899172ea6e32 -- POST / 200 216.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,305 mnist_classifier_MNISTClassifier 88qanr4a fefeec94-8247-4af0-b502-168bb395af38 -- POST / 200 216.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,305 mnist_classifier_MNISTClassifier 88qanr4a 751b8306-d860-4929-b9fe-c693c61db818 -- POST / 200 216.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,305 mnist_classifier_MNISTClassifier 88qanr4a 1280d1c0-142e-48e7-a7c5-79910b32685c -- POST / 200 206.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,306 mnist_classifier_MNISTClassifier 88qanr4a 7faf0155-ac6c-451d-b3a2-4542da5e8e01 -- POST / 200 206.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,306 mnist_classifier_MNISTClassifier 88qanr4a cdf05890-3fbf-4b9c-a36a-ef84d015d1b9 -- POST / 200 205.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,366 mnist_classifier_MNISTClassifier 88qanr4a 8157628c-98e3-488c-bbe5-bcc71126558b -- POST / 200 256.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,399 mnist_classifier_MNISTClassifier 88qanr4a 007bfc55-54e8-4cab-8a48-f66f089dd77d -- POST / 200 285.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,403 mnist_classifier_MNISTClassifier 88qanr4a 0fc9d853-fa62-42f0-9a76-a4f7db5cb7b3 -- POST / 200 288.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,408 mnist_classifier_MNISTClassifier 88qanr4a a842e211-82dc-4cb5-8269-c4752f7ac109 -- POST / 200 273.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,411 mnist_classifier_MNISTClassifier 88qanr4a c049d82c-f608-4de1-ad62-18da212f52e9 -- POST / 200 255.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,412 mnist_classifier_MNISTClassifier 88qanr4a 6e1907cc-523c-49ca-8ae8-e1cf98d8be44 -- POST / 200 255.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,413 mnist_classifier_MNISTClassifier 88qanr4a 6e42c046-27f2-4b9c-8922-e3683e77d98a -- POST / 200 256.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,413 mnist_classifier_MNISTClassifier 88qanr4a 3d8e58f4-ff86-4ba3-a5dc-73b8daffca6d -- POST / 200 256.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,414 mnist_classifier_MNISTClassifier 88qanr4a 2f872f51-6043-40b2-a674-c77399f275bc -- POST / 200 255.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,414 mnist_classifier_MNISTClassifier 88qanr4a 84eb40e0-e51e-4b0e-b4dc-9831d6a7c042 -- POST / 200 255.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,415 mnist_classifier_MNISTClassifier 88qanr4a 087a968d-5b97-4bc6-a20c-8d9204b0a31c -- POST / 200 255.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,415 mnist_classifier_MNISTClassifier 88qanr4a da74b98f-44d1-4dc8-b998-61753d19d5cb -- POST / 200 256.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,415 mnist_classifier_MNISTClassifier 88qanr4a bf2fdd57-421e-4ce9-90e4-b03636180a31 -- POST / 200 256.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,415 mnist_classifier_MNISTClassifier 88qanr4a f51e437b-58d1-4029-ab31-6a8f44189350 -- POST / 200 255.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,416 mnist_classifier_MNISTClassifier 88qanr4a 95902727-a36e-4de7-a092-765e971a82a7 -- POST / 200 255.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,416 mnist_classifier_MNISTClassifier 88qanr4a 0680abf8-ffe4-4229-b8bf-a119d95ed3be -- POST / 200 253.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,419 mnist_classifier_MNISTClassifier 88qanr4a 77d199ba-62b5-4059-834e-c71890ac0707 -- POST / 200 253.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,420 mnist_classifier_MNISTClassifier 88qanr4a 07f2c3a8-cfc7-4376-a7d9-b9e61ceab62b -- POST / 200 254.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,420 mnist_classifier_MNISTClassifier 88qanr4a aef023b0-91b3-42d0-9e66-00b0fe31e1c4 -- POST / 200 253.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,421 mnist_classifier_MNISTClassifier 88qanr4a d44aa063-0bba-4fdd-be6f-6a1d13fe54f0 -- POST / 200 253.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,499 mnist_classifier_MNISTClassifier 88qanr4a 0f9da8f4-8758-436c-a5b5-20f819180c52 -- POST / 200 232.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,506 mnist_classifier_MNISTClassifier 88qanr4a 656b6e55-0003-4af7-879a-29b3e2762c8e -- POST / 200 239.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,506 mnist_classifier_MNISTClassifier 88qanr4a f3678313-aa01-4b49-840c-91825141de93 -- POST / 200 232.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,507 mnist_classifier_MNISTClassifier 88qanr4a 117b3c9b-0462-4e63-bca4-584e87dd9f48 -- POST / 200 232.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,508 mnist_classifier_MNISTClassifier 88qanr4a 1567c3a1-c20e-456e-bd55-c34c34b9176a -- POST / 200 233.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,509 mnist_classifier_MNISTClassifier 88qanr4a 59239553-8d25-455d-98be-2077e6e3a7c5 -- POST / 200 227.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,509 mnist_classifier_MNISTClassifier 88qanr4a 0ba1a010-4c70-46f0-a5d0-074530a3e897 -- POST / 200 214.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,509 mnist_classifier_MNISTClassifier 88qanr4a c571cf82-efb7-4ef2-b5a4-54bc3826de12 -- POST / 200 202.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,510 mnist_classifier_MNISTClassifier 88qanr4a 1b6c14b5-8477-4855-bc9f-8e8a98b5d891 -- POST / 200 194.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,510 mnist_classifier_MNISTClassifier 88qanr4a b9f2e02b-e93e-433d-ab54-7a58b9a3b9e5 -- POST / 200 200.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,515 mnist_classifier_MNISTClassifier 88qanr4a f6377399-aeac-4e78-9cd6-4bee33cdcd3a -- POST / 200 202.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,516 mnist_classifier_MNISTClassifier 88qanr4a 49ccb103-d623-4849-9668-ced62580c3cd -- POST / 200 201.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,519 mnist_classifier_MNISTClassifier 88qanr4a dfac1f30-7484-451a-93fd-a0392cd80ddf -- POST / 200 203.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,520 mnist_classifier_MNISTClassifier 88qanr4a 333714c1-237e-4576-a1a6-3ab0cb0e3e6f -- POST / 200 198.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,521 mnist_classifier_MNISTClassifier 88qanr4a bb83c5ec-7482-4f30-b825-e5c33873276b -- POST / 200 203.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,521 mnist_classifier_MNISTClassifier 88qanr4a 5379ca13-c32d-4087-8771-9e6738f985a7 -- POST / 200 198.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,523 mnist_classifier_MNISTClassifier 88qanr4a ef959f3d-f8c5-4ec1-9a7d-88bc0ebe8aaf -- POST / 200 199.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,652 mnist_classifier_MNISTClassifier 88qanr4a be5f223a-b305-45e6-8787-65ee1e3652f0 -- POST / 200 326.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,672 mnist_classifier_MNISTClassifier 88qanr4a 84c3c2ae-143b-4b1f-ad57-80e0aef0e682 -- POST / 200 346.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,677 mnist_classifier_MNISTClassifier 88qanr4a 7805939c-4153-416d-8d57-b1198f5d3d5d -- POST / 200 351.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,679 mnist_classifier_MNISTClassifier 88qanr4a 1128f70f-7d85-45ea-8c4f-6d96ce244028 -- POST / 200 352.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,679 mnist_classifier_MNISTClassifier 88qanr4a 128cd752-39ef-433c-a3b6-588bec5dd6e6 -- POST / 200 351.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,680 mnist_classifier_MNISTClassifier 88qanr4a cee33ed3-d4b9-4ec1-92e9-f0f9eb62b94e -- POST / 200 351.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,681 mnist_classifier_MNISTClassifier 88qanr4a 7bfcf121-702d-42b9-b3d9-38495c8fc75d -- POST / 200 351.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,681 mnist_classifier_MNISTClassifier 88qanr4a 2e6a5ace-e132-4fef-98fe-da49b37f9bb4 -- POST / 200 351.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,681 mnist_classifier_MNISTClassifier 88qanr4a d8e579af-1e9d-4d63-b1d0-12a74779c3d5 -- POST / 200 351.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,682 mnist_classifier_MNISTClassifier 88qanr4a 9f9dc9f8-a465-461b-9200-fdcb5ba0e609 -- POST / 200 345.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,682 mnist_classifier_MNISTClassifier 88qanr4a df13a24b-15ab-401f-aa8f-45c49e3056f7 -- POST / 200 333.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,683 mnist_classifier_MNISTClassifier 88qanr4a edde3fcf-f56b-456d-a974-8ccb3b88823f -- POST / 200 332.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,688 mnist_classifier_MNISTClassifier 88qanr4a 58893940-8e38-4275-83a6-ef087d6c8d8c -- POST / 200 336.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,689 mnist_classifier_MNISTClassifier 88qanr4a 8bdc8367-40df-4040-b35e-0a936575b528 -- POST / 200 330.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,689 mnist_classifier_MNISTClassifier 88qanr4a 0bf09315-41e8-4972-836a-467e288401ff -- POST / 200 330.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,689 mnist_classifier_MNISTClassifier 88qanr4a 7463ef7e-3120-4799-b6fb-ff46b6485f59 -- POST / 200 329.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,689 mnist_classifier_MNISTClassifier 88qanr4a d051c96d-31c4-4f79-8457-88d8417cb8e1 -- POST / 200 328.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,689 mnist_classifier_MNISTClassifier 88qanr4a f120b7a3-51c4-4bed-904b-b19995ac307a -- POST / 200 263.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,690 mnist_classifier_MNISTClassifier 88qanr4a 2330cb5e-7c1e-471a-be89-8f00e1cd758c -- POST / 200 267.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,690 mnist_classifier_MNISTClassifier 88qanr4a 2001209f-27bd-465f-a2e7-e188f06e39d7 -- POST / 200 267.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,690 mnist_classifier_MNISTClassifier 88qanr4a ad44ddcf-5e24-4983-8993-da8e9bedbec7 -- POST / 200 267.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,690 mnist_classifier_MNISTClassifier 88qanr4a c53da636-c759-416d-8947-25b7e2b5e93d -- POST / 200 268.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,691 mnist_classifier_MNISTClassifier 88qanr4a 0838eaea-3c21-4a55-bbf3-85ef3daa6db8 -- POST / 200 268.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,691 mnist_classifier_MNISTClassifier 88qanr4a 72892c84-f680-49fd-8264-838c6dc19ab1 -- POST / 200 267.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,691 mnist_classifier_MNISTClassifier 88qanr4a 06864592-e6b9-4e86-af35-c56b19d796ba -- POST / 200 267.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,691 mnist_classifier_MNISTClassifier 88qanr4a a8819b99-aae2-4289-a4ee-722d8b1b8921 -- POST / 200 267.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,692 mnist_classifier_MNISTClassifier 88qanr4a c67cf7e8-5071-42c5-bc46-f35d07da468e -- POST / 200 267.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,692 mnist_classifier_MNISTClassifier 88qanr4a 5ce7cf51-4499-494c-bf96-fa27469ccb4f -- POST / 200 267.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,692 mnist_classifier_MNISTClassifier 88qanr4a 94585828-9354-47d2-bb1d-172edb4b05df -- POST / 200 250.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,692 mnist_classifier_MNISTClassifier 88qanr4a 7a6f3776-13e8-4bb7-ad3a-ccc3767d7496 -- POST / 200 250.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,692 mnist_classifier_MNISTClassifier 88qanr4a a43d8fbf-ee94-490c-bfc4-94d35ec602f6 -- POST / 200 249.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,693 mnist_classifier_MNISTClassifier 88qanr4a 03fd010a-3ac9-48fe-8c10-14d553a4db29 -- POST / 200 245.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,693 mnist_classifier_MNISTClassifier 88qanr4a 141dfd22-75bf-460b-9f41-7c2384fcf244 -- POST / 200 245.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,693 mnist_classifier_MNISTClassifier 88qanr4a de012698-a60f-417a-bcbb-d16b9d560128 -- POST / 200 245.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,693 mnist_classifier_MNISTClassifier 88qanr4a 052a627c-047b-4f16-a604-5cc9e2ecea96 -- POST / 200 242.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,693 mnist_classifier_MNISTClassifier 88qanr4a 11c7d97b-dee5-4051-9f3c-04bb425e2ad2 -- POST / 200 242.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,693 mnist_classifier_MNISTClassifier 88qanr4a 33c2735a-9091-469f-a5d6-976dda00b449 -- POST / 200 241.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,694 mnist_classifier_MNISTClassifier 88qanr4a 23d3bef7-7fe1-43c8-bd14-2190b0359903 -- POST / 200 242.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,695 mnist_classifier_MNISTClassifier 88qanr4a 304cecbf-8b17-4c04-b9f3-ed212851e6b4 -- POST / 200 241.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,696 mnist_classifier_MNISTClassifier 88qanr4a 8594d108-3bbf-4d2c-a027-172e586a2506 -- POST / 200 241.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,697 mnist_classifier_MNISTClassifier 88qanr4a 082905fe-c7ef-485f-9709-4f0dae8fa4c3 -- POST / 200 242.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,913 mnist_classifier_MNISTClassifier 88qanr4a 29f40216-5223-49b1-971f-c91be248ebb0 -- POST / 200 458.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,915 mnist_classifier_MNISTClassifier 88qanr4a c238ac4a-64e1-4727-9d4b-0d65ec94dcd0 -- POST / 200 459.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,915 mnist_classifier_MNISTClassifier 88qanr4a 7e4494eb-2f0f-4852-8c57-c14dbc3115e5 -- POST / 200 459.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,920 mnist_classifier_MNISTClassifier 88qanr4a c9c3af2d-9aeb-478e-b26f-193ba929be1c -- POST / 200 463.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,921 mnist_classifier_MNISTClassifier 88qanr4a e21b54f8-3b2b-4269-b152-8649cefe3475 -- POST / 200 463.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,922 mnist_classifier_MNISTClassifier 88qanr4a 5271a0ab-6f29-454c-a44d-dc239549cdb8 -- POST / 200 463.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,923 mnist_classifier_MNISTClassifier 88qanr4a dc16d656-a23e-4c3d-80ec-166257693bdf -- POST / 200 463.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,925 mnist_classifier_MNISTClassifier 88qanr4a 66b48d66-690c-4ccc-8b9b-554fcdc7a07a -- POST / 200 464.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,925 mnist_classifier_MNISTClassifier 88qanr4a af40a4b6-772b-4181-b61c-708277553f82 -- POST / 200 462.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,926 mnist_classifier_MNISTClassifier 88qanr4a a10c7d78-97d1-4210-ba60-d649df9f11df -- POST / 200 463.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,926 mnist_classifier_MNISTClassifier 88qanr4a 29375e7f-7c3a-4beb-808e-d45641a77d96 -- POST / 200 463.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,927 mnist_classifier_MNISTClassifier 88qanr4a 34f62a65-a0bf-4ee8-abaa-455d038241f3 -- POST / 200 462.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,927 mnist_classifier_MNISTClassifier 88qanr4a 2bf88d99-df4b-49c0-ba84-7d7fa0072136 -- POST / 200 458.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,928 mnist_classifier_MNISTClassifier 88qanr4a e3259acf-c36c-4f1a-a5f5-d2c3b7b695de -- POST / 200 453.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,929 mnist_classifier_MNISTClassifier 88qanr4a 9b4a523b-1d4d-44f2-b7e8-ca8e5ee3fe77 -- POST / 200 454.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,930 mnist_classifier_MNISTClassifier 88qanr4a f3e1c441-1d1d-4212-a5ab-e29bd93e96a3 -- POST / 200 454.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,931 mnist_classifier_MNISTClassifier 88qanr4a c42187aa-e8e5-438c-9947-52c15135f270 -- POST / 200 454.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,932 mnist_classifier_MNISTClassifier 88qanr4a 73541d17-ecab-4bfb-8fcb-00e8431fafab -- POST / 200 455.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,933 mnist_classifier_MNISTClassifier 88qanr4a 24a5f7d9-6b1d-48c6-8a64-11765b62d8b7 -- POST / 200 462.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,934 mnist_classifier_MNISTClassifier 88qanr4a e102965a-992a-4acc-bfe5-71f0e6f0d206 -- POST / 200 463.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,938 mnist_classifier_MNISTClassifier 88qanr4a eeb0e363-4cf1-4748-b198-450b2d8ddbf8 -- POST / 200 466.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,942 mnist_classifier_MNISTClassifier 88qanr4a 75d12e7f-21aa-452d-b398-8bb5ec188e00 -- POST / 200 470.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,942 mnist_classifier_MNISTClassifier 88qanr4a b511a2a5-bc62-4678-b0af-04b082623450 -- POST / 200 414.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,943 mnist_classifier_MNISTClassifier 88qanr4a 4361fc58-a97a-457b-9b81-5c51b699f135 -- POST / 200 414.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,943 mnist_classifier_MNISTClassifier 88qanr4a 1bbbc40b-3aba-4d70-a3b4-f7fecc46ca73 -- POST / 200 413.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,944 mnist_classifier_MNISTClassifier 88qanr4a a869ee08-6bb1-4e0d-a439-452f6e348952 -- POST / 200 412.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,944 mnist_classifier_MNISTClassifier 88qanr4a 4235ade9-72b7-4b32-b320-63effac133d6 -- POST / 200 412.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,945 mnist_classifier_MNISTClassifier 88qanr4a b08d6eb1-c77d-42cb-83a5-70a3ba5040ae -- POST / 200 407.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,946 mnist_classifier_MNISTClassifier 88qanr4a 6d0e6957-b603-41c7-9320-c85df8b565d4 -- POST / 200 404.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,948 mnist_classifier_MNISTClassifier 88qanr4a 61ad2034-8cdc-4f2b-b8cb-6afd1123fd98 -- POST / 200 406.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,948 mnist_classifier_MNISTClassifier 88qanr4a 081bb82a-8303-46e5-bc88-6e8f8aa0b074 -- POST / 200 406.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,951 mnist_classifier_MNISTClassifier 88qanr4a 72816671-ceb0-4ed7-9c20-2fe80f224ab6 -- POST / 200 408.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,951 mnist_classifier_MNISTClassifier 88qanr4a 714bc72a-f834-4e14-965f-1c5cf711da7f -- POST / 200 406.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,954 mnist_classifier_MNISTClassifier 88qanr4a dd9dffa8-7499-4aa1-a7ce-f9311c18281e -- POST / 200 406.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,956 mnist_classifier_MNISTClassifier 88qanr4a 273ceefe-8901-4e61-bb26-bb7194bc41e5 -- POST / 200 407.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,960 mnist_classifier_MNISTClassifier 88qanr4a 90595323-c2f2-4ea4-989c-de6f5f21b05d -- POST / 200 411.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,963 mnist_classifier_MNISTClassifier 88qanr4a fd6ea3f0-2307-4e9b-9db2-231e53c88fd8 -- POST / 200 414.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,964 mnist_classifier_MNISTClassifier 88qanr4a 7fc2c740-7d85-499b-89fa-b31672a7c5fa -- POST / 200 412.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,965 mnist_classifier_MNISTClassifier 88qanr4a 717ae9c6-f336-49d7-ab4a-2c15a651dfc3 -- POST / 200 412.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,965 mnist_classifier_MNISTClassifier 88qanr4a e59b14f4-b22b-453f-bdff-9b842edff3e1 -- POST / 200 411.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,967 mnist_classifier_MNISTClassifier 88qanr4a 8c08bc25-36e1-4053-a9b5-d072259b1e41 -- POST / 200 412.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,967 mnist_classifier_MNISTClassifier 88qanr4a c6380f4b-6b7c-460a-ba35-765762f1223c -- POST / 200 412.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,968 mnist_classifier_MNISTClassifier 88qanr4a 835478de-c72a-48f8-9bc0-4e624c0d081b -- POST / 200 387.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,969 mnist_classifier_MNISTClassifier 88qanr4a cf827362-db9c-4e60-bb70-5b974135c5f0 -- POST / 200 386.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,969 mnist_classifier_MNISTClassifier 88qanr4a 09226ed4-7825-42e8-857b-ead0701d278e -- POST / 200 385.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,969 mnist_classifier_MNISTClassifier 88qanr4a 0c8e464c-4e74-437e-9d94-188e8b2a59ae -- POST / 200 385.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,972 mnist_classifier_MNISTClassifier 88qanr4a da81a121-6924-4928-b7dd-219c9fbb3473 -- POST / 200 387.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,974 mnist_classifier_MNISTClassifier 88qanr4a fdc72e71-bebe-4fac-b210-bff5b3c9d6fb -- POST / 200 383.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,975 mnist_classifier_MNISTClassifier 88qanr4a e205f838-0088-46e5-abb0-841e4c6f63a5 -- POST / 200 384.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,978 mnist_classifier_MNISTClassifier 88qanr4a 80b7a33d-67b2-402a-add6-dfc54be055ff -- POST / 200 384.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,981 mnist_classifier_MNISTClassifier 88qanr4a d7b2d774-9b35-4e0c-ad7c-656e4116a9d4 -- POST / 200 386.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,982 mnist_classifier_MNISTClassifier 88qanr4a b977becf-8a57-4652-a48f-a61b4e5cb6f1 -- POST / 200 387.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,983 mnist_classifier_MNISTClassifier 88qanr4a a7ab68ea-0fa9-4432-8b99-15bf81a8ea59 -- POST / 200 388.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,983 mnist_classifier_MNISTClassifier 88qanr4a 37747a2d-7f73-4e84-9fd4-dc643da10711 -- POST / 200 387.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,984 mnist_classifier_MNISTClassifier 88qanr4a 10949c05-f707-4f84-8e27-1618285733bb -- POST / 200 386.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,985 mnist_classifier_MNISTClassifier 88qanr4a 0ae73f74-219a-4fcb-a201-4881802bbd5a -- POST / 200 385.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,985 mnist_classifier_MNISTClassifier 88qanr4a 740c4d18-1312-4e84-80ff-8ca803b9ecd6 -- POST / 200 385.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,986 mnist_classifier_MNISTClassifier 88qanr4a aa17b695-3e4e-4ae9-9202-3f4622d89093 -- POST / 200 386.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:52,986 mnist_classifier_MNISTClassifier 88qanr4a 6bd1492e-590b-4055-b4c2-83193b7d7d67 -- POST / 200 385.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,080 mnist_classifier_MNISTClassifier 88qanr4a 6fe50d7d-3fac-4be5-8163-308af28fb9cd -- POST / 200 439.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,090 mnist_classifier_MNISTClassifier 88qanr4a 35e1319e-74a3-40fb-af4d-0fc56c140e34 -- POST / 200 392.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,091 mnist_classifier_MNISTClassifier 88qanr4a a2457dca-bbb1-4520-9fe7-66aab30d9da6 -- POST / 200 389.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,091 mnist_classifier_MNISTClassifier 88qanr4a c597bb7d-b70b-454b-b799-3b234d1177d2 -- POST / 200 389.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,092 mnist_classifier_MNISTClassifier 88qanr4a 9bb0b105-ed3b-45d9-af64-f59ab49dcad4 -- POST / 200 390.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,094 mnist_classifier_MNISTClassifier 88qanr4a b3b6adb3-0477-431a-b6be-58b4cd146c07 -- POST / 200 388.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,095 mnist_classifier_MNISTClassifier 88qanr4a f066802d-09fa-4f18-9e8e-ca2ef6f9d288 -- POST / 200 389.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,096 mnist_classifier_MNISTClassifier 88qanr4a 4afd2599-0b19-465c-9303-0306a9f7fa8c -- POST / 200 389.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,098 mnist_classifier_MNISTClassifier 88qanr4a 1824b280-7b99-44dc-a050-497d150b5836 -- POST / 200 390.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,098 mnist_classifier_MNISTClassifier 88qanr4a 9ab43a1b-3dff-487f-aa55-ffcf034c173b -- POST / 200 389.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,098 mnist_classifier_MNISTClassifier 88qanr4a ff5e0ac1-b5e8-436f-b4fe-3d947d760eda -- POST / 200 389.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,098 mnist_classifier_MNISTClassifier 88qanr4a fb308a8a-c135-4fb2-b92e-83b930e85e70 -- POST / 200 388.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,099 mnist_classifier_MNISTClassifier 88qanr4a 87627633-889d-4e51-9e68-f7f52c51b617 -- POST / 200 388.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,099 mnist_classifier_MNISTClassifier 88qanr4a 00f0ae56-9767-4041-a263-ca8ae9f7685f -- POST / 200 387.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,099 mnist_classifier_MNISTClassifier 88qanr4a cd49f4f1-4125-4b7c-bf4e-86aea5c27037 -- POST / 200 384.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,099 mnist_classifier_MNISTClassifier 88qanr4a e67f0b26-137a-4a34-8a0c-67011a52ba86 -- POST / 200 387.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,099 mnist_classifier_MNISTClassifier 88qanr4a cf1f601d-9d24-4b8c-a82b-5389f28cfe39 -- POST / 200 386.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,100 mnist_classifier_MNISTClassifier 88qanr4a 9b09d12d-430b-40cc-8252-20bc27e27e86 -- POST / 200 384.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,100 mnist_classifier_MNISTClassifier 88qanr4a 3c90c18b-248b-4c62-8d97-1ce3d42b37dd -- POST / 200 385.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,101 mnist_classifier_MNISTClassifier 88qanr4a 1a123f09-1dac-4261-9491-8523a08eae86 -- POST / 200 385.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,102 mnist_classifier_MNISTClassifier 88qanr4a 5966d55f-20d7-4bc0-ab93-698567f9dddc -- POST / 200 383.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,103 mnist_classifier_MNISTClassifier 88qanr4a a1630a84-18cd-4439-9946-818f06ca3e3f -- POST / 200 386.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,103 mnist_classifier_MNISTClassifier 88qanr4a efc3f641-5abc-4ffc-8bbb-04e9565abcb2 -- POST / 200 385.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,106 mnist_classifier_MNISTClassifier 88qanr4a 69c5a336-0f52-412b-9fde-42b59ba756fc -- POST / 200 389.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,107 mnist_classifier_MNISTClassifier 88qanr4a da75e159-0586-4595-8981-f52489feccc8 -- POST / 200 385.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,108 mnist_classifier_MNISTClassifier 88qanr4a 9a6ecd36-9c96-4ac6-8197-82bd8494fe2e -- POST / 200 385.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,108 mnist_classifier_MNISTClassifier 88qanr4a 8eb9e6e3-3e97-4e2e-905a-9b035253677d -- POST / 200 386.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,109 mnist_classifier_MNISTClassifier 88qanr4a 68ffa772-89b1-4cd9-92f8-e33e0e71567f -- POST / 200 386.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,112 mnist_classifier_MNISTClassifier 88qanr4a 06e7ff85-216d-4ad7-8459-9c97d10c3b1a -- POST / 200 238.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,114 mnist_classifier_MNISTClassifier 88qanr4a 2201bbf1-1818-40ed-ad48-d6da1b3d55c7 -- POST / 200 237.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,114 mnist_classifier_MNISTClassifier 88qanr4a df9040e7-8485-463c-b09d-cac0b84261a6 -- POST / 200 237.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,114 mnist_classifier_MNISTClassifier 88qanr4a 96dcdbf4-fc9a-4f66-952c-0b06ac5df62e -- POST / 200 237.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,115 mnist_classifier_MNISTClassifier 88qanr4a a7a5b548-8003-46ab-a1e6-45aeb9d79842 -- POST / 200 238.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,115 mnist_classifier_MNISTClassifier 88qanr4a 66da93af-bf60-447f-9232-412fed1ccbe1 -- POST / 200 238.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,115 mnist_classifier_MNISTClassifier 88qanr4a ed220163-173d-4bc1-a519-90632de9be70 -- POST / 200 238.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,117 mnist_classifier_MNISTClassifier 88qanr4a 62868da1-2ade-460a-8b70-726cd88528b2 -- POST / 200 240.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,118 mnist_classifier_MNISTClassifier 88qanr4a a867476c-0823-4d70-aa60-7ef7232bab27 -- POST / 200 240.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,121 mnist_classifier_MNISTClassifier 88qanr4a 31377b15-1f16-4b35-a4e6-2faf42f04a4f -- POST / 200 243.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,122 mnist_classifier_MNISTClassifier 88qanr4a 264765bd-a3e7-44a3-bc09-cd90483dd592 -- POST / 200 243.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,122 mnist_classifier_MNISTClassifier 88qanr4a 4a6a3b25-7644-4135-9aa2-fb6c94545b6d -- POST / 200 243.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,217 mnist_classifier_MNISTClassifier 88qanr4a aa011e61-f768-478c-abe0-4b6d62328c8f -- POST / 200 338.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,218 mnist_classifier_MNISTClassifier 88qanr4a d2e60308-e042-4636-af36-2b3c1394f2fe -- POST / 200 281.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,221 mnist_classifier_MNISTClassifier 88qanr4a 5e933d18-c7ca-416a-bb92-355d27a91eb9 -- POST / 200 283.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,223 mnist_classifier_MNISTClassifier 88qanr4a e5e84e49-ef35-4537-8201-dc55e3e5c067 -- POST / 200 285.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,227 mnist_classifier_MNISTClassifier 88qanr4a 47345a99-924d-42ac-bd85-202828c167f3 -- POST / 200 288.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,228 mnist_classifier_MNISTClassifier 88qanr4a fe875334-76d1-4924-9eaf-62a50d37674d -- POST / 200 268.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,230 mnist_classifier_MNISTClassifier 88qanr4a 1b57116f-570a-449b-9b49-7bd311aeb5cd -- POST / 200 251.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,230 mnist_classifier_MNISTClassifier 88qanr4a b86ce1df-aed9-4772-8447-254ee576a603 -- POST / 200 242.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,230 mnist_classifier_MNISTClassifier 88qanr4a ecda6f6d-1a28-4503-91f2-8302d4dadd35 -- POST / 200 240.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,231 mnist_classifier_MNISTClassifier 88qanr4a a6915dd4-7a87-4d0d-afdd-6d25aa4a2a33 -- POST / 200 239.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,233 mnist_classifier_MNISTClassifier 88qanr4a aec58fa9-2222-4f11-9b06-fc2a39ac96d8 -- POST / 200 240.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,234 mnist_classifier_MNISTClassifier 88qanr4a e2182714-342d-4552-a812-1342fa897b63 -- POST / 200 241.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,235 mnist_classifier_MNISTClassifier 88qanr4a 89d75860-1991-4d7a-a91a-2e301c0b0787 -- POST / 200 240.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,235 mnist_classifier_MNISTClassifier 88qanr4a a7f814da-0d42-4cba-8f61-0e96946d6b16 -- POST / 200 240.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,236 mnist_classifier_MNISTClassifier 88qanr4a c0c1e06c-5210-4cd8-83a4-5494ebeda5e4 -- POST / 200 239.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,237 mnist_classifier_MNISTClassifier 88qanr4a 93c57f4e-f0ed-44ec-b2b5-da0cdf378299 -- POST / 200 239.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,239 mnist_classifier_MNISTClassifier 88qanr4a b27b0388-eaec-40bc-9a36-82281986aaa6 -- POST / 200 239.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,240 mnist_classifier_MNISTClassifier 88qanr4a eaa593cd-2382-41c1-94b9-4a086e5ab9f5 -- POST / 200 239.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,241 mnist_classifier_MNISTClassifier 88qanr4a 414ceff5-db39-4e6f-8594-f574c9f6efc1 -- POST / 200 240.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,241 mnist_classifier_MNISTClassifier 88qanr4a 1a0cf8ed-6cac-4ef1-8b9e-66767fb0a5d5 -- POST / 200 240.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,242 mnist_classifier_MNISTClassifier 88qanr4a 225862f8-f41b-4907-a61d-a59f0c07c250 -- POST / 200 239.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,243 mnist_classifier_MNISTClassifier 88qanr4a 43af1a21-898e-4294-87e7-1a0a734cc02b -- POST / 200 239.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,245 mnist_classifier_MNISTClassifier 88qanr4a 79dfc68d-2221-487d-9072-3b70478bb2d0 -- POST / 200 241.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,246 mnist_classifier_MNISTClassifier 88qanr4a 5a9905da-df18-46b4-ab09-6b5b82721819 -- POST / 200 241.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,246 mnist_classifier_MNISTClassifier 88qanr4a ba8628b9-5755-4981-b8b9-f7002cdb248e -- POST / 200 241.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,380 mnist_classifier_MNISTClassifier 88qanr4a 331c8a2d-caf9-438f-a2ec-eba94951ea89 -- POST / 200 373.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,380 mnist_classifier_MNISTClassifier 88qanr4a a652c8b3-87d5-468c-b3f3-119d66e03a30 -- POST / 200 331.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,381 mnist_classifier_MNISTClassifier 88qanr4a b78cb2f9-50d1-4e53-bce3-ca4a421c490b -- POST / 200 373.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,382 mnist_classifier_MNISTClassifier 88qanr4a 603bfb1f-4a04-4386-892e-9507189eca40 -- POST / 200 374.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,382 mnist_classifier_MNISTClassifier 88qanr4a acfa5dd0-e0a9-4ed2-b9cb-eebf4e7f85f7 -- POST / 200 370.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,383 mnist_classifier_MNISTClassifier 88qanr4a bb65e74e-a950-4cc5-adea-53e39737fd1f -- POST / 200 370.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,384 mnist_classifier_MNISTClassifier 88qanr4a c719072b-b114-47b9-9abc-b23ac66c0eb2 -- POST / 200 371.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,385 mnist_classifier_MNISTClassifier 88qanr4a 5ed6eace-2b3a-488a-a618-4b63b82a243d -- POST / 200 372.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,385 mnist_classifier_MNISTClassifier 88qanr4a f1f6c12a-6f21-41cd-86c1-ffc93eff1feb -- POST / 200 368.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,387 mnist_classifier_MNISTClassifier 88qanr4a 83302e61-b462-49b5-a82a-2b2fc60c74b1 -- POST / 200 370.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,388 mnist_classifier_MNISTClassifier 88qanr4a afdca78e-ef1c-4553-97e3-d8f582061416 -- POST / 200 370.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,389 mnist_classifier_MNISTClassifier 88qanr4a 0e78c672-1e7b-4d9a-8610-31a0496bd79d -- POST / 200 369.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,389 mnist_classifier_MNISTClassifier 88qanr4a 0814da25-cb3b-44c8-b9a0-b38852d8057d -- POST / 200 369.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,390 mnist_classifier_MNISTClassifier 88qanr4a be376852-15b2-4f24-95f2-e4656afc6d27 -- POST / 200 369.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,392 mnist_classifier_MNISTClassifier 88qanr4a a8ae89a9-4967-48c8-84ba-ce40348053f0 -- POST / 200 370.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,393 mnist_classifier_MNISTClassifier 88qanr4a fa057437-c89d-4247-919c-6e4c8ba12fb2 -- POST / 200 345.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,393 mnist_classifier_MNISTClassifier 88qanr4a 1f5e5994-2564-4a15-9107-54e80786e658 -- POST / 200 344.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,394 mnist_classifier_MNISTClassifier 88qanr4a 92c45ede-647b-48e5-aaca-69fb4bb16cbf -- POST / 200 345.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,395 mnist_classifier_MNISTClassifier 88qanr4a 87b15d38-2a18-4724-9a2c-71793757b16e -- POST / 200 344.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,398 mnist_classifier_MNISTClassifier 88qanr4a eb934c0a-5b1b-4f80-85d4-fa3c9962eb81 -- POST / 200 345.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,398 mnist_classifier_MNISTClassifier 88qanr4a 4a29818d-1a1d-4f97-9ed3-038a5333ce19 -- POST / 200 346.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,399 mnist_classifier_MNISTClassifier 88qanr4a 6369c869-a5e4-45ba-8c8c-a08c7e8a8a9e -- POST / 200 346.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,400 mnist_classifier_MNISTClassifier 88qanr4a 43013920-750a-4ffb-94d2-8f2989370453 -- POST / 200 345.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,400 mnist_classifier_MNISTClassifier 88qanr4a 843c440e-8a90-4b8e-998a-49a5b95221d6 -- POST / 200 341.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,400 mnist_classifier_MNISTClassifier 88qanr4a 9a35dacc-c76c-4475-9701-aa15e26f583f -- POST / 200 341.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,401 mnist_classifier_MNISTClassifier 88qanr4a 1e8e3ce2-2115-4f8b-b1bf-60217408bee4 -- POST / 200 340.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,401 mnist_classifier_MNISTClassifier 88qanr4a 916540d9-66d9-4ecb-b419-49ace6ee17a5 -- POST / 200 339.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,401 mnist_classifier_MNISTClassifier 88qanr4a 4c09e7bc-a89d-4ae4-b618-6338fcbaeec3 -- POST / 200 337.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,402 mnist_classifier_MNISTClassifier 88qanr4a bc5a77ce-cd42-4c4c-a1a9-7a62b23f3123 -- POST / 200 336.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,402 mnist_classifier_MNISTClassifier 88qanr4a 1cbaf3ed-0fc5-43b4-8c66-cee10c9fd261 -- POST / 200 336.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,403 mnist_classifier_MNISTClassifier 88qanr4a 8e7ccc78-1127-4085-8fb2-18f1744a68c5 -- POST / 200 335.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,403 mnist_classifier_MNISTClassifier 88qanr4a 85cddc6f-c17c-4b58-b78b-5e8507d6981a -- POST / 200 334.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,403 mnist_classifier_MNISTClassifier 88qanr4a 2460508a-0877-4726-a703-40e4e2875cdb -- POST / 200 334.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,403 mnist_classifier_MNISTClassifier 88qanr4a 6f8bf732-6004-455e-ab1c-faf455616215 -- POST / 200 333.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,403 mnist_classifier_MNISTClassifier 88qanr4a 56c8319c-c8a9-43bf-b46b-90a250af5ba1 -- POST / 200 333.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,404 mnist_classifier_MNISTClassifier 88qanr4a d0253c5d-b7b8-4d6e-9496-a87cfc4857c9 -- POST / 200 258.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,404 mnist_classifier_MNISTClassifier 88qanr4a 1b0b26bf-1740-4373-9fce-623e1ea099d0 -- POST / 200 272.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,404 mnist_classifier_MNISTClassifier 88qanr4a 53053457-4ab9-48cc-82d6-808d2990842e -- POST / 200 277.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,405 mnist_classifier_MNISTClassifier 88qanr4a de7369b4-fc83-4dd2-ac7b-133ac3ebffd2 -- POST / 200 277.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,405 mnist_classifier_MNISTClassifier 88qanr4a a13c674a-c3bc-495d-8cbb-a91c7f2cbfd2 -- POST / 200 277.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,406 mnist_classifier_MNISTClassifier 88qanr4a f4509023-3a9b-46bd-8955-ee27d852ace7 -- POST / 200 257.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,407 mnist_classifier_MNISTClassifier 88qanr4a 242b4711-8363-4654-a5b7-9b43dbde3307 -- POST / 200 274.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,408 mnist_classifier_MNISTClassifier 88qanr4a 751bf776-8c6f-4f01-bac9-2d502f1272e3 -- POST / 200 274.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,408 mnist_classifier_MNISTClassifier 88qanr4a b6aa3640-a62c-42d4-8bc0-3714ab228c50 -- POST / 200 249.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,409 mnist_classifier_MNISTClassifier 88qanr4a fcc41c70-3f8d-4745-b642-aa2a8a0b168a -- POST / 200 249.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,409 mnist_classifier_MNISTClassifier 88qanr4a 80ca4a32-e5b2-4506-89db-4703da3803cd -- POST / 200 275.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,410 mnist_classifier_MNISTClassifier 88qanr4a 80f96152-d3fe-4999-8330-bd813cc282c0 -- POST / 200 265.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,410 mnist_classifier_MNISTClassifier 88qanr4a 5453dcdd-1407-4ee2-93f5-76212968194b -- POST / 200 248.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,411 mnist_classifier_MNISTClassifier 88qanr4a 9bbed536-3c48-49da-9657-245abcf481d7 -- POST / 200 243.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,411 mnist_classifier_MNISTClassifier 88qanr4a 54893eb0-f459-4714-9c1d-d670c8afd00f -- POST / 200 243.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,412 mnist_classifier_MNISTClassifier 88qanr4a 2396aebf-d222-4e77-aabf-d24cda567ab9 -- POST / 200 236.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,412 mnist_classifier_MNISTClassifier 88qanr4a c4b90761-5022-47d2-ba76-0b3b5c5f6b11 -- POST / 200 235.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,413 mnist_classifier_MNISTClassifier 88qanr4a d8808cf2-d0c0-43b6-85b7-905a0ec893e5 -- POST / 200 234.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,413 mnist_classifier_MNISTClassifier 88qanr4a 182b0dc8-751f-4862-924d-b6a169bc7c0e -- POST / 200 234.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,413 mnist_classifier_MNISTClassifier 88qanr4a 5281067f-d5c9-4526-8954-47812380177d -- POST / 200 234.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,414 mnist_classifier_MNISTClassifier 88qanr4a 96eb44a5-0d97-4cc0-a53a-de3ea79f6a34 -- POST / 200 232.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,414 mnist_classifier_MNISTClassifier 88qanr4a 7ec22964-47c1-46bf-b3ae-64a4779d4316 -- POST / 200 231.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,416 mnist_classifier_MNISTClassifier 88qanr4a fe12be69-30e6-4d4f-ab43-3e32398d6ba2 -- POST / 200 233.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,417 mnist_classifier_MNISTClassifier 88qanr4a c9d09054-57ba-4ad5-ac00-08d9c73b9861 -- POST / 200 233.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,418 mnist_classifier_MNISTClassifier 88qanr4a f9ca5377-ccc0-4401-b08f-e15b1845a551 -- POST / 200 234.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,418 mnist_classifier_MNISTClassifier 88qanr4a 24229297-6c4f-42e0-a0eb-32551e08ae83 -- POST / 200 234.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,418 mnist_classifier_MNISTClassifier 88qanr4a 8a7ab29a-b7d2-4f17-9b90-010e984caa19 -- POST / 200 230.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,432 mnist_classifier_MNISTClassifier 88qanr4a eac8fd4b-baae-4f41-ab31-e72296265ef2 -- POST / 200 247.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,435 mnist_classifier_MNISTClassifier 88qanr4a 224f1c2d-d180-4d98-93ba-da7392024e09 -- POST / 200 247.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,437 mnist_classifier_MNISTClassifier 88qanr4a 4cacd67e-3669-4e8a-a669-a4334c7a72bb -- POST / 200 250.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,438 mnist_classifier_MNISTClassifier 88qanr4a 5839fd94-8915-468e-b997-11d23fb130b4 -- POST / 200 251.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,439 mnist_classifier_MNISTClassifier 88qanr4a 8ec7fc1a-e54c-4073-bf9b-6ada89a8ca0e -- POST / 200 248.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,443 mnist_classifier_MNISTClassifier 88qanr4a 4a0fec94-164e-4e8b-9315-431ba2c3197c -- POST / 200 251.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,444 mnist_classifier_MNISTClassifier 88qanr4a 491c58d7-8dca-421a-809d-e65e89c71898 -- POST / 200 251.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,446 mnist_classifier_MNISTClassifier 88qanr4a 4213dc2e-7b10-4960-8058-21e37a8b4ee9 -- POST / 200 253.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,447 mnist_classifier_MNISTClassifier 88qanr4a 48b75670-2f38-4ba6-9d0a-409d5e89c230 -- POST / 200 252.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,448 mnist_classifier_MNISTClassifier 88qanr4a d55cb9ea-9c45-4862-833f-ff23239f87f3 -- POST / 200 252.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,449 mnist_classifier_MNISTClassifier 88qanr4a 5c78744b-8493-4f38-82a5-ad3fd7f35f44 -- POST / 200 253.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,450 mnist_classifier_MNISTClassifier 88qanr4a d93530d5-7301-45d3-b05e-e8f2ee909e6a -- POST / 200 253.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,450 mnist_classifier_MNISTClassifier 88qanr4a 645c5104-a1bd-4408-aef1-398eb8df8eef -- POST / 200 252.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,507 mnist_classifier_MNISTClassifier 88qanr4a 1505107c-f993-4800-a973-027632e28b30 -- POST / 200 261.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,524 mnist_classifier_MNISTClassifier 88qanr4a 5629d53e-584a-4672-87f3-803905f34d39 -- POST / 200 263.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,525 mnist_classifier_MNISTClassifier 88qanr4a bc82b38d-8327-4081-b16c-1529ed4a360a -- POST / 200 251.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,526 mnist_classifier_MNISTClassifier 88qanr4a fd6a3ab9-0229-4f7e-a6ba-e3dc4d4b594e -- POST / 200 248.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,527 mnist_classifier_MNISTClassifier 88qanr4a 0757a21e-51fd-4043-8299-843e779b9156 -- POST / 200 264.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,528 mnist_classifier_MNISTClassifier 88qanr4a 7f4fa6ff-77fa-46f1-88e9-0af9c3d5d2b5 -- POST / 200 249.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,529 mnist_classifier_MNISTClassifier 88qanr4a fccf758f-f4f0-495c-8d71-f31198cde1ea -- POST / 200 248.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,529 mnist_classifier_MNISTClassifier 88qanr4a 2adf5f0d-18b4-4662-a7a4-147be884e20c -- POST / 200 248.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,529 mnist_classifier_MNISTClassifier 88qanr4a febf55c8-ff8e-465d-a747-76746337e68b -- POST / 200 248.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,529 mnist_classifier_MNISTClassifier 88qanr4a 243cae26-53cf-49a9-8d7a-c817e0c54e75 -- POST / 200 248.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,531 mnist_classifier_MNISTClassifier 88qanr4a 47f6c897-2070-4710-b69f-9a81704a318f -- POST / 200 250.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,532 mnist_classifier_MNISTClassifier 88qanr4a f79bed12-66bc-4b11-8cdc-d95e18f36226 -- POST / 200 245.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,532 mnist_classifier_MNISTClassifier 88qanr4a 2afcfa1f-f97a-4b47-a7c6-6c4b508ba32e -- POST / 200 242.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,533 mnist_classifier_MNISTClassifier 88qanr4a dae2148c-e3de-4e67-ae89-1c08195b5dfd -- POST / 200 242.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,533 mnist_classifier_MNISTClassifier 88qanr4a 091aa83e-da30-41ff-aa22-4557e0612cb1 -- POST / 200 242.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,533 mnist_classifier_MNISTClassifier 88qanr4a def96de4-4bc5-421d-844f-786ccb2d9741 -- POST / 200 242.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,533 mnist_classifier_MNISTClassifier 88qanr4a d25af1c2-64b3-4b1f-85d4-f34aeca7b131 -- POST / 200 242.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,534 mnist_classifier_MNISTClassifier 88qanr4a 14bab7c8-1800-4c44-a131-29259cb6185e -- POST / 200 242.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,534 mnist_classifier_MNISTClassifier 88qanr4a 9b037421-68a6-4618-abf9-37bad0179ba8 -- POST / 200 242.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,534 mnist_classifier_MNISTClassifier 88qanr4a 1c225f6a-3762-44b2-8674-9a20c4879fd2 -- POST / 200 242.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,534 mnist_classifier_MNISTClassifier 88qanr4a 8995efb9-02f7-497f-bcbf-4678acd814fa -- POST / 200 242.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,534 mnist_classifier_MNISTClassifier 88qanr4a dcda4578-04bb-4352-83b1-0e8062f23636 -- POST / 200 242.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,534 mnist_classifier_MNISTClassifier 88qanr4a aa098697-338e-4922-be1b-6f89262acbbd -- POST / 200 242.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,535 mnist_classifier_MNISTClassifier 88qanr4a e9a87a94-96d4-4658-aa79-7e4491b4d262 -- POST / 200 242.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,535 mnist_classifier_MNISTClassifier 88qanr4a 952a007b-38e2-48fe-aefe-13e3295fc862 -- POST / 200 241.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,813 mnist_classifier_MNISTClassifier 88qanr4a 2d5b5b20-95d7-44d4-9230-07ebb769d559 -- POST / 200 429.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,818 mnist_classifier_MNISTClassifier 88qanr4a da1e6277-0d50-4c52-8017-af20c19a6f13 -- POST / 200 431.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,828 mnist_classifier_MNISTClassifier 88qanr4a c0d5dee6-2382-47ac-8794-f436d761593c -- POST / 200 441.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,837 mnist_classifier_MNISTClassifier 88qanr4a 97b717a0-e4e8-4928-a0c1-a8d47b1056f7 -- POST / 200 447.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,839 mnist_classifier_MNISTClassifier 88qanr4a dfe4c22e-12ed-42b8-a6db-4ae37906af91 -- POST / 200 447.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,843 mnist_classifier_MNISTClassifier 88qanr4a a73b6504-714c-4e0d-9c78-94b455f58462 -- POST / 200 449.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,844 mnist_classifier_MNISTClassifier 88qanr4a 0c3e4082-0545-48e8-9086-d8eea88bcf23 -- POST / 200 401.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,844 mnist_classifier_MNISTClassifier 88qanr4a ef6ee5c4-5b75-4ed1-9a27-2c7d524bb917 -- POST / 200 402.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,845 mnist_classifier_MNISTClassifier 88qanr4a 56f6c829-1777-4341-97aa-e91527addcdd -- POST / 200 394.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,846 mnist_classifier_MNISTClassifier 88qanr4a 36bf7282-5a79-4572-94cc-7dadb31eef49 -- POST / 200 395.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,846 mnist_classifier_MNISTClassifier 88qanr4a 724bed50-90ed-4a84-9d03-d6590c1567c0 -- POST / 200 394.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,847 mnist_classifier_MNISTClassifier 88qanr4a b85ac198-18d1-464c-89d9-03a7f661da49 -- POST / 200 394.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,847 mnist_classifier_MNISTClassifier 88qanr4a 4b0a4a29-0eb3-4697-9531-15140d6f5d21 -- POST / 200 394.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,847 mnist_classifier_MNISTClassifier 88qanr4a cebbef8d-bfd8-4682-8918-0e685a0053e9 -- POST / 200 392.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,848 mnist_classifier_MNISTClassifier 88qanr4a 997b0869-b808-42c5-ae6f-b22cc390fdaa -- POST / 200 393.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,848 mnist_classifier_MNISTClassifier 88qanr4a 87c4b74e-fe2c-49c9-84b5-aadbbf4947f2 -- POST / 200 390.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,849 mnist_classifier_MNISTClassifier 88qanr4a 836c5646-9dc8-4985-b92e-eaa60bd6aaad -- POST / 200 380.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,849 mnist_classifier_MNISTClassifier 88qanr4a 4ff3b9e8-0ed7-4542-ae64-57401d5cdbd9 -- POST / 200 385.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,849 mnist_classifier_MNISTClassifier 88qanr4a ca99c806-24cf-4a27-89c7-d3dc32c498c1 -- POST / 200 383.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,850 mnist_classifier_MNISTClassifier 88qanr4a c82f7285-0c2a-4859-bd2f-47f4563fa88c -- POST / 200 380.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,850 mnist_classifier_MNISTClassifier 88qanr4a 46ea7a6c-5f13-461f-88bb-6baff3fb8fe9 -- POST / 200 381.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,852 mnist_classifier_MNISTClassifier 88qanr4a a714462c-51df-4f16-857d-4d768072914e -- POST / 200 383.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,853 mnist_classifier_MNISTClassifier 88qanr4a 0b520527-4d43-472f-8a50-2fc35a9dc288 -- POST / 200 383.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,853 mnist_classifier_MNISTClassifier 88qanr4a f48b6584-b2df-451f-9b8a-e1dd76e9b2f0 -- POST / 200 383.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,853 mnist_classifier_MNISTClassifier 88qanr4a d69453e9-bacc-4453-afb8-08a6b9aae67c -- POST / 200 383.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,854 mnist_classifier_MNISTClassifier 88qanr4a a2a4d198-1291-41d7-8737-0830de8d6c08 -- POST / 200 383.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,985 mnist_classifier_MNISTClassifier 88qanr4a 900acdda-56ab-422a-90c4-275f37c6527f -- POST / 200 514.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,986 mnist_classifier_MNISTClassifier 88qanr4a 4ff7f3b7-a878-43d9-b383-5576599121ca -- POST / 200 514.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,986 mnist_classifier_MNISTClassifier 88qanr4a 34286a7c-c807-4fd0-8ff2-9ba02d294aa2 -- POST / 200 512.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,987 mnist_classifier_MNISTClassifier 88qanr4a 7df03992-fc87-48d5-8d5c-295cef2c3e9d -- POST / 200 515.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,988 mnist_classifier_MNISTClassifier 88qanr4a e33e746d-3180-4696-b923-e2921a368eb1 -- POST / 200 514.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,988 mnist_classifier_MNISTClassifier 88qanr4a 8f02ffac-302a-4cac-bc63-60351f0080d1 -- POST / 200 517.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,988 mnist_classifier_MNISTClassifier 88qanr4a d83e4646-b083-4517-a080-74ff3f767e3a -- POST / 200 514.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,989 mnist_classifier_MNISTClassifier 88qanr4a 1e67f13d-2714-42a8-9299-bc252509303b -- POST / 200 514.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,990 mnist_classifier_MNISTClassifier 88qanr4a cd941e95-6027-4036-b870-9edc37a17cc5 -- POST / 200 510.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,990 mnist_classifier_MNISTClassifier 88qanr4a 751b43f7-d4db-479d-882a-957bbe6d1036 -- POST / 200 507.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,991 mnist_classifier_MNISTClassifier 88qanr4a 4c18f977-8fd9-41de-a256-d97b0955b85f -- POST / 200 505.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,991 mnist_classifier_MNISTClassifier 88qanr4a c279ddda-944b-49ab-9998-54d363bf2481 -- POST / 200 505.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,991 mnist_classifier_MNISTClassifier 88qanr4a 696cdf86-0714-4201-8929-513a84e1dedb -- POST / 200 502.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,992 mnist_classifier_MNISTClassifier 88qanr4a b64cf30b-67c1-40e3-9c8d-d931a2e41789 -- POST / 200 498.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,992 mnist_classifier_MNISTClassifier 88qanr4a a7adca75-42fc-4c2c-b42b-cbf626609861 -- POST / 200 497.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,993 mnist_classifier_MNISTClassifier 88qanr4a ec6e3433-73be-430e-913f-87d9d4c72a4f -- POST / 200 457.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,993 mnist_classifier_MNISTClassifier 88qanr4a 276b88fc-1dab-4cb8-9ca3-02cb43b86dcc -- POST / 200 456.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,994 mnist_classifier_MNISTClassifier 88qanr4a fa62f81b-fb1f-47a7-9340-b4114aa9d2c7 -- POST / 200 457.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,994 mnist_classifier_MNISTClassifier 88qanr4a 95454100-65dd-4d13-9165-fb29f2b88815 -- POST / 200 457.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,994 mnist_classifier_MNISTClassifier 88qanr4a 58147398-5ead-4e3e-b0cc-4b0aea1d496b -- POST / 200 451.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,995 mnist_classifier_MNISTClassifier 88qanr4a 0cc36c72-cc32-40d6-99e4-9a9499a8e72b -- POST / 200 457.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,995 mnist_classifier_MNISTClassifier 88qanr4a d76be97b-9a5b-4bf3-ba56-62ac08144401 -- POST / 200 452.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,996 mnist_classifier_MNISTClassifier 88qanr4a c6e0ed2d-1657-44c4-97ba-a65cb1def824 -- POST / 200 457.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,996 mnist_classifier_MNISTClassifier 88qanr4a b87f59bb-0cb8-4b38-ba4f-70d1df8526e3 -- POST / 200 456.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:53,997 mnist_classifier_MNISTClassifier 88qanr4a ff8b1382-e47a-48d0-b7a7-58d3b8eadaba -- POST / 200 453.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,002 mnist_classifier_MNISTClassifier 88qanr4a 8095cb8a-6b32-4f7d-8dff-6e5f816361dd -- POST / 200 457.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,003 mnist_classifier_MNISTClassifier 88qanr4a 454a22b3-00d1-4a1a-9d4b-268071d5e025 -- POST / 200 457.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,005 mnist_classifier_MNISTClassifier 88qanr4a b94960f4-a12b-466e-bee1-b4c4ab61f5ad -- POST / 200 459.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,005 mnist_classifier_MNISTClassifier 88qanr4a 7cbc0b98-cc09-4ee2-926d-e6a6c4f39c38 -- POST / 200 457.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,008 mnist_classifier_MNISTClassifier 88qanr4a ca5d8ddd-3087-4dc7-976b-c3ebe8265ecb -- POST / 200 457.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,008 mnist_classifier_MNISTClassifier 88qanr4a a5939bb7-1262-42f5-b872-1492bf3b09df -- POST / 200 457.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,012 mnist_classifier_MNISTClassifier 88qanr4a 356555f2-f012-4765-a096-6bc48de7c741 -- POST / 200 458.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,012 mnist_classifier_MNISTClassifier 88qanr4a 1394975e-2bdc-417f-8c69-fe5ebf385e03 -- POST / 200 452.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,014 mnist_classifier_MNISTClassifier 88qanr4a e44291a2-afa7-484b-bfef-79428fead0dc -- POST / 200 454.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,014 mnist_classifier_MNISTClassifier 88qanr4a d11efe37-ffd1-4eb2-8f52-94f4d1def8a6 -- POST / 200 454.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,014 mnist_classifier_MNISTClassifier 88qanr4a 73a17fe7-8622-4408-be97-1a08045fc6b7 -- POST / 200 451.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,014 mnist_classifier_MNISTClassifier 88qanr4a d16a98ae-2d28-4a89-baaa-e912aebaf1fc -- POST / 200 449.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,014 mnist_classifier_MNISTClassifier 88qanr4a 0ca34b75-70f1-4cca-b8e5-d1d871486fed -- POST / 200 449.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,015 mnist_classifier_MNISTClassifier 88qanr4a 0d9a6029-fd1f-4ea2-8798-46ab9ef1fb6c -- POST / 200 449.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,015 mnist_classifier_MNISTClassifier 88qanr4a 771a8379-101e-459b-a36e-a737a1650b88 -- POST / 200 446.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,015 mnist_classifier_MNISTClassifier 88qanr4a fabf5941-b18a-43de-b8bd-890a96feedf2 -- POST / 200 446.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,015 mnist_classifier_MNISTClassifier 88qanr4a 159a43b2-1369-4fec-8add-3d4239734441 -- POST / 200 443.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,015 mnist_classifier_MNISTClassifier 88qanr4a 5b6d6ffa-f515-4a14-8d25-93629b7ba426 -- POST / 200 443.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,016 mnist_classifier_MNISTClassifier 88qanr4a 2f38afa4-763e-4f22-b46a-79d28686cf96 -- POST / 200 443.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,016 mnist_classifier_MNISTClassifier 88qanr4a 35350109-f27d-4c7d-87ea-0e860c930b9d -- POST / 200 443.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,016 mnist_classifier_MNISTClassifier 88qanr4a 568f04a5-b81a-4124-a27b-db7c6ce3b34d -- POST / 200 442.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,016 mnist_classifier_MNISTClassifier 88qanr4a bb046747-7c51-431b-a6ec-ddcadad91324 -- POST / 200 441.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,016 mnist_classifier_MNISTClassifier 88qanr4a 7787edbe-ccca-4bb1-8665-2c24e9b7173a -- POST / 200 441.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,016 mnist_classifier_MNISTClassifier 88qanr4a f423d1d4-496d-4f9f-ab34-a184eb74440a -- POST / 200 440.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,016 mnist_classifier_MNISTClassifier 88qanr4a dab98260-c619-49cf-9520-e387ccaf60e6 -- POST / 200 423.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,017 mnist_classifier_MNISTClassifier 88qanr4a 54931593-9058-4d40-ab43-684441a9068f -- POST / 200 421.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,017 mnist_classifier_MNISTClassifier 88qanr4a 2a6f6bdb-8b9c-43ce-ab2f-de8ac1337bb0 -- POST / 200 273.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,017 mnist_classifier_MNISTClassifier 88qanr4a cbe5b394-23a4-49b0-910c-9f4db73b7b9d -- POST / 200 273.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,017 mnist_classifier_MNISTClassifier 88qanr4a 40229bf3-870e-4f9b-8bf1-80ca1fdade63 -- POST / 200 272.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,017 mnist_classifier_MNISTClassifier 88qanr4a 367c5668-e342-45a6-9373-ca967a31b459 -- POST / 200 270.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,018 mnist_classifier_MNISTClassifier 88qanr4a 0a17431f-7d46-4bd0-b90f-2de0fff8a186 -- POST / 200 270.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,018 mnist_classifier_MNISTClassifier 88qanr4a 8cb0861b-7074-4711-9667-c4fc21aaee08 -- POST / 200 270.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,018 mnist_classifier_MNISTClassifier 88qanr4a 6a47b80d-196d-4257-9c9b-992c018d46ae -- POST / 200 269.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,018 mnist_classifier_MNISTClassifier 88qanr4a 6f91cc0b-a843-426f-9742-dac6b2e3455a -- POST / 200 269.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,021 mnist_classifier_MNISTClassifier 88qanr4a 9e542801-b8ed-49ea-9db0-6bb62376c927 -- POST / 200 270.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,021 mnist_classifier_MNISTClassifier 88qanr4a 32ea4ca1-a6e6-48e7-877c-15fbbba33029 -- POST / 200 270.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,024 mnist_classifier_MNISTClassifier 88qanr4a b79c0217-398a-485a-8eaf-bdf030f3693c -- POST / 200 273.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,025 mnist_classifier_MNISTClassifier 88qanr4a 13500e9b-67bd-4be1-b03d-d6081a6060e1 -- POST / 200 273.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,027 mnist_classifier_MNISTClassifier 88qanr4a 3563e03d-e3c9-4e4e-8d91-725959ca716e -- POST / 200 276.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,028 mnist_classifier_MNISTClassifier 88qanr4a 38240019-4081-4f46-a5c5-6696170a4cd4 -- POST / 200 275.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,031 mnist_classifier_MNISTClassifier 88qanr4a 9726967e-cb77-44c5-8a81-0f588a0923ad -- POST / 200 277.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,031 mnist_classifier_MNISTClassifier 88qanr4a b0404002-5465-4ccf-938d-ee59953c3f2f -- POST / 200 277.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,031 mnist_classifier_MNISTClassifier 88qanr4a b1ad5a61-6a66-4495-8ca5-339f793931d5 -- POST / 200 276.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,032 mnist_classifier_MNISTClassifier 88qanr4a 3a6af26b-ca97-4262-823b-d3f941aa63c1 -- POST / 200 276.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,032 mnist_classifier_MNISTClassifier 88qanr4a aef9d04c-625c-473d-9eae-f7384a88038d -- POST / 200 276.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,032 mnist_classifier_MNISTClassifier 88qanr4a ab14c667-27a2-408b-9b8c-def091cdc4be -- POST / 200 276.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,033 mnist_classifier_MNISTClassifier 88qanr4a 6ac4228a-6f30-4e69-88d7-7fbc8bb94ff8 -- POST / 200 275.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,033 mnist_classifier_MNISTClassifier 88qanr4a 6436617e-1701-4293-bdb3-51fb9e2b2338 -- POST / 200 275.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,034 mnist_classifier_MNISTClassifier 88qanr4a 31d9e8e2-ae47-4ada-8c12-36d1f5217974 -- POST / 200 275.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,034 mnist_classifier_MNISTClassifier 88qanr4a 0c5fd89c-9fba-4cb8-8da6-53a3f981089b -- POST / 200 248.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,035 mnist_classifier_MNISTClassifier 88qanr4a 1d2053f6-fe9c-44d9-8183-063a15057990 -- POST / 200 247.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,035 mnist_classifier_MNISTClassifier 88qanr4a 66854feb-2088-4072-af2f-177e8cfb402d -- POST / 200 243.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,036 mnist_classifier_MNISTClassifier 88qanr4a af2faa41-affa-4b68-9433-98ecef3d552f -- POST / 200 238.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,036 mnist_classifier_MNISTClassifier 88qanr4a abc76195-fd34-453c-853c-9f416d3edaf4 -- POST / 200 237.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,037 mnist_classifier_MNISTClassifier 88qanr4a 0d9d1778-4fcb-4925-af43-bb93b96bcdaf -- POST / 200 235.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,037 mnist_classifier_MNISTClassifier 88qanr4a f5db353e-506a-4c53-a43c-5374b1d5a2df -- POST / 200 231.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,037 mnist_classifier_MNISTClassifier 88qanr4a 6745a1fa-089a-4bfe-9d99-c3664e77acc7 -- POST / 200 230.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,038 mnist_classifier_MNISTClassifier 88qanr4a c59d4ce7-68d4-4a2d-8867-c43575636e87 -- POST / 200 225.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,038 mnist_classifier_MNISTClassifier 88qanr4a 7b0704cc-2021-4ea7-af2a-1db7b869904b -- POST / 200 177.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,038 mnist_classifier_MNISTClassifier 88qanr4a 6ea2d169-12b3-4302-924f-80d56eae9656 -- POST / 200 149.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,039 mnist_classifier_MNISTClassifier 88qanr4a 4c38bbf5-8942-4e83-8d06-bccffd5fa0f2 -- POST / 200 149.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,039 mnist_classifier_MNISTClassifier 88qanr4a 6373c0bd-05f8-49c2-ac54-5fbfedaaa449 -- POST / 200 148.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,040 mnist_classifier_MNISTClassifier 88qanr4a 0da1a1dc-6907-4fbb-887a-f6ae687aa87b -- POST / 200 145.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,040 mnist_classifier_MNISTClassifier 88qanr4a 7d8fd68e-2c98-4f24-ac1f-603e1e2d97c5 -- POST / 200 145.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,040 mnist_classifier_MNISTClassifier 88qanr4a 06a7fbd4-7552-4db2-bf07-0e084a2b864c -- POST / 200 145.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,041 mnist_classifier_MNISTClassifier 88qanr4a 5ed94466-8a29-4850-bfa2-039e58898cbe -- POST / 200 140.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,041 mnist_classifier_MNISTClassifier 88qanr4a 9827251f-0cd8-4cc2-9cff-dff57e7f09c6 -- POST / 200 140.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,041 mnist_classifier_MNISTClassifier 88qanr4a d1142d34-40b8-4d91-bdf9-543d521670e5 -- POST / 200 140.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,042 mnist_classifier_MNISTClassifier 88qanr4a 334ed10d-2cdf-407c-892e-809ee8cbead4 -- POST / 200 140.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,042 mnist_classifier_MNISTClassifier 88qanr4a 6a4cdecb-29a1-4555-a9d1-7057e925bb4f -- POST / 200 138.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,043 mnist_classifier_MNISTClassifier 88qanr4a 0f943802-667f-41b7-bb98-c441f5351954 -- POST / 200 137.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,043 mnist_classifier_MNISTClassifier 88qanr4a 6516912c-c84c-4499-b0cb-3842b92e0932 -- POST / 200 137.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,043 mnist_classifier_MNISTClassifier 88qanr4a 2791fb86-cda5-43ac-98a9-4f27cf5b1f13 -- POST / 200 137.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,044 mnist_classifier_MNISTClassifier 88qanr4a 0e28b456-7a60-4f28-9450-9dce9b77cbaa -- POST / 200 135.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,044 mnist_classifier_MNISTClassifier 88qanr4a 8318f63f-a21a-4275-bbd6-6c9085638d18 -- POST / 200 135.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,310 mnist_classifier_MNISTClassifier 88qanr4a 553b7904-a815-48e7-81df-53bdbfc46ccb -- POST / 200 276.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,317 mnist_classifier_MNISTClassifier 88qanr4a 1915df22-c2a6-4e71-a0b7-d0ea1de0e378 -- POST / 200 268.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,318 mnist_classifier_MNISTClassifier 88qanr4a 3f8d849a-ab3b-4061-aea4-94724d3aa0ce -- POST / 200 273.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,319 mnist_classifier_MNISTClassifier 88qanr4a 0b3a80f3-d6de-4fb1-beb4-060710833985 -- POST / 200 270.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,319 mnist_classifier_MNISTClassifier 88qanr4a c050a549-155c-4f47-aec2-7d5790f7c4c7 -- POST / 200 264.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,319 mnist_classifier_MNISTClassifier 88qanr4a 7870aa94-d928-4b3a-8bad-db37a5d8cced -- POST / 200 265.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,320 mnist_classifier_MNISTClassifier 88qanr4a 92dfbf0c-8779-4363-82dd-afe3b08c75f2 -- POST / 200 265.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,320 mnist_classifier_MNISTClassifier 88qanr4a 1c059107-f6cb-4d2c-8058-11d175d532bf -- POST / 200 265.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,322 mnist_classifier_MNISTClassifier 88qanr4a 4c3a6ded-32fd-4c2a-a290-67ff65f1ad04 -- POST / 200 258.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,322 mnist_classifier_MNISTClassifier 88qanr4a b1113cfe-22ea-4572-9073-73342ca66201 -- POST / 200 266.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,323 mnist_classifier_MNISTClassifier 88qanr4a b53901de-edbd-4199-bc5b-63b9152a11db -- POST / 200 266.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,323 mnist_classifier_MNISTClassifier 88qanr4a b6c431c8-e076-4787-91eb-244a5f5432ac -- POST / 200 265.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,324 mnist_classifier_MNISTClassifier 88qanr4a f5c65bb1-e56f-4ec5-a629-751f259227de -- POST / 200 265.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,326 mnist_classifier_MNISTClassifier 88qanr4a 75a3bbbf-20c4-426c-a112-09ee4d90b35c -- POST / 200 265.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,326 mnist_classifier_MNISTClassifier 88qanr4a 85c1cea4-4dba-408f-ac91-e054d5adfd2e -- POST / 200 174.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,326 mnist_classifier_MNISTClassifier 88qanr4a 88d4b8fe-8473-48ab-aa6b-6ed7b9ddb335 -- POST / 200 194.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,327 mnist_classifier_MNISTClassifier 88qanr4a 3ae226d9-8e72-4a5b-b5f3-9b71b8b6d69e -- POST / 200 261.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,328 mnist_classifier_MNISTClassifier 88qanr4a a0773ab1-0fbb-472f-9290-1ff430b12f7b -- POST / 200 260.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,329 mnist_classifier_MNISTClassifier 88qanr4a bff31325-0712-45e7-b819-e5b97838a930 -- POST / 200 260.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,330 mnist_classifier_MNISTClassifier 88qanr4a 4a0c9815-ae3a-41b2-bb1e-2d39ce9a38ec -- POST / 200 259.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,330 mnist_classifier_MNISTClassifier 88qanr4a 29aef51f-ce28-4b3e-8e91-de712c818845 -- POST / 200 259.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,331 mnist_classifier_MNISTClassifier 88qanr4a b6df0006-78f1-4838-a0b0-42cd1578f4f3 -- POST / 200 258.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,336 mnist_classifier_MNISTClassifier 88qanr4a 8f520ed2-0a57-405a-a6fc-92f45f669c0f -- POST / 200 263.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,337 mnist_classifier_MNISTClassifier 88qanr4a 511f920a-2fb9-4944-9325-0cee3618619f -- POST / 200 262.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,338 mnist_classifier_MNISTClassifier 88qanr4a f185c651-e12d-4026-85ae-31f300099242 -- POST / 200 262.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,340 mnist_classifier_MNISTClassifier 88qanr4a 775c0c71-4b6c-4cc7-bcd1-52ca039bea41 -- POST / 200 262.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,340 mnist_classifier_MNISTClassifier 88qanr4a 88a43de1-df8c-4980-845c-04e6e7a64cd3 -- POST / 200 261.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,341 mnist_classifier_MNISTClassifier 88qanr4a c16e2f62-bd72-407a-a900-eadc6a9a6e76 -- POST / 200 261.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,342 mnist_classifier_MNISTClassifier 88qanr4a f759f6db-ac13-4338-9a71-536e829249c3 -- POST / 200 262.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,344 mnist_classifier_MNISTClassifier 88qanr4a a1d3707c-b5a1-4d4c-ac06-5ebd2aea2b94 -- POST / 200 263.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,346 mnist_classifier_MNISTClassifier 88qanr4a 4b7d0ee1-fea4-4f64-b32b-4ee3d1e49b9a -- POST / 200 264.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,348 mnist_classifier_MNISTClassifier 88qanr4a 5626b443-93b1-4665-9071-884540f008ca -- POST / 200 264.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,349 mnist_classifier_MNISTClassifier 88qanr4a 9242f5ef-733d-47e9-a723-8447e6cc220c -- POST / 200 253.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,349 mnist_classifier_MNISTClassifier 88qanr4a 6e6f4064-9466-47fc-9c0f-688ef4cdd69e -- POST / 200 230.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,350 mnist_classifier_MNISTClassifier 88qanr4a 5fd30181-6ded-433e-9b2b-a6b9d6a29d08 -- POST / 200 230.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,350 mnist_classifier_MNISTClassifier 88qanr4a 17e3ad14-3d92-4304-8f75-f43c18948b53 -- POST / 200 230.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,422 mnist_classifier_MNISTClassifier 88qanr4a 76b9af68-ebb4-47a8-aff1-5f33e0ed2184 -- POST / 200 300.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,425 mnist_classifier_MNISTClassifier 88qanr4a fce2014a-09fc-4d05-95c6-2e6f4b13fd8e -- POST / 200 302.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,427 mnist_classifier_MNISTClassifier 88qanr4a 542ec7eb-3391-4b5e-acbf-5d73bfd49192 -- POST / 200 303.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,428 mnist_classifier_MNISTClassifier 88qanr4a 6755cb9b-b029-428e-86d5-65cb052de7f7 -- POST / 200 302.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,428 mnist_classifier_MNISTClassifier 88qanr4a 67e41b22-7a9e-48b5-9d97-33d57c7fc2c0 -- POST / 200 301.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,429 mnist_classifier_MNISTClassifier 88qanr4a 1338e9ce-9bb2-4e6d-8b37-7fad0b3e50c5 -- POST / 200 300.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,429 mnist_classifier_MNISTClassifier 88qanr4a 6c0f5bac-c0c1-4752-a775-194806463c28 -- POST / 200 300.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,434 mnist_classifier_MNISTClassifier 88qanr4a 650a807c-9719-487e-8fa8-da30fc75a28c -- POST / 200 281.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,435 mnist_classifier_MNISTClassifier 88qanr4a b936032d-311e-467b-95da-beb62b1abf80 -- POST / 200 302.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,435 mnist_classifier_MNISTClassifier 88qanr4a de7240a7-ef00-4fd5-a6af-38509c4dd200 -- POST / 200 302.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,436 mnist_classifier_MNISTClassifier 88qanr4a 99f89ccb-c686-425d-91e5-6189520e9f2a -- POST / 200 301.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,439 mnist_classifier_MNISTClassifier 88qanr4a 94c7b37e-434e-4365-a828-37149e42a3a8 -- POST / 200 304.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,440 mnist_classifier_MNISTClassifier 88qanr4a 97b02509-057d-403f-8b96-4301ff3da4d0 -- POST / 200 303.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,444 mnist_classifier_MNISTClassifier 88qanr4a 2a4511a6-88c5-4fbe-8b7f-6b30ab74a532 -- POST / 200 305.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,444 mnist_classifier_MNISTClassifier 88qanr4a 27c5b8b9-9f18-4776-b90c-e0ded479189d -- POST / 200 305.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,446 mnist_classifier_MNISTClassifier 88qanr4a c1b63f7f-d23d-4bb1-808b-24ca8d5f6800 -- POST / 200 306.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,447 mnist_classifier_MNISTClassifier 88qanr4a 5cdba59c-deda-41f5-9579-ca885f41aa2d -- POST / 200 306.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,447 mnist_classifier_MNISTClassifier 88qanr4a 5f38f411-02a7-4ebc-b565-d724ef1fdb67 -- POST / 200 305.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,448 mnist_classifier_MNISTClassifier 88qanr4a 4d98d299-e53e-4c69-a35e-f5ce1b229f3d -- POST / 200 304.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,448 mnist_classifier_MNISTClassifier 88qanr4a a1c4899a-033b-4687-bae4-3560950f9c6a -- POST / 200 302.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,449 mnist_classifier_MNISTClassifier 88qanr4a 7c48314f-0608-49c6-a4bd-c6d5de63bd3e -- POST / 200 303.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,454 mnist_classifier_MNISTClassifier 88qanr4a 2f890821-72b7-40ea-a142-263501483c9f -- POST / 200 307.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,454 mnist_classifier_MNISTClassifier 88qanr4a 358cee72-2ead-43f7-8ca1-35e160fec66b -- POST / 200 306.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,455 mnist_classifier_MNISTClassifier 88qanr4a 86a7df80-7f97-4f9f-a101-375d1858c174 -- POST / 200 304.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,456 mnist_classifier_MNISTClassifier 88qanr4a 4957e16e-f39d-46c0-89f4-8dca6d4977e5 -- POST / 200 284.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,460 mnist_classifier_MNISTClassifier 88qanr4a 5969b4e3-8e3c-434a-b91b-c089bfe62bb0 -- POST / 200 287.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,461 mnist_classifier_MNISTClassifier 88qanr4a 4be3645a-6050-4c62-9b23-0de9db8a5263 -- POST / 200 286.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,463 mnist_classifier_MNISTClassifier 88qanr4a 888a065a-9cee-43f9-bc73-8fb60dd53ce7 -- POST / 200 288.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,464 mnist_classifier_MNISTClassifier 88qanr4a 9035c432-59e8-45dd-b9a9-1aa39140a703 -- POST / 200 285.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,464 mnist_classifier_MNISTClassifier 88qanr4a 8a90310d-1110-46b4-bac4-43edc1499826 -- POST / 200 285.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,468 mnist_classifier_MNISTClassifier 88qanr4a bec4b70f-902c-4b6e-ad4a-ab546c0b2659 -- POST / 200 287.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,468 mnist_classifier_MNISTClassifier 88qanr4a af17eba6-f512-4c5f-bf0b-3dd521b304d5 -- POST / 200 287.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,475 mnist_classifier_MNISTClassifier 88qanr4a f773a2a8-78c9-4f06-8633-99fdbeb35b83 -- POST / 200 284.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,479 mnist_classifier_MNISTClassifier 88qanr4a 8524583a-4851-40e8-898f-7e008ba041df -- POST / 200 295.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,484 mnist_classifier_MNISTClassifier 88qanr4a 486b9fc3-91cb-400e-bad5-81b2f1fbbbdc -- POST / 200 301.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,487 mnist_classifier_MNISTClassifier 88qanr4a b8be16e3-cd8b-4e39-a32f-f01f60a1a7c0 -- POST / 200 303.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,488 mnist_classifier_MNISTClassifier 88qanr4a c5bafc9a-01c7-445d-ac94-346a2da5bff7 -- POST / 200 304.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,494 mnist_classifier_MNISTClassifier 88qanr4a 5448ecb0-0f46-4cde-872d-5f907b803548 -- POST / 200 305.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,496 mnist_classifier_MNISTClassifier 88qanr4a ce56f03e-c7c7-46f0-9c18-342349ac3707 -- POST / 200 304.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,502 mnist_classifier_MNISTClassifier 88qanr4a a62265d8-b1b4-474d-95dd-efd90259eb63 -- POST / 200 309.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,502 mnist_classifier_MNISTClassifier 88qanr4a c3c8662a-f92c-4ccc-804a-fe743633f088 -- POST / 200 309.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,503 mnist_classifier_MNISTClassifier 88qanr4a 3ecc4ec6-802c-4144-ae34-6eeb06ab25bc -- POST / 200 310.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,504 mnist_classifier_MNISTClassifier 88qanr4a 643fae99-2f62-4991-a370-0db7cab88f09 -- POST / 200 262.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,505 mnist_classifier_MNISTClassifier 88qanr4a abe28c9a-8000-47e2-ab52-9eb4ba62bff9 -- POST / 200 262.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,506 mnist_classifier_MNISTClassifier 88qanr4a 8ed4ad45-42ab-47d5-a98e-cec0a235b73d -- POST / 200 263.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,506 mnist_classifier_MNISTClassifier 88qanr4a e9dcce70-426d-4ec6-a8c0-f0a0ee77b1c5 -- POST / 200 262.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,508 mnist_classifier_MNISTClassifier 88qanr4a 7aaf754b-1593-4095-8e7f-d62609ea9e30 -- POST / 200 263.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,510 mnist_classifier_MNISTClassifier 88qanr4a 99020a07-d152-4835-abd8-c423dd2306ec -- POST / 200 264.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,510 mnist_classifier_MNISTClassifier 88qanr4a 22513ba0-a4fe-489c-9bcc-c608c7d975f0 -- POST / 200 264.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,510 mnist_classifier_MNISTClassifier 88qanr4a e183c763-574e-4256-b86f-8611038c977b -- POST / 200 262.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,511 mnist_classifier_MNISTClassifier 88qanr4a 0634156f-b6c6-4f95-ae52-7a96addf59ef -- POST / 200 261.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,511 mnist_classifier_MNISTClassifier 88qanr4a f0aaf18c-09be-441f-8bb8-270211c6d613 -- POST / 200 260.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,511 mnist_classifier_MNISTClassifier 88qanr4a f2b1cf85-1cfa-4a8c-8e5d-8c3e942e8267 -- POST / 200 260.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,512 mnist_classifier_MNISTClassifier 88qanr4a 15a7093b-ce1a-423a-864e-d9990c2fc2fe -- POST / 200 259.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,512 mnist_classifier_MNISTClassifier 88qanr4a 7da47749-97dc-4b1f-912b-6b3fe8a5c6e5 -- POST / 200 258.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,566 mnist_classifier_MNISTClassifier 88qanr4a 9e17d24b-ea1c-42ba-b60f-3405508e5c61 -- POST / 200 311.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,566 mnist_classifier_MNISTClassifier 88qanr4a 2ecf099e-e1de-49ec-84e4-1b48afe33e13 -- POST / 200 304.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,567 mnist_classifier_MNISTClassifier 88qanr4a a84d25a2-acf8-4906-9817-4b82fd315d2e -- POST / 200 302.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,567 mnist_classifier_MNISTClassifier 88qanr4a 61538c3b-423b-464c-8e75-30ad53941c7b -- POST / 200 301.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,568 mnist_classifier_MNISTClassifier 88qanr4a 7840b450-2830-49fd-8db4-1de1ed8c057a -- POST / 200 301.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,568 mnist_classifier_MNISTClassifier 88qanr4a c55f7413-1601-4208-be40-f44fcba06bf7 -- POST / 200 301.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,569 mnist_classifier_MNISTClassifier 88qanr4a 432d467c-f574-4d00-a71a-58a80ee38350 -- POST / 200 302.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,570 mnist_classifier_MNISTClassifier 88qanr4a 5e7705b2-aa9c-485c-a51c-632695ebaa46 -- POST / 200 303.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,570 mnist_classifier_MNISTClassifier 88qanr4a f55583ac-6f62-4282-baa8-5dc80784ad35 -- POST / 200 303.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,571 mnist_classifier_MNISTClassifier 88qanr4a 9d34134a-b8ff-4951-ac97-624b145edc04 -- POST / 200 215.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,571 mnist_classifier_MNISTClassifier 88qanr4a 09d436f3-a85a-4a40-b816-a46285fd7b9a -- POST / 200 225.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,571 mnist_classifier_MNISTClassifier 88qanr4a 9ee35a8a-83e4-4218-996b-e4189ea8a073 -- POST / 200 226.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,572 mnist_classifier_MNISTClassifier 88qanr4a bfa264ea-d0bb-46e4-9645-70458f5752cb -- POST / 200 226.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,573 mnist_classifier_MNISTClassifier 88qanr4a 0366728f-7b28-40dc-97b4-f34cc2c3509c -- POST / 200 227.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,573 mnist_classifier_MNISTClassifier 88qanr4a 14094266-2c2a-4fd1-b956-bec0a4c40676 -- POST / 200 217.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,574 mnist_classifier_MNISTClassifier 88qanr4a c685de64-8226-41b1-bed3-f628e101d1d0 -- POST / 200 216.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,575 mnist_classifier_MNISTClassifier 88qanr4a 31c9543a-c124-474e-a124-d743d124da03 -- POST / 200 213.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,578 mnist_classifier_MNISTClassifier 88qanr4a f10522af-b4cb-46d2-b36f-12868454ab4a -- POST / 200 215.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,579 mnist_classifier_MNISTClassifier 88qanr4a 61a4bd72-779e-4086-aa4f-c9d2dd2f5087 -- POST / 200 215.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,579 mnist_classifier_MNISTClassifier 88qanr4a 06528d8f-1c57-4cf6-be9e-122740b5c6cb -- POST / 200 211.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,580 mnist_classifier_MNISTClassifier 88qanr4a 95e9247b-981b-4aac-84da-3f7e0a141bf6 -- POST / 200 212.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,580 mnist_classifier_MNISTClassifier 88qanr4a 805fa595-b527-41df-a31e-75858198b3ff -- POST / 200 210.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,580 mnist_classifier_MNISTClassifier 88qanr4a d2406f8e-0ac0-47f5-8576-f554236d41e7 -- POST / 200 211.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,581 mnist_classifier_MNISTClassifier 88qanr4a 30ce5240-f69c-4d62-befd-84046b498165 -- POST / 200 211.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,581 mnist_classifier_MNISTClassifier 88qanr4a c58e2111-fea1-428a-8c4d-fdbab3e60eb0 -- POST / 200 211.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,582 mnist_classifier_MNISTClassifier 88qanr4a b3e8a26f-7899-468e-95a1-e33256174027 -- POST / 200 211.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,582 mnist_classifier_MNISTClassifier 88qanr4a 20c8517b-5c3f-4b1e-b64b-c63e60c653d7 -- POST / 200 212.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,583 mnist_classifier_MNISTClassifier 88qanr4a 6664516b-f392-4873-a858-1f8408bfc35d -- POST / 200 212.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,583 mnist_classifier_MNISTClassifier 88qanr4a f55ce4f8-7d0f-4976-a289-2bcd9be5844a -- POST / 200 212.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,584 mnist_classifier_MNISTClassifier 88qanr4a c4f4e734-ee37-46c6-a8f9-7ca12d6e77e8 -- POST / 200 213.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,585 mnist_classifier_MNISTClassifier 88qanr4a 538b9a7e-d17d-42bc-81bf-bd1c4d9b18ce -- POST / 200 213.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,585 mnist_classifier_MNISTClassifier 88qanr4a 389522f7-4778-4132-83fe-863ab51b039f -- POST / 200 213.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,586 mnist_classifier_MNISTClassifier 88qanr4a cd0519c4-c35d-4b81-a86f-feefbb6fddb5 -- POST / 200 213.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,587 mnist_classifier_MNISTClassifier 88qanr4a 24be0033-41bd-4ec2-b7fc-e2200bb9b8fb -- POST / 200 213.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,588 mnist_classifier_MNISTClassifier 88qanr4a e5186885-79be-4d86-a485-72cc70282d95 -- POST / 200 204.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,589 mnist_classifier_MNISTClassifier 88qanr4a 2969ad84-be27-413a-9af0-a6ec227d48c7 -- POST / 200 214.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,590 mnist_classifier_MNISTClassifier 88qanr4a 73e05d9b-8ca2-4c84-b66e-b9de33e8fb13 -- POST / 200 214.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,590 mnist_classifier_MNISTClassifier 88qanr4a ecc7bc20-cb38-4394-9a55-84144a9094c0 -- POST / 200 213.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,591 mnist_classifier_MNISTClassifier 88qanr4a 035f8c80-7c86-4919-adb7-bc4d3fe5e466 -- POST / 200 214.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,592 mnist_classifier_MNISTClassifier 88qanr4a f27c73de-7542-43c0-a7dc-070f0540431d -- POST / 200 211.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,592 mnist_classifier_MNISTClassifier 88qanr4a 46e46875-54fb-4f62-a549-9d58a13274ec -- POST / 200 210.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,592 mnist_classifier_MNISTClassifier 88qanr4a bed37d2d-8a71-46f4-b01a-e84cb7d40884 -- POST / 200 207.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,593 mnist_classifier_MNISTClassifier 88qanr4a 443a8ee5-1b1c-4353-b2e1-67e2152cd64f -- POST / 200 206.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,595 mnist_classifier_MNISTClassifier 88qanr4a d07ea2c9-d6be-4ee6-a048-62a1d626fa24 -- POST / 200 207.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,595 mnist_classifier_MNISTClassifier 88qanr4a a58d0ac6-9baf-469d-883a-40de71477c29 -- POST / 200 206.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,597 mnist_classifier_MNISTClassifier 88qanr4a cf667c48-5a2f-4b5f-810b-bb43ba6742a1 -- POST / 200 180.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,598 mnist_classifier_MNISTClassifier 88qanr4a 97e766a2-b44e-4376-a92a-102ff62beea7 -- POST / 200 164.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,598 mnist_classifier_MNISTClassifier 88qanr4a 27b7fd04-7272-4d60-8998-9bd02733abc4 -- POST / 200 150.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,598 mnist_classifier_MNISTClassifier 88qanr4a e840dc63-0cc5-4fac-82a1-f7a433972da5 -- POST / 200 135.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,599 mnist_classifier_MNISTClassifier 88qanr4a 0d2144bb-1b4e-492e-b7d0-302f794000f5 -- POST / 200 93.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,599 mnist_classifier_MNISTClassifier 88qanr4a cfbe3c3d-0dcc-44d5-b4da-5e6be6f36896 -- POST / 200 86.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,599 mnist_classifier_MNISTClassifier 88qanr4a 895e719d-7fd1-4d51-934c-f45d2c728b3f -- POST / 200 83.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,600 mnist_classifier_MNISTClassifier 88qanr4a 134c260b-3573-4d52-92db-994391df0735 -- POST / 200 82.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,600 mnist_classifier_MNISTClassifier 88qanr4a 948627d6-8039-4427-bb5d-56cc3251b415 -- POST / 200 79.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5044) INFO 2026-07-08 22:20:54,600 mnist_classifier_MNISTClassifier 88qanr4a 5d71290d-84da-4e0a-9f9e-49352ffea02f -- POST / 200 77.2ms
Processed 1000 requests in 5.06 seconds
Throughput: 197.54 requests/second

Ray Serve automatically buffers and load balances requests across the replicas.

Fault tolerance

In production, process and machine failures are inevitable. Ray Serve is designed so that each major component in the Serve stack (the controller, replicas, and proxies) can fail and recover while your application continues to handle traffic.

Serve can also recover from larger infrastructure failures, such as entire nodes or pods failing. Serve can even recover from head node failures, or the entire head pod if deploying on KubeRay.

For more information about Ray Serve’s fault tolerance, see the Ray Serve fault-tolerance guide.

Monitor the deployment

Monitoring is critical when running large-scale deployments. The Ray dashboard displays Serve metrics like request throughput, latency, and error rates. It also shows cluster resource usage, replica status, and overall deployment health in real time. The dashboard also lets you inspect logs from individual replicas across the cluster.

For debugging, Ray offers distributed debugging tools that let you attach a debugger to running replicas across the cluster. For more information, see the Ray Serve monitoring documentation.

Conclusion

In this tutorial, you:

• Deployed a PyTorch model using Ray Serve with production best practices.

• Enabled dynamic request batching to optimize performance.

• Configured autoscaling and fractional GPU allocation to efficiently scale across a cluster.

• Tested the service with concurrent asynchronous requests.

Further reading

Ray Serve has more production features that are out of scope for this tutorial but are worth checking out:

• Specialized large language model (LLM) serving APIs that handle complexities like managing key-value (KV) caches and continuous batching.

• Model multiplexing to dynamically load and serve many different models on the same deployment. This is useful for serving per-user fine-tuned models, for example.

• Composed deployments to orchestrate multiple deployments into a single app.

For more information, see the Ray Serve documentation and Ray Serve examples.