Rate this Page

★ ★ ★ ★ ★

beginner/serving_tutorial

Run in Google Colab

Note

Go to the end to download the full example code.

Serve PyTorch models at scale with Ray Serve#

Author: Ricardo Decal

This tutorial shows how to deploy a PyTorch model using Ray Serve with production-ready features.

What you will learn

How to create a production-ready PyTorch model deployment that can scale to thousands of nodes and GPUs
How to configure an HTTP endpoint for the deployment using FastAPI
Enable dynamic request batching for higher throughput
Configure autoscaling and per-replica CPU/GPU resource allocation
Load test the service with concurrent requests and monitor it with the Ray dashboard
How Ray Serve deployments can self-heal from failures
Ray Serve’s advanced features like model multiplexing and model composition.

Prerequisites

PyTorch v2.9+ and torchvision
Ray Serve (ray[serve]) v2.52.1+
A GPU is recommended for higher throughput but is not required

Ray Serve is a scalable framework for serving machine learning models in production. It’s built on top of Ray, which is a unified framework for scaling AI and Python applications that simplifies the complexities of distributed computing. Ray is also open source and part of the PyTorch Foundation.

Setup#

To install the dependencies, run:

pip install "ray[serve]" torch torchvision

Start by importing the required libraries:

import asyncio
import time
from typing import Any

from fastapi import FastAPI
from pydantic import BaseModel
import aiohttp
import numpy as np
import torch
import torch.nn as nn
from ray import serve
from torchvision.transforms import v2

Define a PyTorch model#

Define a simple convolutional neural network for the MNIST digit classification dataset:

class MNISTNet(nn.Module):
    def __init__(self):
        super().__init__()
        self.conv1 = nn.Conv2d(1, 32, 3, 1)
        self.dropout1 = nn.Dropout(0.25)
        self.conv2 = nn.Conv2d(32, 64, 3, 1)
        self.fc1 = nn.Linear(9216, 128)
        self.dropout2 = nn.Dropout(0.5)
        self.fc2 = nn.Linear(128, 10)

    def forward(self, x):
        x = self.conv1(x)
        x = nn.functional.relu(x)
        x = self.conv2(x)
        x = nn.functional.relu(x)
        x = nn.functional.max_pool2d(x, 2)
        x = self.dropout1(x)
        x = torch.flatten(x, 1)
        x = self.fc1(x)
        x = nn.functional.relu(x)
        x = self.dropout2(x)
        x = self.fc2(x)
        return nn.functional.log_softmax(x, dim=1)

Define the Ray Serve deployment#

To deploy this model with Ray Serve, wrap the model in a Python class and decorate it with @serve.deployment.

Processing requests in batches is more efficient than processing requests one by one, especially when using GPUs. Ray Serve provides built-in support for dynamic request batching, where individual incoming requests are opportunistically batched. Enable dynamic batching using the @serve.batch decorator as shown in the following code:

app = FastAPI()

class ImageRequest(BaseModel):  # Used for request validation and generating API documentation
    image: list[list[float]] | list[list[list[float]]]  # 2D or 3D array

@serve.deployment
@serve.ingress(app)
class MNISTClassifier:
    def __init__(self):
        self.device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
        self.model = MNISTNet().to(self.device)
        # Define the transformation pipeline for the input images.
        self.transform = v2.Compose([
            v2.ToImage(),
            v2.ToDtype(torch.float32, scale=True),
            # Mean and standard deviation of the MNIST training subset.
            v2.Normalize(mean=[0.1307], std=[0.3013]),
        ])

        self.model.eval()

    # batch_wait_timeout_s is the maximum time to wait for a full batch,
    # trading off latency for throughput.
    @serve.batch(max_batch_size=128, batch_wait_timeout_s=0.1)
    async def predict_batch(self, images: list[np.ndarray]) -> list[dict[str, Any]]:
        # Stack all images into a single tensor.
        batch_tensor = torch.cat([
            self.transform(img).unsqueeze(0)
            for img in images
        ]).to(self.device).float()

        # Single forward pass on the entire batch at once.
        with torch.no_grad():
            logits = self.model(batch_tensor)
            predictions = torch.argmax(logits, dim=1).cpu().numpy()

        # Unbatch the results and preserve their original order.
        return [
            {
                "predicted_label": int(pred),
                "logits": logit.cpu().numpy().tolist()
            }
            for pred, logit in zip(predictions, logits)
        ]

    @app.post("/")
    async def handle_request(self, request: ImageRequest):
        """Handle an incoming HTTP request using FastAPI.

        Inputs are automatically validated using the Pydantic model.
        """
        # Process the single request.
        image_array = np.array(request.image)

        # Ray Serve's @serve.batch automatically batches requests.
        result = await self.predict_batch(image_array)

        return result

This is a FastAPI app, which extends Ray Serve with features like automatic request validation with Pydantic, auto-generated OpenAPI-style API documentation, and more.

Configure autoscaling and resource allocation#

In production, traffic can vary significantly. Ray Serve’s autoscaling feature automatically adjusts the number of replicas based on traffic load, ensuring you have enough capacity during peaks while saving resources during quiet periods. Ray Serve scales to very large deployments with thousands of nodes and replicas.

You can also specify resource allocation per replica, such as the number of CPUs or GPUs. Ray Serve handles the orchestration of these resources across your cluster. Ray also supports fractional GPUs, allowing multiple replicas to share a single GPU when models are small enough to fit in memory together.

The following is a sample configuration with autoscaling and resource allocation:

num_cpus_per_replica = 1
num_gpus_per_replica = 1  # Set to 0 to run the model on CPUs instead of GPUs.
mnist_app = MNISTClassifier.options(
    autoscaling_config={
        "target_ongoing_requests": 50,  # Target 50 ongoing requests per replica.
        "min_replicas": 1,              # Keep at least 1 replica alive.
        "max_replicas": 80,             # Scale up to 80 replicas to maintain target_ongoing_requests.
        "upscale_delay_s": 5,           # Wait 5s before scaling up.
        "downscale_delay_s": 30,        # Wait 30s before scaling down.
    },
    # Max invocations to handle_request per replica to process simultaneously.
    # Requests exceeding this limit are queued by the router until capacity is available.
    max_ongoing_requests=200,
    # Max queue size for requests that exceed max_ongoing_requests.
    # If the queue is full, future requests are backpressured with errors until space is available.
    # -1 means the queue can grow until cluster memory is exhausted.
    max_queued_requests=-1,
    # Set the resources per replica.
    ray_actor_options={"num_cpus": num_cpus_per_replica, "num_gpus": num_gpus_per_replica}
).bind()

The app is ready to deploy. Suppose you ran this on a cluster of 10 machines, each with 4 GPUs. With num_gpus=0.5, Ray schedules 2 replicas per GPU, giving you 80 replicas across the cluster. This configuration permits the deployment to elastically scale up to 80 replicas as needed to handle traffic spikes and scale back down to 1 replica when traffic subsides.

Test the endpoint with concurrent requests#

To deploy the app, use the serve.run function:

# Start the Ray Serve application.
handle = serve.run(mnist_app, name="mnist_classifier")

2026-04-10 16:16:37,876 WARNING services.py:2137 -- WARNING: The object store is using /tmp instead of /dev/shm because /dev/shm has only 2147471360 bytes available. This will harm performance! You may be able to free up space by deleting files in /dev/shm. If you are inside a Docker container, you can increase /dev/shm size by passing '--shm-size=10.24gb' to 'docker run' (or add it to the run_options list in a Ray cluster config). Make sure to set this to more than 30% of available RAM.
2026-04-10 16:16:38,135 INFO worker.py:2014 -- Started a local Ray instance. View the dashboard at 127.0.0.1:8265
/usr/local/lib/python3.10/dist-packages/ray/_private/worker.py:2062: FutureWarning: Tip: In future versions of Ray, Ray will no longer override accelerator visible devices env var if num_gpus=0 or num_gpus=None (default). To enable this behavior and turn off this error message, set RAY_ACCEL_ENV_VAR_OVERRIDE_ON_ZERO=0
  warnings.warn(
(ProxyActor pid=4527) INFO 2026-04-10 16:16:40,599 proxy 172.17.0.2 -- Proxy starting on node d3af5ad8369221e913a76cc42cc2f55e8d5e0a957461fc6af9467dca (HTTP port: 8000).
INFO 2026-04-10 16:16:40,668 serve 3836 -- Started Serve in namespace "serve".
(ProxyActor pid=4527) INFO 2026-04-10 16:16:40,665 proxy 172.17.0.2 -- Got updated endpoints: {}.
(ServeController pid=4523) INFO 2026-04-10 16:16:40,773 controller 4523 -- Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
(ServeController pid=4523) INFO 2026-04-10 16:16:40,774 controller 4523 -- Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
(ProxyActor pid=4527) INFO 2026-04-10 16:16:40,778 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
(ProxyActor pid=4527) INFO 2026-04-10 16:16:40,784 proxy 172.17.0.2 -- Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x7fa22ba18d00>.
(ServeController pid=4523) INFO 2026-04-10 16:16:40,878 controller 4523 -- Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
(ProxyActor pid=4527) INFO 2026-04-10 16:16:44,613 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=['/', '/docs', '/docs/oauth2-redirect', '/openapi.json', '/redoc'])}.
INFO 2026-04-10 16:16:44,791 serve 3836 -- Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

You will see output similar to:

Started Serve in namespace "serve".
Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
Proxy starting on node ... (HTTP port: 8000).
Got updated endpoints: {}.
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x73a53c52c250>.
Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=['/', '/docs', '/docs/oauth2-redirect', '/openapi.json', '/redoc'])}.
Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

The app is now listening for requests on port 8000.

To test the deployment, you can send many requests concurrently using aiohttp. The following code demonstrates how to send 1000 concurrent requests to the app:

async def send_single_request(session, url, data):
    async with session.post(url, json=data) as response:
        return await response.json()

async def send_concurrent_requests(num_requests):
    image = np.random.rand(28, 28).tolist()

    print(f"Sending {num_requests} concurrent requests...")
    async with aiohttp.ClientSession() as session:
        tasks = [
            send_single_request(session, url="http://localhost:8000/", data={"image": image})
            for _ in range(num_requests)
        ]
        responses = await asyncio.gather(*tasks)

    return responses

# Run the concurrent requests.
start_time = time.time()
responses = asyncio.run(send_concurrent_requests(1000))
elapsed = time.time() - start_time

print(f"Processed {len(responses)} requests in {elapsed:.2f} seconds")
print(f"Throughput: {len(responses)/elapsed:.2f} requests/second")

Sending 1000 concurrent requests...
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,049 mnist_classifier_MNISTClassifier ktse0hpy 478ef767-1dab-48cd-9c10-157fd32eaa4c -- POST / 200 561.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,052 mnist_classifier_MNISTClassifier ktse0hpy 78cbd72b-3e98-440c-b010-dcf4e59010ba -- POST / 200 548.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,055 mnist_classifier_MNISTClassifier ktse0hpy 041ad484-2e0e-4740-b86f-b768da1e61e1 -- POST / 200 550.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,058 mnist_classifier_MNISTClassifier ktse0hpy 3bb2f52b-8b63-4687-957a-bceefb510555 -- POST / 200 551.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,058 mnist_classifier_MNISTClassifier ktse0hpy d69c4f26-fb99-485e-85c8-0d8fb323101e -- POST / 200 551.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,059 mnist_classifier_MNISTClassifier ktse0hpy a07a6cb0-ce8e-44b0-ade0-03c86e84110e -- POST / 200 544.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,059 mnist_classifier_MNISTClassifier ktse0hpy c9b5ba6d-e9a3-4d64-bca8-6fac91726cf9 -- POST / 200 543.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,060 mnist_classifier_MNISTClassifier ktse0hpy a45caf2d-23e1-43a4-807f-7620e1ff263c -- POST / 200 542.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,060 mnist_classifier_MNISTClassifier ktse0hpy bc9244d6-1aef-4f45-a5b9-c479d91e7b38 -- POST / 200 542.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,061 mnist_classifier_MNISTClassifier ktse0hpy 9b9b6b77-7901-4720-a368-0db593458466 -- POST / 200 537.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,062 mnist_classifier_MNISTClassifier ktse0hpy b783842f-be32-4208-946b-f998197c0984 -- POST / 200 538.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,062 mnist_classifier_MNISTClassifier ktse0hpy 368a4053-6da7-430c-999d-0fe999916a32 -- POST / 200 538.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,065 mnist_classifier_MNISTClassifier ktse0hpy 998978c1-a370-4e1c-9e32-b58ecb78f8d3 -- POST / 200 540.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,066 mnist_classifier_MNISTClassifier ktse0hpy 5cc255b8-c839-4f26-bd4d-efff7a75dba8 -- POST / 200 537.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,066 mnist_classifier_MNISTClassifier ktse0hpy 822d9013-7442-4fbe-b459-0496325f9a29 -- POST / 200 537.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,068 mnist_classifier_MNISTClassifier ktse0hpy 2c406433-e814-4ddc-9c7b-27670295cb53 -- POST / 200 536.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,068 mnist_classifier_MNISTClassifier ktse0hpy a3ece45f-bcd6-4aa1-ad3e-97de89e66eca -- POST / 200 536.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,069 mnist_classifier_MNISTClassifier ktse0hpy fc051500-d95a-4aa2-9f8a-ffbba98b2e80 -- POST / 200 536.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,072 mnist_classifier_MNISTClassifier ktse0hpy a7cc6650-0cb0-4a38-82ba-5aab0d34c125 -- POST / 200 538.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,072 mnist_classifier_MNISTClassifier ktse0hpy 983467e5-fbc9-4544-b621-b6ffd81d848f -- POST / 200 535.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,073 mnist_classifier_MNISTClassifier ktse0hpy 6b42857c-f436-4d9d-a6fc-702297d9cac3 -- POST / 200 535.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,074 mnist_classifier_MNISTClassifier ktse0hpy 5b542c40-3d28-4c1c-92d7-0bb465442167 -- POST / 200 535.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,076 mnist_classifier_MNISTClassifier ktse0hpy 410779b6-c74f-400c-b94b-0f7319f2ff6e -- POST / 200 538.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,079 mnist_classifier_MNISTClassifier ktse0hpy 8cd5987c-09c5-4084-b725-28bf6fed7cfa -- POST / 200 538.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,082 mnist_classifier_MNISTClassifier ktse0hpy 104f9a30-db00-4a2d-8905-6d86aa7ce069 -- POST / 200 540.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,084 mnist_classifier_MNISTClassifier ktse0hpy 85a773d8-fd78-4625-8557-0a3ebe368871 -- POST / 200 541.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,087 mnist_classifier_MNISTClassifier ktse0hpy 66baad23-8134-4869-a877-20352e155f97 -- POST / 200 541.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,196 mnist_classifier_MNISTClassifier ktse0hpy 9a2c6eea-a124-4b9b-bf56-75db086b2adc -- POST / 200 649.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,196 mnist_classifier_MNISTClassifier ktse0hpy 24d8fa1f-acb8-486d-b572-64267a77093e -- POST / 200 646.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,212 mnist_classifier_MNISTClassifier ktse0hpy ce12187b-2b81-4631-a379-0c50a0064a9d -- POST / 200 660.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,213 mnist_classifier_MNISTClassifier ktse0hpy 5044f64c-12ae-4c85-b0ef-faebd749a070 -- POST / 200 659.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,214 mnist_classifier_MNISTClassifier ktse0hpy 0e61307d-4642-4376-8356-2324537f697c -- POST / 200 660.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,214 mnist_classifier_MNISTClassifier ktse0hpy 7028cb9c-579b-416d-b0f3-ef780e8b368f -- POST / 200 659.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,215 mnist_classifier_MNISTClassifier ktse0hpy 74e2d9c6-baf9-4a05-9e4c-a51243c41818 -- POST / 200 658.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,216 mnist_classifier_MNISTClassifier ktse0hpy 66f864c2-00aa-41c3-b239-c1f539b1a31f -- POST / 200 656.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,216 mnist_classifier_MNISTClassifier ktse0hpy 44881acb-d272-47b2-8618-3cdcbce0e07d -- POST / 200 655.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,224 mnist_classifier_MNISTClassifier ktse0hpy f27954b6-b1e6-4cbf-9aaf-504539187f05 -- POST / 200 660.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,225 mnist_classifier_MNISTClassifier ktse0hpy de88c413-b302-4dc7-8df0-21d15a1df5bb -- POST / 200 658.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,225 mnist_classifier_MNISTClassifier ktse0hpy 7454c1e4-24f4-4191-a3a9-b3d46f6a1c7e -- POST / 200 658.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,225 mnist_classifier_MNISTClassifier ktse0hpy e1394819-5b43-4163-a22f-a3b50f95eb5f -- POST / 200 656.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,226 mnist_classifier_MNISTClassifier ktse0hpy 256cb19f-bc77-4356-b5e3-ffa11a8cd274 -- POST / 200 656.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,226 mnist_classifier_MNISTClassifier ktse0hpy e2776bf6-a01a-4814-8f35-5933622be298 -- POST / 200 656.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,226 mnist_classifier_MNISTClassifier ktse0hpy 08e0db6b-4607-488c-9494-b0e2938f34f0 -- POST / 200 654.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,226 mnist_classifier_MNISTClassifier ktse0hpy 7270a977-7115-42ce-ad68-077384a03de4 -- POST / 200 652.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,226 mnist_classifier_MNISTClassifier ktse0hpy 413c34f6-5ee2-45d2-9d09-0ea445d96b68 -- POST / 200 652.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,227 mnist_classifier_MNISTClassifier ktse0hpy acaaa388-d3f3-4105-a5ee-5ce2281acd99 -- POST / 200 652.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,227 mnist_classifier_MNISTClassifier ktse0hpy b79fa742-d953-4f61-a61e-83b3cdaaa942 -- POST / 200 651.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,227 mnist_classifier_MNISTClassifier ktse0hpy e0b88666-39f6-4950-98e5-4170a321e890 -- POST / 200 652.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,227 mnist_classifier_MNISTClassifier ktse0hpy 3375a51f-d7c1-41ef-a3fd-11a336ef6022 -- POST / 200 651.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,227 mnist_classifier_MNISTClassifier ktse0hpy 490acb6c-23bc-477f-b918-43bf1dc12065 -- POST / 200 649.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,227 mnist_classifier_MNISTClassifier ktse0hpy 3842a958-4b0b-426f-beb2-48e9bb453816 -- POST / 200 647.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,227 mnist_classifier_MNISTClassifier ktse0hpy dd5cc520-36c1-49b0-af54-f15301bedf4a -- POST / 200 647.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,228 mnist_classifier_MNISTClassifier ktse0hpy 97a7b51c-edf0-4fda-a05c-39b28506fcc0 -- POST / 200 646.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,228 mnist_classifier_MNISTClassifier ktse0hpy 2d2074e6-4c76-44d5-8b68-c458dda03c36 -- POST / 200 645.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,228 mnist_classifier_MNISTClassifier ktse0hpy 86e833ea-dc81-4e04-a4aa-b42747e9d3d0 -- POST / 200 638.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,230 mnist_classifier_MNISTClassifier ktse0hpy 131d5879-94d3-4016-9eef-3563ffc82dc3 -- POST / 200 646.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,230 mnist_classifier_MNISTClassifier ktse0hpy 11e53046-e122-4f7a-8f31-62755f5f337c -- POST / 200 645.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,230 mnist_classifier_MNISTClassifier ktse0hpy ac0137ff-ff36-46a9-ac75-881f6680453e -- POST / 200 640.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,230 mnist_classifier_MNISTClassifier ktse0hpy a2856fda-9058-4b17-97f4-aa680f7d781e -- POST / 200 635.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,231 mnist_classifier_MNISTClassifier ktse0hpy 2458e919-b0b2-4d60-a2e3-e535d2087735 -- POST / 200 639.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,232 mnist_classifier_MNISTClassifier ktse0hpy 7eb30834-42d3-4e13-892e-8eff99c698d2 -- POST / 200 640.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,233 mnist_classifier_MNISTClassifier ktse0hpy b0c41dd9-2423-4281-8e17-4ff899ff950a -- POST / 200 640.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,234 mnist_classifier_MNISTClassifier ktse0hpy efefd8b1-fb45-4516-b5d4-ef6dc0cfac9d -- POST / 200 640.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,234 mnist_classifier_MNISTClassifier ktse0hpy ac00a5b5-a181-465c-9d6f-ecf4e885885b -- POST / 200 640.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,235 mnist_classifier_MNISTClassifier ktse0hpy f699fa72-7ade-4382-a272-005534c727a2 -- POST / 200 639.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,298 mnist_classifier_MNISTClassifier ktse0hpy d4a56cf1-2160-4314-adc5-7a9dc152363f -- POST / 200 702.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,300 mnist_classifier_MNISTClassifier ktse0hpy 2852ac7d-346f-4b3a-a33f-21bc051b7ef4 -- POST / 200 573.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,301 mnist_classifier_MNISTClassifier ktse0hpy ea579cf1-3820-4db1-bbf6-2205a7998d85 -- POST / 200 574.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,302 mnist_classifier_MNISTClassifier ktse0hpy 59338659-e47c-4fae-a4e0-4b5e92bd563d -- POST / 200 573.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,303 mnist_classifier_MNISTClassifier ktse0hpy 87af2e82-7cd7-4f21-827d-fc5c811abbca -- POST / 200 573.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,304 mnist_classifier_MNISTClassifier ktse0hpy d2a6f5e0-352f-4212-a6d9-14576636abc7 -- POST / 200 575.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,306 mnist_classifier_MNISTClassifier ktse0hpy 10b8e424-5781-4f29-ab14-be7b35d1973f -- POST / 200 572.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,306 mnist_classifier_MNISTClassifier ktse0hpy f0d0e5b3-6420-4d6c-a897-4141f8f2518e -- POST / 200 577.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,307 mnist_classifier_MNISTClassifier ktse0hpy 94ef687d-b987-4680-bdd5-9148efa23179 -- POST / 200 572.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,312 mnist_classifier_MNISTClassifier ktse0hpy 5bf08f51-1d2c-4e49-9bc0-e10335a59566 -- POST / 200 580.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,313 mnist_classifier_MNISTClassifier ktse0hpy 7119369e-c04a-428a-ae66-07a71624ca13 -- POST / 200 580.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,313 mnist_classifier_MNISTClassifier ktse0hpy eb658525-736a-406f-bdb7-2ebd85c10794 -- POST / 200 576.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,316 mnist_classifier_MNISTClassifier ktse0hpy 5394e27e-781d-4da2-af6b-a0e0d694744d -- POST / 200 580.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,317 mnist_classifier_MNISTClassifier ktse0hpy 149a151f-8c0b-450b-bb22-e013f7482444 -- POST / 200 580.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,321 mnist_classifier_MNISTClassifier ktse0hpy 5776bead-243d-444c-97c6-4d2444875065 -- POST / 200 582.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,322 mnist_classifier_MNISTClassifier ktse0hpy 304c9241-be76-456a-9fec-39ccc01057a4 -- POST / 200 582.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,334 mnist_classifier_MNISTClassifier ktse0hpy ac61e990-7d15-4067-beef-a173e7efbb6c -- POST / 200 593.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,338 mnist_classifier_MNISTClassifier ktse0hpy 3f50351f-acb8-4b12-a129-b0b1b8909c3b -- POST / 200 598.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,339 mnist_classifier_MNISTClassifier ktse0hpy 14041124-fb05-4c62-9a34-01541b8d20fe -- POST / 200 597.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,340 mnist_classifier_MNISTClassifier ktse0hpy 6bfd70eb-0d21-408c-ba30-27a40ebba1fb -- POST / 200 597.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,340 mnist_classifier_MNISTClassifier ktse0hpy a675c11f-d40c-4331-9867-51a4fafb2b71 -- POST / 200 596.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,341 mnist_classifier_MNISTClassifier ktse0hpy 18bc87f5-58bd-4b97-bca6-1bcf5a39ca69 -- POST / 200 597.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,344 mnist_classifier_MNISTClassifier ktse0hpy 889de70c-103e-45ff-9bd1-64545ef891be -- POST / 200 599.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,346 mnist_classifier_MNISTClassifier ktse0hpy f0ffc67a-6759-4938-9155-67f5572b3a11 -- POST / 200 601.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,347 mnist_classifier_MNISTClassifier ktse0hpy 0a36f0e1-9fe0-4236-9301-d8dd519c5e16 -- POST / 200 602.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,347 mnist_classifier_MNISTClassifier ktse0hpy b406f344-231c-4410-9d3e-cf4d86fee75d -- POST / 200 602.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,348 mnist_classifier_MNISTClassifier ktse0hpy 9743f0ee-3ea6-4479-b9ea-bca75e1a4258 -- POST / 200 602.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,348 mnist_classifier_MNISTClassifier ktse0hpy a4a777e4-d9c6-4d2d-81bc-32c058dcc945 -- POST / 200 601.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,356 mnist_classifier_MNISTClassifier ktse0hpy 6c660d41-5122-4ec5-b703-901644b5201b -- POST / 200 608.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,356 mnist_classifier_MNISTClassifier ktse0hpy 8aea8f09-8f57-446f-9885-af391d3e4592 -- POST / 200 607.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,356 mnist_classifier_MNISTClassifier ktse0hpy 5319c300-9df2-48f1-93a1-cf8de2ca3b6b -- POST / 200 607.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,357 mnist_classifier_MNISTClassifier ktse0hpy 83db8c54-279d-41d0-b53b-332fd51cfb29 -- POST / 200 607.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,358 mnist_classifier_MNISTClassifier ktse0hpy da8c1101-8106-406a-b0d4-19d3b369c3a4 -- POST / 200 607.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,360 mnist_classifier_MNISTClassifier ktse0hpy 38f7da9d-1ff6-4188-9329-c86d78ffac2a -- POST / 200 608.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,360 mnist_classifier_MNISTClassifier ktse0hpy ca50c7c5-0fed-4adb-92fb-3dc184bb9a06 -- POST / 200 608.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,361 mnist_classifier_MNISTClassifier ktse0hpy e7dd4f82-dcdb-4364-a3e6-3fca8cd589c7 -- POST / 200 285.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,362 mnist_classifier_MNISTClassifier ktse0hpy c12a1660-9933-401a-beb1-a38376393860 -- POST / 200 300.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,363 mnist_classifier_MNISTClassifier ktse0hpy 15c6079e-6ae5-479b-ad22-4fb05d39a428 -- POST / 200 301.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,364 mnist_classifier_MNISTClassifier ktse0hpy ae081358-2189-4c58-969b-16bb0f642014 -- POST / 200 301.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,365 mnist_classifier_MNISTClassifier ktse0hpy 8d5d935b-46df-4ef0-984f-d1dd64325f37 -- POST / 200 288.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,365 mnist_classifier_MNISTClassifier ktse0hpy f4be3454-e816-41f2-ac27-bd88d8e0d7b8 -- POST / 200 275.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,367 mnist_classifier_MNISTClassifier ktse0hpy 39609ba3-42ca-4189-bc3d-95323a0e6912 -- POST / 200 274.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,367 mnist_classifier_MNISTClassifier ktse0hpy 60cee388-0535-4ee4-b9d7-ba6757a071da -- POST / 200 274.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,368 mnist_classifier_MNISTClassifier ktse0hpy 789335b9-0889-4701-9a54-802f2b1505a9 -- POST / 200 273.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,370 mnist_classifier_MNISTClassifier ktse0hpy 2ebb0f84-c1a7-4e35-a3be-321deaa12bdc -- POST / 200 268.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,372 mnist_classifier_MNISTClassifier ktse0hpy 54269eee-49ce-402d-ba85-117d4f276d64 -- POST / 200 270.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,373 mnist_classifier_MNISTClassifier ktse0hpy 2843852c-9aea-44eb-8abd-129773a620f8 -- POST / 200 269.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,373 mnist_classifier_MNISTClassifier ktse0hpy 1a844c29-852c-4961-8a01-75c09e43a8c6 -- POST / 200 269.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,374 mnist_classifier_MNISTClassifier ktse0hpy 911c0b8b-ea3c-414c-ad92-bd35fb4e1a4c -- POST / 200 268.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,374 mnist_classifier_MNISTClassifier ktse0hpy 3549b874-bb17-4cb6-91d2-793f8bb899a2 -- POST / 200 265.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,375 mnist_classifier_MNISTClassifier ktse0hpy fa8738d3-4be7-465d-82ac-b9975ef3e8b1 -- POST / 200 267.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,376 mnist_classifier_MNISTClassifier ktse0hpy f76064b7-3c5e-4efc-b412-11332b98e391 -- POST / 200 265.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,377 mnist_classifier_MNISTClassifier ktse0hpy 1eeadd63-165d-4d09-b131-df034a8cca6b -- POST / 200 265.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,378 mnist_classifier_MNISTClassifier ktse0hpy b37b15c0-72c0-421b-89d1-9c48b6418dfc -- POST / 200 265.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,378 mnist_classifier_MNISTClassifier ktse0hpy 3818c1ad-6f6f-415f-81f1-e295c61a9465 -- POST / 200 265.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,379 mnist_classifier_MNISTClassifier ktse0hpy 9fb3b757-17ac-4fbe-93d2-6f177461e988 -- POST / 200 265.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,380 mnist_classifier_MNISTClassifier ktse0hpy 6eb58bd0-bdb0-425a-9e96-0ddaf0cb2894 -- POST / 200 264.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,382 mnist_classifier_MNISTClassifier ktse0hpy 63dfbbc5-1c5e-4e33-bffc-a5c80e94d69c -- POST / 200 266.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,382 mnist_classifier_MNISTClassifier ktse0hpy 14168c02-db22-4fe1-97c1-e4d489c52fa5 -- POST / 200 263.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,383 mnist_classifier_MNISTClassifier ktse0hpy 0d8ccb14-bed7-4f1b-bdc9-bc59cc51c4be -- POST / 200 257.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,383 mnist_classifier_MNISTClassifier ktse0hpy 4f510cde-6368-4e56-99bd-e24f16e4c73c -- POST / 200 247.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,383 mnist_classifier_MNISTClassifier ktse0hpy 560864cf-5edd-4f82-a684-bca1e36f349d -- POST / 200 247.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,461 mnist_classifier_MNISTClassifier ktse0hpy 00c6182a-0de1-461f-ba45-0eaf263508e0 -- POST / 200 221.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,473 mnist_classifier_MNISTClassifier ktse0hpy 84faf059-7766-4700-ac3c-30b2dff5a343 -- POST / 200 291.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,475 mnist_classifier_MNISTClassifier ktse0hpy bad3ae49-bcc3-4c93-b2e5-1c80618b18d8 -- POST / 200 293.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,476 mnist_classifier_MNISTClassifier ktse0hpy 4e7ab772-5aac-4237-9db3-2f0db7bff4ac -- POST / 200 289.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,476 mnist_classifier_MNISTClassifier ktse0hpy 2084863b-1037-4757-bda8-9338518d492a -- POST / 200 288.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,479 mnist_classifier_MNISTClassifier ktse0hpy 8505da8a-e0d9-402f-bf57-696ce8ad62de -- POST / 200 284.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,480 mnist_classifier_MNISTClassifier ktse0hpy 63f5e48b-e184-4041-887f-5ccb3c697911 -- POST / 200 242.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,485 mnist_classifier_MNISTClassifier ktse0hpy 94a2d85c-3a01-4751-bb2f-6eb378f17da8 -- POST / 200 246.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,485 mnist_classifier_MNISTClassifier ktse0hpy 2c7547ce-bad5-4745-a522-289c753800d2 -- POST / 200 241.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,486 mnist_classifier_MNISTClassifier ktse0hpy d684d25a-ad61-4ec3-a130-75932e68688e -- POST / 200 242.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,486 mnist_classifier_MNISTClassifier ktse0hpy 4467bc8a-a62d-4447-9e34-69b5c5dfdc77 -- POST / 200 241.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,486 mnist_classifier_MNISTClassifier ktse0hpy 3d6d724f-47d9-42ad-a9d3-6fb2294fa92b -- POST / 200 240.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,487 mnist_classifier_MNISTClassifier ktse0hpy afbcfc0a-720a-4960-bf47-92fe13786432 -- POST / 200 240.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,487 mnist_classifier_MNISTClassifier ktse0hpy 3e7564e3-67b3-4b44-a014-172328b3cf69 -- POST / 200 238.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,487 mnist_classifier_MNISTClassifier ktse0hpy 8a56f087-ee07-4de5-bd08-42367bfb24d6 -- POST / 200 238.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,488 mnist_classifier_MNISTClassifier ktse0hpy 36102b74-deb8-469f-9440-02bc28d43cfc -- POST / 200 237.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,488 mnist_classifier_MNISTClassifier ktse0hpy fae1a4ea-3c2b-4fb7-aa3f-2f24d501683d -- POST / 200 238.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,489 mnist_classifier_MNISTClassifier ktse0hpy 696b5a32-b1b6-4bb3-8109-ee9476f9e785 -- POST / 200 238.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,490 mnist_classifier_MNISTClassifier ktse0hpy 8be66ab1-d2bd-4590-a829-e9d682ebe7f2 -- POST / 200 238.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,490 mnist_classifier_MNISTClassifier ktse0hpy a8673982-e5f0-4e7a-b802-94e702eb55ef -- POST / 200 236.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,490 mnist_classifier_MNISTClassifier ktse0hpy 892c5651-ca8c-4cc8-8741-116965f2740b -- POST / 200 237.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,491 mnist_classifier_MNISTClassifier ktse0hpy 88fc2d37-6a56-406b-b7a0-761da1f68e8a -- POST / 200 237.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,494 mnist_classifier_MNISTClassifier ktse0hpy 818a926b-ada1-4e70-8fb5-2a2931bae4b0 -- POST / 200 238.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,498 mnist_classifier_MNISTClassifier ktse0hpy 14c6b6b4-2f48-458c-9000-74b8416b0294 -- POST / 200 241.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,499 mnist_classifier_MNISTClassifier ktse0hpy 52c65b44-577e-4224-a7f3-77b0a283d665 -- POST / 200 243.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,500 mnist_classifier_MNISTClassifier ktse0hpy a0c073ea-845a-4c01-9962-e2500773a206 -- POST / 200 243.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,500 mnist_classifier_MNISTClassifier ktse0hpy f217f17f-efe3-4f31-9dda-0e76801e3b3a -- POST / 200 241.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,500 mnist_classifier_MNISTClassifier ktse0hpy 3f68ac0f-3788-4915-b2fd-43dd95688d53 -- POST / 200 242.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,501 mnist_classifier_MNISTClassifier ktse0hpy 09abed55-9fbb-4fda-8639-dd9b6113de4d -- POST / 200 242.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,502 mnist_classifier_MNISTClassifier ktse0hpy c391070f-d205-40f4-87e1-d3da8d5a486e -- POST / 200 241.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,505 mnist_classifier_MNISTClassifier ktse0hpy 0349c7c1-c6c5-4913-90b9-b03c6fd93051 -- POST / 200 247.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,506 mnist_classifier_MNISTClassifier ktse0hpy 6e60b6f0-7dcd-4b13-9443-97578b56a61b -- POST / 200 247.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,506 mnist_classifier_MNISTClassifier ktse0hpy 68fecce8-55b6-47ed-8a03-5536503904e4 -- POST / 200 245.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,506 mnist_classifier_MNISTClassifier ktse0hpy e0257012-a365-4a8f-9581-59510a02d9b6 -- POST / 200 240.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,507 mnist_classifier_MNISTClassifier ktse0hpy d957fb67-f82b-493a-adda-e9732da79aed -- POST / 200 244.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,507 mnist_classifier_MNISTClassifier ktse0hpy 93026d68-266f-4648-8d53-7ef48104b86f -- POST / 200 241.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,508 mnist_classifier_MNISTClassifier ktse0hpy d62eecc5-dd81-4f7b-aaad-538504683ea6 -- POST / 200 241.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,509 mnist_classifier_MNISTClassifier ktse0hpy 05a6efd7-10a9-4f49-a5e3-2135251bce8f -- POST / 200 242.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,601 mnist_classifier_MNISTClassifier ktse0hpy d87ed7b6-4367-4e6a-9c17-4a13a3cc0553 -- POST / 200 289.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,604 mnist_classifier_MNISTClassifier ktse0hpy d679ca39-d1bd-4ef7-b578-e763d906442c -- POST / 200 266.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,606 mnist_classifier_MNISTClassifier ktse0hpy cd57dd79-394a-4f0b-96bf-f8e53b216188 -- POST / 200 265.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,606 mnist_classifier_MNISTClassifier ktse0hpy d9d821c2-5800-4357-9e64-86c0412b3d8f -- POST / 200 248.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,606 mnist_classifier_MNISTClassifier ktse0hpy c60356e7-c5e0-4010-ab27-3a54e0588597 -- POST / 200 246.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,607 mnist_classifier_MNISTClassifier ktse0hpy a31b3a09-ec42-4d6e-9f79-4ba1d94e6abd -- POST / 200 245.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,609 mnist_classifier_MNISTClassifier ktse0hpy 96999b5e-2ebe-4a3b-b126-b1a46a8c00ad -- POST / 200 245.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,609 mnist_classifier_MNISTClassifier ktse0hpy 53a81e0c-c1f2-41c2-99a5-4d2f889a248d -- POST / 200 224.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,610 mnist_classifier_MNISTClassifier ktse0hpy 631913c7-06ad-4bdc-b992-9e7a73490c40 -- POST / 200 223.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,611 mnist_classifier_MNISTClassifier ktse0hpy cb48a244-4c6e-4a03-9653-188fd86ad073 -- POST / 200 244.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,612 mnist_classifier_MNISTClassifier ktse0hpy b2059332-1168-4140-8af7-e313c1c8609e -- POST / 200 239.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,612 mnist_classifier_MNISTClassifier ktse0hpy 11b641cb-9ab3-4050-8eff-aa3e698e6fe8 -- POST / 200 228.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,613 mnist_classifier_MNISTClassifier ktse0hpy f0e8203f-51a2-4345-a53e-2793fa2b11c3 -- POST / 200 228.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,614 mnist_classifier_MNISTClassifier ktse0hpy 22ea2e75-282b-4e37-a4e7-108d2bdcf96e -- POST / 200 229.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,615 mnist_classifier_MNISTClassifier ktse0hpy a9381aca-6ee9-403f-aaac-25c7202b6cdd -- POST / 200 225.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,616 mnist_classifier_MNISTClassifier ktse0hpy 432a7a80-bc8b-4710-b86b-5d375f1426e2 -- POST / 200 226.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,617 mnist_classifier_MNISTClassifier ktse0hpy 14e4b9a0-b5c2-493b-9b46-d448ae9c0311 -- POST / 200 224.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,618 mnist_classifier_MNISTClassifier ktse0hpy a8f9733f-f4bc-41d5-b971-b327653167f9 -- POST / 200 225.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,620 mnist_classifier_MNISTClassifier ktse0hpy a5166307-37f1-4bfd-8139-93f47dcade60 -- POST / 200 224.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,621 mnist_classifier_MNISTClassifier ktse0hpy dd481fc3-836d-4500-9f9d-83df09c43569 -- POST / 200 225.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,623 mnist_classifier_MNISTClassifier ktse0hpy 8af4e85a-24e3-4288-8d86-347ae0625ab5 -- POST / 200 223.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,628 mnist_classifier_MNISTClassifier ktse0hpy 5f3fd8bd-f7c4-43dc-90bd-1f98882d7fca -- POST / 200 228.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,629 mnist_classifier_MNISTClassifier ktse0hpy 9df73445-e388-46d1-bc83-d6884ea9cdbb -- POST / 200 228.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,630 mnist_classifier_MNISTClassifier ktse0hpy a83a1de7-e5dc-4e7d-be33-3e676402712f -- POST / 200 221.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,630 mnist_classifier_MNISTClassifier ktse0hpy 49ca7636-5470-4880-a9c9-062a2518254a -- POST / 200 220.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,630 mnist_classifier_MNISTClassifier ktse0hpy 463d6b10-7809-448c-8d8a-00746ae7bc2d -- POST / 200 219.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,631 mnist_classifier_MNISTClassifier ktse0hpy 32f0e8b0-7ec4-4d14-9d88-393dca81e662 -- POST / 200 219.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,631 mnist_classifier_MNISTClassifier ktse0hpy df837700-023e-4b55-bcae-7e069048512c -- POST / 200 219.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,632 mnist_classifier_MNISTClassifier ktse0hpy e6912b97-119a-4c04-8296-46a3133bed6b -- POST / 200 217.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,633 mnist_classifier_MNISTClassifier ktse0hpy f038fd3c-d8ce-4594-94e4-63f1759bd87c -- POST / 200 217.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,633 mnist_classifier_MNISTClassifier ktse0hpy 013fcfc0-f8cf-4da8-8d3a-08b4acbe3e38 -- POST / 200 217.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,639 mnist_classifier_MNISTClassifier ktse0hpy db5e44b1-469a-4046-bb09-e1e6af1b303a -- POST / 200 221.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,641 mnist_classifier_MNISTClassifier ktse0hpy 0a9b7a68-dd74-4854-86c1-5b092b4d5b13 -- POST / 200 223.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,643 mnist_classifier_MNISTClassifier ktse0hpy 089101c4-43f1-4ac8-9a7e-96e8cb549d2a -- POST / 200 224.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,643 mnist_classifier_MNISTClassifier ktse0hpy 95bef8ab-faa3-4d9f-bbe6-ed85b5f4c9b5 -- POST / 200 224.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,643 mnist_classifier_MNISTClassifier ktse0hpy 32c94953-44b0-494b-9fcd-1fb66f26ce72 -- POST / 200 224.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,645 mnist_classifier_MNISTClassifier ktse0hpy 53b864d2-0431-4b39-bc11-f08d92155f24 -- POST / 200 225.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,646 mnist_classifier_MNISTClassifier ktse0hpy 0d4438a3-1539-4528-94fc-b8b16214dc1a -- POST / 200 222.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,647 mnist_classifier_MNISTClassifier ktse0hpy 2d2abb67-849b-435f-930c-70edc281d4d6 -- POST / 200 223.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,648 mnist_classifier_MNISTClassifier ktse0hpy c27a63bd-ede8-47e6-b4cd-63bd4e2756ce -- POST / 200 220.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,648 mnist_classifier_MNISTClassifier ktse0hpy bc98db71-f662-42c7-b203-ca1407a2daef -- POST / 200 218.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,648 mnist_classifier_MNISTClassifier ktse0hpy bf70c4b9-dc2a-4c42-b7e7-569bc4666262 -- POST / 200 220.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,924 mnist_classifier_MNISTClassifier ktse0hpy 7d1ff14d-46cc-4332-92e5-3b9b0f91418e -- POST / 200 479.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,926 mnist_classifier_MNISTClassifier ktse0hpy 4a204fc1-6e35-4a3e-8424-1c746f00ca3e -- POST / 200 483.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,929 mnist_classifier_MNISTClassifier ktse0hpy efff933a-7843-423f-a351-9ad9491f334c -- POST / 200 484.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,932 mnist_classifier_MNISTClassifier ktse0hpy 57d25c8c-3dc2-44c9-a766-94ec9f33229a -- POST / 200 485.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,933 mnist_classifier_MNISTClassifier ktse0hpy 80dc9056-a7d7-4db3-b2f6-a89d265278ba -- POST / 200 475.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,933 mnist_classifier_MNISTClassifier ktse0hpy 78b014a7-4729-4313-bfdc-f92122efe30f -- POST / 200 439.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,933 mnist_classifier_MNISTClassifier ktse0hpy 04cfab91-0c9d-4cf7-b124-08d2f885b1d0 -- POST / 200 439.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,934 mnist_classifier_MNISTClassifier ktse0hpy cc67b5c0-c323-4708-9ebb-aa1e6fef93c0 -- POST / 200 440.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,934 mnist_classifier_MNISTClassifier ktse0hpy b1ebf6f5-c25d-4f41-9b68-602a7f94684b -- POST / 200 440.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,935 mnist_classifier_MNISTClassifier ktse0hpy 49f2cc37-06a3-48d7-b4ae-c7d4f4e816f1 -- POST / 200 440.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,936 mnist_classifier_MNISTClassifier ktse0hpy b2fb017e-5f5d-458f-a4a8-1dc5babc1dd8 -- POST / 200 426.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,937 mnist_classifier_MNISTClassifier ktse0hpy 8c32553c-65a3-4f4a-aaa6-8ac47d62bb1a -- POST / 200 416.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,939 mnist_classifier_MNISTClassifier ktse0hpy bec48a4b-06cf-4344-8eb2-ab6f27641249 -- POST / 200 407.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,940 mnist_classifier_MNISTClassifier ktse0hpy c17d2f44-b5b5-44f0-ad19-0d7b762faf25 -- POST / 200 415.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,940 mnist_classifier_MNISTClassifier ktse0hpy ae0dbf3c-ce09-4ec0-a46f-6d3b58f15202 -- POST / 200 415.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,941 mnist_classifier_MNISTClassifier ktse0hpy bd756be4-5a50-4187-8c0f-3bf3a47253ec -- POST / 200 414.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,943 mnist_classifier_MNISTClassifier ktse0hpy 6aad58d9-aec2-4105-b399-408d96418be9 -- POST / 200 416.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,943 mnist_classifier_MNISTClassifier ktse0hpy eb60c284-b22b-4afb-9784-0dd11ee430a1 -- POST / 200 415.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,944 mnist_classifier_MNISTClassifier ktse0hpy f6076f08-ad14-41f9-abd7-39690f36fb0f -- POST / 200 415.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,945 mnist_classifier_MNISTClassifier ktse0hpy 2c4619b6-3195-49ae-8dda-26322f585e3a -- POST / 200 413.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,946 mnist_classifier_MNISTClassifier ktse0hpy 4414f921-0469-4c38-a0ff-2e23a52cb40b -- POST / 200 395.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,948 mnist_classifier_MNISTClassifier ktse0hpy 262bfe7b-d801-4459-8994-df8350aec5f2 -- POST / 200 409.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,948 mnist_classifier_MNISTClassifier ktse0hpy 7bfc4e64-7ace-4bb0-b9c2-e1db16332cf2 -- POST / 200 404.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,949 mnist_classifier_MNISTClassifier ktse0hpy 7ce166d5-506a-4dc4-a2d2-93e5e275a5cc -- POST / 200 416.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,950 mnist_classifier_MNISTClassifier ktse0hpy 49044cfe-16a7-443c-b657-628d8fb8b336 -- POST / 200 414.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,952 mnist_classifier_MNISTClassifier ktse0hpy 05a6f431-b9f8-4efa-bad1-fe1012b2326e -- POST / 200 415.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,952 mnist_classifier_MNISTClassifier ktse0hpy 051a6d68-c38d-439b-93f0-36f9b7d0c4fd -- POST / 200 414.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,952 mnist_classifier_MNISTClassifier ktse0hpy a8e127e1-cd6e-424b-9cab-d60ada0e31a5 -- POST / 200 400.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,958 mnist_classifier_MNISTClassifier ktse0hpy 8d85019d-b2b8-42b2-8b18-b501ceb749c2 -- POST / 200 404.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,958 mnist_classifier_MNISTClassifier ktse0hpy 4def24b9-58cf-40ce-be81-71efeb65d502 -- POST / 200 404.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,960 mnist_classifier_MNISTClassifier ktse0hpy 29e11243-0957-42a4-b468-05ad2d3e5a7d -- POST / 200 405.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,960 mnist_classifier_MNISTClassifier ktse0hpy 933de9ea-ce4d-472e-b01c-c07a00e81207 -- POST / 200 405.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,960 mnist_classifier_MNISTClassifier ktse0hpy c6a878ae-4b95-4c33-9bb9-a8a5039b1c03 -- POST / 200 406.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,961 mnist_classifier_MNISTClassifier ktse0hpy 27b7a859-e45b-40e2-9ac3-614c493d592c -- POST / 200 405.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,961 mnist_classifier_MNISTClassifier ktse0hpy 2be8ffd5-dbaf-415e-a1c4-d56f6d1c40be -- POST / 200 406.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,961 mnist_classifier_MNISTClassifier ktse0hpy da193145-0baf-41cb-b83e-9cdf76c64d54 -- POST / 200 405.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,962 mnist_classifier_MNISTClassifier ktse0hpy f514e7c6-15fb-4320-80ad-eb11a8c48d8c -- POST / 200 406.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,962 mnist_classifier_MNISTClassifier ktse0hpy cff7afad-7bf3-4814-98c6-62f6662a39d6 -- POST / 200 406.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,962 mnist_classifier_MNISTClassifier ktse0hpy e1a88098-ca31-4f1c-962d-c23936a9613d -- POST / 200 406.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,963 mnist_classifier_MNISTClassifier ktse0hpy 69e68ab2-725b-4e4b-a63a-29bd931dbcb3 -- POST / 200 407.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,963 mnist_classifier_MNISTClassifier ktse0hpy c02c8e86-ca82-455c-b2fa-f47126c016e0 -- POST / 200 406.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:46,963 mnist_classifier_MNISTClassifier ktse0hpy 67f806f5-19ce-466d-a0ff-c3663e6c0cbb -- POST / 200 406.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,067 mnist_classifier_MNISTClassifier ktse0hpy d69c717b-aa58-4386-8241-27f7fe35acdb -- POST / 200 508.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,069 mnist_classifier_MNISTClassifier ktse0hpy 95ad01e0-5705-4d50-815a-17fe5b55fbc8 -- POST / 200 510.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,070 mnist_classifier_MNISTClassifier ktse0hpy f2d44f4b-658c-4960-b993-1a4f3ba355ed -- POST / 200 509.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,071 mnist_classifier_MNISTClassifier ktse0hpy 6f619760-0524-4a77-806e-ed7f7fc7889d -- POST / 200 508.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,072 mnist_classifier_MNISTClassifier ktse0hpy b6eff47c-2c12-4ce4-a078-7c9b66d5169b -- POST / 200 509.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,073 mnist_classifier_MNISTClassifier ktse0hpy ee952862-2f02-4e5f-9435-3e85a7f20c1c -- POST / 200 509.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,073 mnist_classifier_MNISTClassifier ktse0hpy b32eaa30-0998-418d-a3a7-f76e7f0f577a -- POST / 200 509.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,075 mnist_classifier_MNISTClassifier ktse0hpy 60845d15-8ab9-4d3a-8c40-f994440a19fc -- POST / 200 511.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,077 mnist_classifier_MNISTClassifier ktse0hpy e597705e-159b-4d7f-ba49-03bd94ec0e25 -- POST / 200 509.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,078 mnist_classifier_MNISTClassifier ktse0hpy c1ab18a2-b04c-4bb8-9b38-7b10429a33dd -- POST / 200 508.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,083 mnist_classifier_MNISTClassifier ktse0hpy 113684d6-fa44-47ae-be15-42998df7b0be -- POST / 200 512.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,085 mnist_classifier_MNISTClassifier ktse0hpy 44d903d3-1099-46e8-acdb-db98116e8d31 -- POST / 200 514.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,085 mnist_classifier_MNISTClassifier ktse0hpy 63e8f5c8-938b-4919-beb2-5c6098c05539 -- POST / 200 513.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,086 mnist_classifier_MNISTClassifier ktse0hpy f863c111-14bb-456f-867a-155889de3d92 -- POST / 200 513.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,088 mnist_classifier_MNISTClassifier ktse0hpy fb6a12aa-9605-431b-8635-43a65bc7de06 -- POST / 200 515.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,088 mnist_classifier_MNISTClassifier ktse0hpy 1c89f10f-fe72-4003-b3e3-1cd41c7a0ab9 -- POST / 200 514.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,089 mnist_classifier_MNISTClassifier ktse0hpy 411ba625-8a69-456e-83c7-8d49ac4fe7e2 -- POST / 200 438.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,089 mnist_classifier_MNISTClassifier ktse0hpy 3107a1c8-2617-4789-8071-2e5de18130c9 -- POST / 200 433.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,089 mnist_classifier_MNISTClassifier ktse0hpy be4d259e-80cd-4fc8-99e3-1c96dc8cd4c0 -- POST / 200 424.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,090 mnist_classifier_MNISTClassifier ktse0hpy d3a3ba91-4de7-45aa-b338-50bfa4292965 -- POST / 200 423.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,090 mnist_classifier_MNISTClassifier ktse0hpy 6429c47d-07b4-4d02-ba00-935b710440f3 -- POST / 200 424.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,095 mnist_classifier_MNISTClassifier ktse0hpy 93e091cd-cbcd-46c5-87da-7b7a8aae4d0b -- POST / 200 428.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,096 mnist_classifier_MNISTClassifier ktse0hpy 3f0c1535-c667-46dc-a6c5-24fa2e76eb36 -- POST / 200 429.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,099 mnist_classifier_MNISTClassifier ktse0hpy 8212e029-ac41-4bf7-9c7a-8c121b64c9d8 -- POST / 200 431.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,100 mnist_classifier_MNISTClassifier ktse0hpy eb6541d6-c6db-4c06-9041-b45eada57ea5 -- POST / 200 431.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,100 mnist_classifier_MNISTClassifier ktse0hpy 394da398-b45c-4857-9e5f-eb97e054a532 -- POST / 200 423.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,101 mnist_classifier_MNISTClassifier ktse0hpy da54f14c-12b6-488f-961c-d157abea58b5 -- POST / 200 422.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,102 mnist_classifier_MNISTClassifier ktse0hpy 5bf23fd5-465b-4571-843b-bed2f1247a57 -- POST / 200 422.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,102 mnist_classifier_MNISTClassifier ktse0hpy c36919fb-fb2c-4343-825f-dda5762ed549 -- POST / 200 416.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,102 mnist_classifier_MNISTClassifier ktse0hpy 1ec7019f-9837-4cd3-87e8-ca65c7ab41f4 -- POST / 200 420.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,105 mnist_classifier_MNISTClassifier ktse0hpy ba35f866-9b46-4bfb-9c9b-b75ef0a64943 -- POST / 200 419.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,106 mnist_classifier_MNISTClassifier ktse0hpy af7a0871-803e-4c11-9c80-58eb4ec9e56c -- POST / 200 419.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,106 mnist_classifier_MNISTClassifier ktse0hpy 10351d6e-0759-4826-8045-cb8b32cac047 -- POST / 200 418.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,107 mnist_classifier_MNISTClassifier ktse0hpy 0eb7d4dc-20e9-4c73-b9a2-68fcdadcb175 -- POST / 200 418.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,108 mnist_classifier_MNISTClassifier ktse0hpy e2d12e14-5d79-47f0-9b85-a13806843757 -- POST / 200 418.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,108 mnist_classifier_MNISTClassifier ktse0hpy cfee59f9-6e3d-40cc-82be-27ed2c1c3ba1 -- POST / 200 417.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,109 mnist_classifier_MNISTClassifier ktse0hpy c99c2dbf-eaf2-4a8a-a76c-c6c89fe0dede -- POST / 200 416.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,111 mnist_classifier_MNISTClassifier ktse0hpy 8b3c4a8b-5220-4611-a85b-411049d380e6 -- POST / 200 418.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,112 mnist_classifier_MNISTClassifier ktse0hpy eaa69cc6-e6ed-4b4a-9b89-5d7ac8777fef -- POST / 200 418.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,112 mnist_classifier_MNISTClassifier ktse0hpy 505b6b6a-22cb-4f16-923d-4697ef53550c -- POST / 200 417.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,113 mnist_classifier_MNISTClassifier ktse0hpy 532be2a9-ba70-412e-9853-5f9a15304c5a -- POST / 200 414.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,114 mnist_classifier_MNISTClassifier ktse0hpy cef568bd-f198-484e-81ac-0427c48dac5d -- POST / 200 413.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,114 mnist_classifier_MNISTClassifier ktse0hpy 0d8db661-2add-469c-a8cf-f23ecde8b704 -- POST / 200 412.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,115 mnist_classifier_MNISTClassifier ktse0hpy 7bfd31e4-4cbc-4be1-bc19-16021efbc13b -- POST / 200 412.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,116 mnist_classifier_MNISTClassifier ktse0hpy 4056ca36-68c6-4194-ad59-82e468474675 -- POST / 200 411.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,118 mnist_classifier_MNISTClassifier ktse0hpy 24755861-e672-435a-b172-77113ebfac5d -- POST / 200 410.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,118 mnist_classifier_MNISTClassifier ktse0hpy f60ca536-1585-4d6f-8760-c153abe89abc -- POST / 200 410.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,119 mnist_classifier_MNISTClassifier ktse0hpy cb96f5e2-ba41-4034-8ffa-f2637225f613 -- POST / 200 411.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,120 mnist_classifier_MNISTClassifier ktse0hpy d7a5244e-92f2-4ed9-a5af-7d93002b41f3 -- POST / 200 411.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,120 mnist_classifier_MNISTClassifier ktse0hpy 5dc987a4-02d0-4220-a7df-eec15723a06e -- POST / 200 410.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,120 mnist_classifier_MNISTClassifier ktse0hpy 0f4cb8ab-f4ef-43c1-b87a-c463794a811a -- POST / 200 410.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,121 mnist_classifier_MNISTClassifier ktse0hpy 43a0b945-06e3-4744-b6e5-97a92fea81ed -- POST / 200 410.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,122 mnist_classifier_MNISTClassifier ktse0hpy 4b729773-d712-4b5a-9e1b-4e0a472cba14 -- POST / 200 409.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,123 mnist_classifier_MNISTClassifier ktse0hpy 1d3ccdf3-c938-4cbe-988b-d0770b10821b -- POST / 200 407.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,123 mnist_classifier_MNISTClassifier ktse0hpy dcfdffee-9b4d-4744-a1b5-bb7d5acde179 -- POST / 200 409.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,123 mnist_classifier_MNISTClassifier ktse0hpy 08eb5fd8-296c-43f8-ad17-4a565e3031ec -- POST / 200 407.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,124 mnist_classifier_MNISTClassifier ktse0hpy 9f7765c9-3cbc-413d-9292-5e65005c137c -- POST / 200 271.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,124 mnist_classifier_MNISTClassifier ktse0hpy f57a2387-61c4-4a59-8bff-114f0039de19 -- POST / 200 271.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,125 mnist_classifier_MNISTClassifier ktse0hpy cc3f924e-ccf3-4a24-8929-c9f61f8d76f5 -- POST / 200 186.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,126 mnist_classifier_MNISTClassifier ktse0hpy a36a5f07-ea25-4f81-8006-21ff83646b2d -- POST / 200 178.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,126 mnist_classifier_MNISTClassifier ktse0hpy 6466a3ab-8e31-406f-8915-416d40b7cff1 -- POST / 200 168.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,126 mnist_classifier_MNISTClassifier ktse0hpy 9286a52c-0f40-40c2-9e80-991a38783d0e -- POST / 200 168.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,229 mnist_classifier_MNISTClassifier ktse0hpy 3888e3f4-9e99-4403-9bca-c03c4122f4a5 -- POST / 200 265.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,232 mnist_classifier_MNISTClassifier ktse0hpy c8702b48-a6d8-4dec-a21b-f45ee60c2f18 -- POST / 200 266.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,232 mnist_classifier_MNISTClassifier ktse0hpy c052718a-39e0-49f1-be77-1929e8b49b52 -- POST / 200 267.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,234 mnist_classifier_MNISTClassifier ktse0hpy d998f78c-d784-403f-ac14-72eee9b135d0 -- POST / 200 261.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,237 mnist_classifier_MNISTClassifier ktse0hpy 4ef1d37f-ba82-41eb-a332-3b7398434fe1 -- POST / 200 266.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,238 mnist_classifier_MNISTClassifier ktse0hpy dd744e01-53e0-46ae-8c74-7a5f7540dba3 -- POST / 200 265.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,238 mnist_classifier_MNISTClassifier ktse0hpy 32f3ee1e-1698-4e1f-ba02-8e4f0f50f014 -- POST / 200 264.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,240 mnist_classifier_MNISTClassifier ktse0hpy 5ef61cf4-303e-48b9-898d-21dcf264d7b3 -- POST / 200 265.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,242 mnist_classifier_MNISTClassifier ktse0hpy ae33d80e-3b07-4c6d-91b7-13a8ea9b8764 -- POST / 200 266.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,242 mnist_classifier_MNISTClassifier ktse0hpy 74cb4934-57b2-4a60-853c-5b3b7d2d5844 -- POST / 200 266.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,243 mnist_classifier_MNISTClassifier ktse0hpy add9cea1-6617-490e-8172-739ecb1bcba5 -- POST / 200 265.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,243 mnist_classifier_MNISTClassifier ktse0hpy 0bece8fe-370b-48f5-8d48-f255a689a874 -- POST / 200 262.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,246 mnist_classifier_MNISTClassifier ktse0hpy b1b13be2-2260-45b9-99c6-88807bbe2fdd -- POST / 200 263.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,248 mnist_classifier_MNISTClassifier ktse0hpy 9fcc7116-036f-4860-b94a-2c0206d57f03 -- POST / 200 264.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,248 mnist_classifier_MNISTClassifier ktse0hpy a2bd7ffd-6c3a-48f5-aac9-be02ee40537c -- POST / 200 264.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,248 mnist_classifier_MNISTClassifier ktse0hpy dd0b7932-f1c7-4817-8d65-3dd7c2aadc31 -- POST / 200 262.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,249 mnist_classifier_MNISTClassifier ktse0hpy f4319d1b-b8c5-4cb9-b9fe-7c100142e46f -- POST / 200 257.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,250 mnist_classifier_MNISTClassifier ktse0hpy 560429b5-2a52-417d-8f38-b62e8b31f2d9 -- POST / 200 250.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,251 mnist_classifier_MNISTClassifier ktse0hpy efeb7f72-6b54-400d-8487-02a909e52de6 -- POST / 200 241.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,253 mnist_classifier_MNISTClassifier ktse0hpy ea77a5a7-aed0-49c7-be09-7943b40d3c3d -- POST / 200 242.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,255 mnist_classifier_MNISTClassifier ktse0hpy a050ef18-5316-4022-b629-64139c329fdc -- POST / 200 243.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,257 mnist_classifier_MNISTClassifier ktse0hpy 4228d15a-04a9-4ce9-86ee-06ea34485585 -- POST / 200 245.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,259 mnist_classifier_MNISTClassifier ktse0hpy 8131bb3d-265c-47e5-970a-a57a73623c0a -- POST / 200 245.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,262 mnist_classifier_MNISTClassifier ktse0hpy 63364f46-d22f-448a-800e-ebc6f7280a26 -- POST / 200 246.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,262 mnist_classifier_MNISTClassifier ktse0hpy 95f00658-8747-4df7-81e7-2e5285e55fee -- POST / 200 244.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,267 mnist_classifier_MNISTClassifier ktse0hpy 7c9579f1-4896-4e06-aa99-41a26c786db5 -- POST / 200 248.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,271 mnist_classifier_MNISTClassifier ktse0hpy 6d9778aa-6d53-40e3-b479-dc0b772e6828 -- POST / 200 250.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,272 mnist_classifier_MNISTClassifier ktse0hpy 039ff11e-36f6-42e0-a396-33cd02715e77 -- POST / 200 251.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,273 mnist_classifier_MNISTClassifier ktse0hpy cf4ea490-b974-4e8f-a88a-ae896f0ee2e2 -- POST / 200 250.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,273 mnist_classifier_MNISTClassifier ktse0hpy 7f21932e-e995-4f1f-91ba-336005e3a929 -- POST / 200 245.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,275 mnist_classifier_MNISTClassifier ktse0hpy e07120a6-63e8-4253-a971-408167bee6fe -- POST / 200 248.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,276 mnist_classifier_MNISTClassifier ktse0hpy 8d908900-9e13-4e24-a9c9-e783ffeac197 -- POST / 200 250.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,276 mnist_classifier_MNISTClassifier ktse0hpy 6d398a62-3e1a-40f8-a8e9-4f5f536176c7 -- POST / 200 247.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,277 mnist_classifier_MNISTClassifier ktse0hpy 84ef90fe-c5bd-4028-9167-2558ed9d46fd -- POST / 200 248.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,407 mnist_classifier_MNISTClassifier ktse0hpy c6baf0e0-0040-443c-9ac1-d976d5d932b5 -- POST / 200 377.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,408 mnist_classifier_MNISTClassifier ktse0hpy 09203e15-fd45-4871-ac5b-7506de69bfbe -- POST / 200 378.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,409 mnist_classifier_MNISTClassifier ktse0hpy 6150f394-a673-4995-a2c4-390a5e903a9f -- POST / 200 378.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,409 mnist_classifier_MNISTClassifier ktse0hpy be4108ef-ab8b-418f-a8e0-638969b8dbf6 -- POST / 200 278.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,410 mnist_classifier_MNISTClassifier ktse0hpy a896137e-245d-48ea-956d-40e859d2af9d -- POST / 200 278.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,411 mnist_classifier_MNISTClassifier ktse0hpy 4d68ac1f-6f6a-462e-9992-10954a1a3d12 -- POST / 200 380.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,411 mnist_classifier_MNISTClassifier ktse0hpy fadb4828-0497-4032-a3ca-ce44674fff03 -- POST / 200 349.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,413 mnist_classifier_MNISTClassifier ktse0hpy 6269d34a-053b-414c-bcd3-338978a36ec8 -- POST / 200 285.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,414 mnist_classifier_MNISTClassifier ktse0hpy 043e1d06-3bbd-4ae6-a433-ab19e0307657 -- POST / 200 285.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,415 mnist_classifier_MNISTClassifier ktse0hpy 4704112f-1c57-4394-950f-ce521dbcd471 -- POST / 200 282.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,418 mnist_classifier_MNISTClassifier ktse0hpy c50b7351-19f9-4f60-a5e2-d687f89dffae -- POST / 200 284.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,419 mnist_classifier_MNISTClassifier ktse0hpy 50946e9a-75dd-4c5b-8287-75870bd263bd -- POST / 200 280.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,420 mnist_classifier_MNISTClassifier ktse0hpy 9a42943f-5f09-4682-9832-aab2b23239cd -- POST / 200 285.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,421 mnist_classifier_MNISTClassifier ktse0hpy a7baa348-9f3e-4b3b-9fc0-ee3b37a4bf65 -- POST / 200 285.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,421 mnist_classifier_MNISTClassifier ktse0hpy cafa7348-b038-49a1-9540-807d3e451ef0 -- POST / 200 285.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,425 mnist_classifier_MNISTClassifier ktse0hpy 2302c33b-8057-4d3f-95ed-2b84a8bc1992 -- POST / 200 288.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,429 mnist_classifier_MNISTClassifier ktse0hpy a50f9e6e-9690-42a4-90ca-eaa8d29f2a58 -- POST / 200 291.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,430 mnist_classifier_MNISTClassifier ktse0hpy b233dded-da6d-439d-8bb4-f5819a8e4459 -- POST / 200 288.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,430 mnist_classifier_MNISTClassifier ktse0hpy 68e5d390-fcca-4485-a734-90996b534ab3 -- POST / 200 288.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,433 mnist_classifier_MNISTClassifier ktse0hpy 5dd8ff19-7b2a-4469-ace4-c854ccff4128 -- POST / 200 291.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,435 mnist_classifier_MNISTClassifier ktse0hpy 8705c567-bbf3-45b5-b0bd-b7f6284ee568 -- POST / 200 292.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,435 mnist_classifier_MNISTClassifier ktse0hpy d387b6a9-69a5-42db-ad20-ad597114a6d0 -- POST / 200 289.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,435 mnist_classifier_MNISTClassifier ktse0hpy 9d4c96c1-7b46-4a4f-868c-436066d59baa -- POST / 200 287.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,436 mnist_classifier_MNISTClassifier ktse0hpy b181bacb-0d77-47c8-b0b2-30dd3c018920 -- POST / 200 276.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,437 mnist_classifier_MNISTClassifier ktse0hpy 9b8fabe5-def7-4e92-b7f3-f4a9482d9ef7 -- POST / 200 287.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,438 mnist_classifier_MNISTClassifier ktse0hpy 27a72993-9f7f-4f38-aeef-34f3c89364be -- POST / 200 277.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,438 mnist_classifier_MNISTClassifier ktse0hpy 909f7241-1e8e-4160-adea-10ed2153f6c8 -- POST / 200 285.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,439 mnist_classifier_MNISTClassifier ktse0hpy e46980e0-7c0e-4a15-b170-72c80975c271 -- POST / 200 285.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,440 mnist_classifier_MNISTClassifier ktse0hpy c6198e7c-7c70-4607-9ec1-eab04d2d4299 -- POST / 200 286.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,441 mnist_classifier_MNISTClassifier ktse0hpy 78fd0122-86fa-4c54-8231-ca5f49d2d601 -- POST / 200 286.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,442 mnist_classifier_MNISTClassifier ktse0hpy 647f0abf-1438-4d85-80ca-c21242b566d7 -- POST / 200 287.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,442 mnist_classifier_MNISTClassifier ktse0hpy 59876ce4-ebba-4265-b6b3-da8b9c6d1966 -- POST / 200 287.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,445 mnist_classifier_MNISTClassifier ktse0hpy dc2382c3-55e3-47b1-a1ee-94a4bd3b7071 -- POST / 200 285.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,446 mnist_classifier_MNISTClassifier ktse0hpy fd7f4c4e-792e-461f-a1b9-d64e117a4805 -- POST / 200 285.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,446 mnist_classifier_MNISTClassifier ktse0hpy b26f4232-cc3b-4a6e-b2f0-6923d61bcde2 -- POST / 200 276.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,447 mnist_classifier_MNISTClassifier ktse0hpy a0e0e863-6d6c-43f4-b259-1fb26b151bb3 -- POST / 200 274.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,447 mnist_classifier_MNISTClassifier ktse0hpy 1a33dbdd-dfd3-45a6-a8b1-89af8ce88a75 -- POST / 200 272.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,449 mnist_classifier_MNISTClassifier ktse0hpy 970948ec-8296-4651-8f4e-d4d22815a51d -- POST / 200 275.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,449 mnist_classifier_MNISTClassifier ktse0hpy 532611d1-95c6-475f-bcfc-d3346b5207b1 -- POST / 200 274.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,449 mnist_classifier_MNISTClassifier ktse0hpy 589d5aec-4558-4d7f-b757-6ebf44c3f9dd -- POST / 200 274.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,449 mnist_classifier_MNISTClassifier ktse0hpy b34fd8be-5f04-4957-97b8-482810af1882 -- POST / 200 274.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,450 mnist_classifier_MNISTClassifier ktse0hpy 1fc53afb-1b7b-4cf2-9efd-2040291c5fe2 -- POST / 200 275.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,450 mnist_classifier_MNISTClassifier ktse0hpy ab1e491f-1701-4d36-940c-d0c290db6379 -- POST / 200 275.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,454 mnist_classifier_MNISTClassifier ktse0hpy 08697bfc-f8ab-45fa-86bc-4c2b1b8cb336 -- POST / 200 278.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,456 mnist_classifier_MNISTClassifier ktse0hpy 8a52ba4b-c418-47a6-b4bd-538445edd012 -- POST / 200 279.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,457 mnist_classifier_MNISTClassifier ktse0hpy b7cae3dc-f974-4f3e-9503-35a4e3a23e82 -- POST / 200 281.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,458 mnist_classifier_MNISTClassifier ktse0hpy 96ef6e98-f659-4bd6-a2d6-6d8df9c62ba5 -- POST / 200 281.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,460 mnist_classifier_MNISTClassifier ktse0hpy 6f0403b8-8c33-4bc6-833d-8c3e9882203c -- POST / 200 284.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,461 mnist_classifier_MNISTClassifier ktse0hpy 4daeb98c-31c9-4705-9aae-bd74e4f0d3c0 -- POST / 200 284.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,461 mnist_classifier_MNISTClassifier ktse0hpy 6e692577-1cca-47fc-b9be-ae3b9aaf7c03 -- POST / 200 283.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,466 mnist_classifier_MNISTClassifier ktse0hpy e5603811-84e1-433b-8179-961dd19ee247 -- POST / 200 282.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,467 mnist_classifier_MNISTClassifier ktse0hpy cea591f4-7089-419f-88cd-8c5919b843b9 -- POST / 200 281.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,467 mnist_classifier_MNISTClassifier ktse0hpy 3b7a6f42-04df-48e4-98b6-f6e14f7e3400 -- POST / 200 279.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,467 mnist_classifier_MNISTClassifier ktse0hpy 03608015-8b04-4009-a8e6-90d63e2cbe10 -- POST / 200 279.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,467 mnist_classifier_MNISTClassifier ktse0hpy f193f001-2920-46ae-ba35-847638eb97c3 -- POST / 200 279.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,468 mnist_classifier_MNISTClassifier ktse0hpy c2d14f7f-40cf-43b4-85ad-27c52dfcada6 -- POST / 200 265.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,468 mnist_classifier_MNISTClassifier ktse0hpy c45285ae-f132-4cde-ba80-4a9e96530ed2 -- POST / 200 265.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,469 mnist_classifier_MNISTClassifier ktse0hpy 2f4ab4d6-090a-4087-a14d-1f654dce7aed -- POST / 200 263.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,475 mnist_classifier_MNISTClassifier ktse0hpy 0eda4470-2db3-4470-b960-d5246bf2d892 -- POST / 200 271.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,476 mnist_classifier_MNISTClassifier ktse0hpy 0439649f-7e2c-4dad-b447-284685c248b4 -- POST / 200 270.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,476 mnist_classifier_MNISTClassifier ktse0hpy 309df656-e3ab-41a1-a9df-6b00adc5ffa3 -- POST / 200 268.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,477 mnist_classifier_MNISTClassifier ktse0hpy 7ed2d180-6c82-4522-88d4-2dde3a124220 -- POST / 200 269.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,543 mnist_classifier_MNISTClassifier ktse0hpy a6b76332-cf90-4726-9d1e-1c258781e92a -- POST / 200 334.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,546 mnist_classifier_MNISTClassifier ktse0hpy 62047d7d-a555-4b92-89aa-8ea7b91abff6 -- POST / 200 337.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,549 mnist_classifier_MNISTClassifier ktse0hpy da210624-47fa-455b-8d2d-1be2b6948e23 -- POST / 200 339.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,558 mnist_classifier_MNISTClassifier ktse0hpy b2e37c12-606b-42be-870a-d493032cd1c5 -- POST / 200 346.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,561 mnist_classifier_MNISTClassifier ktse0hpy 4b303906-01c4-4287-bd8f-f8cee7150e7a -- POST / 200 282.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,561 mnist_classifier_MNISTClassifier ktse0hpy a2522f2d-ebe3-4bad-b0aa-165f81f9554a -- POST / 200 302.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,562 mnist_classifier_MNISTClassifier ktse0hpy 96b4e1ac-bae4-46bc-9a94-030b486af267 -- POST / 200 281.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,562 mnist_classifier_MNISTClassifier ktse0hpy 143db170-849f-4a5a-af33-6fe2dffcd3d0 -- POST / 200 286.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,563 mnist_classifier_MNISTClassifier ktse0hpy 5c912733-5478-4098-b6dd-b8a3f366f6ba -- POST / 200 281.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,563 mnist_classifier_MNISTClassifier ktse0hpy e3dc2054-a813-4205-a560-b5e0f6af3e30 -- POST / 200 280.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,565 mnist_classifier_MNISTClassifier ktse0hpy bb8a5efb-d635-4775-bf7b-5ba7e2897c37 -- POST / 200 280.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,567 mnist_classifier_MNISTClassifier ktse0hpy 76765d41-c3cf-41dd-bb31-90b2cae920c7 -- POST / 200 281.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,568 mnist_classifier_MNISTClassifier ktse0hpy 9230bccd-f0ec-42e5-a139-22551a302163 -- POST / 200 282.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,568 mnist_classifier_MNISTClassifier ktse0hpy cc9acfbf-fef4-430a-8f54-b36437d63303 -- POST / 200 281.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,569 mnist_classifier_MNISTClassifier ktse0hpy 350dcfeb-ac2b-46be-8225-3b4ac2e9b546 -- POST / 200 261.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,570 mnist_classifier_MNISTClassifier ktse0hpy 79ae1620-6344-4f6c-b48e-5452f57bab5e -- POST / 200 239.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,571 mnist_classifier_MNISTClassifier ktse0hpy 8c5f8938-07c8-45b9-96ec-8a630b8b3c1d -- POST / 200 239.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,572 mnist_classifier_MNISTClassifier ktse0hpy e8e9a541-2b89-4f9a-9a9d-0338c7b16788 -- POST / 200 237.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,573 mnist_classifier_MNISTClassifier ktse0hpy c2979f2f-0166-4850-b0f5-43508ef83475 -- POST / 200 235.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,575 mnist_classifier_MNISTClassifier ktse0hpy d82626eb-8d25-4b64-8082-f10675e21984 -- POST / 200 239.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,576 mnist_classifier_MNISTClassifier ktse0hpy 4c413450-bd07-4870-aaf2-1af926ca9355 -- POST / 200 238.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,576 mnist_classifier_MNISTClassifier ktse0hpy ce6c0604-7700-4438-bdc0-b59645b12ac7 -- POST / 200 236.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,577 mnist_classifier_MNISTClassifier ktse0hpy 998082e9-a44c-4a2d-96f4-b7007a442ddb -- POST / 200 236.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,577 mnist_classifier_MNISTClassifier ktse0hpy dc067708-451a-4257-9345-2be283ceaba6 -- POST / 200 235.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,578 mnist_classifier_MNISTClassifier ktse0hpy 4405e076-6982-4f68-91d2-3a5905834c7e -- POST / 200 235.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,579 mnist_classifier_MNISTClassifier ktse0hpy d702659f-9e82-4ad3-a1c3-539f7406ede8 -- POST / 200 236.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,579 mnist_classifier_MNISTClassifier ktse0hpy fcb6ab29-d69e-4373-bbff-a1b7050eb334 -- POST / 200 236.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,580 mnist_classifier_MNISTClassifier ktse0hpy 677e410f-adf4-41d9-960e-b0e5cc6cd90d -- POST / 200 237.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,581 mnist_classifier_MNISTClassifier ktse0hpy cedb07cc-8b02-48b3-8296-9c9681f97914 -- POST / 200 236.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,581 mnist_classifier_MNISTClassifier ktse0hpy a5ea2209-fd79-403b-86d5-9eabd153f3a8 -- POST / 200 234.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,581 mnist_classifier_MNISTClassifier ktse0hpy 6a253e71-f265-4778-9207-3cbc08d343ef -- POST / 200 232.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,581 mnist_classifier_MNISTClassifier ktse0hpy 7f50767c-8212-4323-99f7-8bab8de4bf54 -- POST / 200 233.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,581 mnist_classifier_MNISTClassifier ktse0hpy 297abbc1-87a5-4138-b950-dfbc536927f6 -- POST / 200 229.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,582 mnist_classifier_MNISTClassifier ktse0hpy 83d8beec-2043-4a32-9a93-1ddb474601f5 -- POST / 200 227.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,583 mnist_classifier_MNISTClassifier ktse0hpy 47ab89a5-9c36-4d44-8ca5-3b47676b90f2 -- POST / 200 228.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,584 mnist_classifier_MNISTClassifier ktse0hpy e352c114-4870-4ecc-b520-473781c52fb8 -- POST / 200 227.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,585 mnist_classifier_MNISTClassifier ktse0hpy ff9a7f81-e552-49f5-acdd-0b241bd4525b -- POST / 200 228.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,585 mnist_classifier_MNISTClassifier ktse0hpy 77c400ec-23a2-46ea-85dd-492b8078a5d3 -- POST / 200 229.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,690 mnist_classifier_MNISTClassifier ktse0hpy e67b60db-c8b9-43e1-a2fb-c87c53ae87ba -- POST / 200 257.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,693 mnist_classifier_MNISTClassifier ktse0hpy f6295ed9-e956-4f82-b2ac-70f37439ed57 -- POST / 200 251.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,694 mnist_classifier_MNISTClassifier ktse0hpy 883241f4-6de5-4718-96d8-a3dcab3850b5 -- POST / 200 237.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,695 mnist_classifier_MNISTClassifier ktse0hpy 80ca71fa-6704-482b-9505-35ae65e658f6 -- POST / 200 224.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,695 mnist_classifier_MNISTClassifier ktse0hpy d999eaef-3b82-4941-9fb3-5d43157f190d -- POST / 200 217.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,698 mnist_classifier_MNISTClassifier ktse0hpy 61e5312e-6969-46bf-bf4a-f01befea6b3c -- POST / 200 219.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,699 mnist_classifier_MNISTClassifier ktse0hpy 9f6c61b6-db89-4507-b273-a150a81f6a47 -- POST / 200 217.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,703 mnist_classifier_MNISTClassifier ktse0hpy d1eebb00-f7d2-4e7d-9dd9-7c55412f3e89 -- POST / 200 220.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,705 mnist_classifier_MNISTClassifier ktse0hpy 527140af-e13a-4502-bdaf-21c8ae007616 -- POST / 200 222.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,706 mnist_classifier_MNISTClassifier ktse0hpy 01c72e37-baca-42b6-bfc3-6bade7f78b8e -- POST / 200 221.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,706 mnist_classifier_MNISTClassifier ktse0hpy 3ed2293d-5d51-430d-a592-357c8bf62c80 -- POST / 200 216.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,707 mnist_classifier_MNISTClassifier ktse0hpy c7618a79-07f0-4c2e-a7af-e85e5154f249 -- POST / 200 216.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,708 mnist_classifier_MNISTClassifier ktse0hpy bdfb575b-f230-4976-b835-da79f94b9783 -- POST / 200 214.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,710 mnist_classifier_MNISTClassifier ktse0hpy 4982532d-bb58-441f-8f02-6dfabcaf4430 -- POST / 200 216.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,711 mnist_classifier_MNISTClassifier ktse0hpy 4be4dfbb-41f8-4a1d-bffc-781b1b6f94f0 -- POST / 200 224.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,711 mnist_classifier_MNISTClassifier ktse0hpy 70d8cd0e-482c-43c5-baf8-90c8d0f63610 -- POST / 200 217.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,711 mnist_classifier_MNISTClassifier ktse0hpy 3ad4c494-cbc2-4b7b-a80a-31d5a9cfd543 -- POST / 200 217.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,717 mnist_classifier_MNISTClassifier ktse0hpy a079fece-be77-4bb5-8f02-100ade1db8c2 -- POST / 200 222.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,718 mnist_classifier_MNISTClassifier ktse0hpy c064ba90-aa8f-4e5d-88ce-258536c2b18c -- POST / 200 221.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,718 mnist_classifier_MNISTClassifier ktse0hpy 66033e53-c96b-4988-b85d-0139506b327e -- POST / 200 219.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,719 mnist_classifier_MNISTClassifier ktse0hpy 4d697ffb-75de-4c7e-8b81-4d8b914f4db9 -- POST / 200 222.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,719 mnist_classifier_MNISTClassifier ktse0hpy 8d6b7923-5094-4ee2-a47c-8832dce45c27 -- POST / 200 221.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,719 mnist_classifier_MNISTClassifier ktse0hpy a25df696-0469-44bd-bf07-1d790b620b38 -- POST / 200 218.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,720 mnist_classifier_MNISTClassifier ktse0hpy 6fb2ac64-e9d2-4bd3-9bce-25594f9743d4 -- POST / 200 221.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,721 mnist_classifier_MNISTClassifier ktse0hpy 08c16f10-167e-47ad-aa90-9cfc4467e2d5 -- POST / 200 219.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,721 mnist_classifier_MNISTClassifier ktse0hpy 7201f2af-b9ee-485b-ab80-cacf31656210 -- POST / 200 218.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,722 mnist_classifier_MNISTClassifier ktse0hpy 1deadc4a-a3ad-4ac3-addb-d5a7b9e9d813 -- POST / 200 218.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,722 mnist_classifier_MNISTClassifier ktse0hpy 3603a980-234c-442b-96ef-c05c43daa2d9 -- POST / 200 218.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,722 mnist_classifier_MNISTClassifier ktse0hpy f216bac5-c395-41a5-bfa9-d7aaa68a0a3b -- POST / 200 217.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,723 mnist_classifier_MNISTClassifier ktse0hpy 621e4326-20ff-43fd-8876-04df33d7484c -- POST / 200 217.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,956 mnist_classifier_MNISTClassifier ktse0hpy e64285b6-002e-4abc-a263-c28b9a7bc1d0 -- POST / 200 449.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,956 mnist_classifier_MNISTClassifier ktse0hpy 057cfe06-18d0-48f1-b276-81b164b0740d -- POST / 200 448.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,971 mnist_classifier_MNISTClassifier ktse0hpy a94c2c4a-df95-4b18-99a6-93ecb4881d0d -- POST / 200 460.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,971 mnist_classifier_MNISTClassifier ktse0hpy 01d8873c-ecc0-4b71-877e-ec0f9d64d600 -- POST / 200 461.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,972 mnist_classifier_MNISTClassifier ktse0hpy a377a6a9-b326-4985-84e3-306a14bd0122 -- POST / 200 464.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,972 mnist_classifier_MNISTClassifier ktse0hpy 1d5316ab-f4f7-4eb4-9345-0c30128124bd -- POST / 200 463.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,982 mnist_classifier_MNISTClassifier ktse0hpy 752c5034-0ec0-4030-9901-37b6e241a05f -- POST / 200 471.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,990 mnist_classifier_MNISTClassifier ktse0hpy 6c75cb2c-c6fa-48e5-ad19-42b17f92be4d -- POST / 200 477.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,991 mnist_classifier_MNISTClassifier ktse0hpy da51535b-c954-47b7-91bd-b9f4561f4383 -- POST / 200 477.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,991 mnist_classifier_MNISTClassifier ktse0hpy b623804a-6d0f-48ad-81a1-717a51e5cccc -- POST / 200 479.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,991 mnist_classifier_MNISTClassifier ktse0hpy b04915d7-4ca5-4c70-9015-52d68c15115b -- POST / 200 478.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,992 mnist_classifier_MNISTClassifier ktse0hpy 043156d4-461f-43b5-8a74-ae575a0f00ea -- POST / 200 478.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,992 mnist_classifier_MNISTClassifier ktse0hpy 9a7d4601-f536-4f06-91b5-55edddb8e76b -- POST / 200 474.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,992 mnist_classifier_MNISTClassifier ktse0hpy 9d1cc5f9-119a-4052-8fac-f9b7aeec2677 -- POST / 200 476.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,992 mnist_classifier_MNISTClassifier ktse0hpy 3bf8638d-5fa1-4c81-a18c-530ebaed6cc8 -- POST / 200 476.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,993 mnist_classifier_MNISTClassifier ktse0hpy 6ceaa75c-2c58-4b42-8617-286d302b5997 -- POST / 200 473.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,993 mnist_classifier_MNISTClassifier ktse0hpy c663fee7-ad70-4239-83e0-2b2c48a4a95f -- POST / 200 450.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:47,993 mnist_classifier_MNISTClassifier ktse0hpy 8376449d-77db-42de-abc3-2515299ed6c8 -- POST / 200 404.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,066 mnist_classifier_MNISTClassifier ktse0hpy 753dd5c7-da76-441b-bb17-f0ec2d6e8c0b -- POST / 200 517.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,067 mnist_classifier_MNISTClassifier ktse0hpy f16ca757-e970-46b5-a9d6-5ebf67a7d4da -- POST / 200 518.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,067 mnist_classifier_MNISTClassifier ktse0hpy 9f90432b-c782-4f86-8975-14c41be94c76 -- POST / 200 518.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,068 mnist_classifier_MNISTClassifier ktse0hpy 91b3cafa-2824-4787-9e5b-4e360eae218f -- POST / 200 504.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,069 mnist_classifier_MNISTClassifier ktse0hpy 60bb622a-41d8-4328-a6ae-909cec7a7ab0 -- POST / 200 480.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,069 mnist_classifier_MNISTClassifier ktse0hpy 33f2d73d-e443-4d03-8af9-e94d33260cec -- POST / 200 466.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,069 mnist_classifier_MNISTClassifier ktse0hpy 120b1b91-de9f-4a40-8b49-b12ca6eed981 -- POST / 200 474.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,070 mnist_classifier_MNISTClassifier ktse0hpy 58f98a2e-00f7-4fab-946e-4b1ad6b83de3 -- POST / 200 468.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,070 mnist_classifier_MNISTClassifier ktse0hpy f34962b9-7f9e-4e3b-bcd6-e33bcd7c9879 -- POST / 200 468.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,070 mnist_classifier_MNISTClassifier ktse0hpy 529d9ff1-da45-4948-84af-2691212b56db -- POST / 200 467.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,071 mnist_classifier_MNISTClassifier ktse0hpy 65b8ee94-7676-444c-bc6f-28058e85089a -- POST / 200 467.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,072 mnist_classifier_MNISTClassifier ktse0hpy a74584fd-d5c7-4ead-a1d4-daa2653235ec -- POST / 200 467.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,072 mnist_classifier_MNISTClassifier ktse0hpy 6c88390c-a7db-49f3-86ec-13848959099c -- POST / 200 440.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,073 mnist_classifier_MNISTClassifier ktse0hpy a3c5c752-0ba8-40bc-b4c4-168010cff13d -- POST / 200 467.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,075 mnist_classifier_MNISTClassifier ktse0hpy 020f76c5-21a0-444d-b495-3e28cadaaed7 -- POST / 200 468.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,075 mnist_classifier_MNISTClassifier ktse0hpy 52009044-1493-4e7a-9a6a-78ff30bbacb9 -- POST / 200 467.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,076 mnist_classifier_MNISTClassifier ktse0hpy c5cd43e4-2982-4983-b43f-09e67e5422a6 -- POST / 200 467.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,076 mnist_classifier_MNISTClassifier ktse0hpy 386460da-113c-43fd-bb56-13bb3401b468 -- POST / 200 453.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,083 mnist_classifier_MNISTClassifier ktse0hpy 7a587d93-0f35-4c2b-8b86-9552afb5af05 -- POST / 200 458.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,085 mnist_classifier_MNISTClassifier ktse0hpy 63f232ef-f0fa-4ea3-a4f1-c67b1ce6a886 -- POST / 200 459.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,085 mnist_classifier_MNISTClassifier ktse0hpy cc480688-e028-49c7-9b82-3a32b7691609 -- POST / 200 456.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,085 mnist_classifier_MNISTClassifier ktse0hpy 4798d37c-bd19-4c27-aa19-5ff205adc3df -- POST / 200 456.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,086 mnist_classifier_MNISTClassifier ktse0hpy bfa22bdb-9d46-4ccd-907d-61b6dcba76ec -- POST / 200 455.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,086 mnist_classifier_MNISTClassifier ktse0hpy 359c5f4c-c773-4ace-8cd1-08f3155ba7fa -- POST / 200 450.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,086 mnist_classifier_MNISTClassifier ktse0hpy ab645f46-caa4-4af2-8f18-739ec7a1fdef -- POST / 200 450.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,086 mnist_classifier_MNISTClassifier ktse0hpy 71d4c00a-dcbf-45c5-ab95-31f707b89b96 -- POST / 200 448.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,086 mnist_classifier_MNISTClassifier ktse0hpy e83fa9d3-d0d1-470f-af45-c68dac59bba3 -- POST / 200 448.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,087 mnist_classifier_MNISTClassifier ktse0hpy 07202b0c-6521-4ce2-8b18-be7d58e6dd8b -- POST / 200 446.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,087 mnist_classifier_MNISTClassifier ktse0hpy 2aeee642-145d-420d-b352-732cde00fb92 -- POST / 200 445.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,087 mnist_classifier_MNISTClassifier ktse0hpy db546fdd-a445-4e27-a546-298b2ec87017 -- POST / 200 445.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,087 mnist_classifier_MNISTClassifier ktse0hpy e0cd368d-2535-4016-9522-f7b73d3ec1be -- POST / 200 443.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,088 mnist_classifier_MNISTClassifier ktse0hpy 736d9330-3594-40df-8193-c691f19b89ee -- POST / 200 442.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,088 mnist_classifier_MNISTClassifier ktse0hpy 6ab81778-df4a-44c7-88ca-8cd506783731 -- POST / 200 440.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,088 mnist_classifier_MNISTClassifier ktse0hpy b0051185-dbe4-4d0b-8791-6dc27f59dd57 -- POST / 200 439.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,088 mnist_classifier_MNISTClassifier ktse0hpy c620da0c-9c81-482f-baa1-8c757be55402 -- POST / 200 436.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,088 mnist_classifier_MNISTClassifier ktse0hpy 31766d7f-f7fb-4b4c-aa23-cd6c4cd9c12a -- POST / 200 435.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,088 mnist_classifier_MNISTClassifier ktse0hpy 88fc5b49-5e67-4351-a856-f3cea9edf289 -- POST / 200 434.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,089 mnist_classifier_MNISTClassifier ktse0hpy ca544220-fd45-42e1-a81a-121ae3854a22 -- POST / 200 433.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,089 mnist_classifier_MNISTClassifier ktse0hpy f0310110-cf38-4c59-974f-0d49ebbad4bd -- POST / 200 430.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,089 mnist_classifier_MNISTClassifier ktse0hpy 27b50d45-18ab-4f7c-b9c7-d1eef2477319 -- POST / 200 429.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,089 mnist_classifier_MNISTClassifier ktse0hpy 0319bb2a-2507-45b2-aeb9-e9c90706d0cd -- POST / 200 426.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,090 mnist_classifier_MNISTClassifier ktse0hpy 5ed38c8f-e229-4062-ac8e-b4adff8d5270 -- POST / 200 426.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,090 mnist_classifier_MNISTClassifier ktse0hpy ed675303-d4d3-49e4-9ac6-6b3f024c0481 -- POST / 200 426.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,090 mnist_classifier_MNISTClassifier ktse0hpy 3d7cac0d-a969-48ea-876e-38071a346f90 -- POST / 200 425.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,090 mnist_classifier_MNISTClassifier ktse0hpy 54ae2397-894e-4d6c-ac35-a85f90372579 -- POST / 200 424.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,090 mnist_classifier_MNISTClassifier ktse0hpy 388380d2-cb1a-4057-b0a9-e617eaa16ea2 -- POST / 200 424.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,091 mnist_classifier_MNISTClassifier ktse0hpy 4de69415-894a-4c69-92b6-4a76fe77cc49 -- POST / 200 424.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,091 mnist_classifier_MNISTClassifier ktse0hpy 140843ef-a691-41f4-b676-26850281e0a9 -- POST / 200 423.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,091 mnist_classifier_MNISTClassifier ktse0hpy f51b461b-5689-4226-9e42-794a802d1155 -- POST / 200 422.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,091 mnist_classifier_MNISTClassifier ktse0hpy 27a651b3-2fc3-4a06-b3fb-964ef9a4a86d -- POST / 200 421.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,091 mnist_classifier_MNISTClassifier ktse0hpy 4cd589a1-adf8-4564-8f28-99194cfc325e -- POST / 200 420.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,092 mnist_classifier_MNISTClassifier ktse0hpy bb4221c1-b182-47bd-8c13-095af3c46370 -- POST / 200 421.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,092 mnist_classifier_MNISTClassifier ktse0hpy 88a7efc6-62fa-4546-886f-f42f0c7963ed -- POST / 200 382.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,092 mnist_classifier_MNISTClassifier ktse0hpy 452e9d48-5fde-4c10-a203-291e66b5ff2f -- POST / 200 372.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,093 mnist_classifier_MNISTClassifier ktse0hpy ec1a79a0-0743-4360-91ef-a2f62a5c6f03 -- POST / 200 369.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,093 mnist_classifier_MNISTClassifier ktse0hpy 24d94dd5-c41c-4f16-9c23-f658326c39eb -- POST / 200 369.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,095 mnist_classifier_MNISTClassifier ktse0hpy 96233d25-9cd1-496b-9312-d52e45b329bd -- POST / 200 365.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,095 mnist_classifier_MNISTClassifier ktse0hpy 711c0003-386a-4d87-a594-b3d729c6c1c2 -- POST / 200 369.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,096 mnist_classifier_MNISTClassifier ktse0hpy 5e5e4daa-7637-49f8-981d-dd8c56cf26f6 -- POST / 200 366.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,096 mnist_classifier_MNISTClassifier ktse0hpy bd03caae-b527-4e23-b87c-88f0d1157fb2 -- POST / 200 367.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,098 mnist_classifier_MNISTClassifier ktse0hpy 49af0b4a-3a19-4e0c-9580-7892646c9131 -- POST / 200 367.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,098 mnist_classifier_MNISTClassifier ktse0hpy c768e897-5882-4d90-9808-5dd29626d605 -- POST / 200 367.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,099 mnist_classifier_MNISTClassifier ktse0hpy 42feb5a7-c125-4558-95c1-4e20cc199f82 -- POST / 200 365.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,099 mnist_classifier_MNISTClassifier ktse0hpy 3d2b0096-d7bf-49fa-98c8-7277a1a64883 -- POST / 200 364.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,099 mnist_classifier_MNISTClassifier ktse0hpy 04b8673f-0d3c-4977-8af1-ec2a11c0f584 -- POST / 200 363.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,101 mnist_classifier_MNISTClassifier ktse0hpy 8438027e-30a8-42fd-9f73-5a8e9a823ee1 -- POST / 200 353.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,102 mnist_classifier_MNISTClassifier ktse0hpy a6dfc03b-216c-42c8-882b-42bd09212aef -- POST / 200 351.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,103 mnist_classifier_MNISTClassifier ktse0hpy 505270a2-7437-434a-baed-d54ca398bf6c -- POST / 200 351.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,104 mnist_classifier_MNISTClassifier ktse0hpy 6d84ae79-f6f9-46c8-bd83-788769d4c153 -- POST / 200 348.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,105 mnist_classifier_MNISTClassifier ktse0hpy 6cb17058-823f-4731-949a-b3b12621044c -- POST / 200 348.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,105 mnist_classifier_MNISTClassifier ktse0hpy 5b9ab348-c89b-4421-a4ec-6615de42e63d -- POST / 200 348.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,105 mnist_classifier_MNISTClassifier ktse0hpy 8b499f3e-c9e9-4afc-8d44-0c94815a479d -- POST / 200 207.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,106 mnist_classifier_MNISTClassifier ktse0hpy 850c67bf-80b1-4238-a113-9853d1dc03a3 -- POST / 200 206.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,106 mnist_classifier_MNISTClassifier ktse0hpy aebb3d9f-4101-4b83-ae66-6c9ec0e1feda -- POST / 200 206.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,107 mnist_classifier_MNISTClassifier ktse0hpy 1c6280f6-1373-4b1d-ac85-abcea1d8944f -- POST / 200 206.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,107 mnist_classifier_MNISTClassifier ktse0hpy 7e94464f-9664-4804-a1fa-3a255b326b8e -- POST / 200 206.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,108 mnist_classifier_MNISTClassifier ktse0hpy ba1c8999-db3d-498e-9761-482e45419e29 -- POST / 200 206.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,108 mnist_classifier_MNISTClassifier ktse0hpy a52b873e-4354-442a-bc2d-75979fa89171 -- POST / 200 207.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,108 mnist_classifier_MNISTClassifier ktse0hpy 340aa94a-a7a3-425d-8039-440a9c963379 -- POST / 200 207.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,109 mnist_classifier_MNISTClassifier ktse0hpy 34a2c7b7-7ab7-49f3-8f35-0e9c83cf6f0f -- POST / 200 206.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,109 mnist_classifier_MNISTClassifier ktse0hpy 9f855874-845a-46c0-ae55-1d3513614271 -- POST / 200 204.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,109 mnist_classifier_MNISTClassifier ktse0hpy f22a52c6-296d-4a8a-bce7-f98d04902a1f -- POST / 200 204.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,110 mnist_classifier_MNISTClassifier ktse0hpy bb2ea69c-276b-49a8-8332-9200c6d392bb -- POST / 200 182.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,110 mnist_classifier_MNISTClassifier ktse0hpy 3f5ae912-e480-4ecc-93f5-7e2cdaa66e41 -- POST / 200 178.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,110 mnist_classifier_MNISTClassifier ktse0hpy a8af85f8-8aa5-49a4-843f-f63938de4167 -- POST / 200 175.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,111 mnist_classifier_MNISTClassifier ktse0hpy 5c1046ce-207c-48d5-b0f7-94f60870df65 -- POST / 200 167.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,111 mnist_classifier_MNISTClassifier ktse0hpy 1e5c7a8e-ba94-4f7e-9f9a-aa29a8f864ab -- POST / 200 166.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,111 mnist_classifier_MNISTClassifier ktse0hpy beff7615-6b6d-430c-8fbc-5e1944ae168c -- POST / 200 164.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,112 mnist_classifier_MNISTClassifier ktse0hpy 2ec43e0b-8aaf-4296-8498-1200582af006 -- POST / 200 163.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,112 mnist_classifier_MNISTClassifier ktse0hpy cd28cc5b-72a2-4b3c-bd30-9fee6501f6f9 -- POST / 200 163.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,112 mnist_classifier_MNISTClassifier ktse0hpy 83ac5a9e-b966-4ccc-9f8f-d433977eff32 -- POST / 200 161.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,112 mnist_classifier_MNISTClassifier ktse0hpy 85fa35d2-a28b-4d54-90cb-8f7eee1327ba -- POST / 200 163.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,113 mnist_classifier_MNISTClassifier ktse0hpy 68cd60ca-2d6c-41fc-98b9-2458519cede4 -- POST / 200 161.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,113 mnist_classifier_MNISTClassifier ktse0hpy 155b36e4-4974-4f96-b0e8-df7d1ead1974 -- POST / 200 161.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,179 mnist_classifier_MNISTClassifier ktse0hpy 576febbf-4e58-4720-9000-b1845f752eb0 -- POST / 200 169.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,208 mnist_classifier_MNISTClassifier ktse0hpy ef9205c3-1417-4e5d-9781-f38f9d1ac03c -- POST / 200 197.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,209 mnist_classifier_MNISTClassifier ktse0hpy d9c05450-3034-4a46-937a-a9fc41dfcf77 -- POST / 200 197.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,209 mnist_classifier_MNISTClassifier ktse0hpy ae63c56a-f2a3-4368-9cea-93e216f332c2 -- POST / 200 196.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,209 mnist_classifier_MNISTClassifier ktse0hpy 08eb0257-1b31-4144-beed-af8fce24b36a -- POST / 200 196.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,209 mnist_classifier_MNISTClassifier ktse0hpy c74b32f6-7b87-4589-8189-09d0cd97516c -- POST / 200 196.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,337 mnist_classifier_MNISTClassifier ktse0hpy ac818a54-cbef-4887-b104-b1f381046cc7 -- POST / 200 262.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,339 mnist_classifier_MNISTClassifier ktse0hpy 32dbe5bf-8e9a-42a5-9f8b-54259e4c1037 -- POST / 200 265.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,343 mnist_classifier_MNISTClassifier ktse0hpy 4aa01472-b095-45ec-8636-244e1845e5e0 -- POST / 200 260.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,344 mnist_classifier_MNISTClassifier ktse0hpy e5c1d1ba-c921-4ac1-a44b-a004978e1d03 -- POST / 200 269.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,344 mnist_classifier_MNISTClassifier ktse0hpy 6a53efcd-9343-43c8-92d5-f3e84234562f -- POST / 200 246.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,345 mnist_classifier_MNISTClassifier ktse0hpy 634e2608-b088-42bb-9673-8db6b2566205 -- POST / 200 221.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,345 mnist_classifier_MNISTClassifier ktse0hpy a4fb8d1c-b8c6-4966-8b22-fd79485f84c0 -- POST / 200 226.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,345 mnist_classifier_MNISTClassifier ktse0hpy 5cac7a91-c01a-4eca-b2ea-c3eff94dd527 -- POST / 200 225.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,346 mnist_classifier_MNISTClassifier ktse0hpy 1a293884-70dc-4fde-8178-10a810485776 -- POST / 200 226.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,347 mnist_classifier_MNISTClassifier ktse0hpy 3215d546-f7f3-4a0d-bfde-104ab3c13403 -- POST / 200 218.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,348 mnist_classifier_MNISTClassifier ktse0hpy 73b8b431-ad80-41d9-8335-d2c21a8448d9 -- POST / 200 218.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,480 mnist_classifier_MNISTClassifier ktse0hpy 736c0489-162a-4070-8346-88980703dd3c -- POST / 200 263.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,481 mnist_classifier_MNISTClassifier ktse0hpy b6ec499e-c0a8-48ff-a1f9-9cb8120f53a9 -- POST / 200 269.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,481 mnist_classifier_MNISTClassifier ktse0hpy 6594ed25-bef1-4733-946a-17abe9a3d7a0 -- POST / 200 267.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,482 mnist_classifier_MNISTClassifier ktse0hpy d04e2142-f23c-4b2f-9cbe-b3e99bb94202 -- POST / 200 268.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,483 mnist_classifier_MNISTClassifier ktse0hpy 4b9f28da-28ab-4a43-a36e-49f603730981 -- POST / 200 268.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,483 mnist_classifier_MNISTClassifier ktse0hpy b3888b10-616e-4bb6-9540-9ed8abbf39fb -- POST / 200 268.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,485 mnist_classifier_MNISTClassifier ktse0hpy 16fb7718-c5c3-4e33-a62a-db1df842db1e -- POST / 200 270.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,486 mnist_classifier_MNISTClassifier ktse0hpy 4726a637-cf10-42a0-b560-2b272469e812 -- POST / 200 271.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,486 mnist_classifier_MNISTClassifier ktse0hpy b869c6d5-17d0-4bc5-85b2-d458269541c1 -- POST / 200 271.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,487 mnist_classifier_MNISTClassifier ktse0hpy f5dbc692-edd4-48ba-958f-cc622bd9bcb9 -- POST / 200 271.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,487 mnist_classifier_MNISTClassifier ktse0hpy 8e79293f-99e7-4358-b809-7609ac6753ff -- POST / 200 271.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,487 mnist_classifier_MNISTClassifier ktse0hpy 72adb53b-4ce9-4813-9574-2c709df70d67 -- POST / 200 271.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,488 mnist_classifier_MNISTClassifier ktse0hpy a35736f9-502a-4c86-9a28-3bab1e65b73a -- POST / 200 271.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,488 mnist_classifier_MNISTClassifier ktse0hpy fe4b3316-7d91-4ade-8acd-51b94bdb2239 -- POST / 200 271.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,488 mnist_classifier_MNISTClassifier ktse0hpy 279000ba-10e1-42d1-9458-fa8935faa4de -- POST / 200 271.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,489 mnist_classifier_MNISTClassifier ktse0hpy 586bd7a7-9447-4420-b032-ebe89f29d16d -- POST / 200 272.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,489 mnist_classifier_MNISTClassifier ktse0hpy e63d9fd8-6adf-46bb-9768-1f14837f4d4a -- POST / 200 272.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,489 mnist_classifier_MNISTClassifier ktse0hpy e7cda335-09f5-4c0b-a6aa-e2e8c0abcc40 -- POST / 200 360.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,490 mnist_classifier_MNISTClassifier ktse0hpy c57b3cda-e1dd-477d-9157-fea57a5db668 -- POST / 200 359.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,490 mnist_classifier_MNISTClassifier ktse0hpy b0cb458e-ae78-43f0-b546-4f652c56b195 -- POST / 200 357.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,491 mnist_classifier_MNISTClassifier ktse0hpy 39614d22-c821-48db-8f00-1beed134004b -- POST / 200 357.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,491 mnist_classifier_MNISTClassifier ktse0hpy cdb8937c-10b5-4b69-8487-91a2525b4b55 -- POST / 200 356.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,492 mnist_classifier_MNISTClassifier ktse0hpy b6761447-2a62-4662-b2ec-b505b2f4214c -- POST / 200 355.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,493 mnist_classifier_MNISTClassifier ktse0hpy f0171fd9-19a9-4da6-886a-d77ff4d98f7c -- POST / 200 356.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,493 mnist_classifier_MNISTClassifier ktse0hpy 06a6931f-43d1-4030-879b-0e31ae8ecfac -- POST / 200 355.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,493 mnist_classifier_MNISTClassifier ktse0hpy f8e9299b-517f-4da7-86b3-2bdb8fb4c536 -- POST / 200 353.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,494 mnist_classifier_MNISTClassifier ktse0hpy 2815c86a-6fa6-4158-8bc6-e5a1958e85f2 -- POST / 200 354.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,494 mnist_classifier_MNISTClassifier ktse0hpy 2cc855f6-f031-4fe1-b00b-969bf7831334 -- POST / 200 353.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,495 mnist_classifier_MNISTClassifier ktse0hpy 61b16af2-76a0-470b-9fe0-1aa2547d0576 -- POST / 200 353.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,496 mnist_classifier_MNISTClassifier ktse0hpy a375c44e-7a9e-4c5d-9687-bb2148515a4d -- POST / 200 353.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,497 mnist_classifier_MNISTClassifier ktse0hpy c4f0b0c1-8faf-46ce-b69c-db913dce42e7 -- POST / 200 352.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,497 mnist_classifier_MNISTClassifier ktse0hpy 2fb82236-5f30-4ea0-9de2-17d7a7415864 -- POST / 200 352.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,498 mnist_classifier_MNISTClassifier ktse0hpy 14153365-e608-4a07-8404-1ce5e6aa7e37 -- POST / 200 352.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,499 mnist_classifier_MNISTClassifier ktse0hpy 7a52b1ad-cb5a-453f-976d-0beadd85130c -- POST / 200 342.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,499 mnist_classifier_MNISTClassifier ktse0hpy 474bae94-9152-463d-95e4-27467e6639ae -- POST / 200 341.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,500 mnist_classifier_MNISTClassifier ktse0hpy 5122a2a3-6458-45e9-939f-9dfbbe9c2dbd -- POST / 200 333.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,501 mnist_classifier_MNISTClassifier ktse0hpy 55fe3831-dfc7-4f9f-bb64-81ed2a291356 -- POST / 200 329.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,501 mnist_classifier_MNISTClassifier ktse0hpy b167c2ea-ebd4-430a-afe5-36252aae44c0 -- POST / 200 283.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,501 mnist_classifier_MNISTClassifier ktse0hpy 3333ec1f-3db4-4fb1-b6d5-84052abb1f4d -- POST / 200 283.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,502 mnist_classifier_MNISTClassifier ktse0hpy ec412a8f-254c-43fe-aded-470515766f62 -- POST / 200 284.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,502 mnist_classifier_MNISTClassifier ktse0hpy 86ff4c91-f6fa-4c60-a874-8cf4296bf690 -- POST / 200 284.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,506 mnist_classifier_MNISTClassifier ktse0hpy dfd42b5e-e770-46e3-bf07-a59e237ee2f6 -- POST / 200 287.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,507 mnist_classifier_MNISTClassifier ktse0hpy 630a78a9-fc3d-4406-b897-a5cb3f6f3e12 -- POST / 200 288.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,507 mnist_classifier_MNISTClassifier ktse0hpy 3eba195d-a249-45ae-81cd-226168e34494 -- POST / 200 288.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,507 mnist_classifier_MNISTClassifier ktse0hpy 3ebfe1c5-4317-4d7f-9b4b-f267a0291e31 -- POST / 200 288.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,508 mnist_classifier_MNISTClassifier ktse0hpy ce16315c-ffc1-4d9c-9219-75cf045a6e41 -- POST / 200 287.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,511 mnist_classifier_MNISTClassifier ktse0hpy 977a4c2c-c6ab-4382-be67-b38cdde1ac4a -- POST / 200 289.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,513 mnist_classifier_MNISTClassifier ktse0hpy bafe27e9-da47-4e6a-adc2-4926905c5cd9 -- POST / 200 269.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,521 mnist_classifier_MNISTClassifier ktse0hpy eba97f27-429d-4487-83bd-c41d5f43744e -- POST / 200 276.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,521 mnist_classifier_MNISTClassifier ktse0hpy 25383255-adf8-43ae-a440-3d46d14c1565 -- POST / 200 276.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,521 mnist_classifier_MNISTClassifier ktse0hpy 37437ed2-3d5b-4964-806b-28722e961c15 -- POST / 200 275.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,521 mnist_classifier_MNISTClassifier ktse0hpy 7f092e05-fcf2-415a-be79-6f4b1488096b -- POST / 200 273.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,522 mnist_classifier_MNISTClassifier ktse0hpy 28de1780-d5f2-416d-b2e9-9d7049060374 -- POST / 200 273.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,522 mnist_classifier_MNISTClassifier ktse0hpy c80b65d5-5ae0-47bd-8eab-dbe75ae6bd83 -- POST / 200 271.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,522 mnist_classifier_MNISTClassifier ktse0hpy 745bfd8d-29cd-4b4e-90c1-e0523abbc13b -- POST / 200 271.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,522 mnist_classifier_MNISTClassifier ktse0hpy 78143be6-7603-4c50-8ea4-80c8ad6aa1f5 -- POST / 200 270.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,523 mnist_classifier_MNISTClassifier ktse0hpy 904643e7-a27d-4a5a-9e1e-4ffa52bb09d0 -- POST / 200 269.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,523 mnist_classifier_MNISTClassifier ktse0hpy ee20def8-7ff4-4d2a-9bcf-cdc675218c65 -- POST / 200 269.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,526 mnist_classifier_MNISTClassifier ktse0hpy f9f3116c-510c-4d90-b93f-7eb0d74dad55 -- POST / 200 271.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,526 mnist_classifier_MNISTClassifier ktse0hpy 5402c740-325b-4344-8c7d-c190df46a3d7 -- POST / 200 271.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,527 mnist_classifier_MNISTClassifier ktse0hpy a4f6e293-4670-44eb-9034-e7eca43b729e -- POST / 200 270.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,528 mnist_classifier_MNISTClassifier ktse0hpy 1f827d88-545d-42fd-8b98-5d507dcc35e6 -- POST / 200 271.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,529 mnist_classifier_MNISTClassifier ktse0hpy ab7c5f5a-cb98-4785-be85-01a8f56e9500 -- POST / 200 270.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,532 mnist_classifier_MNISTClassifier ktse0hpy 8e00e855-1ea4-442f-a5e5-340e1b42f35a -- POST / 200 273.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,532 mnist_classifier_MNISTClassifier ktse0hpy a4ffdc2d-e4f3-4e88-a501-f7725477a225 -- POST / 200 273.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,533 mnist_classifier_MNISTClassifier ktse0hpy 3e822f10-f156-4ef9-bffa-858d07b24fa5 -- POST / 200 273.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,535 mnist_classifier_MNISTClassifier ktse0hpy e39c1d75-6db3-4ffa-b512-8a37888097f0 -- POST / 200 232.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,536 mnist_classifier_MNISTClassifier ktse0hpy 1f3ccd4a-3f72-486c-85f0-013399380a82 -- POST / 200 227.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,536 mnist_classifier_MNISTClassifier ktse0hpy be0fe567-0b76-44b6-ab61-f3a6e156cd27 -- POST / 200 231.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,539 mnist_classifier_MNISTClassifier ktse0hpy a5cd6d22-b4b0-4929-9a1a-e6f4fb62ee56 -- POST / 200 235.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,541 mnist_classifier_MNISTClassifier ktse0hpy 5057b26f-740b-4cb3-a0be-ad1315d0e7a6 -- POST / 200 235.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,541 mnist_classifier_MNISTClassifier ktse0hpy bc7d5864-c361-44e4-98b2-4cb485037bb8 -- POST / 200 235.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,542 mnist_classifier_MNISTClassifier ktse0hpy aefc32fb-2236-4619-8dfc-6a4e52ea3752 -- POST / 200 218.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,544 mnist_classifier_MNISTClassifier ktse0hpy 019e41fa-5b99-4081-ab14-7e2b17e075cc -- POST / 200 217.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,544 mnist_classifier_MNISTClassifier ktse0hpy dc94d6cb-eebd-48fb-8bd8-e261105041e7 -- POST / 200 195.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,545 mnist_classifier_MNISTClassifier ktse0hpy 63d7604b-e1eb-4ad9-862e-a052d81dcd42 -- POST / 200 195.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,545 mnist_classifier_MNISTClassifier ktse0hpy 6d559f73-5b05-4a0a-b73d-1faa8530d968 -- POST / 200 178.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,545 mnist_classifier_MNISTClassifier ktse0hpy ff9a7067-769b-4d28-9325-5849c4799176 -- POST / 200 177.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,545 mnist_classifier_MNISTClassifier ktse0hpy aa6e823c-c53d-4948-9581-18292cced72f -- POST / 200 176.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,546 mnist_classifier_MNISTClassifier ktse0hpy 7162008a-acdf-4d36-96de-f99f753927dc -- POST / 200 173.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,546 mnist_classifier_MNISTClassifier ktse0hpy ca815d40-ce8d-4a9d-9283-440c99c74a3f -- POST / 200 172.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,546 mnist_classifier_MNISTClassifier ktse0hpy 0af543aa-80f1-4094-95f3-27669b466b66 -- POST / 200 172.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,546 mnist_classifier_MNISTClassifier ktse0hpy b118aa60-cc4d-4134-b8cd-3a134649bb5d -- POST / 200 172.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,549 mnist_classifier_MNISTClassifier ktse0hpy 01bea138-807b-458b-b797-105c3c2f9490 -- POST / 200 323.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,549 mnist_classifier_MNISTClassifier ktse0hpy 2a3079a7-d6d9-4ef7-9d4c-2d820960c635 -- POST / 200 323.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,549 mnist_classifier_MNISTClassifier ktse0hpy 3cebe613-7c98-439b-a049-ec8c437d25c7 -- POST / 200 323.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,549 mnist_classifier_MNISTClassifier ktse0hpy 8a2fc2dd-aa00-47e3-b9bb-b149d83d2c99 -- POST / 200 323.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,550 mnist_classifier_MNISTClassifier ktse0hpy 19d44aae-8cec-452a-96cd-657bd3d41728 -- POST / 200 323.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,550 mnist_classifier_MNISTClassifier ktse0hpy 1ca806d8-587a-4941-83b2-97464bb849ec -- POST / 200 322.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,550 mnist_classifier_MNISTClassifier ktse0hpy 294e8470-f50e-4daf-8c34-e11da4a45f3f -- POST / 200 322.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,551 mnist_classifier_MNISTClassifier ktse0hpy bbc8f990-b651-4e73-919e-ba5e9af147e4 -- POST / 200 322.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,551 mnist_classifier_MNISTClassifier ktse0hpy 6eda3316-a846-4745-97d6-369e86d23d9a -- POST / 200 320.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,551 mnist_classifier_MNISTClassifier ktse0hpy 2ac65283-348d-48de-93ed-66fc47386d33 -- POST / 200 320.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,551 mnist_classifier_MNISTClassifier ktse0hpy 52b85033-fb10-46ce-bd93-0a2ddf67a256 -- POST / 200 319.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,552 mnist_classifier_MNISTClassifier ktse0hpy 3d2d823e-0b31-4146-9b0e-2cc1749d79f3 -- POST / 200 316.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,552 mnist_classifier_MNISTClassifier ktse0hpy 5a1c6f12-9fbd-49f8-a9e9-6b3524f9f88e -- POST / 200 314.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,552 mnist_classifier_MNISTClassifier ktse0hpy 1a8fdf88-bd0b-4983-bc21-a99506c09cff -- POST / 200 313.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,552 mnist_classifier_MNISTClassifier ktse0hpy 812328c8-6d02-4a8a-a158-78cae12fb47c -- POST / 200 309.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,553 mnist_classifier_MNISTClassifier ktse0hpy 6d80af9c-deac-4ceb-9ab5-f52c2404e65b -- POST / 200 310.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,553 mnist_classifier_MNISTClassifier ktse0hpy be1de3b3-b003-4a89-b87f-f7edde075c29 -- POST / 200 310.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,884 mnist_classifier_MNISTClassifier ktse0hpy d59392ab-042b-4e64-ab4a-19fae0b811e8 -- POST / 200 371.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,885 mnist_classifier_MNISTClassifier ktse0hpy c3b6c03b-cece-4257-ad20-27c120f9763c -- POST / 200 331.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,886 mnist_classifier_MNISTClassifier ktse0hpy 4e519091-052d-406b-86bf-ccf14deb4068 -- POST / 200 329.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,886 mnist_classifier_MNISTClassifier ktse0hpy 186f4fa5-4274-4afc-83e0-56e978835c5b -- POST / 200 327.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,887 mnist_classifier_MNISTClassifier ktse0hpy ba6ae46f-905b-478f-9bcd-18ff27b2c571 -- POST / 200 327.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,887 mnist_classifier_MNISTClassifier ktse0hpy 80d018e7-4193-40b8-bb4c-33aa347b0e07 -- POST / 200 326.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,888 mnist_classifier_MNISTClassifier ktse0hpy 42ede513-5f40-47cd-b2e6-1a22bda62a44 -- POST / 200 324.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:48,889 mnist_classifier_MNISTClassifier ktse0hpy 0b08c1fd-ff58-4c5a-a015-2bbee1439905 -- POST / 200 326.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,058 mnist_classifier_MNISTClassifier ktse0hpy dd618e4c-b87f-4a9f-94d0-0af529656cd0 -- POST / 200 496.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,059 mnist_classifier_MNISTClassifier ktse0hpy c51034a4-0fe0-40a4-a03a-7b9e985190ee -- POST / 200 493.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,059 mnist_classifier_MNISTClassifier ktse0hpy 75261c10-79cd-423d-9871-effaca7ce5e0 -- POST / 200 493.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,059 mnist_classifier_MNISTClassifier ktse0hpy 07cb406d-ce60-417a-9f00-46d7c070b29d -- POST / 200 475.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,060 mnist_classifier_MNISTClassifier ktse0hpy ff9b9aa2-9b53-4c84-a0e4-05b9e5450cd1 -- POST / 200 474.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,061 mnist_classifier_MNISTClassifier ktse0hpy e74e5bb0-d122-4448-b1bb-39f149b35101 -- POST / 200 494.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,061 mnist_classifier_MNISTClassifier ktse0hpy 24829157-400a-4b93-8035-7690843a22d9 -- POST / 200 494.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,062 mnist_classifier_MNISTClassifier ktse0hpy 04f74d79-f2cf-4827-a1d6-69a1a8086117 -- POST / 200 494.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,063 mnist_classifier_MNISTClassifier ktse0hpy e3dd41e5-107a-4610-b37d-9564b6b03a45 -- POST / 200 495.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,064 mnist_classifier_MNISTClassifier ktse0hpy 550e905f-06c6-48cf-8e9f-897c13d5cd8e -- POST / 200 494.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,065 mnist_classifier_MNISTClassifier ktse0hpy ac18d268-8909-47f0-b88f-948143aac7d3 -- POST / 200 495.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,065 mnist_classifier_MNISTClassifier ktse0hpy a63335e7-4925-4206-8d76-0f34eb4163bd -- POST / 200 494.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,066 mnist_classifier_MNISTClassifier ktse0hpy 6a517d0a-3a71-4408-b071-1c71a42e2f6e -- POST / 200 494.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,066 mnist_classifier_MNISTClassifier ktse0hpy dacd748e-73dd-4917-a3a8-0c310ded93ff -- POST / 200 494.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,067 mnist_classifier_MNISTClassifier ktse0hpy 48547675-bc65-40e7-8240-547921e1452a -- POST / 200 494.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,068 mnist_classifier_MNISTClassifier ktse0hpy 42d60f86-c89f-4d38-8ed3-a0618007edb8 -- POST / 200 494.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,068 mnist_classifier_MNISTClassifier ktse0hpy e4860955-920b-4d3e-9221-eb3f0cbc3b73 -- POST / 200 493.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,069 mnist_classifier_MNISTClassifier ktse0hpy b0626457-0c9d-48a2-b3ad-e74eee2fd6e1 -- POST / 200 492.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,070 mnist_classifier_MNISTClassifier ktse0hpy aa5224fc-d6c5-463c-9a8d-1ee9192ddf60 -- POST / 200 492.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,070 mnist_classifier_MNISTClassifier ktse0hpy 064f261a-d7c5-4b6a-b2ca-95d883f1f765 -- POST / 200 491.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,070 mnist_classifier_MNISTClassifier ktse0hpy 552e1e7c-e48f-4ebb-b9c5-ee2dbaa14fba -- POST / 200 491.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,071 mnist_classifier_MNISTClassifier ktse0hpy 97dd6f41-a2c2-4ddb-a0a7-bcb51fac5022 -- POST / 200 491.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,071 mnist_classifier_MNISTClassifier ktse0hpy 5a782dd6-a52c-4d40-9e80-90e1ab55ab50 -- POST / 200 490.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,071 mnist_classifier_MNISTClassifier ktse0hpy 6f6d1323-5092-4ed1-8d4f-5655f0b0971d -- POST / 200 490.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,071 mnist_classifier_MNISTClassifier ktse0hpy 5d6af880-964d-4797-bbaf-5f6dbba6b52a -- POST / 200 490.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,072 mnist_classifier_MNISTClassifier ktse0hpy 7e9b93d0-5453-4003-9d57-d2bf054ce68c -- POST / 200 489.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,073 mnist_classifier_MNISTClassifier ktse0hpy 059b6c44-771d-4349-bb1c-e7cb613c0702 -- POST / 200 453.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,074 mnist_classifier_MNISTClassifier ktse0hpy 56db042f-4b2b-404b-9e8c-4c02a626ff0e -- POST / 200 488.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,077 mnist_classifier_MNISTClassifier ktse0hpy 39aae4f2-ca58-4fe4-a747-eb04f657ad89 -- POST / 200 490.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,080 mnist_classifier_MNISTClassifier ktse0hpy 087e0902-10ce-4cc4-8eec-dcbea749a936 -- POST / 200 492.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,081 mnist_classifier_MNISTClassifier ktse0hpy 96fd51fe-a0de-4626-8ced-94a35953051b -- POST / 200 493.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,082 mnist_classifier_MNISTClassifier ktse0hpy 29ca95ea-0074-4150-a4d0-eef54ce54593 -- POST / 200 492.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,085 mnist_classifier_MNISTClassifier ktse0hpy bb4bfdfa-5c52-4bca-9750-80f8f8a4534b -- POST / 200 419.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,103 mnist_classifier_MNISTClassifier ktse0hpy 330443aa-5376-45f5-81ca-47772fcfd910 -- POST / 200 423.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,104 mnist_classifier_MNISTClassifier ktse0hpy 566564c6-e320-427d-8e03-8b58b5940d32 -- POST / 200 423.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,105 mnist_classifier_MNISTClassifier ktse0hpy 4c9ce062-69fe-40c0-8e25-111a50f1c711 -- POST / 200 420.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,105 mnist_classifier_MNISTClassifier ktse0hpy 07e15af4-fcf8-4f54-beda-ec08555f636a -- POST / 200 420.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,105 mnist_classifier_MNISTClassifier ktse0hpy 20b8572a-437e-4445-b00e-09a399cbf5cc -- POST / 200 416.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,106 mnist_classifier_MNISTClassifier ktse0hpy f384a433-b6c7-4534-a227-62cef5ed50bc -- POST / 200 275.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,107 mnist_classifier_MNISTClassifier ktse0hpy c5627619-539d-41fe-b3df-5bb456158540 -- POST / 200 273.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,107 mnist_classifier_MNISTClassifier ktse0hpy c333f280-810b-44f3-a2b7-600e22e950c9 -- POST / 200 273.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,108 mnist_classifier_MNISTClassifier ktse0hpy 06661b04-f4ee-4cf2-a251-10813112e322 -- POST / 200 274.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,108 mnist_classifier_MNISTClassifier ktse0hpy 3700eb7f-a0e3-42b2-a8bd-45db22ab8075 -- POST / 200 272.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,108 mnist_classifier_MNISTClassifier ktse0hpy 03ca1386-380c-4416-9934-aefb9e4db805 -- POST / 200 271.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,109 mnist_classifier_MNISTClassifier ktse0hpy f9105642-2171-4010-aa4d-8bf021385ad9 -- POST / 200 271.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,110 mnist_classifier_MNISTClassifier ktse0hpy 90cd1e53-250e-43f5-8416-aef83fb8c647 -- POST / 200 272.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,110 mnist_classifier_MNISTClassifier ktse0hpy 0b29bc02-3a48-4607-95be-28608cdeb085 -- POST / 200 270.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,110 mnist_classifier_MNISTClassifier ktse0hpy 7c51a87b-aab5-4bf4-9bd0-e30bd541da6a -- POST / 200 269.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,110 mnist_classifier_MNISTClassifier ktse0hpy d24cda50-69a9-49d4-a868-efa29b310416 -- POST / 200 269.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,112 mnist_classifier_MNISTClassifier ktse0hpy e78cbb97-ee0e-479f-9352-c65a4a1775d7 -- POST / 200 268.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,112 mnist_classifier_MNISTClassifier ktse0hpy f8bc5cf1-b75a-4e6f-aa0c-612202bc032f -- POST / 200 269.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,114 mnist_classifier_MNISTClassifier ktse0hpy fae759be-bfa2-41ef-9cf6-26916bc15dbc -- POST / 200 270.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,115 mnist_classifier_MNISTClassifier ktse0hpy 4b2b83cc-759f-47fc-b2b0-a207994d76d8 -- POST / 200 524.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,115 mnist_classifier_MNISTClassifier ktse0hpy 23925e47-6e96-4d1b-82a6-18d3747e1ed8 -- POST / 200 524.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,115 mnist_classifier_MNISTClassifier ktse0hpy c66cc51b-60b0-4cd1-8258-c615a47af0cc -- POST / 200 524.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,116 mnist_classifier_MNISTClassifier ktse0hpy 03fb5322-4be4-4647-9203-54fefc6619f4 -- POST / 200 524.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,116 mnist_classifier_MNISTClassifier ktse0hpy 6022a676-56f1-4b97-b756-639afcdecf14 -- POST / 200 496.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,116 mnist_classifier_MNISTClassifier ktse0hpy 3d404109-b4f9-4ce1-9e0b-e801fb6d2150 -- POST / 200 522.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,116 mnist_classifier_MNISTClassifier ktse0hpy f6497b49-0ba9-4551-bf6c-5973dab631c8 -- POST / 200 498.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,116 mnist_classifier_MNISTClassifier ktse0hpy 57f6cc74-18a3-47ef-ae84-5a3bbcca43be -- POST / 200 487.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,117 mnist_classifier_MNISTClassifier ktse0hpy ddade53f-f2c0-483b-b9bd-0c77364b947a -- POST / 200 487.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,117 mnist_classifier_MNISTClassifier ktse0hpy 3c2be9b6-36bb-4f58-8c11-0fce08b61d1c -- POST / 200 488.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,117 mnist_classifier_MNISTClassifier ktse0hpy b954b533-bdaa-4ac2-b362-dc44209c89c4 -- POST / 200 483.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,118 mnist_classifier_MNISTClassifier ktse0hpy 817cc2fb-2c6b-4d35-88e8-5389c4016248 -- POST / 200 480.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,118 mnist_classifier_MNISTClassifier ktse0hpy 388c7480-bf05-4051-96d7-769d0d53ca5a -- POST / 200 480.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,118 mnist_classifier_MNISTClassifier ktse0hpy 7633e8ac-fddf-42f0-9635-d45cc7bcb4b2 -- POST / 200 479.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,118 mnist_classifier_MNISTClassifier ktse0hpy 15e5c6da-e66b-4cfe-9aed-72b235be03ce -- POST / 200 479.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,118 mnist_classifier_MNISTClassifier ktse0hpy fb91e715-9fd5-4f2d-beb9-3f12059ae173 -- POST / 200 479.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,119 mnist_classifier_MNISTClassifier ktse0hpy 077905a7-1d18-4141-8352-79a08863779e -- POST / 200 479.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,119 mnist_classifier_MNISTClassifier ktse0hpy d26d0e15-aa24-4eb0-8dbf-283022e5b52a -- POST / 200 478.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,119 mnist_classifier_MNISTClassifier ktse0hpy a41c8e33-f731-45e3-9fc9-41d3b5ca1309 -- POST / 200 477.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,119 mnist_classifier_MNISTClassifier ktse0hpy ccb61e4b-9891-426c-b7c9-23ec8b7d7e4e -- POST / 200 477.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,119 mnist_classifier_MNISTClassifier ktse0hpy 58f245f1-76bc-40a8-9d01-6ca374cc3ac2 -- POST / 200 476.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,119 mnist_classifier_MNISTClassifier ktse0hpy d3af3b10-a155-4d6c-a9eb-3e5f2bc27dd4 -- POST / 200 475.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,119 mnist_classifier_MNISTClassifier ktse0hpy 2d67507b-99ab-4181-90cd-d24c1faf502c -- POST / 200 473.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,119 mnist_classifier_MNISTClassifier ktse0hpy 59cec971-d815-4670-962f-4ac282308e68 -- POST / 200 475.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,120 mnist_classifier_MNISTClassifier ktse0hpy 2dfa98e9-bc50-413b-8cce-093b37fa1773 -- POST / 200 468.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,120 mnist_classifier_MNISTClassifier ktse0hpy 5e4ad2eb-a5bb-42a8-a7e7-f1f5c16517ab -- POST / 200 474.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,120 mnist_classifier_MNISTClassifier ktse0hpy a2e6ad4c-96a2-46bf-8c39-0af0931c3445 -- POST / 200 466.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,120 mnist_classifier_MNISTClassifier ktse0hpy dd305d02-2883-42d8-93d2-3646c7412d8f -- POST / 200 466.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,120 mnist_classifier_MNISTClassifier ktse0hpy 2c78bc1e-8c74-45cf-9807-5efc86ecffdb -- POST / 200 466.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,120 mnist_classifier_MNISTClassifier ktse0hpy 501745c1-5d63-42ad-9ecd-1b0fe5801560 -- POST / 200 466.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,120 mnist_classifier_MNISTClassifier ktse0hpy ea05ab32-ef39-43ae-a09e-3e7489a9a4be -- POST / 200 466.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,120 mnist_classifier_MNISTClassifier ktse0hpy 366ada0c-6810-45a5-94e1-6a7f61761504 -- POST / 200 466.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,121 mnist_classifier_MNISTClassifier ktse0hpy 52acd0ae-ffa7-4718-91b0-32d31bce2b92 -- POST / 200 465.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,121 mnist_classifier_MNISTClassifier ktse0hpy f34564dc-c19a-496c-91b9-e3df09b19298 -- POST / 200 464.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,121 mnist_classifier_MNISTClassifier ktse0hpy 20d0ed24-92bb-4d9d-ae9e-771cbaf822d4 -- POST / 200 464.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,121 mnist_classifier_MNISTClassifier ktse0hpy 8cccaddb-d63d-4f5f-880d-2bc93512b8e1 -- POST / 200 463.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,121 mnist_classifier_MNISTClassifier ktse0hpy 7f10369a-2372-4c6b-b706-0869055faec1 -- POST / 200 459.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,121 mnist_classifier_MNISTClassifier ktse0hpy fe507b60-2afc-4d17-b1c7-f621aff318bb -- POST / 200 458.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,121 mnist_classifier_MNISTClassifier ktse0hpy 3af54b6a-f066-404d-9f8c-bcdbb44ffc1b -- POST / 200 277.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,122 mnist_classifier_MNISTClassifier ktse0hpy 29ba3bbd-e73c-43ef-9fae-bd799e07a428 -- POST / 200 277.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,122 mnist_classifier_MNISTClassifier ktse0hpy 92f9c92c-cc41-4cce-8438-a2dfc30e6a19 -- POST / 200 256.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,122 mnist_classifier_MNISTClassifier ktse0hpy bff992d1-f783-445d-acc1-d6fe001d1f16 -- POST / 200 253.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,122 mnist_classifier_MNISTClassifier ktse0hpy bba2a350-f121-4578-95a2-d96a5ca02de9 -- POST / 200 251.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,122 mnist_classifier_MNISTClassifier ktse0hpy 436dedd1-b2c1-4b49-afd4-9fe3712996a2 -- POST / 200 250.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,122 mnist_classifier_MNISTClassifier ktse0hpy 81971a41-641a-4b60-9694-e7a321c55482 -- POST / 200 248.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,122 mnist_classifier_MNISTClassifier ktse0hpy fe715543-b513-4e33-af02-79c324fcfb3e -- POST / 200 242.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,123 mnist_classifier_MNISTClassifier ktse0hpy f5b50182-f762-4cc2-92bf-988ed5748cc7 -- POST / 200 243.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,123 mnist_classifier_MNISTClassifier ktse0hpy 0ef339e9-bbc3-4981-b5e8-6d74b10e6eb1 -- POST / 200 242.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,415 mnist_classifier_MNISTClassifier ktse0hpy 8370a134-285c-4037-bc08-dde6cd66f601 -- POST / 200 303.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,416 mnist_classifier_MNISTClassifier ktse0hpy 1e6167fa-4342-49d2-9729-8b6e66bb08d0 -- POST / 200 302.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,416 mnist_classifier_MNISTClassifier ktse0hpy 7e84b963-f904-49f7-b533-ae33e968b764 -- POST / 200 302.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,417 mnist_classifier_MNISTClassifier ktse0hpy d27399e3-d65f-4141-9ba0-062d9d0d61c8 -- POST / 200 293.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,418 mnist_classifier_MNISTClassifier ktse0hpy 12368b33-c82a-4ece-a0ca-339e94934423 -- POST / 200 290.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,418 mnist_classifier_MNISTClassifier ktse0hpy b7e1f19a-592a-4dd4-bb8b-9fb65e6f04bb -- POST / 200 289.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,419 mnist_classifier_MNISTClassifier ktse0hpy dfbe6fb6-9790-4278-be76-3d00dde67364 -- POST / 200 286.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,420 mnist_classifier_MNISTClassifier ktse0hpy 458847fd-20d7-4195-805a-a7fbc9fd3e82 -- POST / 200 286.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,421 mnist_classifier_MNISTClassifier ktse0hpy 4e1053df-dbe9-4392-bbaa-9b3c44b63ee3 -- POST / 200 287.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,423 mnist_classifier_MNISTClassifier ktse0hpy f29bbae1-2970-4e8e-ab1c-8a3f22ee0e2c -- POST / 200 171.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,424 mnist_classifier_MNISTClassifier ktse0hpy eb08bb2c-05ea-40b2-af16-f1e8b99194c6 -- POST / 200 289.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,424 mnist_classifier_MNISTClassifier ktse0hpy b8d6ea3d-fb12-437d-b415-f332407370cb -- POST / 200 288.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,425 mnist_classifier_MNISTClassifier ktse0hpy 4001c1bd-8a7f-496e-8ba6-102be7b72121 -- POST / 200 288.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,425 mnist_classifier_MNISTClassifier ktse0hpy 3b74c1d5-89d8-4996-8982-1e1baede42bb -- POST / 200 286.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,425 mnist_classifier_MNISTClassifier ktse0hpy d68547fd-7204-4af8-8a41-e84eeaa72025 -- POST / 200 285.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,426 mnist_classifier_MNISTClassifier ktse0hpy 0424a3d6-5bff-4122-bda3-03a4a9d1cee9 -- POST / 200 286.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,426 mnist_classifier_MNISTClassifier ktse0hpy 0e840f82-c6a4-4d57-b908-18172eb3bc68 -- POST / 200 286.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,426 mnist_classifier_MNISTClassifier ktse0hpy cd4d34f4-6102-41f6-83c6-34c86abf4d40 -- POST / 200 281.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,426 mnist_classifier_MNISTClassifier ktse0hpy b8a612b3-5c30-459c-9aa4-ba561e976cd6 -- POST / 200 281.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,427 mnist_classifier_MNISTClassifier ktse0hpy 22c5505e-c85a-4e0a-9151-92b9ed7a3a09 -- POST / 200 279.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,427 mnist_classifier_MNISTClassifier ktse0hpy 2dee56bd-49e9-4e0e-96fc-f6e1a25b1d1a -- POST / 200 279.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,428 mnist_classifier_MNISTClassifier ktse0hpy 754cb612-15c7-4f42-ad7e-8caf6b84d3cd -- POST / 200 280.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,429 mnist_classifier_MNISTClassifier ktse0hpy 639d4985-bf17-4593-910c-9bd18c268479 -- POST / 200 280.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,429 mnist_classifier_MNISTClassifier ktse0hpy ef9ccb8d-5cb8-4d30-9e17-afbf35b120bf -- POST / 200 280.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,429 mnist_classifier_MNISTClassifier ktse0hpy ff7719c8-6158-4356-9d3b-5b5972981c8b -- POST / 200 280.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,430 mnist_classifier_MNISTClassifier ktse0hpy 12602c2b-34a5-4fdb-ae6c-bcdaf9ea1a8f -- POST / 200 280.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,430 mnist_classifier_MNISTClassifier ktse0hpy 84d352d1-ef08-43db-9577-e0160fef27cb -- POST / 200 280.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,432 mnist_classifier_MNISTClassifier ktse0hpy 98c5a326-dda5-41ba-baeb-fe3f5d97593a -- POST / 200 281.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,432 mnist_classifier_MNISTClassifier ktse0hpy 0e594e37-d6a4-47e7-b8df-9b78c3d49d88 -- POST / 200 281.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,433 mnist_classifier_MNISTClassifier ktse0hpy 52681782-f7c1-40ac-92de-1223d62a5117 -- POST / 200 281.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,433 mnist_classifier_MNISTClassifier ktse0hpy 411bdb05-769e-4a31-b10d-d78a6a077759 -- POST / 200 281.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,435 mnist_classifier_MNISTClassifier ktse0hpy a6807a37-bbf2-454b-a86b-e0852aa6d910 -- POST / 200 283.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,435 mnist_classifier_MNISTClassifier ktse0hpy 8e43c902-4035-466b-910a-7e6e9c8a3972 -- POST / 200 283.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,436 mnist_classifier_MNISTClassifier ktse0hpy ebae5d99-7230-401b-a766-0e6aecbb59cb -- POST / 200 242.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,437 mnist_classifier_MNISTClassifier ktse0hpy c4087bfc-b7c1-4cf5-9a5f-64386bb412e5 -- POST / 200 241.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,437 mnist_classifier_MNISTClassifier ktse0hpy 5d36cc17-9bd8-4563-ae3c-773dc772dda3 -- POST / 200 240.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,438 mnist_classifier_MNISTClassifier ktse0hpy 85370f32-4667-4803-8ae9-9a755b157305 -- POST / 200 240.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,438 mnist_classifier_MNISTClassifier ktse0hpy a3f2cc21-5b45-41e7-b586-370c83274771 -- POST / 200 240.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,439 mnist_classifier_MNISTClassifier ktse0hpy 18dde17c-3048-42d3-b925-2e0670e8ef82 -- POST / 200 240.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,439 mnist_classifier_MNISTClassifier ktse0hpy a3ed39e6-582b-460e-b6d0-0f3c1b2a67ab -- POST / 200 239.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,441 mnist_classifier_MNISTClassifier ktse0hpy a7d7577d-5f97-417c-97bb-5ca6aaf73942 -- POST / 200 239.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,441 mnist_classifier_MNISTClassifier ktse0hpy 9c09e0ad-1ccc-4586-bf75-467d0f6093d0 -- POST / 200 239.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,442 mnist_classifier_MNISTClassifier ktse0hpy f58bfee9-a3b8-40bf-bd9a-eeecc7da7921 -- POST / 200 240.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,442 mnist_classifier_MNISTClassifier ktse0hpy 500d917b-0ad5-46b6-9de2-7f568545cbc1 -- POST / 200 237.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,443 mnist_classifier_MNISTClassifier ktse0hpy 5fcf4dcd-ca6b-458d-abb7-c3de22eb159c -- POST / 200 237.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,443 mnist_classifier_MNISTClassifier ktse0hpy 229bb75d-274d-474e-a6de-6eaf33903c65 -- POST / 200 237.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,444 mnist_classifier_MNISTClassifier ktse0hpy 2fedd870-b484-4f55-bb71-60152ea3c1bc -- POST / 200 238.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,444 mnist_classifier_MNISTClassifier ktse0hpy da546333-757a-4e70-b92a-6b601694dc8f -- POST / 200 238.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,444 mnist_classifier_MNISTClassifier ktse0hpy 1779c1a1-088b-460f-9c39-26cfbc7a9f11 -- POST / 200 236.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,444 mnist_classifier_MNISTClassifier ktse0hpy cf548c34-238a-4bb4-a3fc-c062b45f878c -- POST / 200 236.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,445 mnist_classifier_MNISTClassifier ktse0hpy c6a6cd2e-6b33-40ca-a02f-d47b2078d917 -- POST / 200 236.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,445 mnist_classifier_MNISTClassifier ktse0hpy 8ff3f3de-2fb8-4b11-a785-783dcd0f161f -- POST / 200 237.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,446 mnist_classifier_MNISTClassifier ktse0hpy a9cb2961-7dff-45de-9107-dd1bfdfbf85f -- POST / 200 237.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,447 mnist_classifier_MNISTClassifier ktse0hpy ee9d378f-024a-49d0-a845-2cbc7072a23a -- POST / 200 200.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,458 mnist_classifier_MNISTClassifier ktse0hpy 663f920d-ec7f-4823-bb07-6fcc59e5d65b -- POST / 200 210.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,458 mnist_classifier_MNISTClassifier ktse0hpy 4a1cfa8e-eda5-4e56-b0a0-4f7d045f319a -- POST / 200 210.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,458 mnist_classifier_MNISTClassifier ktse0hpy 571b59aa-4288-4e87-b9ca-973c4c51a37a -- POST / 200 209.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,458 mnist_classifier_MNISTClassifier ktse0hpy 6be3196f-8096-4c4b-8f60-369f55b11c1f -- POST / 200 209.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,458 mnist_classifier_MNISTClassifier ktse0hpy 5fbc75e1-d733-41bb-b672-c77559c236c5 -- POST / 200 208.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,464 mnist_classifier_MNISTClassifier ktse0hpy cf7fffc8-53ee-42fd-b1a5-4a2cea526320 -- POST / 200 252.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,465 mnist_classifier_MNISTClassifier ktse0hpy 059ac579-b3f2-4ac9-87c9-92dd56acd1cf -- POST / 200 253.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,465 mnist_classifier_MNISTClassifier ktse0hpy ca53522f-0827-4a32-ab04-c898b99e18e7 -- POST / 200 253.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,465 mnist_classifier_MNISTClassifier ktse0hpy de88ac28-bc42-416c-88a0-788df916380a -- POST / 200 252.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,465 mnist_classifier_MNISTClassifier ktse0hpy 65b7dd55-3bb9-4f5c-a5b7-516717fc20fe -- POST / 200 251.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,466 mnist_classifier_MNISTClassifier ktse0hpy b32c10bd-2519-4978-aca3-73dd13b3796e -- POST / 200 251.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,466 mnist_classifier_MNISTClassifier ktse0hpy 69c4fcfd-f673-471a-8c3e-80affbef6aab -- POST / 200 250.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,467 mnist_classifier_MNISTClassifier ktse0hpy 8da83cc6-f061-42c4-a297-707dc759eb21 -- POST / 200 250.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,467 mnist_classifier_MNISTClassifier ktse0hpy e8b674c7-7997-4dae-ba02-023985638c53 -- POST / 200 250.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,467 mnist_classifier_MNISTClassifier ktse0hpy 4e795c2f-1239-47b2-995b-fa2a79a34935 -- POST / 200 249.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,468 mnist_classifier_MNISTClassifier ktse0hpy 2379a77b-6823-46c3-b5b4-526d0370a420 -- POST / 200 244.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,468 mnist_classifier_MNISTClassifier ktse0hpy 4e196aea-12a7-4069-abfa-2e7d3133da47 -- POST / 200 235.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,468 mnist_classifier_MNISTClassifier ktse0hpy 6338685d-fd51-474c-9993-764ed2f31534 -- POST / 200 235.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,529 mnist_classifier_MNISTClassifier ktse0hpy af73d216-b141-4c5a-a4e9-4c3a7b0c8fd8 -- POST / 200 277.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,547 mnist_classifier_MNISTClassifier ktse0hpy a019f21a-3c28-40c4-b2c3-61bf3b5678fe -- POST / 200 293.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,548 mnist_classifier_MNISTClassifier ktse0hpy 06e6d92e-3ef4-4dfa-b475-b5b1c954044a -- POST / 200 293.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,548 mnist_classifier_MNISTClassifier ktse0hpy da7935ca-e11d-4b45-8504-5ae47bc93f19 -- POST / 200 293.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,553 mnist_classifier_MNISTClassifier ktse0hpy 5d5f5ebf-c12d-45ba-8d4a-e4b9fe6e3354 -- POST / 200 297.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,553 mnist_classifier_MNISTClassifier ktse0hpy a15abae1-ecc5-449e-9003-6b1c88a91d96 -- POST / 200 297.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,554 mnist_classifier_MNISTClassifier ktse0hpy d03b2407-be04-42a9-bac6-b0c93654318b -- POST / 200 296.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,554 mnist_classifier_MNISTClassifier ktse0hpy 4caee656-a5be-439c-bb6a-5365ba7eabc0 -- POST / 200 292.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,554 mnist_classifier_MNISTClassifier ktse0hpy db054b02-f2c5-48ae-ab44-1a526636243b -- POST / 200 290.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,554 mnist_classifier_MNISTClassifier ktse0hpy bd5ac195-4297-4751-9738-7204c40f4382 -- POST / 200 290.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,554 mnist_classifier_MNISTClassifier ktse0hpy 0125843c-4aae-4b29-8431-9c3e984ed6b3 -- POST / 200 288.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,555 mnist_classifier_MNISTClassifier ktse0hpy 1cc6fa6f-7f39-4e35-a0bb-d20a735c9b47 -- POST / 200 284.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,555 mnist_classifier_MNISTClassifier ktse0hpy 1cb47c77-94a1-40ee-a0f4-818731e478bb -- POST / 200 283.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,556 mnist_classifier_MNISTClassifier ktse0hpy 6e205764-a39a-4022-a6a8-782d74bfad47 -- POST / 200 283.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,556 mnist_classifier_MNISTClassifier ktse0hpy 2d21f8e8-e18a-4d1d-a227-743a449ddeb0 -- POST / 200 283.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,556 mnist_classifier_MNISTClassifier ktse0hpy d51dce64-11e3-4298-ab72-69a0e8179220 -- POST / 200 283.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,556 mnist_classifier_MNISTClassifier ktse0hpy c22451c9-adb7-45ef-9e10-6c0ed8897ff2 -- POST / 200 280.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,556 mnist_classifier_MNISTClassifier ktse0hpy f50c75a0-b869-415a-af02-dc0276d5b6d5 -- POST / 200 279.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,557 mnist_classifier_MNISTClassifier ktse0hpy 858ed071-9d68-4dd9-8925-cdb6a121ca05 -- POST / 200 267.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,557 mnist_classifier_MNISTClassifier ktse0hpy dae964eb-4da4-4b1a-9e1c-c4c089e09ce2 -- POST / 200 265.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,557 mnist_classifier_MNISTClassifier ktse0hpy 7d3589c0-99c5-4586-aa89-9c0ed72d1dde -- POST / 200 263.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,557 mnist_classifier_MNISTClassifier ktse0hpy 18d4addf-693a-4d98-a260-675e668199a3 -- POST / 200 263.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,558 mnist_classifier_MNISTClassifier ktse0hpy 98d95c11-fe14-429d-8271-b2ac97a64708 -- POST / 200 263.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,560 mnist_classifier_MNISTClassifier ktse0hpy 3a2f5871-b98c-4483-b021-7153e3985014 -- POST / 200 265.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,561 mnist_classifier_MNISTClassifier ktse0hpy 9fb03de7-c714-4f5a-a17f-74bf1cbe8e6f -- POST / 200 263.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,561 mnist_classifier_MNISTClassifier ktse0hpy 24e0c149-17fb-41aa-87ad-1ecfe1c75bb3 -- POST / 200 263.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,561 mnist_classifier_MNISTClassifier ktse0hpy ad069a80-f887-419d-9426-96d9be510d20 -- POST / 200 262.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,561 mnist_classifier_MNISTClassifier ktse0hpy b99c63f8-8642-4f39-85b8-d58a983a5417 -- POST / 200 309.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,561 mnist_classifier_MNISTClassifier ktse0hpy ec0f3cb7-801d-4cff-a2e4-f8867179a10d -- POST / 200 140.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,562 mnist_classifier_MNISTClassifier ktse0hpy 1ba9a6ec-f7a8-4c2e-a150-06b1fe5c49d5 -- POST / 200 127.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,563 mnist_classifier_MNISTClassifier ktse0hpy 52783c31-3bb1-4a9d-8ac1-c5c43cf21c7d -- POST / 200 128.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,567 mnist_classifier_MNISTClassifier ktse0hpy d76d8471-d5aa-4d5d-97dd-366e59e0abdf -- POST / 200 132.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,673 mnist_classifier_MNISTClassifier ktse0hpy ac5c85fe-c0f5-4f09-baa5-1d120e832c5f -- POST / 200 204.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,675 mnist_classifier_MNISTClassifier ktse0hpy 78f27753-7763-4096-b3b7-135d62d7584d -- POST / 200 203.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,676 mnist_classifier_MNISTClassifier ktse0hpy b8a5fd1d-e0de-4191-8e78-5c115e452ae9 -- POST / 200 202.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,679 mnist_classifier_MNISTClassifier ktse0hpy 002c4d20-89dc-416a-92d0-252a31f998a4 -- POST / 200 205.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,681 mnist_classifier_MNISTClassifier ktse0hpy 7b949c7d-bdbb-4e7a-907d-180fc8fb75fd -- POST / 200 208.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,682 mnist_classifier_MNISTClassifier ktse0hpy 75697ff4-71e0-4b22-bf9e-1b687806be17 -- POST / 200 207.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,685 mnist_classifier_MNISTClassifier ktse0hpy 86d58bb1-e97b-49a5-9598-1b5fd7eced2a -- POST / 200 210.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,688 mnist_classifier_MNISTClassifier ktse0hpy a7ac45d5-d92c-4469-b79e-39002db24919 -- POST / 200 211.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,690 mnist_classifier_MNISTClassifier ktse0hpy 91098750-5075-4830-b1e5-c3a0ab6c1c9c -- POST / 200 212.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,690 mnist_classifier_MNISTClassifier ktse0hpy 47972fbb-7143-4f46-8132-15966f60809f -- POST / 200 211.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,693 mnist_classifier_MNISTClassifier ktse0hpy a3089c24-f551-4616-9ca2-8aca219f8de0 -- POST / 200 214.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,694 mnist_classifier_MNISTClassifier ktse0hpy b6ffe1f8-5e75-415e-b296-72080c428621 -- POST / 200 215.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,695 mnist_classifier_MNISTClassifier ktse0hpy 7e47ecdb-006e-4b46-966b-23b4be6016dc -- POST / 200 215.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,696 mnist_classifier_MNISTClassifier ktse0hpy 0091e1bb-32d8-4e9b-a0a5-1974064ca24a -- POST / 200 214.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,696 mnist_classifier_MNISTClassifier ktse0hpy 0429cc80-b358-4387-b280-487297fb039b -- POST / 200 214.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,696 mnist_classifier_MNISTClassifier ktse0hpy 10451de6-a89d-4716-8f14-81cdeac6a1df -- POST / 200 213.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,696 mnist_classifier_MNISTClassifier ktse0hpy 7623dc76-5445-4150-b44d-4b62ec5e9930 -- POST / 200 213.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,699 mnist_classifier_MNISTClassifier ktse0hpy e90c73b7-4c3e-4f83-a680-d4b2bba542fc -- POST / 200 212.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,701 mnist_classifier_MNISTClassifier ktse0hpy 86c2eb85-33a0-4c10-b7f8-9825f790719e -- POST / 200 214.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,710 mnist_classifier_MNISTClassifier ktse0hpy 67295f56-2d8e-4a85-8d3b-569a0e9e0651 -- POST / 200 219.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,712 mnist_classifier_MNISTClassifier ktse0hpy a691208d-5fde-4129-ba3c-4ccf67362405 -- POST / 200 219.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,713 mnist_classifier_MNISTClassifier ktse0hpy 0c9a1eb9-426e-4415-8c81-91400f6137a0 -- POST / 200 205.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,714 mnist_classifier_MNISTClassifier ktse0hpy f31b7bf2-9217-443f-845f-1f1320669e8c -- POST / 200 217.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,716 mnist_classifier_MNISTClassifier ktse0hpy da7658bf-1489-4222-88e1-f7286de4ff21 -- POST / 200 218.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,716 mnist_classifier_MNISTClassifier ktse0hpy 70546f84-ffba-4cc0-8aa0-030d4043ce6a -- POST / 200 218.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,716 mnist_classifier_MNISTClassifier ktse0hpy 0da7721f-02a6-43eb-bd4e-5e976ecc8407 -- POST / 200 218.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,717 mnist_classifier_MNISTClassifier ktse0hpy 6fae8106-36ec-4f80-ab40-026872549910 -- POST / 200 218.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,718 mnist_classifier_MNISTClassifier ktse0hpy a1656233-cbc1-4c3e-a782-cdf8b5509d6c -- POST / 200 216.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,719 mnist_classifier_MNISTClassifier ktse0hpy ff878aba-3df9-4dac-be98-8e9f507e6081 -- POST / 200 217.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,719 mnist_classifier_MNISTClassifier ktse0hpy b2801efb-ace8-4633-b2c9-6a3c79704b6f -- POST / 200 217.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,925 mnist_classifier_MNISTClassifier ktse0hpy b14e22db-0437-4766-bf14-1c2672d895ed -- POST / 200 431.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,926 mnist_classifier_MNISTClassifier ktse0hpy cab56cc4-b910-4bb9-8d5a-95379441a56e -- POST / 200 418.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,926 mnist_classifier_MNISTClassifier ktse0hpy 0c3ae610-ba5f-44b1-b59c-74f67fc2e92f -- POST / 200 350.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,927 mnist_classifier_MNISTClassifier ktse0hpy 40ae7f26-0844-4e2a-a1c2-2a574d85442d -- POST / 200 418.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,928 mnist_classifier_MNISTClassifier ktse0hpy ae68d5f9-c507-43ff-b0c2-659346e0a0aa -- POST / 200 351.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,928 mnist_classifier_MNISTClassifier ktse0hpy 8922f04c-c6a3-4956-a31f-44dbded29065 -- POST / 200 418.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,929 mnist_classifier_MNISTClassifier ktse0hpy cce22236-538d-48ae-88da-70558941f034 -- POST / 200 412.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,930 mnist_classifier_MNISTClassifier ktse0hpy e3b1679a-3af1-4fee-8ddc-ccd60ebe1396 -- POST / 200 412.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,930 mnist_classifier_MNISTClassifier ktse0hpy 51f145f8-2308-4f08-a842-c5dd553f3c5c -- POST / 200 410.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,930 mnist_classifier_MNISTClassifier ktse0hpy 911c6b25-b9f6-4e35-af74-2cfd7f41d028 -- POST / 200 409.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,931 mnist_classifier_MNISTClassifier ktse0hpy 5d311870-7109-4e1a-a2bc-71d508db93cd -- POST / 200 409.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,931 mnist_classifier_MNISTClassifier ktse0hpy dff79e7f-ce7e-4960-bf23-141d95e903d4 -- POST / 200 361.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,932 mnist_classifier_MNISTClassifier ktse0hpy 5917f5a1-0ceb-4b6a-8ea8-8e66e4816ea4 -- POST / 200 356.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,932 mnist_classifier_MNISTClassifier ktse0hpy f31de7c8-46b8-4ff8-98fa-008883625afd -- POST / 200 356.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,933 mnist_classifier_MNISTClassifier ktse0hpy 9642d2ab-5357-4f3d-a020-14f516fc0d24 -- POST / 200 357.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,933 mnist_classifier_MNISTClassifier ktse0hpy e36b122a-5192-4d7f-8da0-98c78ccff9a3 -- POST / 200 356.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,934 mnist_classifier_MNISTClassifier ktse0hpy c3de507a-a7db-42ab-bc50-3d82d8f6b515 -- POST / 200 353.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,935 mnist_classifier_MNISTClassifier ktse0hpy 28520d10-f7be-44f0-93f7-57ddbfa0d062 -- POST / 200 358.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,936 mnist_classifier_MNISTClassifier ktse0hpy 163f9488-9a69-4299-b225-6aac4987c8fa -- POST / 200 355.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,936 mnist_classifier_MNISTClassifier ktse0hpy ccb96450-8141-41cd-bf34-571c963e83a9 -- POST / 200 358.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,936 mnist_classifier_MNISTClassifier ktse0hpy 23b4240a-1559-4aaf-a7c1-abae8080b0a3 -- POST / 200 358.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,936 mnist_classifier_MNISTClassifier ktse0hpy dba4be95-e93d-48e0-8d30-5dba2b4acae6 -- POST / 200 354.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,937 mnist_classifier_MNISTClassifier ktse0hpy 248d0feb-111b-42bb-a43d-b36e1472f02b -- POST / 200 354.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,937 mnist_classifier_MNISTClassifier ktse0hpy 78175aaf-acbc-4319-aaf2-7abaacf69d7e -- POST / 200 353.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,938 mnist_classifier_MNISTClassifier ktse0hpy 5d780c01-378d-497a-9242-7451a450d47a -- POST / 200 350.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,938 mnist_classifier_MNISTClassifier ktse0hpy 805d23a1-d477-4317-83fe-4bba1948b58b -- POST / 200 350.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,939 mnist_classifier_MNISTClassifier ktse0hpy 10283d75-490c-4205-964f-e8792a45fade -- POST / 200 350.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,940 mnist_classifier_MNISTClassifier ktse0hpy 9353a9e6-02c6-480a-9550-7a2da9fee95d -- POST / 200 351.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,941 mnist_classifier_MNISTClassifier ktse0hpy a9a92b0a-69f5-4ea3-b1aa-be3402f7a2ca -- POST / 200 352.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,941 mnist_classifier_MNISTClassifier ktse0hpy 92d946e2-ae29-410d-860e-266d338821e2 -- POST / 200 346.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,942 mnist_classifier_MNISTClassifier ktse0hpy d595a616-efa4-4fd2-9ef0-a34a0af1513d -- POST / 200 350.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,943 mnist_classifier_MNISTClassifier ktse0hpy 5de82228-513f-450f-ae6b-b99cfaae3faf -- POST / 200 350.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,943 mnist_classifier_MNISTClassifier ktse0hpy c01eb187-b701-4ac1-8926-aa073f48b2d9 -- POST / 200 349.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,943 mnist_classifier_MNISTClassifier ktse0hpy 0355031c-2666-402d-8454-e016e025a520 -- POST / 200 349.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,944 mnist_classifier_MNISTClassifier ktse0hpy 17cc4f03-cd5d-451d-a786-084b6f728715 -- POST / 200 348.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,944 mnist_classifier_MNISTClassifier ktse0hpy 71724c67-23cc-409d-90c9-3ff304f45fa7 -- POST / 200 344.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,945 mnist_classifier_MNISTClassifier ktse0hpy 01ff6ca3-d67e-45ef-8e26-c20c1c2d3d6d -- POST / 200 344.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,945 mnist_classifier_MNISTClassifier ktse0hpy 4c5c3cb5-5410-4dc1-82ba-46c781c52174 -- POST / 200 344.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,946 mnist_classifier_MNISTClassifier ktse0hpy 03eae5d9-1377-4a5f-b48f-da0a5d93b41d -- POST / 200 314.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,946 mnist_classifier_MNISTClassifier ktse0hpy 16519bb5-0b83-4046-b8c8-41bf6ddc00f7 -- POST / 200 313.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,947 mnist_classifier_MNISTClassifier ktse0hpy ea6e1ddc-0087-48a1-9111-944643ee1e2f -- POST / 200 313.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,947 mnist_classifier_MNISTClassifier ktse0hpy 4202caae-58cd-474c-a248-a510e260266e -- POST / 200 312.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,948 mnist_classifier_MNISTClassifier ktse0hpy bdca9789-7c80-4373-b6e9-53dfc6fd6208 -- POST / 200 311.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,949 mnist_classifier_MNISTClassifier ktse0hpy b20a7ab6-40b8-433f-ba16-8e7407d146c5 -- POST / 200 309.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,949 mnist_classifier_MNISTClassifier ktse0hpy f05abcd4-f03f-4a69-8d1d-d9affb9083f6 -- POST / 200 309.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,950 mnist_classifier_MNISTClassifier ktse0hpy 3571e637-335c-433e-8d09-1469c77f2ad2 -- POST / 200 309.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,950 mnist_classifier_MNISTClassifier ktse0hpy 0b553331-7f74-4d15-a865-a6c6307608db -- POST / 200 308.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,952 mnist_classifier_MNISTClassifier ktse0hpy 01e0c0c8-6cc6-41dc-93f9-fd68db1a08c7 -- POST / 200 307.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,954 mnist_classifier_MNISTClassifier ktse0hpy 402938f4-db5b-4739-9021-be0108b5be5b -- POST / 200 308.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,954 mnist_classifier_MNISTClassifier ktse0hpy 8111fef8-e908-4b96-a7d2-e7563cb37647 -- POST / 200 309.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,957 mnist_classifier_MNISTClassifier ktse0hpy c593b6f5-f4f9-49c3-915b-b50735b9fb37 -- POST / 200 309.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,957 mnist_classifier_MNISTClassifier ktse0hpy 1406f2f5-66ea-4103-99c5-cb294eb4325f -- POST / 200 310.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,958 mnist_classifier_MNISTClassifier ktse0hpy 4ca1becc-91b7-4fc2-a76e-12f28981fa85 -- POST / 200 310.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4522) INFO 2026-04-10 16:16:49,958 mnist_classifier_MNISTClassifier ktse0hpy ae79dc11-40ab-4e90-9683-47ea6f69945a -- POST / 200 309.5ms
Processed 1000 requests in 5.19 seconds
Throughput: 192.75 requests/second

Ray Serve automatically buffers and load balances requests across the replicas.

Fault tolerance#

In production, process and machine failures are inevitable. Ray Serve is designed so that each major component in the Serve stack (the controller, replicas, and proxies) can fail and recover while your application continues to handle traffic.

Serve can also recover from larger infrastructure failures, such as entire nodes or pods failing. Serve can even recover from head node failures, or the entire head pod if deploying on KubeRay.

For more information about Ray Serve’s fault tolerance, see the Ray Serve fault-tolerance guide.

Monitor the deployment#

Monitoring is critical when running large-scale deployments. The Ray dashboard displays Serve metrics like request throughput, latency, and error rates. It also shows cluster resource usage, replica status, and overall deployment health in real time. The dashboard also lets you inspect logs from individual replicas across the cluster.

For debugging, Ray offers distributed debugging tools that let you attach a debugger to running replicas across the cluster. For more information, see the Ray Serve monitoring documentation.

Conclusion#

In this tutorial, you:

Deployed a PyTorch model using Ray Serve with production best practices.
Enabled dynamic request batching to optimize performance.
Configured autoscaling and fractional GPU allocation to efficiently scale across a cluster.
Tested the service with concurrent asynchronous requests.

Serve PyTorch models at scale with Ray Serve#

Setup#

Define a PyTorch model#

Define the Ray Serve deployment#

Configure autoscaling and resource allocation#

Test the endpoint with concurrent requests#

Fault tolerance#

Monitor the deployment#

Conclusion#

Further reading#

Docs

Tutorials

Resources