beginner/serving_tutorial

Run in Google Colab

Colab

Download Notebook

Notebook

View on GitHub

GitHub

Serve PyTorch models at scale with Ray Serve

Author: Ricardo Decal

This tutorial shows how to deploy a PyTorch model using Ray Serve with production-ready features.

What you will learn

• How to create a production-ready PyTorch model deployment that can scale to thousands of nodes and GPUs

• How to configure an HTTP endpoint for the deployment using FastAPI

• Enable dynamic request batching for higher throughput

• Configure autoscaling and per-replica CPU/GPU resource allocation

• Load test the service with concurrent requests and monitor it with the Ray dashboard

• How Ray Serve deployments can self-heal from failures

• Ray Serve’s advanced features like model multiplexing and model composition.

Prerequisites

• PyTorch v2.9+ and torchvision

• Ray Serve (ray[serve]) v2.52.1+

• A GPU is recommended for higher throughput but is not required

Ray Serve is a scalable framework for serving machine learning models in production. It’s built on top of Ray, which is a unified framework for scaling AI and Python applications that simplifies the complexities of distributed computing. Ray is also open source and part of the PyTorch Foundation.

Setup

To install the dependencies, run:

pip install "ray[serve]" torch torchvision

Start by importing the required libraries:

import asyncio
import time
from typing import Any

from fastapi import FastAPI
from pydantic import BaseModel
import aiohttp
import numpy as np
import torch
import torch.nn as nn
from ray import serve
from torchvision.transforms import v2

Define a PyTorch model

Define a simple convolutional neural network for the MNIST digit classification dataset:

class MNISTNet(nn.Module):
    def __init__(self):
        super().__init__()
        self.conv1 = nn.Conv2d(1, 32, 3, 1)
        self.dropout1 = nn.Dropout(0.25)
        self.conv2 = nn.Conv2d(32, 64, 3, 1)
        self.fc1 = nn.Linear(9216, 128)
        self.dropout2 = nn.Dropout(0.5)
        self.fc2 = nn.Linear(128, 10)

    def forward(self, x):
        x = self.conv1(x)
        x = nn.functional.relu(x)
        x = self.conv2(x)
        x = nn.functional.relu(x)
        x = nn.functional.max_pool2d(x, 2)
        x = self.dropout1(x)
        x = torch.flatten(x, 1)
        x = self.fc1(x)
        x = nn.functional.relu(x)
        x = self.dropout2(x)
        x = self.fc2(x)
        return nn.functional.log_softmax(x, dim=1)

Define the Ray Serve deployment

To deploy this model with Ray Serve, wrap the model in a Python class and decorate it with @serve.deployment.

Processing requests in batches is more efficient than processing requests one by one, especially when using GPUs. Ray Serve provides built-in support for dynamic request batching, where individual incoming requests are opportunistically batched. Enable dynamic batching using the @serve.batch decorator as shown in the following code:

app = FastAPI()

class ImageRequest(BaseModel):  # Used for request validation and generating API documentation
    image: list[list[float]] | list[list[list[float]]]  # 2D or 3D array

@serve.deployment
@serve.ingress(app)
class MNISTClassifier:
    def __init__(self):
        self.device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
        self.model = MNISTNet().to(self.device)
        # Define the transformation pipeline for the input images.
        self.transform = v2.Compose([
            v2.ToImage(),
            v2.ToDtype(torch.float32, scale=True),
            # Mean and standard deviation of the MNIST training subset.
            v2.Normalize(mean=[0.1307], std=[0.3013]),
        ])

        self.model.eval()

    # batch_wait_timeout_s is the maximum time to wait for a full batch,
    # trading off latency for throughput.
    @serve.batch(max_batch_size=128, batch_wait_timeout_s=0.1)
    async def predict_batch(self, images: list[np.ndarray]) -> list[dict[str, Any]]:
        # Stack all images into a single tensor.
        batch_tensor = torch.cat([
            self.transform(img).unsqueeze(0)
            for img in images
        ]).to(self.device).float()

        # Single forward pass on the entire batch at once.
        with torch.no_grad():
            logits = self.model(batch_tensor)
            predictions = torch.argmax(logits, dim=1).cpu().numpy()

        # Unbatch the results and preserve their original order.
        return [
            {
                "predicted_label": int(pred),
                "logits": logit.cpu().numpy().tolist()
            }
            for pred, logit in zip(predictions, logits)
        ]

    @app.post("/")
    async def handle_request(self, request: ImageRequest):
        """Handle an incoming HTTP request using FastAPI.

        Inputs are automatically validated using the Pydantic model.
        """
        # Process the single request.
        image_array = np.array(request.image)

        # Ray Serve's @serve.batch automatically batches requests.
        result = await self.predict_batch(image_array)

        return result

This is a FastAPI app, which extends Ray Serve with features like automatic request validation with Pydantic, auto-generated OpenAPI-style API documentation, and more.

Configure autoscaling and resource allocation

In production, traffic can vary significantly. Ray Serve’s autoscaling feature automatically adjusts the number of replicas based on traffic load, ensuring you have enough capacity during peaks while saving resources during quiet periods. Ray Serve scales to very large deployments with thousands of nodes and replicas.

You can also specify resource allocation per replica, such as the number of CPUs or GPUs. Ray Serve handles the orchestration of these resources across your cluster. Ray also supports fractional GPUs, allowing multiple replicas to share a single GPU when models are small enough to fit in memory together.

The following is a sample configuration with autoscaling and resource allocation:

num_cpus_per_replica = 1
num_gpus_per_replica = 1  # Set to 0 to run the model on CPUs instead of GPUs.
mnist_app = MNISTClassifier.options(
    autoscaling_config={
        "target_ongoing_requests": 50,  # Target 50 ongoing requests per replica.
        "min_replicas": 1,              # Keep at least 1 replica alive.
        "max_replicas": 80,             # Scale up to 80 replicas to maintain target_ongoing_requests.
        "upscale_delay_s": 5,           # Wait 5s before scaling up.
        "downscale_delay_s": 30,        # Wait 30s before scaling down.
    },
    # Max invocations to handle_request per replica to process simultaneously.
    # Requests exceeding this limit are queued by the router until capacity is available.
    max_ongoing_requests=200,
    # Max queue size for requests that exceed max_ongoing_requests.
    # If the queue is full, future requests are backpressured with errors until space is available.
    # -1 means the queue can grow until cluster memory is exhausted.
    max_queued_requests=-1,
    # Set the resources per replica.
    ray_actor_options={"num_cpus": num_cpus_per_replica, "num_gpus": num_gpus_per_replica}
).bind()

The app is ready to deploy. Suppose you ran this on a cluster of 10 machines, each with 4 GPUs. With num_gpus=0.5, Ray schedules 2 replicas per GPU, giving you 80 replicas across the cluster. This configuration permits the deployment to elastically scale up to 80 replicas as needed to handle traffic spikes and scale back down to 1 replica when traffic subsides.

Test the endpoint with concurrent requests

To deploy the app, use the serve.run function:

# Start the Ray Serve application.
handle = serve.run(mnist_app, name="mnist_classifier")

2026-05-20 04:37:48,437 WARNING services.py:2213 -- WARNING: The object store is using /tmp/ray instead of /dev/shm because /dev/shm has only 2147471360 bytes available. This will harm performance! You may be able to free up space by deleting files in /dev/shm. If you are inside a Docker container, you can increase /dev/shm size by passing '--shm-size=10.24gb' to 'docker run' (or add it to the run_options list in a Ray cluster config). Make sure to set this to more than 30% of available RAM.
2026-05-20 04:37:50,608 INFO worker.py:2003 -- Started a local Ray instance. View the dashboard at 127.0.0.1:8265
/usr/local/lib/python3.10/dist-packages/ray/_private/worker.py:2051: FutureWarning: Tip: In future versions of Ray, Ray will no longer override accelerator visible devices env var if num_gpus=0 or num_gpus=None (default). To enable this behavior and turn off this error message, set RAY_ACCEL_ENV_VAR_OVERRIDE_ON_ZERO=0
  warnings.warn(
(ProxyActor pid=4654) INFO 2026-05-20 04:37:53,201 proxy 172.17.0.2 -- Proxy starting on node 1057ab7f9086b23a0c63c5433a2b87b24f1dbcb5da6b89ba50cb7663 (HTTP port: 8000).
INFO 2026-05-20 04:37:53,273 serve 3837 -- Started Serve in namespace "serve".
(ProxyActor pid=4654) INFO 2026-05-20 04:37:53,270 proxy 172.17.0.2 -- Got updated endpoints: {}.
(ServeController pid=4649) INFO 2026-05-20 04:37:53,343 controller 4649 -- Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
(ServeController pid=4649) INFO 2026-05-20 04:37:53,343 controller 4649 -- Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
(ProxyActor pid=4654) INFO 2026-05-20 04:37:53,347 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
(ProxyActor pid=4654) INFO 2026-05-20 04:37:53,354 proxy 172.17.0.2 -- Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x7f4f78216260>.
(ServeController pid=4649) INFO 2026-05-20 04:37:53,447 controller 4649 -- Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
(ProxyActor pid=4654) INFO 2026-05-20 04:37:57,562 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=[RoutePattern(methods=['POST'], path='/'), RoutePattern(methods=['GET', 'HEAD'], path='/docs'), RoutePattern(methods=['GET', 'HEAD'], path='/docs/oauth2-redirect'), RoutePattern(methods=['GET', 'HEAD'], path='/openapi.json'), RoutePattern(methods=['GET', 'HEAD'], path='/redoc')])}.
INFO 2026-05-20 04:37:58,399 serve 3837 -- Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

You will see output similar to:

Started Serve in namespace "serve".
Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
Proxy starting on node ... (HTTP port: 8000).
Got updated endpoints: {}.
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x73a53c52c250>.
Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=['/', '/docs', '/docs/oauth2-redirect', '/openapi.json', '/redoc'])}.
Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

The app is now listening for requests on port 8000.

To test the deployment, you can send many requests concurrently using aiohttp. The following code demonstrates how to send 1000 concurrent requests to the app:

async def send_single_request(session, url, data):
    async with session.post(url, json=data) as response:
        return await response.json()

async def send_concurrent_requests(num_requests):
    image = np.random.rand(28, 28).tolist()

    print(f"Sending {num_requests} concurrent requests...")
    async with aiohttp.ClientSession() as session:
        tasks = [
            send_single_request(session, url="http://localhost:8000/", data={"image": image})
            for _ in range(num_requests)
        ]
        responses = await asyncio.gather(*tasks)

    return responses

# Run the concurrent requests.
start_time = time.time()
responses = asyncio.run(send_concurrent_requests(1000))
elapsed = time.time() - start_time

print(f"Processed {len(responses)} requests in {elapsed:.2f} seconds")
print(f"Throughput: {len(responses)/elapsed:.2f} requests/second")

Sending 1000 concurrent requests...
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,494 mnist_classifier_MNISTClassifier e3knvfvk f5209239-307e-4bd8-be5a-75a7c4b8b086 -- POST / 200 432.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,495 mnist_classifier_MNISTClassifier e3knvfvk feacab3a-cac6-42e2-83a2-7c11f0fd8dfc -- POST / 200 426.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,496 mnist_classifier_MNISTClassifier e3knvfvk 18852145-e3cf-43dc-bf57-5fce73543602 -- POST / 200 426.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,497 mnist_classifier_MNISTClassifier e3knvfvk f7144fcb-84ab-45a6-b12a-2546824dd2d6 -- POST / 200 425.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,497 mnist_classifier_MNISTClassifier e3knvfvk 2c41cf85-41b6-4bcc-a764-cbd2cf00d48e -- POST / 200 425.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,499 mnist_classifier_MNISTClassifier e3knvfvk b1287069-7ed4-4e66-9c2a-024bb3d53741 -- POST / 200 425.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,501 mnist_classifier_MNISTClassifier e3knvfvk 7404d0c1-9b1d-4a15-935b-e4757394723d -- POST / 200 427.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,502 mnist_classifier_MNISTClassifier e3knvfvk 6be678a8-e588-430c-9879-c907c26d75f4 -- POST / 200 427.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,503 mnist_classifier_MNISTClassifier e3knvfvk 7559bf21-0e53-4d98-8d67-3b4e79d5b4b7 -- POST / 200 427.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,504 mnist_classifier_MNISTClassifier e3knvfvk ccd9683b-c3d5-4894-b074-23f700a372c7 -- POST / 200 428.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,504 mnist_classifier_MNISTClassifier e3knvfvk 813bdde2-1f32-4af0-a191-83d17c9b3876 -- POST / 200 427.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,505 mnist_classifier_MNISTClassifier e3knvfvk 29430e80-1fd4-4d94-9aac-4aa9b9d2ced2 -- POST / 200 426.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,505 mnist_classifier_MNISTClassifier e3knvfvk dbca9f61-34e6-4d9b-a686-4031da330d0d -- POST / 200 424.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,506 mnist_classifier_MNISTClassifier e3knvfvk ffd5318c-b6b7-4c6f-9db6-72c521f2dc71 -- POST / 200 422.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,509 mnist_classifier_MNISTClassifier e3knvfvk 70a0eb58-ac7c-4549-b27d-5238006fb41e -- POST / 200 425.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,515 mnist_classifier_MNISTClassifier e3knvfvk f4c1c64e-2aa0-4839-8b6f-df12325ca1f5 -- POST / 200 431.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,518 mnist_classifier_MNISTClassifier e3knvfvk c7ef48d6-a007-495a-99c0-81d4405218df -- POST / 200 431.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,518 mnist_classifier_MNISTClassifier e3knvfvk 3e6ffd2a-cb4d-4117-876d-8069d2bfdf41 -- POST / 200 431.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,519 mnist_classifier_MNISTClassifier e3knvfvk 01fdb6b0-44c0-418e-add5-200c468c00ec -- POST / 200 431.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,520 mnist_classifier_MNISTClassifier e3knvfvk 4d813210-358b-4f24-bbda-382e0cb9400e -- POST / 200 429.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,521 mnist_classifier_MNISTClassifier e3knvfvk abe3789d-d632-42be-b8ae-5e9898c4743c -- POST / 200 430.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,524 mnist_classifier_MNISTClassifier e3knvfvk 5961b5c3-fc2c-4be4-9492-75006842f2fd -- POST / 200 432.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,525 mnist_classifier_MNISTClassifier e3knvfvk 8725fb43-aad3-42f0-915c-1bf3c08a178b -- POST / 200 431.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,525 mnist_classifier_MNISTClassifier e3knvfvk 5e2e64c2-7d25-461a-8c6b-f5391722ee42 -- POST / 200 431.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,526 mnist_classifier_MNISTClassifier e3knvfvk fddcf25e-8a55-422d-9117-1b822c08685c -- POST / 200 431.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,526 mnist_classifier_MNISTClassifier e3knvfvk 3c640caa-f07c-41fa-a44d-099823e6bffe -- POST / 200 431.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,527 mnist_classifier_MNISTClassifier e3knvfvk a2f79946-b68c-4e20-b5ba-1ac2e7564125 -- POST / 200 428.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,527 mnist_classifier_MNISTClassifier e3knvfvk b7cacf2b-de19-4295-94b1-a5a029620dd2 -- POST / 200 429.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,528 mnist_classifier_MNISTClassifier e3knvfvk eb04344d-c4b2-4400-822f-553ab3f44e9a -- POST / 200 428.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,587 mnist_classifier_MNISTClassifier e3knvfvk c4c5c68a-639b-47c0-9d35-0fe24ff08a49 -- POST / 200 486.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,588 mnist_classifier_MNISTClassifier e3knvfvk 6a817598-7cd4-4762-bfbb-5239ada966ba -- POST / 200 486.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,590 mnist_classifier_MNISTClassifier e3knvfvk 2711e662-0fc7-4ae7-a8e5-e825685aa11d -- POST / 200 487.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,591 mnist_classifier_MNISTClassifier e3knvfvk 91d65f5b-2114-45f5-a265-ef1394d1ce7f -- POST / 200 485.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,591 mnist_classifier_MNISTClassifier e3knvfvk 2121766b-fbe5-4661-8313-c7fd8b736dea -- POST / 200 485.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,591 mnist_classifier_MNISTClassifier e3knvfvk 99226e52-e3f8-4dd9-bf01-5b5a94601013 -- POST / 200 485.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,591 mnist_classifier_MNISTClassifier e3knvfvk af8b2c75-a178-4826-bdf4-9ee7c86bd8d6 -- POST / 200 484.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,592 mnist_classifier_MNISTClassifier e3knvfvk e986405a-2d36-4120-926f-8cdda4ef1231 -- POST / 200 479.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,592 mnist_classifier_MNISTClassifier e3knvfvk c484ee8b-fb99-4cc4-9d75-5c6fce5e23e1 -- POST / 200 479.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,592 mnist_classifier_MNISTClassifier e3knvfvk ad4bc446-ee5e-4a0a-9b13-483d8b1fbcd1 -- POST / 200 477.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,592 mnist_classifier_MNISTClassifier e3knvfvk b6eb9e89-b706-47af-bdb4-dbdee5ed7653 -- POST / 200 475.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,593 mnist_classifier_MNISTClassifier e3knvfvk 6e4152ce-0e93-4b87-b614-36e9ceeda17f -- POST / 200 475.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,594 mnist_classifier_MNISTClassifier e3knvfvk 831b0cde-426c-4045-a150-4bcb7ea08b99 -- POST / 200 476.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,596 mnist_classifier_MNISTClassifier e3knvfvk d1127b46-1d02-4067-a251-39c6193abfec -- POST / 200 478.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,596 mnist_classifier_MNISTClassifier e3knvfvk 89b9f4f8-892e-4a47-9f84-99c0bdd25759 -- POST / 200 478.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,813 mnist_classifier_MNISTClassifier e3knvfvk 3f198ff0-0d82-4492-9b34-c3d5e0f04875 -- POST / 200 694.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,819 mnist_classifier_MNISTClassifier e3knvfvk 6eb751c3-c9f2-4024-8624-0ecc219fcd01 -- POST / 200 698.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,819 mnist_classifier_MNISTClassifier e3knvfvk 73ebf15c-acb2-42a9-97e1-91cf662d44e0 -- POST / 200 697.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,820 mnist_classifier_MNISTClassifier e3knvfvk a45b1bc1-4c6f-42ae-bda8-24191cdb966c -- POST / 200 697.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,832 mnist_classifier_MNISTClassifier e3knvfvk f7df5992-b5dd-4e50-bfe1-7115ee0f62ce -- POST / 200 707.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,833 mnist_classifier_MNISTClassifier e3knvfvk e618a095-c56a-443c-b840-8fb38d911817 -- POST / 200 709.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,834 mnist_classifier_MNISTClassifier e3knvfvk b6ba010e-cfa7-4ad9-b92c-a990400cdd2f -- POST / 200 705.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,834 mnist_classifier_MNISTClassifier e3knvfvk 82228431-f6b7-467d-a5ca-bab3f8a19393 -- POST / 200 706.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,835 mnist_classifier_MNISTClassifier e3knvfvk bb268e7d-7142-4e4c-a919-e2917ff2a5cf -- POST / 200 706.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,835 mnist_classifier_MNISTClassifier e3knvfvk 213c2cdc-bcb5-4a21-9dc4-bfc0a1823f17 -- POST / 200 706.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,836 mnist_classifier_MNISTClassifier e3knvfvk 5277589b-7a94-4061-bbc7-b12c186374f0 -- POST / 200 704.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,836 mnist_classifier_MNISTClassifier e3knvfvk 42c78d73-2404-4af0-89e3-23a55cbbfd69 -- POST / 200 700.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,837 mnist_classifier_MNISTClassifier e3knvfvk c1fadc71-f2fd-4dd3-97b5-c0162a631641 -- POST / 200 698.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,838 mnist_classifier_MNISTClassifier e3knvfvk 6df23222-fe1e-41bc-b816-8e51545ad343 -- POST / 200 698.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,838 mnist_classifier_MNISTClassifier e3knvfvk bab3bf24-64e6-4466-a4c1-6bb474f9c41e -- POST / 200 694.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,838 mnist_classifier_MNISTClassifier e3knvfvk 86ef42c1-c1f0-4ad0-9202-21e6b686c72e -- POST / 200 694.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,839 mnist_classifier_MNISTClassifier e3knvfvk 88bd9473-5735-4987-9d5b-0f115bb14060 -- POST / 200 695.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,839 mnist_classifier_MNISTClassifier e3knvfvk 23890a58-9eff-409a-a850-0bfb7c589660 -- POST / 200 695.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,839 mnist_classifier_MNISTClassifier e3knvfvk 6d2ec487-6dcf-41c7-91a8-3f86ebd6d17e -- POST / 200 695.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,840 mnist_classifier_MNISTClassifier e3knvfvk 8eae110b-4382-49f4-81fe-7a26bc316e8d -- POST / 200 695.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,840 mnist_classifier_MNISTClassifier e3knvfvk 8476955f-8597-407c-9fc8-6adb7da89a5d -- POST / 200 694.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,840 mnist_classifier_MNISTClassifier e3knvfvk 2765297d-07d0-4f6f-9701-5db57a77b523 -- POST / 200 693.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,841 mnist_classifier_MNISTClassifier e3knvfvk 133548ff-f143-4800-be4c-9a53589c6fb4 -- POST / 200 693.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,841 mnist_classifier_MNISTClassifier e3knvfvk 349e84a6-7f8f-4bed-8710-267016c8d3c3 -- POST / 200 693.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,841 mnist_classifier_MNISTClassifier e3knvfvk 4170d855-0052-42bd-8cda-ef075e7173d1 -- POST / 200 693.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,842 mnist_classifier_MNISTClassifier e3knvfvk 68ac6311-70ac-4d86-a287-fe4dc631a5bf -- POST / 200 691.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,844 mnist_classifier_MNISTClassifier e3knvfvk d2a8e4a5-1341-4e69-ba33-885e1a7391ab -- POST / 200 691.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,845 mnist_classifier_MNISTClassifier e3knvfvk eff0218d-fbe0-46cd-9810-61505f0000b7 -- POST / 200 693.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,846 mnist_classifier_MNISTClassifier e3knvfvk a93ad1a1-350f-4784-bf04-c1e22763e27a -- POST / 200 693.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,846 mnist_classifier_MNISTClassifier e3knvfvk 8bc74afd-055a-4ab2-a08b-af9a4f2a18d0 -- POST / 200 688.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,846 mnist_classifier_MNISTClassifier e3knvfvk d056b910-4365-4a80-b337-9dfa323f19e3 -- POST / 200 688.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,847 mnist_classifier_MNISTClassifier e3knvfvk f425b7c1-cb8b-45d0-89d9-97eb980bb189 -- POST / 200 689.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,847 mnist_classifier_MNISTClassifier e3knvfvk 622f7d34-46f3-4387-b1fa-c7d545ad8769 -- POST / 200 688.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,848 mnist_classifier_MNISTClassifier e3knvfvk d8a0f9dc-abbe-41c0-99eb-3b2f9c698719 -- POST / 200 685.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,848 mnist_classifier_MNISTClassifier e3knvfvk c1d7f882-aa97-470c-9650-df45913bb36e -- POST / 200 687.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,848 mnist_classifier_MNISTClassifier e3knvfvk 530817a6-e346-49c0-bded-99f4d42950e6 -- POST / 200 687.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,849 mnist_classifier_MNISTClassifier e3knvfvk e9d70ac4-66b6-4c8c-b623-0e3bce255a54 -- POST / 200 687.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,849 mnist_classifier_MNISTClassifier e3knvfvk e40764f3-c87f-466a-901a-b3399ee2ea01 -- POST / 200 687.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,849 mnist_classifier_MNISTClassifier e3knvfvk bb581b2d-3d8b-47b1-9f8a-22a13213a140 -- POST / 200 686.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,850 mnist_classifier_MNISTClassifier e3knvfvk bfa250b3-1f55-49e0-aea1-200e9d669944 -- POST / 200 686.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,850 mnist_classifier_MNISTClassifier e3knvfvk 6992c344-e31f-4b06-aeac-a51ddeb2283d -- POST / 200 684.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,850 mnist_classifier_MNISTClassifier e3knvfvk b264a682-7c7a-4669-8c6c-ca211f999dd7 -- POST / 200 684.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,851 mnist_classifier_MNISTClassifier e3knvfvk f7037f4b-6324-4802-bfe5-c06be8b5239f -- POST / 200 683.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,920 mnist_classifier_MNISTClassifier e3knvfvk 66e0cee2-ae3b-410e-b272-cf63d61d9d48 -- POST / 200 753.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,923 mnist_classifier_MNISTClassifier e3knvfvk 39590606-0154-4604-8da5-77bc84207a8b -- POST / 200 755.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,924 mnist_classifier_MNISTClassifier e3knvfvk b7da95b9-dc99-4a1c-aff9-d8a74d5f1bff -- POST / 200 754.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,925 mnist_classifier_MNISTClassifier e3knvfvk f7cc715b-dd80-4d2d-b264-33ed24507c6d -- POST / 200 750.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,925 mnist_classifier_MNISTClassifier e3knvfvk 8022219f-ea31-480b-9535-47df5e423dbe -- POST / 200 750.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,926 mnist_classifier_MNISTClassifier e3knvfvk d1c3401e-5b55-46e9-b49e-b2eeeb769824 -- POST / 200 751.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,928 mnist_classifier_MNISTClassifier e3knvfvk 47b84ac6-51e8-4d58-acc7-df77f1fb681a -- POST / 200 752.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,928 mnist_classifier_MNISTClassifier e3knvfvk 3b90acf6-174d-4ae6-b7ee-1f8bca4e265a -- POST / 200 751.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,930 mnist_classifier_MNISTClassifier e3knvfvk 0e8a70e3-de71-4055-8c73-680379b8a340 -- POST / 200 752.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,931 mnist_classifier_MNISTClassifier e3knvfvk 9e6efa15-4c3a-4ecd-b0d8-5330046dabc7 -- POST / 200 753.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,931 mnist_classifier_MNISTClassifier e3knvfvk 0a7fe8b0-68ea-4c30-b8a3-94898241102e -- POST / 200 752.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,935 mnist_classifier_MNISTClassifier e3knvfvk ca7cfa84-8981-4cf0-8ddf-9e597ce66080 -- POST / 200 755.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:37:59,935 mnist_classifier_MNISTClassifier e3knvfvk 004bd9af-fa54-4659-8d64-3dcbd2f45d74 -- POST / 200 755.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,043 mnist_classifier_MNISTClassifier e3knvfvk b1105d8f-51c9-4fe7-a8ea-bc9a3611d1da -- POST / 200 513.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,044 mnist_classifier_MNISTClassifier e3knvfvk e90f1880-6211-4671-b08d-c5256b79e06e -- POST / 200 510.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,044 mnist_classifier_MNISTClassifier e3knvfvk de55af45-c9d7-40d0-8310-93e178e80709 -- POST / 200 533.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,045 mnist_classifier_MNISTClassifier e3knvfvk 286e9619-4ee9-426c-abd2-097e1711ddd1 -- POST / 200 509.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,045 mnist_classifier_MNISTClassifier e3knvfvk 26ed96b7-95af-4402-9c99-f039d3a46b37 -- POST / 200 509.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,046 mnist_classifier_MNISTClassifier e3knvfvk 0dae88cd-7188-434b-bee8-c4ff0542b09c -- POST / 200 509.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,046 mnist_classifier_MNISTClassifier e3knvfvk a34a06da-d016-4a1c-a102-ae153db70b62 -- POST / 200 507.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,047 mnist_classifier_MNISTClassifier e3knvfvk 32772fdf-ac17-4f3c-9f63-40122f0e4de6 -- POST / 200 507.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,047 mnist_classifier_MNISTClassifier e3knvfvk 4dc785d6-994d-4bcb-a525-1471661ae7e5 -- POST / 200 507.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,052 mnist_classifier_MNISTClassifier e3knvfvk 0fbc9a7e-bd90-487e-9c39-caf04d4296e3 -- POST / 200 510.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,052 mnist_classifier_MNISTClassifier e3knvfvk 0c3efa60-bee8-44b6-84ee-43c890831cb8 -- POST / 200 510.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,053 mnist_classifier_MNISTClassifier e3knvfvk 1862ea0d-541a-4ff1-bf61-201e65be5a14 -- POST / 200 511.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,053 mnist_classifier_MNISTClassifier e3knvfvk 9dd81b7a-6d45-4630-bf47-1a806bf66110 -- POST / 200 511.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,054 mnist_classifier_MNISTClassifier e3knvfvk a2a99b83-67fe-4078-ac04-02b0327a8ab9 -- POST / 200 510.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,054 mnist_classifier_MNISTClassifier e3knvfvk 06f67f45-171a-455d-bd3a-9da33963e291 -- POST / 200 509.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,054 mnist_classifier_MNISTClassifier e3knvfvk 53d7de1e-467e-45cf-8d30-7291cd30bc62 -- POST / 200 510.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,054 mnist_classifier_MNISTClassifier e3knvfvk ad7dc6de-1040-41f0-bf73-94048c5b92f3 -- POST / 200 509.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,055 mnist_classifier_MNISTClassifier e3knvfvk d5766df4-4963-40e3-93d8-4dd8efebe538 -- POST / 200 509.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,055 mnist_classifier_MNISTClassifier e3knvfvk 6fc93189-0990-44cd-996d-fc6a6a158222 -- POST / 200 508.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,055 mnist_classifier_MNISTClassifier e3knvfvk 933d5245-86df-41b7-949b-c6ddced42c3b -- POST / 200 508.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,055 mnist_classifier_MNISTClassifier e3knvfvk 8ac98f87-bbe6-420e-9f48-6626d1404a47 -- POST / 200 507.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,055 mnist_classifier_MNISTClassifier e3knvfvk 9d085b33-558e-4653-af6d-ba61da31f421 -- POST / 200 507.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,056 mnist_classifier_MNISTClassifier e3knvfvk f7da3719-f294-45f5-9f40-91f5cd1d4c6d -- POST / 200 506.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,056 mnist_classifier_MNISTClassifier e3knvfvk ff21bdd2-1e93-40ee-b672-a44732c8b96e -- POST / 200 506.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,056 mnist_classifier_MNISTClassifier e3knvfvk 687ab4ee-a1cc-40c1-ab2d-73197fd6b402 -- POST / 200 507.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,057 mnist_classifier_MNISTClassifier e3knvfvk f1ca9689-f7b4-4151-996f-7e60679887db -- POST / 200 507.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,057 mnist_classifier_MNISTClassifier e3knvfvk 822e3f21-d59e-49b8-ba3f-3fb254049781 -- POST / 200 506.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,057 mnist_classifier_MNISTClassifier e3knvfvk b873e0bc-6d83-4657-9663-c6e401b77b14 -- POST / 200 501.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,057 mnist_classifier_MNISTClassifier e3knvfvk b8be4b4f-6809-41cf-89c2-0abf600f0df3 -- POST / 200 501.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,058 mnist_classifier_MNISTClassifier e3knvfvk 2c33116b-0585-4cac-835e-97c1748a5dbb -- POST / 200 461.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,058 mnist_classifier_MNISTClassifier e3knvfvk f31b9426-1767-4409-b43c-a4f4beec1a5f -- POST / 200 450.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,058 mnist_classifier_MNISTClassifier e3knvfvk ed62a297-e384-4c01-998a-1cd02bd32671 -- POST / 200 448.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,059 mnist_classifier_MNISTClassifier e3knvfvk f678cf77-834d-409c-a5f9-47f0584438be -- POST / 200 448.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,059 mnist_classifier_MNISTClassifier e3knvfvk 4aff2e67-0f89-4824-a925-76135e04ca5b -- POST / 200 447.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,059 mnist_classifier_MNISTClassifier e3knvfvk 802487e3-f345-4355-87e4-a44932b52233 -- POST / 200 454.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,060 mnist_classifier_MNISTClassifier e3knvfvk 55a0a937-0072-49f5-aa87-affb8525fc06 -- POST / 200 446.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,060 mnist_classifier_MNISTClassifier e3knvfvk d9b2bea5-874e-482f-86f1-738df3bb9963 -- POST / 200 445.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,060 mnist_classifier_MNISTClassifier e3knvfvk 33824887-5e54-405c-aea1-f369a7388d9b -- POST / 200 445.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,060 mnist_classifier_MNISTClassifier e3knvfvk 0bc55b93-775f-45eb-b853-9ee4288c9e44 -- POST / 200 442.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,060 mnist_classifier_MNISTClassifier e3knvfvk e81781c2-4a42-40ce-91e8-71561c6a5414 -- POST / 200 442.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,061 mnist_classifier_MNISTClassifier e3knvfvk 3a941778-4ed1-4809-ad0a-fa6ad53b8e14 -- POST / 200 440.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,061 mnist_classifier_MNISTClassifier e3knvfvk e8701a5f-a3d8-4f5f-98f8-7ba1756d1547 -- POST / 200 440.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,062 mnist_classifier_MNISTClassifier e3knvfvk 8f27f9f0-b0c2-45aa-bae0-708f02417021 -- POST / 200 440.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,062 mnist_classifier_MNISTClassifier e3knvfvk 36d14c2b-1901-4de0-91ba-e8ad8d4a2070 -- POST / 200 440.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,064 mnist_classifier_MNISTClassifier e3knvfvk 9a17b1e9-86d4-4ae1-ba32-8ed8887fc887 -- POST / 200 260.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,065 mnist_classifier_MNISTClassifier e3knvfvk 58b22c02-6285-4d92-aa80-1df63262db13 -- POST / 200 258.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,065 mnist_classifier_MNISTClassifier e3knvfvk 2ce8b5d5-8b8e-40f0-9107-c7e1694341cf -- POST / 200 262.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,065 mnist_classifier_MNISTClassifier e3knvfvk cdfff478-9561-419a-95f7-7a116ba6fdc3 -- POST / 200 210.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,066 mnist_classifier_MNISTClassifier e3knvfvk a9563128-896d-4dac-814c-12fe69929af5 -- POST / 200 210.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,067 mnist_classifier_MNISTClassifier e3knvfvk 609f390f-2c53-4ece-be18-da9820294d37 -- POST / 200 210.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,067 mnist_classifier_MNISTClassifier e3knvfvk 3ee3a5f6-8211-4d82-927a-eab3e430cceb -- POST / 200 210.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,067 mnist_classifier_MNISTClassifier e3knvfvk c2c907f3-34e6-4a47-a16a-b4064f4e9f14 -- POST / 200 204.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,068 mnist_classifier_MNISTClassifier e3knvfvk 7c3065e0-335f-4631-8b6d-a87956b89c2a -- POST / 200 203.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,068 mnist_classifier_MNISTClassifier e3knvfvk b16df44a-c5de-4b46-9d29-8037611dbec7 -- POST / 200 204.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,069 mnist_classifier_MNISTClassifier e3knvfvk fd5f8c07-9e16-41ae-aee8-da9ff9a7fc51 -- POST / 200 203.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,069 mnist_classifier_MNISTClassifier e3knvfvk 368d3363-4aa0-4640-9681-7f9dafda9119 -- POST / 200 203.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,070 mnist_classifier_MNISTClassifier e3knvfvk 8e772177-3fef-49b4-9d9e-2b26674f08e4 -- POST / 200 203.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,070 mnist_classifier_MNISTClassifier e3knvfvk 625ad35f-5fea-452f-bd5a-965b3cbf0322 -- POST / 200 203.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,071 mnist_classifier_MNISTClassifier e3knvfvk b52d0f14-8c9b-4487-a0b5-749b06826659 -- POST / 200 202.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,071 mnist_classifier_MNISTClassifier e3knvfvk a6a61ee9-7a4b-4181-9674-51de610b2352 -- POST / 200 201.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,071 mnist_classifier_MNISTClassifier e3knvfvk e9df4fdb-085f-4d94-aea5-246e5c32545a -- POST / 200 201.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,072 mnist_classifier_MNISTClassifier e3knvfvk eb7a337e-d546-4f51-bc1e-f82cea0f022e -- POST / 200 201.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,073 mnist_classifier_MNISTClassifier e3knvfvk 29eb041d-bf44-4dc8-9448-b464d234edd5 -- POST / 200 200.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,073 mnist_classifier_MNISTClassifier e3knvfvk cba7699d-5fa1-444d-8e02-d7e96dd380ee -- POST / 200 200.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,074 mnist_classifier_MNISTClassifier e3knvfvk 0f6c69f9-374f-431c-92eb-d0942eab8b64 -- POST / 200 200.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,074 mnist_classifier_MNISTClassifier e3knvfvk d8830fe3-31f1-4ecb-8e82-fa49ef6aabfc -- POST / 200 199.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,076 mnist_classifier_MNISTClassifier e3knvfvk 156b4ab9-f8f3-4504-91cc-1bf83524177f -- POST / 200 201.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,076 mnist_classifier_MNISTClassifier e3knvfvk cc0e3fd6-6990-4f05-aa57-72354e1efed9 -- POST / 200 199.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,076 mnist_classifier_MNISTClassifier e3knvfvk 2b3aa5f4-07b6-4be0-9b3f-eb63077ab88a -- POST / 200 198.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,077 mnist_classifier_MNISTClassifier e3knvfvk cf92c27a-7b1f-4844-b38a-906fe16dc14d -- POST / 200 195.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,077 mnist_classifier_MNISTClassifier e3knvfvk 2592d3fa-1664-4bed-82d8-b03dfc13ada8 -- POST / 200 198.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,078 mnist_classifier_MNISTClassifier e3knvfvk 8d2f7019-54f7-43fe-a74e-1906dca90375 -- POST / 200 196.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,078 mnist_classifier_MNISTClassifier e3knvfvk 7b0d3c84-d64f-495d-ba11-3172b5c2b7f8 -- POST / 200 195.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,078 mnist_classifier_MNISTClassifier e3knvfvk 93586e2f-002f-4921-8a56-5ac165079a40 -- POST / 200 188.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,078 mnist_classifier_MNISTClassifier e3knvfvk 5be69096-72a4-4e37-8956-83b3f70b795d -- POST / 200 188.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,079 mnist_classifier_MNISTClassifier e3knvfvk 93ae0ec5-9d82-4ebb-8422-aa48356aa49e -- POST / 200 186.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,080 mnist_classifier_MNISTClassifier e3knvfvk 64598486-eb0f-4334-99ad-13369d20cd0b -- POST / 200 184.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,083 mnist_classifier_MNISTClassifier e3knvfvk 2eb7e2ef-138a-49bb-a175-3c156c673ead -- POST / 200 186.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,084 mnist_classifier_MNISTClassifier e3knvfvk ca1f6c59-54e0-4b06-b45e-416a5511e41c -- POST / 200 186.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,084 mnist_classifier_MNISTClassifier e3knvfvk 6acab2a1-07c0-44fa-850c-70044da04749 -- POST / 200 186.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,085 mnist_classifier_MNISTClassifier e3knvfvk 47c57bf2-4a2b-48a3-8615-1cb07e205884 -- POST / 200 185.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,085 mnist_classifier_MNISTClassifier e3knvfvk 8c398805-81fb-4831-809f-9c2b32c829cf -- POST / 200 185.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,085 mnist_classifier_MNISTClassifier e3knvfvk a66ab0d1-86b5-42bd-affe-a810b414ef89 -- POST / 200 184.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,085 mnist_classifier_MNISTClassifier e3knvfvk b7ed3ef9-7e15-4722-9a97-aa78328b7a73 -- POST / 200 184.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,085 mnist_classifier_MNISTClassifier e3knvfvk 7857b0dd-0b9c-46e0-ac55-ee25f0f39fda -- POST / 200 183.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,086 mnist_classifier_MNISTClassifier e3knvfvk 0c6a0d6d-10ae-4afa-b831-aa2c963e3ae3 -- POST / 200 184.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,089 mnist_classifier_MNISTClassifier e3knvfvk 7f369e88-3d74-4cce-86e4-9669200bf2fd -- POST / 200 186.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,093 mnist_classifier_MNISTClassifier e3knvfvk e514d032-ae23-4c5c-8071-e9c678ac3707 -- POST / 200 143.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,095 mnist_classifier_MNISTClassifier e3knvfvk 5cb2a74c-5885-482a-bc92-8e1cd13c0e04 -- POST / 200 143.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,097 mnist_classifier_MNISTClassifier e3knvfvk 23d23e60-bc57-46b7-b8b6-46e3ac276e65 -- POST / 200 144.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,097 mnist_classifier_MNISTClassifier e3knvfvk 8a24124a-f9df-458b-a74f-b631c058b2e4 -- POST / 200 144.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,100 mnist_classifier_MNISTClassifier e3knvfvk 6e318e6f-1927-4137-80a4-a794cbf5fe8a -- POST / 200 143.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,101 mnist_classifier_MNISTClassifier e3knvfvk cf9ffb88-bb8a-4924-9744-438a1147709a -- POST / 200 143.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,101 mnist_classifier_MNISTClassifier e3knvfvk 6fd7c1f8-a116-4a13-a0ae-4246b6e5375d -- POST / 200 142.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,102 mnist_classifier_MNISTClassifier e3knvfvk e632340c-48d3-4daf-8b51-36bbf1810d24 -- POST / 200 139.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,106 mnist_classifier_MNISTClassifier e3knvfvk a658e1ab-0ad0-4030-a598-9aed17fd9c74 -- POST / 200 142.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,106 mnist_classifier_MNISTClassifier e3knvfvk 49f6ae53-08c4-44cc-bf18-a8c2a35a6520 -- POST / 200 141.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,106 mnist_classifier_MNISTClassifier e3knvfvk c6f695ef-2a03-4ea5-9590-8c3e38d5da0c -- POST / 200 139.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,107 mnist_classifier_MNISTClassifier e3knvfvk 34661799-d9c0-4dad-aeaa-7293fb106dda -- POST / 200 139.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,107 mnist_classifier_MNISTClassifier e3knvfvk 98a6e018-9010-4456-b3ed-9fa0bf20770d -- POST / 200 138.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,358 mnist_classifier_MNISTClassifier e3knvfvk b4d8fffe-3131-4da2-adcd-a1d4b0086068 -- POST / 200 250.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,360 mnist_classifier_MNISTClassifier e3knvfvk 392f58c1-3c33-4aed-9c4b-8c77ee1d68cb -- POST / 200 252.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,360 mnist_classifier_MNISTClassifier e3knvfvk 928edb8d-0c7d-4898-880d-ad4f54a46d6c -- POST / 200 247.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,361 mnist_classifier_MNISTClassifier e3knvfvk 1ef2a037-2316-4a91-b8fd-3eb48179a0d1 -- POST / 200 251.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,361 mnist_classifier_MNISTClassifier e3knvfvk 2d3a94e0-1449-433c-84dd-25794d5b4206 -- POST / 200 248.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,371 mnist_classifier_MNISTClassifier e3knvfvk b0eb78ce-af46-4ca0-9eaa-c92024d8783c -- POST / 200 257.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,372 mnist_classifier_MNISTClassifier e3knvfvk 0f3e6946-1ae2-4db8-b6ab-d16f18a6ec4b -- POST / 200 257.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,372 mnist_classifier_MNISTClassifier e3knvfvk a6214747-1fd5-4dba-88bd-ee84458a2f52 -- POST / 200 253.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,373 mnist_classifier_MNISTClassifier e3knvfvk 61af91a3-4e65-47dc-b9fa-3a905e9123c2 -- POST / 200 254.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,373 mnist_classifier_MNISTClassifier e3knvfvk 11dbbf5e-14e7-4056-bae3-b7c1b5b687b0 -- POST / 200 258.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,375 mnist_classifier_MNISTClassifier e3knvfvk 7976a05a-a289-4cb4-b34e-eb620be9bb5a -- POST / 200 259.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,375 mnist_classifier_MNISTClassifier e3knvfvk 75e3ff52-49cb-46dc-87be-9fee14c422fc -- POST / 200 259.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,376 mnist_classifier_MNISTClassifier e3knvfvk 21db030a-cc77-4454-951c-6074b29b5c88 -- POST / 200 256.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,377 mnist_classifier_MNISTClassifier e3knvfvk 759e4ad2-70c4-451f-ba53-8a169228d4af -- POST / 200 246.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,379 mnist_classifier_MNISTClassifier e3knvfvk aae50d1f-2db6-472b-9e6e-2aa7bf4e883d -- POST / 200 234.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,381 mnist_classifier_MNISTClassifier e3knvfvk cb13fcb0-fabe-472c-9e49-aeed3e6447e6 -- POST / 200 238.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,382 mnist_classifier_MNISTClassifier e3knvfvk 8ee577be-185c-4f3d-a7b6-320369c2b014 -- POST / 200 260.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,390 mnist_classifier_MNISTClassifier e3knvfvk 96684b59-7775-4d20-b5e5-5041001015d9 -- POST / 200 267.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,394 mnist_classifier_MNISTClassifier e3knvfvk 78da229e-69bc-4fc3-9ab4-828e958b9037 -- POST / 200 269.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,396 mnist_classifier_MNISTClassifier e3knvfvk b9eaef4b-6c25-42d4-9335-12a2932624f0 -- POST / 200 270.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,396 mnist_classifier_MNISTClassifier e3knvfvk ccfd3e44-6c33-4c2b-89e1-ebc315b4af2f -- POST / 200 270.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,400 mnist_classifier_MNISTClassifier e3knvfvk 49eeabc0-6c96-4e5b-bfca-b02593375e46 -- POST / 200 272.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,404 mnist_classifier_MNISTClassifier e3knvfvk f6d9b6d8-e3c2-45ca-8001-ddf7e2d45812 -- POST / 200 276.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,405 mnist_classifier_MNISTClassifier e3knvfvk e27ea38b-15f2-49f4-b037-5bb957628fa1 -- POST / 200 275.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,405 mnist_classifier_MNISTClassifier e3knvfvk 6b479108-a64c-4af8-86ea-7b4ac749d8bb -- POST / 200 275.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,411 mnist_classifier_MNISTClassifier e3knvfvk bb0909c2-8930-46db-b883-3c3f518fc77a -- POST / 200 280.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,412 mnist_classifier_MNISTClassifier e3knvfvk e0902ad2-6651-459b-9310-7da658d01bc2 -- POST / 200 267.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,413 mnist_classifier_MNISTClassifier e3knvfvk fd89c785-8334-414a-9793-d56f1ca02a3c -- POST / 200 267.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,418 mnist_classifier_MNISTClassifier e3knvfvk a6ec814e-e20d-4e61-a76c-5b33ced082b3 -- POST / 200 269.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,420 mnist_classifier_MNISTClassifier e3knvfvk a9429167-4a85-4bb6-824d-41569150d4da -- POST / 200 270.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,420 mnist_classifier_MNISTClassifier e3knvfvk 3c9a1d8e-f634-4aef-b157-efbda555c539 -- POST / 200 263.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,421 mnist_classifier_MNISTClassifier e3knvfvk 08bcff84-fbe2-4c76-85e5-5dc99e9dc9ac -- POST / 200 263.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,421 mnist_classifier_MNISTClassifier e3knvfvk 34f67b34-1fbd-4ac4-a01a-e4a4e21ffe17 -- POST / 200 261.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,421 mnist_classifier_MNISTClassifier e3knvfvk 06cf94e1-ba0e-4505-8ffc-d3ac869e46d0 -- POST / 200 258.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,422 mnist_classifier_MNISTClassifier e3knvfvk 15c4798a-1ba7-45f3-95ea-7eb7e28c7e90 -- POST / 200 256.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,479 mnist_classifier_MNISTClassifier e3knvfvk ff3a2c61-adcb-460b-b1d3-e573bf662fd1 -- POST / 200 313.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,481 mnist_classifier_MNISTClassifier e3knvfvk da663153-71f7-453e-81d2-53c44980b446 -- POST / 200 314.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,481 mnist_classifier_MNISTClassifier e3knvfvk 1fc0e43b-a048-41c2-a752-feb3eb8fccb0 -- POST / 200 313.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,482 mnist_classifier_MNISTClassifier e3knvfvk 7f0e431f-7d4a-4204-b77c-c1907c92fd01 -- POST / 200 312.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,483 mnist_classifier_MNISTClassifier e3knvfvk 6100b8e5-1dfb-4366-a5d2-f5819479541a -- POST / 200 310.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,485 mnist_classifier_MNISTClassifier e3knvfvk 97e309b8-0677-4c1b-9234-ba8c16e58f5a -- POST / 200 312.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,485 mnist_classifier_MNISTClassifier e3knvfvk 5e925f3e-7dab-4a20-863a-bf6de8b561c3 -- POST / 200 311.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,486 mnist_classifier_MNISTClassifier e3knvfvk f32f59f8-350d-4d35-9f1d-7433ff2543a3 -- POST / 200 310.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,489 mnist_classifier_MNISTClassifier e3knvfvk 1f449d90-c04b-4c57-9ec0-000c6216bf64 -- POST / 200 307.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,492 mnist_classifier_MNISTClassifier e3knvfvk f106508c-2d06-438e-84b2-dfd321c8a041 -- POST / 200 308.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,494 mnist_classifier_MNISTClassifier e3knvfvk 8261c42e-5418-49c3-a6f3-1f96fa5f3167 -- POST / 200 308.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,494 mnist_classifier_MNISTClassifier e3knvfvk 56f431b6-7d61-4b56-95af-70706695586a -- POST / 200 287.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,495 mnist_classifier_MNISTClassifier e3knvfvk 32a666c4-190f-4be0-aa4d-1dc072b85de2 -- POST / 200 285.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,495 mnist_classifier_MNISTClassifier e3knvfvk 468e28c1-94ac-4680-9718-42b685930b0e -- POST / 200 309.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,496 mnist_classifier_MNISTClassifier e3knvfvk 8aaf21ad-93da-43bc-a8bf-ee30f1f95671 -- POST / 200 299.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,497 mnist_classifier_MNISTClassifier e3knvfvk 08b6fccf-eac3-4b87-9f81-144f22904657 -- POST / 200 296.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,497 mnist_classifier_MNISTClassifier e3knvfvk 93c2724b-bba9-4f52-b678-107066af655e -- POST / 200 285.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,498 mnist_classifier_MNISTClassifier e3knvfvk d84d9bdc-5e13-4edb-a195-8943ed094eb3 -- POST / 200 285.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,500 mnist_classifier_MNISTClassifier e3knvfvk f71da30c-77d2-411e-9095-96264cac99f7 -- POST / 200 284.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,509 mnist_classifier_MNISTClassifier e3knvfvk 116be34c-371d-42ea-a006-23718f4e4520 -- POST / 200 295.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,512 mnist_classifier_MNISTClassifier e3knvfvk 49c8f4f1-bb5a-4df7-b4dd-dbdab349794d -- POST / 200 271.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,517 mnist_classifier_MNISTClassifier e3knvfvk 14e68148-9b99-4466-b88f-14f855853730 -- POST / 200 293.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,521 mnist_classifier_MNISTClassifier e3knvfvk 2043ab12-5a8f-433f-94aa-00b52984d8b7 -- POST / 200 288.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,522 mnist_classifier_MNISTClassifier e3knvfvk a4ac2c50-f786-49f6-bd71-0770b6239d8a -- POST / 200 280.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,522 mnist_classifier_MNISTClassifier e3knvfvk ffa87da1-3b1a-4b20-bc79-7e5b81c2b7f8 -- POST / 200 282.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,522 mnist_classifier_MNISTClassifier e3knvfvk 640c6bbf-c086-4988-8ed9-9b0d7cac76a8 -- POST / 200 279.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,523 mnist_classifier_MNISTClassifier e3knvfvk 5cd6936a-ca45-4d55-8a29-08e9b116ff9d -- POST / 200 279.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,523 mnist_classifier_MNISTClassifier e3knvfvk b381eb42-c9db-438a-b567-5c77e3c769ae -- POST / 200 279.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,524 mnist_classifier_MNISTClassifier e3knvfvk e89f3c76-b348-4343-b5c2-669438cc3ea5 -- POST / 200 280.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,525 mnist_classifier_MNISTClassifier e3knvfvk 6c7b38b0-d009-4aa7-a258-87b1a3cc04b8 -- POST / 200 279.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,526 mnist_classifier_MNISTClassifier e3knvfvk 1d45c172-5588-4bd6-9c76-1980188a10a4 -- POST / 200 279.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,526 mnist_classifier_MNISTClassifier e3knvfvk f41c5365-3ebd-466a-9db5-0852c113aa4b -- POST / 200 279.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,527 mnist_classifier_MNISTClassifier e3knvfvk 109ede97-4ad5-4069-8583-700cb08ba9f5 -- POST / 200 274.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,527 mnist_classifier_MNISTClassifier e3knvfvk afbdc8d4-3370-4cbe-99e2-3dfc2d9e8cfc -- POST / 200 273.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,528 mnist_classifier_MNISTClassifier e3knvfvk 7d02bde3-dfd1-4113-9aae-cb0aba590fc0 -- POST / 200 272.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,528 mnist_classifier_MNISTClassifier e3knvfvk 62cf52de-8e04-4817-a2dd-abbe67bdfc13 -- POST / 200 272.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,529 mnist_classifier_MNISTClassifier e3knvfvk c9a2d895-a43f-4073-9bce-a7e249043e3a -- POST / 200 272.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,530 mnist_classifier_MNISTClassifier e3knvfvk 9124dc9b-6bc2-48cf-b753-c906742e1230 -- POST / 200 273.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,537 mnist_classifier_MNISTClassifier e3knvfvk 9e1fca1c-f860-46e5-b243-a81e3084736d -- POST / 200 279.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,539 mnist_classifier_MNISTClassifier e3knvfvk 68889304-1100-47d8-b43e-74168c61c695 -- POST / 200 281.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,539 mnist_classifier_MNISTClassifier e3knvfvk 7191ccca-4ac3-476d-b6cf-ae46d4cbebd8 -- POST / 200 281.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,540 mnist_classifier_MNISTClassifier e3knvfvk 3babc459-6dcb-49a6-93cd-593b6cf1cddf -- POST / 200 273.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,540 mnist_classifier_MNISTClassifier e3knvfvk 0cb53ffe-7901-4378-8810-6eaa9dbd321c -- POST / 200 278.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,540 mnist_classifier_MNISTClassifier e3knvfvk 32726c81-f7cb-4122-81cd-09b8ee6d8ee8 -- POST / 200 276.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,541 mnist_classifier_MNISTClassifier e3knvfvk 1f4bcad3-f00e-48ca-b67a-db077f34b699 -- POST / 200 273.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,541 mnist_classifier_MNISTClassifier e3knvfvk 30260491-31f5-4015-b4d1-40ce1170ba37 -- POST / 200 273.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,543 mnist_classifier_MNISTClassifier e3knvfvk eb3c2aea-eb25-4f18-a358-78c6dc9f27a5 -- POST / 200 275.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,544 mnist_classifier_MNISTClassifier e3knvfvk c90528a7-e812-4803-a399-d69f35c17f57 -- POST / 200 274.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,545 mnist_classifier_MNISTClassifier e3knvfvk a3401d19-1a82-4156-8d1b-908096b992d8 -- POST / 200 275.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,546 mnist_classifier_MNISTClassifier e3knvfvk 0c2a7110-52ad-4d5d-9cde-c49013d1d430 -- POST / 200 276.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,547 mnist_classifier_MNISTClassifier e3knvfvk c95c423e-f3aa-454b-90bc-af86c4fa1adf -- POST / 200 276.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,548 mnist_classifier_MNISTClassifier e3knvfvk 982ee956-0bf7-4a93-ad35-d6d0dc6e1198 -- POST / 200 277.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,549 mnist_classifier_MNISTClassifier e3knvfvk 2a9f490b-38c8-4df6-96d6-2d6a5c6ebe52 -- POST / 200 278.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,550 mnist_classifier_MNISTClassifier e3knvfvk 34085694-4a44-4876-bfb4-bf91fbb4b053 -- POST / 200 278.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,550 mnist_classifier_MNISTClassifier e3knvfvk bad4f4a2-8bdd-4826-ab01-881da4e10743 -- POST / 200 274.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,550 mnist_classifier_MNISTClassifier e3knvfvk 20350fef-cf56-4024-9079-4be9d0eda8a3 -- POST / 200 272.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,552 mnist_classifier_MNISTClassifier e3knvfvk 2f5ce2ff-875a-40de-b5d0-d75624683726 -- POST / 200 271.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,552 mnist_classifier_MNISTClassifier e3knvfvk d16bee91-dbba-4195-ac2a-4e951c77ea22 -- POST / 200 273.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,553 mnist_classifier_MNISTClassifier e3knvfvk fb4c9f57-6ced-440e-aff8-a464b59234f1 -- POST / 200 271.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,553 mnist_classifier_MNISTClassifier e3knvfvk 1b3e180c-39bd-423e-b5c8-43aaf5fe8296 -- POST / 200 269.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,553 mnist_classifier_MNISTClassifier e3knvfvk bb79813f-fb0a-48e7-a6a8-c448a8e27ee6 -- POST / 200 268.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,553 mnist_classifier_MNISTClassifier e3knvfvk 56e81923-171d-4e24-8f06-0e3cc30f3d16 -- POST / 200 264.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,553 mnist_classifier_MNISTClassifier e3knvfvk 4f45c90f-0a0c-4edc-af28-7baef92d355b -- POST / 200 265.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,554 mnist_classifier_MNISTClassifier e3knvfvk bc7fced6-7a19-4e1d-a848-580d68b23386 -- POST / 200 265.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,554 mnist_classifier_MNISTClassifier e3knvfvk 86145897-0893-4404-8235-785fd948b15e -- POST / 200 266.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,813 mnist_classifier_MNISTClassifier e3knvfvk f12f99ed-90fd-4a24-9bbd-f8a07976502e -- POST / 200 390.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,814 mnist_classifier_MNISTClassifier e3knvfvk def165cf-27c7-4c1f-ad07-6dafe482edb8 -- POST / 200 391.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,816 mnist_classifier_MNISTClassifier e3knvfvk 7f856edb-f573-4b99-a111-59c897b7bf4c -- POST / 200 426.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,817 mnist_classifier_MNISTClassifier e3knvfvk 48d76047-5357-430f-9893-ea76ef3e6ec5 -- POST / 200 426.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,817 mnist_classifier_MNISTClassifier e3knvfvk f5580ada-2cd5-4f2c-a136-65d4279ace25 -- POST / 200 406.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,818 mnist_classifier_MNISTClassifier e3knvfvk 0b5afadb-5cdd-4529-a766-09a88b10097e -- POST / 200 405.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,818 mnist_classifier_MNISTClassifier e3knvfvk 84712aff-8366-4bb2-9a0e-82c080ec21b6 -- POST / 200 401.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,819 mnist_classifier_MNISTClassifier e3knvfvk 37c7fe56-3c7d-4f92-8e95-ebe09a0cf50a -- POST / 200 396.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,819 mnist_classifier_MNISTClassifier e3knvfvk f9bb9f49-abea-4b18-9609-d7325aa056fa -- POST / 200 395.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,819 mnist_classifier_MNISTClassifier e3knvfvk 47e8ecf7-34d5-422e-b2bf-0609f3e62473 -- POST / 200 395.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,819 mnist_classifier_MNISTClassifier e3knvfvk c40065f9-6141-4e9c-90fd-f31c37cb40df -- POST / 200 395.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,834 mnist_classifier_MNISTClassifier e3knvfvk a09838c9-991f-48ce-ae56-05553329a3c2 -- POST / 200 409.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,837 mnist_classifier_MNISTClassifier e3knvfvk 2fe69c7e-075f-4d18-9164-f70e05e2a3a4 -- POST / 200 413.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,838 mnist_classifier_MNISTClassifier e3knvfvk 46942fdb-ec83-439a-a6d2-7780c5e0a3fb -- POST / 200 413.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,839 mnist_classifier_MNISTClassifier e3knvfvk 24d78c74-1766-4b9a-9c55-d48c079bf348 -- POST / 200 413.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,839 mnist_classifier_MNISTClassifier e3knvfvk 7491c079-a801-4ddd-ac0a-e4a316f8d1b7 -- POST / 200 414.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,840 mnist_classifier_MNISTClassifier e3knvfvk eb48f7a9-adde-4a85-9aba-f71c1edaf902 -- POST / 200 414.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,840 mnist_classifier_MNISTClassifier e3knvfvk 6981c375-aa5c-41cd-b83f-63e5671326bf -- POST / 200 415.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,841 mnist_classifier_MNISTClassifier e3knvfvk c7dedcd5-d752-40cd-9fa8-adbfae6d665c -- POST / 200 415.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,841 mnist_classifier_MNISTClassifier e3knvfvk 333f0145-8b9e-4b1a-a78f-27ef6d34d99a -- POST / 200 415.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,842 mnist_classifier_MNISTClassifier e3knvfvk 64367a4b-6020-49ae-b31d-182258790e18 -- POST / 200 415.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,842 mnist_classifier_MNISTClassifier e3knvfvk 9d2d4d9b-2ac8-4e0c-a1ef-1379eaedaae9 -- POST / 200 408.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,843 mnist_classifier_MNISTClassifier e3knvfvk 78fd8137-852a-498f-9c66-a28984907128 -- POST / 200 407.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,843 mnist_classifier_MNISTClassifier e3knvfvk f0928c6d-2f89-4119-bfea-c71491654d08 -- POST / 200 410.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,844 mnist_classifier_MNISTClassifier e3knvfvk 86609a1e-9a41-4870-bc63-daf5ec7b8200 -- POST / 200 410.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,844 mnist_classifier_MNISTClassifier e3knvfvk 3197a244-6e2d-4088-99cb-58f530ce8038 -- POST / 200 389.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,845 mnist_classifier_MNISTClassifier e3knvfvk acb8deb2-9c27-4342-9d5c-597c421f22e2 -- POST / 200 409.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,846 mnist_classifier_MNISTClassifier e3knvfvk c7ef4e06-6b5f-4728-abfc-a51aac3d5385 -- POST / 200 394.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,846 mnist_classifier_MNISTClassifier e3knvfvk 757a6fc2-43f1-40ec-86f5-94162c048bab -- POST / 200 394.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,847 mnist_classifier_MNISTClassifier e3knvfvk 265b0eec-6394-4eee-b2ce-30d754372753 -- POST / 200 393.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,847 mnist_classifier_MNISTClassifier e3knvfvk 26bd4b26-3fcc-4d5b-9e63-28d8a73ca91f -- POST / 200 393.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,847 mnist_classifier_MNISTClassifier e3knvfvk 23bf188f-ec23-4404-ab5d-c500939f77f4 -- POST / 200 391.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,848 mnist_classifier_MNISTClassifier e3knvfvk 598a77d8-df74-4023-9675-62cb8352749f -- POST / 200 391.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,848 mnist_classifier_MNISTClassifier e3knvfvk 0247f260-8fe9-4ef2-b02a-09365474d292 -- POST / 200 390.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,852 mnist_classifier_MNISTClassifier e3knvfvk d9d93fa8-cd15-43ff-a8e6-bdc3577a8ad1 -- POST / 200 394.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,980 mnist_classifier_MNISTClassifier e3knvfvk d601c57a-bc58-4e19-b21b-68bd51409894 -- POST / 200 403.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,981 mnist_classifier_MNISTClassifier e3knvfvk eadbd427-7681-4d56-aaef-4232d393380c -- POST / 200 482.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,981 mnist_classifier_MNISTClassifier e3knvfvk 685a0edc-d273-41c9-aa38-9da76cefdb51 -- POST / 200 459.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,982 mnist_classifier_MNISTClassifier e3knvfvk e47d961f-4fe2-4180-8981-ce088c4fd67f -- POST / 200 455.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,982 mnist_classifier_MNISTClassifier e3knvfvk 2ced38ae-085e-4662-bc7c-507227293bfe -- POST / 200 452.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,983 mnist_classifier_MNISTClassifier e3knvfvk 091b63b0-3b2d-4bbe-b7ac-ed712101fa01 -- POST / 200 428.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,984 mnist_classifier_MNISTClassifier e3knvfvk ee79dd42-6b4f-440a-9e7d-a6db3f912aae -- POST / 200 428.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,984 mnist_classifier_MNISTClassifier e3knvfvk 7e5286f5-8269-4306-8fb8-cee621fcc07e -- POST / 200 424.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,985 mnist_classifier_MNISTClassifier e3knvfvk 0bd9346b-67d5-4fb0-b45b-8bd96e8a629e -- POST / 200 422.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,986 mnist_classifier_MNISTClassifier e3knvfvk f7a14c09-db4d-48a5-8e1e-3fc31201cf80 -- POST / 200 418.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,986 mnist_classifier_MNISTClassifier e3knvfvk 5695a93e-fa07-4adf-a6f9-f2663e698fb5 -- POST / 200 418.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,987 mnist_classifier_MNISTClassifier e3knvfvk 645b1b4f-bcaf-452c-886e-0144d987124b -- POST / 200 417.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,988 mnist_classifier_MNISTClassifier e3knvfvk 30db7591-fbbd-429d-b154-729fb4437c7e -- POST / 200 417.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,988 mnist_classifier_MNISTClassifier e3knvfvk 551ddd52-da10-4262-bdd1-1e2ded07098f -- POST / 200 416.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,988 mnist_classifier_MNISTClassifier e3knvfvk 053b955f-b757-4230-b7ce-a1c98025393a -- POST / 200 416.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,989 mnist_classifier_MNISTClassifier e3knvfvk 4677c47a-8597-403c-a87b-8f49f05af17a -- POST / 200 411.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,989 mnist_classifier_MNISTClassifier e3knvfvk b1117b50-d4e7-4c77-82a0-90c72897df92 -- POST / 200 410.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,991 mnist_classifier_MNISTClassifier e3knvfvk cb9fe6b2-0cbf-4675-b90e-e08ab9c0cf69 -- POST / 200 411.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,992 mnist_classifier_MNISTClassifier e3knvfvk 8390be39-1c00-41d2-8fe2-a3b37a68179f -- POST / 200 411.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,992 mnist_classifier_MNISTClassifier e3knvfvk 5bae5376-6af4-4df7-a878-fcad98dfeb9e -- POST / 200 411.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,992 mnist_classifier_MNISTClassifier e3knvfvk 2a92f2ed-ab77-4157-9219-c615ef298c53 -- POST / 200 410.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,992 mnist_classifier_MNISTClassifier e3knvfvk f76fdb77-05d5-4e36-8e95-6efe2e5ea99b -- POST / 200 407.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,993 mnist_classifier_MNISTClassifier e3knvfvk d4e36540-d502-4cf0-b4a8-5e1df9156fd5 -- POST / 200 407.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,993 mnist_classifier_MNISTClassifier e3knvfvk 2a8e356a-7ca6-490d-89b1-36be45094011 -- POST / 200 407.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,994 mnist_classifier_MNISTClassifier e3knvfvk 6ae87d16-95a0-4dae-9ec0-67ed4ac05d13 -- POST / 200 408.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,994 mnist_classifier_MNISTClassifier e3knvfvk d07a9938-ec2f-4f04-8a3f-4c8ddd59b872 -- POST / 200 408.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,994 mnist_classifier_MNISTClassifier e3knvfvk 96971729-bb77-45dc-ba8f-64e8774d8cd2 -- POST / 200 407.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,995 mnist_classifier_MNISTClassifier e3knvfvk 78ef45c3-17b6-4c46-8b65-aa3477cbf3b7 -- POST / 200 407.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,995 mnist_classifier_MNISTClassifier e3knvfvk 4e7b55ba-d76e-4a86-bbf8-2f048aae64f2 -- POST / 200 406.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,996 mnist_classifier_MNISTClassifier e3knvfvk e561391d-6a77-4319-a328-4e7a2ed98bbf -- POST / 200 407.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,997 mnist_classifier_MNISTClassifier e3knvfvk b5f654a9-1772-4627-b935-ec0596d9d636 -- POST / 200 404.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,997 mnist_classifier_MNISTClassifier e3knvfvk 8ec6d19a-9db0-4a40-8da5-ad7a21ff198e -- POST / 200 404.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,997 mnist_classifier_MNISTClassifier e3knvfvk ee6a9a46-2ae8-4c4b-84b1-1461736fe824 -- POST / 200 404.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,997 mnist_classifier_MNISTClassifier e3knvfvk 5ecce214-775c-4219-8d6b-be2c8f1d8eec -- POST / 200 404.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,998 mnist_classifier_MNISTClassifier e3knvfvk 93a280c0-a04c-4a0b-8926-60fd18fd8400 -- POST / 200 404.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,998 mnist_classifier_MNISTClassifier e3knvfvk 85d203e0-0612-4ace-8680-23dcfb123e72 -- POST / 200 404.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:00,999 mnist_classifier_MNISTClassifier e3knvfvk 8fc679bc-1158-4205-9a42-d72d55492368 -- POST / 200 400.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,000 mnist_classifier_MNISTClassifier e3knvfvk 996197d2-9721-4593-b3c4-215bd80fee06 -- POST / 200 240.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,000 mnist_classifier_MNISTClassifier e3knvfvk 917ef6b2-005e-44c1-b3fc-b08f67372360 -- POST / 200 238.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,001 mnist_classifier_MNISTClassifier e3knvfvk 90fca71d-6b89-4158-8e19-14cddd2965d2 -- POST / 200 238.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,002 mnist_classifier_MNISTClassifier e3knvfvk 73cb5187-20e1-4327-b941-5ffb6484e29c -- POST / 200 239.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,007 mnist_classifier_MNISTClassifier e3knvfvk 7bc58b56-fb2b-4426-ab4e-dc2fa5d0f318 -- POST / 200 243.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,008 mnist_classifier_MNISTClassifier e3knvfvk ae5a991d-b310-4d9d-8878-3d7cbd69dab2 -- POST / 200 244.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,008 mnist_classifier_MNISTClassifier e3knvfvk cc9ac428-9239-42bb-aa3e-e32f9f2f6576 -- POST / 200 243.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,008 mnist_classifier_MNISTClassifier e3knvfvk 75511985-b8c4-4dd2-9456-772c142bfc33 -- POST / 200 243.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,008 mnist_classifier_MNISTClassifier e3knvfvk cf9278ec-82ca-4e58-a0ac-a6cb36664950 -- POST / 200 242.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,009 mnist_classifier_MNISTClassifier e3knvfvk 0b2079ac-a315-4c02-8e56-9584cff9fa6b -- POST / 200 241.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,009 mnist_classifier_MNISTClassifier e3knvfvk 8441e94a-f2a4-42ea-8594-96847eb05a0c -- POST / 200 239.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,010 mnist_classifier_MNISTClassifier e3knvfvk 460dd060-af7c-4040-b504-e5c0296a4432 -- POST / 200 241.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,011 mnist_classifier_MNISTClassifier e3knvfvk feb3d8d4-29f2-4917-adb8-025b83037bca -- POST / 200 241.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,011 mnist_classifier_MNISTClassifier e3knvfvk 3f034375-131a-493e-b365-dea4105e5e44 -- POST / 200 243.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,012 mnist_classifier_MNISTClassifier e3knvfvk 2c87fa07-f519-4e7b-96cd-2dc13e1195fc -- POST / 200 241.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,012 mnist_classifier_MNISTClassifier e3knvfvk 9f2af8f5-6626-4e72-8b74-aece835c4316 -- POST / 200 241.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,012 mnist_classifier_MNISTClassifier e3knvfvk f00b7442-b23f-4a20-b0ce-034f25ae1819 -- POST / 200 241.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,013 mnist_classifier_MNISTClassifier e3knvfvk e51b4f0f-3773-4e56-a290-a88732a1c4f9 -- POST / 200 235.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,013 mnist_classifier_MNISTClassifier e3knvfvk 1ceda8f8-93c7-4a1d-bb4a-9d35dd722922 -- POST / 200 240.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,013 mnist_classifier_MNISTClassifier e3knvfvk b6d65f59-9092-4687-8168-96421bead2ba -- POST / 200 240.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,014 mnist_classifier_MNISTClassifier e3knvfvk b7767046-34ce-4c24-b2a0-1dc2a5cf70ce -- POST / 200 239.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,015 mnist_classifier_MNISTClassifier e3knvfvk 9c98aec4-7f50-4830-b530-963b1f444690 -- POST / 200 238.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,015 mnist_classifier_MNISTClassifier e3knvfvk 86633e74-d0e8-4e8a-81d1-b25dc068a487 -- POST / 200 237.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,015 mnist_classifier_MNISTClassifier e3knvfvk 142b5c9f-9a72-44b2-a4b0-68b8ea6c7bf1 -- POST / 200 237.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,017 mnist_classifier_MNISTClassifier e3knvfvk 5542a449-4236-4a21-b50b-de91c3625d1f -- POST / 200 159.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,020 mnist_classifier_MNISTClassifier e3knvfvk b7ad0f46-1fba-45d9-972a-caea7e90c9a7 -- POST / 200 160.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,020 mnist_classifier_MNISTClassifier e3knvfvk ad37b04b-4154-4f2d-b569-741e4d559bf4 -- POST / 200 158.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,020 mnist_classifier_MNISTClassifier e3knvfvk fdbdf3e7-9f12-495c-837c-e3316ad0b513 -- POST / 200 158.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,026 mnist_classifier_MNISTClassifier e3knvfvk 3c14f982-160d-467a-be9c-c0bd03d020ef -- POST / 200 164.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,027 mnist_classifier_MNISTClassifier e3knvfvk e5159f80-5b7d-4527-ab7b-26354f8b64cb -- POST / 200 164.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,028 mnist_classifier_MNISTClassifier e3knvfvk d0a0aee6-7a77-4b60-bc69-801a1eddad53 -- POST / 200 165.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,032 mnist_classifier_MNISTClassifier e3knvfvk 50712a39-50cd-4707-acd3-2933795d804e -- POST / 200 169.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,033 mnist_classifier_MNISTClassifier e3knvfvk fd11bb1e-1914-4c07-9de0-c329693016e1 -- POST / 200 169.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,033 mnist_classifier_MNISTClassifier e3knvfvk 86272c5d-715c-45f2-938a-50f8bc3ecc1f -- POST / 200 169.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,034 mnist_classifier_MNISTClassifier e3knvfvk 0f100d66-d77f-458f-acdd-519b60f5f2ae -- POST / 200 165.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,036 mnist_classifier_MNISTClassifier e3knvfvk 6d36a492-cee8-47b9-aa3c-93baffef12e0 -- POST / 200 165.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,037 mnist_classifier_MNISTClassifier e3knvfvk 23972c80-5c70-4a92-a4e2-a4f58e930037 -- POST / 200 164.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,038 mnist_classifier_MNISTClassifier e3knvfvk 0616e4bc-def6-4d2d-ab2d-3baf4b3a937e -- POST / 200 164.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,038 mnist_classifier_MNISTClassifier e3knvfvk 1ceb30a3-ba2d-4905-9ce9-4cfb7643aed1 -- POST / 200 164.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,038 mnist_classifier_MNISTClassifier e3knvfvk 6828445f-f2c2-43de-bb53-148ece59d8cf -- POST / 200 164.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,038 mnist_classifier_MNISTClassifier e3knvfvk f0b82d96-6847-4355-a9ca-3c7abb147db3 -- POST / 200 164.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,039 mnist_classifier_MNISTClassifier e3knvfvk 2c904007-28b8-4fa0-811e-6eddc54c6164 -- POST / 200 161.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,039 mnist_classifier_MNISTClassifier e3knvfvk 603d2c96-bdb1-4f3f-b196-ffb4848afe18 -- POST / 200 162.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,039 mnist_classifier_MNISTClassifier e3knvfvk 30c2a2b1-23bd-40d9-82fe-3dfa97202ecc -- POST / 200 161.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,039 mnist_classifier_MNISTClassifier e3knvfvk 463c0ace-8518-4cf8-ad0b-076d6b7b996e -- POST / 200 159.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,040 mnist_classifier_MNISTClassifier e3knvfvk 41658303-75ba-4ed5-8b2d-54d466b42a09 -- POST / 200 149.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,040 mnist_classifier_MNISTClassifier e3knvfvk 1669410c-133d-4fa0-8a1d-19f1cf2b06ee -- POST / 200 147.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,040 mnist_classifier_MNISTClassifier e3knvfvk 1106b6d1-b7d3-442d-b190-96bb3586b0b4 -- POST / 200 147.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,041 mnist_classifier_MNISTClassifier e3knvfvk 1670fb44-fae2-4fca-979d-04bbad3b24df -- POST / 200 147.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,041 mnist_classifier_MNISTClassifier e3knvfvk 08f72b5f-d4b1-4c52-8840-b752e0161f65 -- POST / 200 145.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,041 mnist_classifier_MNISTClassifier e3knvfvk d38bc2e3-9652-4de0-99e1-049710324350 -- POST / 200 145.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,042 mnist_classifier_MNISTClassifier e3knvfvk 55a4899c-f2d1-4d6e-87a3-4092e13deda6 -- POST / 200 146.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,043 mnist_classifier_MNISTClassifier e3knvfvk ec510253-55a2-487c-ac16-f2bd97c62cdd -- POST / 200 137.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,044 mnist_classifier_MNISTClassifier e3knvfvk 1ae71ed5-ff5b-4068-a3c5-3331532af86b -- POST / 200 138.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,044 mnist_classifier_MNISTClassifier e3knvfvk 22edce4e-0f1b-4535-acfa-f9f6eef86dcd -- POST / 200 136.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,047 mnist_classifier_MNISTClassifier e3knvfvk 309d17f2-e273-43a3-a983-ac8b20ca5dad -- POST / 200 267.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,047 mnist_classifier_MNISTClassifier e3knvfvk 88ca7763-4981-48bf-806a-7e7f70f129c8 -- POST / 200 267.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,048 mnist_classifier_MNISTClassifier e3knvfvk 526a1769-439d-46d5-843a-10731a3a40cb -- POST / 200 268.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,049 mnist_classifier_MNISTClassifier e3knvfvk dd21f676-4f8a-40a3-ae50-80b98f093747 -- POST / 200 268.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,049 mnist_classifier_MNISTClassifier e3knvfvk d76c3581-e960-420f-b32a-f0f4deb8b58d -- POST / 200 197.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,050 mnist_classifier_MNISTClassifier e3knvfvk 06101250-6154-4de1-901e-cf0bf5c65c72 -- POST / 200 197.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,050 mnist_classifier_MNISTClassifier e3knvfvk 272a8bfe-a53f-494f-9700-a4f3b737e135 -- POST / 200 194.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,051 mnist_classifier_MNISTClassifier e3knvfvk c3b6fe08-209f-44ed-bd5b-a093be3ef7c9 -- POST / 200 194.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,247 mnist_classifier_MNISTClassifier e3knvfvk 73bcb7da-cc48-4e1a-b41f-3798e522b165 -- POST / 200 261.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,248 mnist_classifier_MNISTClassifier e3knvfvk b2270b70-11a5-493a-9f83-62ea3c0b94e6 -- POST / 200 231.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,249 mnist_classifier_MNISTClassifier e3knvfvk 2c7e6bfb-92f3-49e5-b755-5fc98c05e1d5 -- POST / 200 223.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,251 mnist_classifier_MNISTClassifier e3knvfvk 5cfbdbd1-f373-4e24-9769-3fd293e4804e -- POST / 200 199.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,252 mnist_classifier_MNISTClassifier e3knvfvk b51bf7cb-7190-462e-a14e-674aaef60f99 -- POST / 200 197.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,253 mnist_classifier_MNISTClassifier e3knvfvk 3f88e90c-0e4c-4d9c-9ed1-2b558599012a -- POST / 200 192.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,257 mnist_classifier_MNISTClassifier e3knvfvk 433e3e5e-5d01-43f9-bd47-cb21f2457500 -- POST / 200 193.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,258 mnist_classifier_MNISTClassifier e3knvfvk ce82c919-69fc-41a4-9b77-4c0adf0b747d -- POST / 200 199.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,259 mnist_classifier_MNISTClassifier e3knvfvk 365e4cb8-97b4-4048-9512-9e8819ee60d6 -- POST / 200 191.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,260 mnist_classifier_MNISTClassifier e3knvfvk 6c08b784-4a8e-4198-9b83-b2845894cccc -- POST / 200 192.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,262 mnist_classifier_MNISTClassifier e3knvfvk 5daabc5f-397b-45cd-9bc4-ceebda066d69 -- POST / 200 197.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,262 mnist_classifier_MNISTClassifier e3knvfvk 3462febe-c6b2-4993-925e-98a4c65a7f47 -- POST / 200 194.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,263 mnist_classifier_MNISTClassifier e3knvfvk 966b3c1c-aaf0-46fb-9c8c-fc4f106433ed -- POST / 200 190.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,380 mnist_classifier_MNISTClassifier e3knvfvk 4522dcd4-138a-4d6a-be1b-349a1c30aa1a -- POST / 200 310.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,380 mnist_classifier_MNISTClassifier e3knvfvk ba0a3d14-5e00-458d-abb6-6c0663076484 -- POST / 200 312.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,381 mnist_classifier_MNISTClassifier e3knvfvk e87a6328-cd97-473d-b6a0-f51a07dea0bd -- POST / 200 312.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,382 mnist_classifier_MNISTClassifier e3knvfvk 2a6e9257-f045-4679-9d83-0fb059296684 -- POST / 200 313.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,383 mnist_classifier_MNISTClassifier e3knvfvk ec3e950a-7920-4f69-b5be-390fdbc714f6 -- POST / 200 314.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,383 mnist_classifier_MNISTClassifier e3knvfvk 5fa62afb-0c68-4349-af37-3bbd7b9519c9 -- POST / 200 314.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,385 mnist_classifier_MNISTClassifier e3knvfvk 027bdb37-95d8-473c-b5d4-36bf169fa226 -- POST / 200 299.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,386 mnist_classifier_MNISTClassifier e3knvfvk 3dd30946-0221-4714-b82e-dced933e5aca -- POST / 200 316.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,386 mnist_classifier_MNISTClassifier e3knvfvk 45085b23-a66b-49d4-9fed-fc1627398df3 -- POST / 200 316.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,386 mnist_classifier_MNISTClassifier e3knvfvk 7f750af2-638d-4530-bc56-019f92588b9f -- POST / 200 316.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,387 mnist_classifier_MNISTClassifier e3knvfvk 9d0d3364-b771-4271-9478-df665f1a08cf -- POST / 200 316.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,388 mnist_classifier_MNISTClassifier e3knvfvk 89fba371-0cae-42ad-a831-2e5cff80ef5b -- POST / 200 317.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,388 mnist_classifier_MNISTClassifier e3knvfvk a6bbcaca-a416-46dc-b060-7b9a053562a2 -- POST / 200 317.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,389 mnist_classifier_MNISTClassifier e3knvfvk 65f76e0e-78ca-4a56-a2d8-c031330abf22 -- POST / 200 317.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,389 mnist_classifier_MNISTClassifier e3knvfvk 1b251248-e635-4ee7-add5-f91a09f2b5e9 -- POST / 200 317.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,389 mnist_classifier_MNISTClassifier e3knvfvk 4670802f-fd02-45e3-b3ca-7665ddfe797b -- POST / 200 317.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,389 mnist_classifier_MNISTClassifier e3knvfvk 77960e77-03a9-4e80-b28e-24e673899ea2 -- POST / 200 317.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,390 mnist_classifier_MNISTClassifier e3knvfvk 8b09472f-c1a2-479c-a859-324d511b8d4f -- POST / 200 317.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,390 mnist_classifier_MNISTClassifier e3knvfvk ae20e98b-aab0-443b-b2e5-0832ae8d7e36 -- POST / 200 317.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,390 mnist_classifier_MNISTClassifier e3knvfvk fcca6479-f949-4688-b931-29624c5a8ac1 -- POST / 200 317.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,391 mnist_classifier_MNISTClassifier e3knvfvk 95920f4d-2170-45c4-a8a1-4b9d8a117c10 -- POST / 200 302.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,391 mnist_classifier_MNISTClassifier e3knvfvk c572ae8f-070e-451b-937f-1bf7e20bb987 -- POST / 200 302.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,391 mnist_classifier_MNISTClassifier e3knvfvk 578fb761-9fda-4e26-b254-2db9a11bfef3 -- POST / 200 302.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,391 mnist_classifier_MNISTClassifier e3knvfvk 13636259-f860-4a68-a4c5-b86905dd4393 -- POST / 200 296.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,392 mnist_classifier_MNISTClassifier e3knvfvk 018faf67-dc18-4109-bfb8-1abac942b4ab -- POST / 200 290.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,392 mnist_classifier_MNISTClassifier e3knvfvk 5752c052-0961-44a0-bc5c-8256462d7161 -- POST / 200 296.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,393 mnist_classifier_MNISTClassifier e3knvfvk c91b8ff2-217f-40c2-b683-3c6869b41f87 -- POST / 200 299.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,393 mnist_classifier_MNISTClassifier e3knvfvk 5ea1857e-766b-4351-81e4-79853e8cc524 -- POST / 200 298.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,393 mnist_classifier_MNISTClassifier e3knvfvk 265f746f-ecaa-48da-8919-3697946e51f9 -- POST / 200 291.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,394 mnist_classifier_MNISTClassifier e3knvfvk 2b28843f-73ee-4743-8cbb-4845b82cca1b -- POST / 200 290.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,394 mnist_classifier_MNISTClassifier e3knvfvk 90d4f5b1-845e-4841-81c0-f56401131d6d -- POST / 200 289.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,394 mnist_classifier_MNISTClassifier e3knvfvk a44bb523-f495-467d-8d14-75ab2d403651 -- POST / 200 288.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,395 mnist_classifier_MNISTClassifier e3knvfvk ea2abfec-a363-430a-b008-fc12ab84d199 -- POST / 200 287.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,396 mnist_classifier_MNISTClassifier e3knvfvk 8e038577-3687-4d7b-9aa9-33599c214da6 -- POST / 200 284.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,396 mnist_classifier_MNISTClassifier e3knvfvk 0bc8b956-aac8-4c9a-bfc6-c7e13b72fa41 -- POST / 200 288.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,397 mnist_classifier_MNISTClassifier e3knvfvk dda108b2-568e-4430-b1b5-a5796240d316 -- POST / 200 288.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,397 mnist_classifier_MNISTClassifier e3knvfvk 29f4c008-9c50-4a77-9c22-da4882372576 -- POST / 200 288.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,398 mnist_classifier_MNISTClassifier e3knvfvk 14d78a0f-4153-46ea-9b70-637887844bcb -- POST / 200 287.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,399 mnist_classifier_MNISTClassifier e3knvfvk 0ef49f10-85c0-440e-8191-5f35e0c049f3 -- POST / 200 287.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,400 mnist_classifier_MNISTClassifier e3knvfvk 9c2dcc5b-336d-4843-b938-d775d3c2835f -- POST / 200 288.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,401 mnist_classifier_MNISTClassifier e3knvfvk 928bf334-a779-4c1f-8aed-8b306dbc1c79 -- POST / 200 284.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,401 mnist_classifier_MNISTClassifier e3knvfvk dc7ab310-d521-453e-a714-b18ad053f411 -- POST / 200 283.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,402 mnist_classifier_MNISTClassifier e3knvfvk bea3ee6e-fff8-49ba-aa81-53b665e7e9af -- POST / 200 280.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,402 mnist_classifier_MNISTClassifier e3knvfvk 89906249-b7ea-4234-ba7d-6a03c17b1f83 -- POST / 200 268.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,403 mnist_classifier_MNISTClassifier e3knvfvk 81a175c0-ee4c-4d8d-9e88-b951a4df9aa3 -- POST / 200 253.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,403 mnist_classifier_MNISTClassifier e3knvfvk 1c5a7dbb-0c8e-4c54-a70c-8ca8ba805992 -- POST / 200 250.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,403 mnist_classifier_MNISTClassifier e3knvfvk 025666e6-913d-466f-b1e5-d696c64fa0c6 -- POST / 200 249.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,404 mnist_classifier_MNISTClassifier e3knvfvk f3875bf7-53ac-449e-ab79-5f36b9b56761 -- POST / 200 249.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,404 mnist_classifier_MNISTClassifier e3knvfvk d6f53ef2-6b44-4230-bb9b-b4ef1bd982cc -- POST / 200 248.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,410 mnist_classifier_MNISTClassifier e3knvfvk e3af5adc-2735-4cef-95f9-5787e58d653f -- POST / 200 253.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,414 mnist_classifier_MNISTClassifier e3knvfvk 92cc2af7-e043-4957-a6e3-5c143af321c8 -- POST / 200 257.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,416 mnist_classifier_MNISTClassifier e3knvfvk 75e46512-bb4d-42b7-a7dd-272aa723f26d -- POST / 200 254.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,416 mnist_classifier_MNISTClassifier e3knvfvk 8951aef6-ff1a-40aa-bf47-614914949e62 -- POST / 200 254.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,417 mnist_classifier_MNISTClassifier e3knvfvk 3735dec5-33ae-4542-be21-2ddf7ebe9323 -- POST / 200 253.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,417 mnist_classifier_MNISTClassifier e3knvfvk bc1ffdc5-1172-4eab-97c0-bc7a19a69bc8 -- POST / 200 254.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,418 mnist_classifier_MNISTClassifier e3knvfvk b9fca3c7-4ffc-4bfb-8eea-9fb6cd15049d -- POST / 200 253.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,419 mnist_classifier_MNISTClassifier e3knvfvk 816d1374-396f-444d-a06e-cdc6b6139b2b -- POST / 200 253.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,420 mnist_classifier_MNISTClassifier e3knvfvk 1b108d66-21c1-41a7-bed7-4d1d122c3e4f -- POST / 200 253.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,420 mnist_classifier_MNISTClassifier e3knvfvk 1f4ca812-bb44-48a2-9ab0-198534f7fe3f -- POST / 200 253.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,420 mnist_classifier_MNISTClassifier e3knvfvk 28f64564-d583-4a0e-a7fb-0b0ff4609d76 -- POST / 200 253.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,420 mnist_classifier_MNISTClassifier e3knvfvk dd73a317-1810-4832-b14c-6511abff2dc8 -- POST / 200 252.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,421 mnist_classifier_MNISTClassifier e3knvfvk af6203b4-9c44-4773-8954-d9db67ba06e6 -- POST / 200 252.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,421 mnist_classifier_MNISTClassifier e3knvfvk 6003e2bd-7c7f-4b76-bc0f-6b3c4eeb0227 -- POST / 200 251.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,421 mnist_classifier_MNISTClassifier e3knvfvk 85139cd9-d496-47f4-b437-e568dcb7cc5d -- POST / 200 230.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,421 mnist_classifier_MNISTClassifier e3knvfvk 63b9da87-dcfb-4e69-a09a-8b629ae1139e -- POST / 200 227.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,422 mnist_classifier_MNISTClassifier e3knvfvk ae26b06e-968d-4a95-bb28-1573a878776f -- POST / 200 218.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,422 mnist_classifier_MNISTClassifier e3knvfvk dc054371-707a-46be-9054-51e1777d9f73 -- POST / 200 218.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,422 mnist_classifier_MNISTClassifier e3knvfvk a30cb086-b337-4167-9790-90d08f976b86 -- POST / 200 217.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,422 mnist_classifier_MNISTClassifier e3knvfvk e5c1ed6a-0bf0-411e-a1a3-275fad7362cf -- POST / 200 217.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,422 mnist_classifier_MNISTClassifier e3knvfvk 30dbf59a-b584-4b7b-88f3-6e54a3ec6dc1 -- POST / 200 214.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,423 mnist_classifier_MNISTClassifier e3knvfvk 8db0c339-9ab3-42b2-ba43-fb8da565d176 -- POST / 200 214.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,423 mnist_classifier_MNISTClassifier e3knvfvk ad2bdd29-cd30-4f42-8870-a7283e80c2f7 -- POST / 200 212.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,423 mnist_classifier_MNISTClassifier e3knvfvk 882c9f54-148a-46de-aac5-54f267a23cd7 -- POST / 200 211.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,423 mnist_classifier_MNISTClassifier e3knvfvk 356c3ea8-f53b-454f-b6fc-bb7a972447d4 -- POST / 200 211.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,423 mnist_classifier_MNISTClassifier e3knvfvk aa1a7fb4-9c82-407a-bce1-65ed06253f2c -- POST / 200 211.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,423 mnist_classifier_MNISTClassifier e3knvfvk 969abe62-579e-4291-8f2e-dde55dbe02e8 -- POST / 200 209.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,424 mnist_classifier_MNISTClassifier e3knvfvk 96a770b0-80f5-4807-a717-8139804760e7 -- POST / 200 208.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,424 mnist_classifier_MNISTClassifier e3knvfvk c2449811-e7d7-416b-b885-05d9050a9239 -- POST / 200 207.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,424 mnist_classifier_MNISTClassifier e3knvfvk 2baf32f7-feab-4660-b8ad-2162927f040f -- POST / 200 204.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,424 mnist_classifier_MNISTClassifier e3knvfvk fa48eea0-be7f-46a7-8649-ebe2105bff7a -- POST / 200 204.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,424 mnist_classifier_MNISTClassifier e3knvfvk 5a832a08-7a70-4ac3-b646-9e6b487538bb -- POST / 200 204.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,424 mnist_classifier_MNISTClassifier e3knvfvk 22c12d87-596f-4145-a4de-7de1be205918 -- POST / 200 204.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,425 mnist_classifier_MNISTClassifier e3knvfvk 3d50de2c-3d70-4009-afb5-4b66f1ba91b7 -- POST / 200 205.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,428 mnist_classifier_MNISTClassifier e3knvfvk 4dc13141-9abd-43d7-b528-98f890ee60c1 -- POST / 200 207.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,429 mnist_classifier_MNISTClassifier e3knvfvk 9b514f4b-1f12-4e91-a467-407999c1e7b6 -- POST / 200 207.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,429 mnist_classifier_MNISTClassifier e3knvfvk 40a8fa76-f7d2-4d20-9c7d-1409fd1878f7 -- POST / 200 205.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,429 mnist_classifier_MNISTClassifier e3knvfvk ac04e3ce-8cb1-48ee-8a60-482bf4d6508e -- POST / 200 205.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,494 mnist_classifier_MNISTClassifier e3knvfvk 9f347b51-537e-4d98-b62b-af2c19d46d6d -- POST / 200 224.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,552 mnist_classifier_MNISTClassifier e3knvfvk 588733aa-c937-4b3b-915f-97570cf019e9 -- POST / 200 280.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,552 mnist_classifier_MNISTClassifier e3knvfvk db2dae9c-822e-4d5d-9063-ec95ab2c30c2 -- POST / 200 276.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,553 mnist_classifier_MNISTClassifier e3knvfvk 3a8330ef-97e3-4f95-9ac1-77d630573d97 -- POST / 200 274.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,553 mnist_classifier_MNISTClassifier e3knvfvk 15ef310e-fdde-44fe-bd92-519ac1d1bc98 -- POST / 200 276.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,554 mnist_classifier_MNISTClassifier e3knvfvk 7273b512-cd43-477c-995f-5489f7484fd4 -- POST / 200 275.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,554 mnist_classifier_MNISTClassifier e3knvfvk e7edb370-5eb5-4dd6-89c1-fc45a461ae35 -- POST / 200 268.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,555 mnist_classifier_MNISTClassifier e3knvfvk a7e60184-29e7-4097-a48d-f6a54e2f75dd -- POST / 200 276.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,555 mnist_classifier_MNISTClassifier e3knvfvk 7c25eb36-383a-47e6-82f8-f3a270801b9b -- POST / 200 268.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,555 mnist_classifier_MNISTClassifier e3knvfvk 593097f6-1aa3-4062-98d2-cf7747d945f9 -- POST / 200 268.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,555 mnist_classifier_MNISTClassifier e3knvfvk 8707eb84-be37-4609-9992-bbfa7f6530a4 -- POST / 200 268.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,556 mnist_classifier_MNISTClassifier e3knvfvk ce9d6298-5b2e-4700-8c60-2196edcdd4b5 -- POST / 200 256.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,557 mnist_classifier_MNISTClassifier e3knvfvk 3de99b0a-ba01-4dae-8967-2f27b0dcc216 -- POST / 200 255.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,796 mnist_classifier_MNISTClassifier e3knvfvk e764cad9-d8d6-45c4-b9f5-9f816f67f822 -- POST / 200 358.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,797 mnist_classifier_MNISTClassifier e3knvfvk 48e725ed-b216-4a6e-befa-3ca98894fedd -- POST / 200 400.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,797 mnist_classifier_MNISTClassifier e3knvfvk caa9ba38-cef1-4165-98df-95c2d231c357 -- POST / 200 381.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,798 mnist_classifier_MNISTClassifier e3knvfvk 976ed104-10d6-4f48-8a91-cc24d4480823 -- POST / 200 364.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,801 mnist_classifier_MNISTClassifier e3knvfvk d69cd42e-7207-4703-9d69-c7aea9e79b01 -- POST / 200 359.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,805 mnist_classifier_MNISTClassifier e3knvfvk 59895f62-2e52-4169-958f-322bbd4afc6c -- POST / 200 363.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,806 mnist_classifier_MNISTClassifier e3knvfvk 2cae27c2-858f-4a83-bc7f-08f9cebca297 -- POST / 200 365.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,806 mnist_classifier_MNISTClassifier e3knvfvk fe832674-2232-4ea3-b41d-974d8d2a73be -- POST / 200 360.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,806 mnist_classifier_MNISTClassifier e3knvfvk 8e1e3e6a-d720-4c02-aaca-6a27f0dfd211 -- POST / 200 360.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,807 mnist_classifier_MNISTClassifier e3knvfvk 0913df57-e5c8-400d-a2ca-897c577296cb -- POST / 200 360.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,808 mnist_classifier_MNISTClassifier e3knvfvk 7f43421a-266c-41c4-8286-4fc9cd6bdd7e -- POST / 200 358.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,809 mnist_classifier_MNISTClassifier e3knvfvk cda12e88-6e85-467a-b358-96ac974dc194 -- POST / 200 356.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,811 mnist_classifier_MNISTClassifier e3knvfvk e81a2c1f-7c78-4d2b-b5a8-7667dd86bd0e -- POST / 200 361.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,812 mnist_classifier_MNISTClassifier e3knvfvk 0ac71dcd-127c-4534-bd0e-4b79e7abcad0 -- POST / 200 358.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,812 mnist_classifier_MNISTClassifier e3knvfvk 9562b905-1409-45c4-b1b3-7fc1c1b2eac8 -- POST / 200 361.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,813 mnist_classifier_MNISTClassifier e3knvfvk fb41d9a5-a6f0-4563-ac9a-c16ff4bd343a -- POST / 200 356.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,814 mnist_classifier_MNISTClassifier e3knvfvk cef2f054-55de-4d7b-8e1f-2da89b0235e5 -- POST / 200 355.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,815 mnist_classifier_MNISTClassifier e3knvfvk af7f029d-9bda-46b3-94a8-abb3934da288 -- POST / 200 354.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,816 mnist_classifier_MNISTClassifier e3knvfvk d59d2882-c4f7-4375-a929-b17d5460679c -- POST / 200 354.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,817 mnist_classifier_MNISTClassifier e3knvfvk c8a21eba-4a81-4751-b28a-35dafe198dd5 -- POST / 200 353.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,817 mnist_classifier_MNISTClassifier e3knvfvk 970fc404-41ec-4c6b-979e-927d25fcf833 -- POST / 200 352.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,818 mnist_classifier_MNISTClassifier e3knvfvk 913a901b-b01d-44ad-bf4f-76507a5acd93 -- POST / 200 352.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,819 mnist_classifier_MNISTClassifier e3knvfvk f330a4fc-9a56-4373-b8ac-6516a91a6481 -- POST / 200 352.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,819 mnist_classifier_MNISTClassifier e3knvfvk d39ba0eb-857b-443f-a774-9dcdcebb2431 -- POST / 200 349.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,820 mnist_classifier_MNISTClassifier e3knvfvk 14f9939b-e625-49ec-93e0-0624471f9225 -- POST / 200 353.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,821 mnist_classifier_MNISTClassifier e3knvfvk c1cbca03-13de-46e8-b762-622ad1ff4399 -- POST / 200 350.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,821 mnist_classifier_MNISTClassifier e3knvfvk 7f2d138b-cea8-4f3f-9b2a-ae66097b51e8 -- POST / 200 350.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,896 mnist_classifier_MNISTClassifier e3knvfvk 8a188f2d-69fe-4749-98a0-3356d397d6cc -- POST / 200 420.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,897 mnist_classifier_MNISTClassifier e3knvfvk 7faaafdc-88cb-4291-a9a3-cf2020aecd3c -- POST / 200 426.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,898 mnist_classifier_MNISTClassifier e3knvfvk 28e9a8b1-9ec0-4b23-b07c-b46c68b61b27 -- POST / 200 422.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,898 mnist_classifier_MNISTClassifier e3knvfvk 91fad1d1-c942-4be8-81bf-5dc5f2bfbf8d -- POST / 200 426.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,898 mnist_classifier_MNISTClassifier e3knvfvk 712dd61b-fb03-4191-9866-201a69b97d31 -- POST / 200 423.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,899 mnist_classifier_MNISTClassifier e3knvfvk 3af6d57e-7735-47c5-b39a-dec2c28ae1d6 -- POST / 200 418.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,900 mnist_classifier_MNISTClassifier e3knvfvk 39d2e44e-85ab-4145-9a3b-1b21073f2c96 -- POST / 200 418.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,900 mnist_classifier_MNISTClassifier e3knvfvk 9549786d-9cee-46a7-b15f-ea716608745f -- POST / 200 418.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,901 mnist_classifier_MNISTClassifier e3knvfvk efe1fb5c-1f39-40fd-8c9c-2602723ecd00 -- POST / 200 414.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,901 mnist_classifier_MNISTClassifier e3knvfvk 4b6c2826-b7a5-46c3-a237-047df6d6f833 -- POST / 200 338.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,901 mnist_classifier_MNISTClassifier e3knvfvk d0b8d246-e183-4445-aeae-fe845744a20a -- POST / 200 342.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,901 mnist_classifier_MNISTClassifier e3knvfvk 2ff76245-f053-411f-b9fd-b1567d67bdf7 -- POST / 200 332.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,905 mnist_classifier_MNISTClassifier e3knvfvk e851d23f-c5ac-402f-92a3-dc6c605f9e29 -- POST / 200 335.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,914 mnist_classifier_MNISTClassifier e3knvfvk 91a1ad33-226b-4170-a944-844871bff719 -- POST / 200 344.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,916 mnist_classifier_MNISTClassifier e3knvfvk 11aa557b-afa5-4bdf-9502-980548f5ec9a -- POST / 200 346.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,916 mnist_classifier_MNISTClassifier e3knvfvk 99cf35fa-2e3c-41f1-beb8-ad90beaffd52 -- POST / 200 346.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,917 mnist_classifier_MNISTClassifier e3knvfvk 6606ab12-b6f6-4550-89f5-6c6f1a52dc58 -- POST / 200 346.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,918 mnist_classifier_MNISTClassifier e3knvfvk db583809-b382-48e7-984d-078fec1bee9d -- POST / 200 347.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,919 mnist_classifier_MNISTClassifier e3knvfvk e8992237-d54c-499b-9577-66e4fb6f3f7f -- POST / 200 348.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,919 mnist_classifier_MNISTClassifier e3knvfvk ec8e47a5-6aeb-4593-b537-64d87212cd49 -- POST / 200 348.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,920 mnist_classifier_MNISTClassifier e3knvfvk b458f14a-dc25-478a-b07f-d275a18bbc85 -- POST / 200 348.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,922 mnist_classifier_MNISTClassifier e3knvfvk 8192bd5a-0485-4543-8239-7731f2a84e05 -- POST / 200 350.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,923 mnist_classifier_MNISTClassifier e3knvfvk c8031432-c1dd-47ec-ad71-ee0f36142e4f -- POST / 200 351.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,925 mnist_classifier_MNISTClassifier e3knvfvk 79ee1cce-546f-4f67-ba92-f8704ce2a36d -- POST / 200 353.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,926 mnist_classifier_MNISTClassifier e3knvfvk 69acf4db-9362-4f0d-a46a-e337f4dbcfd5 -- POST / 200 354.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,926 mnist_classifier_MNISTClassifier e3knvfvk d19c1c33-e5f8-4d07-9d41-2292dd7c6236 -- POST / 200 354.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,928 mnist_classifier_MNISTClassifier e3knvfvk bbee082e-6471-463f-aca2-ae5bc3f3f19e -- POST / 200 355.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,928 mnist_classifier_MNISTClassifier e3knvfvk d036874a-d377-4eab-a65b-baae808fbd79 -- POST / 200 354.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:01,929 mnist_classifier_MNISTClassifier e3knvfvk 887b5d3b-acf3-40da-b395-203dde930a8b -- POST / 200 356.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,015 mnist_classifier_MNISTClassifier e3knvfvk cf7f2001-9f51-42eb-98ae-018a9be49698 -- POST / 200 438.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,016 mnist_classifier_MNISTClassifier e3knvfvk df047441-b371-4663-b887-88f6bafe226f -- POST / 200 437.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,017 mnist_classifier_MNISTClassifier e3knvfvk 5cb4669a-7b7d-4469-a7bb-f834601d1fae -- POST / 200 437.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,017 mnist_classifier_MNISTClassifier e3knvfvk 7c97c8ee-ee54-4db3-b7ca-8011aa4bc7de -- POST / 200 437.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,018 mnist_classifier_MNISTClassifier e3knvfvk 197cc237-5834-49eb-bc31-794d6be63cda -- POST / 200 432.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,019 mnist_classifier_MNISTClassifier e3knvfvk 9d954f1c-f3f4-463a-bbca-3de42711ec7e -- POST / 200 438.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,020 mnist_classifier_MNISTClassifier e3knvfvk b74e09e1-a08c-4dd0-835c-9076d80bbd63 -- POST / 200 428.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,023 mnist_classifier_MNISTClassifier e3knvfvk c95c722b-0cd9-49a7-8236-a23a4caf7f43 -- POST / 200 434.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,027 mnist_classifier_MNISTClassifier e3knvfvk d7157819-a47b-4491-8de3-094313bafb57 -- POST / 200 441.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,028 mnist_classifier_MNISTClassifier e3knvfvk d38017a7-ac8d-4a7b-a1a3-7a6d0ec8d2e5 -- POST / 200 436.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,029 mnist_classifier_MNISTClassifier e3knvfvk d2accd03-6e63-4a4c-90cb-1b13b4376b11 -- POST / 200 439.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,035 mnist_classifier_MNISTClassifier e3knvfvk ce72ab3e-87a5-474e-b40b-ae1a179c4fff -- POST / 200 442.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,036 mnist_classifier_MNISTClassifier e3knvfvk a81e1800-4de0-4d51-89a2-629c6f73a2d1 -- POST / 200 445.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,039 mnist_classifier_MNISTClassifier e3knvfvk d2422786-ddf6-4525-bd70-e7a201c36aae -- POST / 200 447.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,040 mnist_classifier_MNISTClassifier e3knvfvk 0d4b487c-b9ab-4db9-9586-1ee628ced98d -- POST / 200 308.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,041 mnist_classifier_MNISTClassifier e3knvfvk 1f3540de-04fe-4129-9187-1c9ba155ef75 -- POST / 200 293.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,042 mnist_classifier_MNISTClassifier e3knvfvk b1e4dce8-7d15-42d7-88e4-14e17ff4e663 -- POST / 200 304.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,042 mnist_classifier_MNISTClassifier e3knvfvk 8a6e142a-53a7-4fe4-909b-09df4e9df1f4 -- POST / 200 304.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,043 mnist_classifier_MNISTClassifier e3knvfvk 400d443d-c15c-4d03-a736-1f90e0f61fbb -- POST / 200 305.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,044 mnist_classifier_MNISTClassifier e3knvfvk 29d1f070-159e-4c1d-b80f-0dfff7e42ba4 -- POST / 200 306.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,048 mnist_classifier_MNISTClassifier e3knvfvk 91b786ac-cf29-4160-8a2c-92fef0a70054 -- POST / 200 309.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,050 mnist_classifier_MNISTClassifier e3knvfvk 360becba-6c37-4e50-94e8-3cd290eacbf2 -- POST / 200 309.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,058 mnist_classifier_MNISTClassifier e3knvfvk 5c758353-b986-43c7-bb31-b1dd28fa22a0 -- POST / 200 317.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,059 mnist_classifier_MNISTClassifier e3knvfvk 69ab0ff6-4fe9-4d0d-b289-ec5f5482618e -- POST / 200 318.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,060 mnist_classifier_MNISTClassifier e3knvfvk 073ff9bb-5a26-4326-bde9-5e1b889a5a26 -- POST / 200 318.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,064 mnist_classifier_MNISTClassifier e3knvfvk 1ebab2c2-70fb-4cb6-a7d0-e5c75cd86004 -- POST / 200 321.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,065 mnist_classifier_MNISTClassifier e3knvfvk 3f04d00c-4ce1-440a-836a-b7b2fc5158bc -- POST / 200 323.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,066 mnist_classifier_MNISTClassifier e3knvfvk ad0d16d1-0fd6-44ec-9df1-6c53f505d73e -- POST / 200 321.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,068 mnist_classifier_MNISTClassifier e3knvfvk 28910bd8-d0fc-41f5-bc9f-496a9953ae64 -- POST / 200 322.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,069 mnist_classifier_MNISTClassifier e3knvfvk e6f68e79-2b9e-4375-853c-0bc8339a4949 -- POST / 200 323.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,069 mnist_classifier_MNISTClassifier e3knvfvk b9d69879-50ad-4504-8536-6c3bb1135af0 -- POST / 200 319.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,070 mnist_classifier_MNISTClassifier e3knvfvk 0e27b771-91fa-4383-b17c-b76237e87744 -- POST / 200 319.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,070 mnist_classifier_MNISTClassifier e3knvfvk 3f898805-77e1-42eb-b147-fcccfb6a8f99 -- POST / 200 320.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,072 mnist_classifier_MNISTClassifier e3knvfvk 23a1eaa0-8564-446e-844c-60398e4c0932 -- POST / 200 320.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,072 mnist_classifier_MNISTClassifier e3knvfvk 8b8207ce-bac0-41ad-b8c0-ba3db313fa67 -- POST / 200 320.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,076 mnist_classifier_MNISTClassifier e3knvfvk ce4ef346-ab31-468f-9833-6883774d1042 -- POST / 200 322.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,077 mnist_classifier_MNISTClassifier e3knvfvk 247d7aa0-f2ef-48e2-8eac-227201891c0e -- POST / 200 323.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,077 mnist_classifier_MNISTClassifier e3knvfvk e37f8a3a-a675-4789-87f0-4b6faee20c15 -- POST / 200 321.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,079 mnist_classifier_MNISTClassifier e3knvfvk b98d24fc-cf85-494f-afa9-45049ea7e889 -- POST / 200 323.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,081 mnist_classifier_MNISTClassifier e3knvfvk 4181d220-dbe2-450e-ba7a-a55d686f7226 -- POST / 200 324.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,082 mnist_classifier_MNISTClassifier e3knvfvk 7854f654-aa3d-4c47-9c94-420132491ce0 -- POST / 200 322.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,083 mnist_classifier_MNISTClassifier e3knvfvk 328ba745-3693-416d-9396-d5bccfe975ca -- POST / 200 324.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,083 mnist_classifier_MNISTClassifier e3knvfvk 1144ba6a-6c1f-4e2a-8fe6-9bdd03e6c099 -- POST / 200 324.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,083 mnist_classifier_MNISTClassifier e3knvfvk 5dcae923-262b-44fd-b7ec-f84de08b370b -- POST / 200 321.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,084 mnist_classifier_MNISTClassifier e3knvfvk 3e19b952-eea3-45a7-ba3b-76fa929d7ec7 -- POST / 200 272.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,085 mnist_classifier_MNISTClassifier e3knvfvk f8888fad-5474-4074-a6c1-005c0785afa2 -- POST / 200 258.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,086 mnist_classifier_MNISTClassifier e3knvfvk 2642bdf6-896f-40e3-9e18-642189520970 -- POST / 200 258.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,087 mnist_classifier_MNISTClassifier e3knvfvk b756059f-e8cb-4263-a33b-aae130f9c717 -- POST / 200 249.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,090 mnist_classifier_MNISTClassifier e3knvfvk 5b0c06b9-b37d-4949-9077-9d431c09dce7 -- POST / 200 252.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,091 mnist_classifier_MNISTClassifier e3knvfvk aff7ef9e-1439-430b-a7be-f95a15c02915 -- POST / 200 252.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,092 mnist_classifier_MNISTClassifier e3knvfvk b8f8682a-0b59-4992-a3fb-02a4a93d9c29 -- POST / 200 252.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,093 mnist_classifier_MNISTClassifier e3knvfvk 202d31db-09dc-4430-9828-33390a114a84 -- POST / 200 252.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,095 mnist_classifier_MNISTClassifier e3knvfvk c542e824-a3fd-4a49-81d1-85bfc1ef9412 -- POST / 200 254.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,100 mnist_classifier_MNISTClassifier e3knvfvk bddaa271-83ba-423d-845a-9e14bdb4dd3a -- POST / 200 256.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,101 mnist_classifier_MNISTClassifier e3knvfvk 333511fa-ef37-4b96-9c66-195d02d9265e -- POST / 200 256.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,101 mnist_classifier_MNISTClassifier e3knvfvk c5d2660c-4469-450a-9af6-ef6e99c58903 -- POST / 200 256.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,101 mnist_classifier_MNISTClassifier e3knvfvk 38c98d05-ba65-4215-8644-e61c06d43dbe -- POST / 200 255.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,102 mnist_classifier_MNISTClassifier e3knvfvk c89ec546-745e-45c3-9651-66aeb3927d75 -- POST / 200 255.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,103 mnist_classifier_MNISTClassifier e3knvfvk 5834871e-707b-4cce-a528-ba1115ae590e -- POST / 200 254.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,104 mnist_classifier_MNISTClassifier e3knvfvk 5b3d8aa9-6610-420d-b9bd-125ded0bd691 -- POST / 200 255.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,105 mnist_classifier_MNISTClassifier e3knvfvk a024852c-874c-43fb-8554-8e11294984fd -- POST / 200 255.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,105 mnist_classifier_MNISTClassifier e3knvfvk d6a9a1f9-2ed3-4d61-966f-296e62bfcd19 -- POST / 200 256.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,105 mnist_classifier_MNISTClassifier e3knvfvk 5551a68f-debf-4db8-86df-e7ae430dbe55 -- POST / 200 255.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,106 mnist_classifier_MNISTClassifier e3knvfvk 25e85a20-7240-4956-b677-7ba23e541ad4 -- POST / 200 255.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,106 mnist_classifier_MNISTClassifier e3knvfvk 519ddf4b-cc2b-4f87-8db0-20e0c9b7ce8e -- POST / 200 252.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,151 mnist_classifier_MNISTClassifier e3knvfvk b50fec1b-8a73-4e6a-bde0-a587e83a1038 -- POST / 200 291.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,172 mnist_classifier_MNISTClassifier e3knvfvk ee1fc8ba-952f-4e7c-bc30-0d80302c5a66 -- POST / 200 311.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,175 mnist_classifier_MNISTClassifier e3knvfvk b2e52eef-81fe-4ee9-9a98-ade2dce0dd92 -- POST / 200 321.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,177 mnist_classifier_MNISTClassifier e3knvfvk 0bb58dd7-191e-48ae-b748-efb269cf3567 -- POST / 200 320.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,177 mnist_classifier_MNISTClassifier e3knvfvk fcd37457-500f-4486-b6bc-8ce5ebbc2e84 -- POST / 200 320.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,177 mnist_classifier_MNISTClassifier e3knvfvk ba375889-7f2f-42f7-a580-533c20c5545a -- POST / 200 317.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,177 mnist_classifier_MNISTClassifier e3knvfvk 46ea4d7c-712e-422c-bb60-c6a9eb97d7fa -- POST / 200 252.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,178 mnist_classifier_MNISTClassifier e3knvfvk d25b5d44-34db-4dc5-9db5-d6de8a41d83a -- POST / 200 224.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,178 mnist_classifier_MNISTClassifier e3knvfvk f929b901-57e8-475a-ae75-5a64891da90a -- POST / 200 221.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,178 mnist_classifier_MNISTClassifier e3knvfvk c1888c93-d775-42d9-89d1-162a437f3456 -- POST / 200 223.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,178 mnist_classifier_MNISTClassifier e3knvfvk 1c819cb7-b77f-4621-bf33-57f62cad26b9 -- POST / 200 218.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,178 mnist_classifier_MNISTClassifier e3knvfvk 166ca802-4d1e-44f0-a77b-b2853425b032 -- POST / 200 222.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,179 mnist_classifier_MNISTClassifier e3knvfvk b319fd27-93c6-46f6-9fcb-55a876e700f4 -- POST / 200 219.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,179 mnist_classifier_MNISTClassifier e3knvfvk de0a510c-8ba9-4d3e-a096-06b460b17b82 -- POST / 200 218.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,179 mnist_classifier_MNISTClassifier e3knvfvk 70c5048a-4ca9-4862-b94e-2742711ed4f4 -- POST / 200 215.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,179 mnist_classifier_MNISTClassifier e3knvfvk 0352a20b-4ef8-43d1-a78f-37d221618bf0 -- POST / 200 218.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,179 mnist_classifier_MNISTClassifier e3knvfvk d0c88833-c64b-4f23-8bea-1466b405e03e -- POST / 200 218.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,179 mnist_classifier_MNISTClassifier e3knvfvk 0ffc725f-1568-4d3f-bfc7-87674e39a88d -- POST / 200 216.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,180 mnist_classifier_MNISTClassifier e3knvfvk 9a914eb2-e359-43a3-a212-3dc42fa120e3 -- POST / 200 217.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,180 mnist_classifier_MNISTClassifier e3knvfvk 9dd96ffe-20d2-4b2b-ad30-332ca3dcafb8 -- POST / 200 215.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,180 mnist_classifier_MNISTClassifier e3knvfvk ca6c66fa-78d5-4123-8453-4aaa1a791aee -- POST / 200 214.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,180 mnist_classifier_MNISTClassifier e3knvfvk dc08b93b-174a-4cc9-a567-434571f63e93 -- POST / 200 213.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,180 mnist_classifier_MNISTClassifier e3knvfvk 6f88637c-6590-47ad-9539-e21c4c05e6e1 -- POST / 200 212.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,180 mnist_classifier_MNISTClassifier e3knvfvk e61d26ad-7e1a-4260-ae3a-1192c19fdd37 -- POST / 200 211.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,180 mnist_classifier_MNISTClassifier e3knvfvk fc83ab6f-5006-4d3f-b2f2-a4eb17af1a81 -- POST / 200 212.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,181 mnist_classifier_MNISTClassifier e3knvfvk ead06941-d6d6-4f62-b7bc-2a4bebe17148 -- POST / 200 211.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,181 mnist_classifier_MNISTClassifier e3knvfvk 6667d088-1c90-4984-bc86-71ca17557a2d -- POST / 200 210.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,181 mnist_classifier_MNISTClassifier e3knvfvk 0bdafe3d-6182-41e4-9c80-afcb9d76e355 -- POST / 200 209.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,181 mnist_classifier_MNISTClassifier e3knvfvk d30a2172-7300-43db-bb96-5e829861bc80 -- POST / 200 209.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,183 mnist_classifier_MNISTClassifier e3knvfvk f7864658-82cf-402f-8cec-700d430b67c7 -- POST / 200 209.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,183 mnist_classifier_MNISTClassifier e3knvfvk 8ecd9cae-6f07-4b75-98c5-3b0849263e00 -- POST / 200 208.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,183 mnist_classifier_MNISTClassifier e3knvfvk 7167211a-55c5-4077-9261-d0ddcc260d2a -- POST / 200 207.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,183 mnist_classifier_MNISTClassifier e3knvfvk 78f35d8c-8321-4846-8d37-41bd669ded19 -- POST / 200 207.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,184 mnist_classifier_MNISTClassifier e3knvfvk 8af9abca-635d-48a3-87aa-ab6207eb6778 -- POST / 200 207.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,185 mnist_classifier_MNISTClassifier e3knvfvk b1772cc7-4656-44a1-872f-20603a2e503a -- POST / 200 208.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,321 mnist_classifier_MNISTClassifier e3knvfvk c2150e91-1c79-4408-b345-2f624f0065ec -- POST / 200 310.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,325 mnist_classifier_MNISTClassifier e3knvfvk fe96c80d-3f5b-437d-9f9a-2bd831cea81c -- POST / 200 302.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,327 mnist_classifier_MNISTClassifier e3knvfvk 6f0973be-b4d4-469b-99ed-a2ac3c50e2a0 -- POST / 200 303.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,328 mnist_classifier_MNISTClassifier e3knvfvk 15ccd18f-f7e0-4746-b7ec-e391a3d4a365 -- POST / 200 293.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,328 mnist_classifier_MNISTClassifier e3knvfvk a548183f-fd28-4246-985b-cfba1fef6dfb -- POST / 200 293.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,330 mnist_classifier_MNISTClassifier e3knvfvk 72c86641-808a-4a02-8c16-a009ea97f30b -- POST / 200 295.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,330 mnist_classifier_MNISTClassifier e3knvfvk 1b43d74b-37d0-409c-abd6-6913d6602f01 -- POST / 200 287.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,331 mnist_classifier_MNISTClassifier e3knvfvk d0fdb9e7-8800-488c-bdbe-78ff913f28ba -- POST / 200 286.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,332 mnist_classifier_MNISTClassifier e3knvfvk ac246961-56b0-4b9d-802f-7942988ff118 -- POST / 200 256.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,332 mnist_classifier_MNISTClassifier e3knvfvk bd619831-9a61-48f3-bce5-b90b2658076a -- POST / 200 282.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,333 mnist_classifier_MNISTClassifier e3knvfvk 09cf0b88-0f65-4a4a-aa0d-5346b2d12efc -- POST / 200 252.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,337 mnist_classifier_MNISTClassifier e3knvfvk 94d48b5d-20f3-448c-9b91-0d9792e184fb -- POST / 200 256.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,337 mnist_classifier_MNISTClassifier e3knvfvk 915e2ffc-f9d0-4cc5-a5d3-bcb77d1eea96 -- POST / 200 256.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,341 mnist_classifier_MNISTClassifier e3knvfvk cf21150f-b8dc-4caf-9161-0140524588ad -- POST / 200 255.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,341 mnist_classifier_MNISTClassifier e3knvfvk 9a040853-eb3d-4304-9ac1-c6093c11e107 -- POST / 200 247.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,342 mnist_classifier_MNISTClassifier e3knvfvk 9afac8e7-9881-44c6-963e-01e09ca994a1 -- POST / 200 234.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,344 mnist_classifier_MNISTClassifier e3knvfvk 98bdb8d2-91c6-42c4-ba5f-ffb64e35c5b0 -- POST / 200 234.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,344 mnist_classifier_MNISTClassifier e3knvfvk d448176b-50e6-4570-829d-126e93c69db1 -- POST / 200 234.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,346 mnist_classifier_MNISTClassifier e3knvfvk b42e0720-1ca5-442d-8f2a-69d3e32d444a -- POST / 200 231.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,348 mnist_classifier_MNISTClassifier e3knvfvk 0b38aea5-82b4-4433-8fe8-69b440da1690 -- POST / 200 237.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,349 mnist_classifier_MNISTClassifier e3knvfvk 348b39d7-73c2-42c9-950e-2d48b8b5d085 -- POST / 200 233.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,351 mnist_classifier_MNISTClassifier e3knvfvk 98be831c-4726-437f-914b-819089484650 -- POST / 200 236.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,351 mnist_classifier_MNISTClassifier e3knvfvk ab9d130f-48b4-4ddb-9498-e6b0a9f809bb -- POST / 200 234.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,361 mnist_classifier_MNISTClassifier e3knvfvk 43278f68-b6c9-4deb-acd6-2fe6ae1735b8 -- POST / 200 243.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,364 mnist_classifier_MNISTClassifier e3knvfvk 78127498-68cc-4e40-a043-4f57520aa9f8 -- POST / 200 245.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,365 mnist_classifier_MNISTClassifier e3knvfvk d785cb53-c813-4e26-8610-3aaa153dfe84 -- POST / 200 245.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,366 mnist_classifier_MNISTClassifier e3knvfvk 9353241b-f2c5-43e5-897a-26c9446232ac -- POST / 200 238.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,366 mnist_classifier_MNISTClassifier e3knvfvk b6260008-97a2-4f60-8bd9-14592dd88b51 -- POST / 200 237.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,366 mnist_classifier_MNISTClassifier e3knvfvk d82f1258-8c64-4cdd-bdfc-962b181d971d -- POST / 200 237.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,366 mnist_classifier_MNISTClassifier e3knvfvk 22b1cb9c-1c0a-4d13-a79a-d06c6b46ceb0 -- POST / 200 237.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,367 mnist_classifier_MNISTClassifier e3knvfvk 527b6a10-b100-43f3-a687-4214ca1fc4c7 -- POST / 200 237.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,367 mnist_classifier_MNISTClassifier e3knvfvk b0898543-60a9-4a6a-9b54-9790262b6f74 -- POST / 200 232.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,369 mnist_classifier_MNISTClassifier e3knvfvk 65e52c91-bfd0-4ee7-8de5-d2a4b89f9f81 -- POST / 200 233.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,372 mnist_classifier_MNISTClassifier e3knvfvk c1ba4a97-6f34-493f-976c-0c336cda5e8d -- POST / 200 235.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,373 mnist_classifier_MNISTClassifier e3knvfvk f2776fdf-9dd0-47fc-948b-68accfbae4de -- POST / 200 236.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,374 mnist_classifier_MNISTClassifier e3knvfvk f6729646-a25f-4f3f-9ed0-66beba1d7f60 -- POST / 200 236.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,374 mnist_classifier_MNISTClassifier e3knvfvk 691a88cc-59d8-4b45-8eeb-76c85c1a3644 -- POST / 200 224.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,375 mnist_classifier_MNISTClassifier e3knvfvk af4d1f12-b209-42f2-b5e4-b53c1245d2e0 -- POST / 200 201.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,635 mnist_classifier_MNISTClassifier e3knvfvk a18f7168-9bb6-4793-b771-01f682fddcca -- POST / 200 447.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,636 mnist_classifier_MNISTClassifier e3knvfvk 438403bb-edf4-4680-bc1f-b02d6dd3fae0 -- POST / 200 447.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,636 mnist_classifier_MNISTClassifier e3knvfvk fc7747af-1fbc-4ee2-bf3a-38f0dede844a -- POST / 200 447.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,637 mnist_classifier_MNISTClassifier e3knvfvk 117dc0d7-d172-4ef8-877f-060ea124dae7 -- POST / 200 447.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,637 mnist_classifier_MNISTClassifier e3knvfvk acf7a9e4-f56c-4d56-82d9-05184bf45773 -- POST / 200 448.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,638 mnist_classifier_MNISTClassifier e3knvfvk f5a1f1d4-a151-4826-8a2d-dfa7f22585f2 -- POST / 200 450.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,638 mnist_classifier_MNISTClassifier e3knvfvk 1c3cc9b0-7c82-4176-92fc-617b7c374b93 -- POST / 200 450.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,639 mnist_classifier_MNISTClassifier e3knvfvk 5d4cfb6f-f58c-4293-b71b-8940e0655459 -- POST / 200 451.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,639 mnist_classifier_MNISTClassifier e3knvfvk c36175fe-c243-467c-8716-fe68f2c61cc7 -- POST / 200 450.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,640 mnist_classifier_MNISTClassifier e3knvfvk 55986feb-bb26-46f7-bd7f-954f8b19b234 -- POST / 200 450.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,640 mnist_classifier_MNISTClassifier e3knvfvk 08d1a477-e47e-4dab-89d0-60df69d6e6ec -- POST / 200 450.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,641 mnist_classifier_MNISTClassifier e3knvfvk bb3edbf0-b5f3-409f-8d68-d9725ad631eb -- POST / 200 427.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,641 mnist_classifier_MNISTClassifier e3knvfvk 90bbb394-a2a5-4849-b38b-fa0ab262ce53 -- POST / 200 427.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,642 mnist_classifier_MNISTClassifier e3knvfvk 5f66ec6a-9327-4937-97cb-7800e996e91f -- POST / 200 427.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,652 mnist_classifier_MNISTClassifier e3knvfvk 64cd6751-bee2-48a7-9635-f556ad1b63e8 -- POST / 200 434.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,652 mnist_classifier_MNISTClassifier e3knvfvk 6ba26d28-9220-4132-bbc2-6d4073350575 -- POST / 200 434.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,653 mnist_classifier_MNISTClassifier e3knvfvk b90a2ddc-797e-4b22-866f-fe6bf09db296 -- POST / 200 434.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,656 mnist_classifier_MNISTClassifier e3knvfvk d33ba4ce-07e3-427a-a58f-36f4ada729da -- POST / 200 436.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,659 mnist_classifier_MNISTClassifier e3knvfvk 4568237c-297e-4df2-a1d1-f6c2cffc4817 -- POST / 200 439.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,660 mnist_classifier_MNISTClassifier e3knvfvk af01097e-828e-45eb-b605-6a8eca8b975d -- POST / 200 438.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,662 mnist_classifier_MNISTClassifier e3knvfvk 1579d09d-79ab-4449-b2c1-3fe9f05fd76a -- POST / 200 442.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,665 mnist_classifier_MNISTClassifier e3knvfvk 605c16d4-25cf-48fa-9e31-12b3d5927d33 -- POST / 200 443.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,665 mnist_classifier_MNISTClassifier e3knvfvk 5724b030-9710-48f4-8407-88e92b200c3c -- POST / 200 442.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,665 mnist_classifier_MNISTClassifier e3knvfvk 43de43eb-5dff-4875-8763-4b58656a2187 -- POST / 200 440.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,667 mnist_classifier_MNISTClassifier e3knvfvk 83986993-a6e1-4246-8fbc-f02142d7f031 -- POST / 200 443.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,673 mnist_classifier_MNISTClassifier e3knvfvk 1d22abb7-cf9d-4aa7-8920-ff0dfe194a13 -- POST / 200 444.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,674 mnist_classifier_MNISTClassifier e3knvfvk bc37f30b-346d-47c8-9f44-fe327dd6d7c9 -- POST / 200 445.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,675 mnist_classifier_MNISTClassifier e3knvfvk 820aca7b-146a-4e01-ace9-abc5721df22f -- POST / 200 414.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,676 mnist_classifier_MNISTClassifier e3knvfvk 3f1d8105-8974-4312-b7c7-0667de626922 -- POST / 200 414.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,676 mnist_classifier_MNISTClassifier e3knvfvk 440f0d00-7656-4571-9420-725506993b53 -- POST / 200 404.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,676 mnist_classifier_MNISTClassifier e3knvfvk 9937568b-3872-4bcf-879a-0da3dc617d07 -- POST / 200 413.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,676 mnist_classifier_MNISTClassifier e3knvfvk 4c4e18a5-d1ba-4752-bc33-5dee304d8fac -- POST / 200 406.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,676 mnist_classifier_MNISTClassifier e3knvfvk adb5ef69-d9c5-41ed-8d4e-54b5a5a3059a -- POST / 200 406.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,677 mnist_classifier_MNISTClassifier e3knvfvk 2e32cd77-3dbe-4482-bb6d-ad63cc84ca43 -- POST / 200 403.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,677 mnist_classifier_MNISTClassifier e3knvfvk 71ab2b9a-5f96-4480-8839-b9a1f390a751 -- POST / 200 397.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,691 mnist_classifier_MNISTClassifier e3knvfvk 1293c48d-0f7f-4f62-9331-7d75b5f518ea -- POST / 200 418.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,692 mnist_classifier_MNISTClassifier e3knvfvk 6a59e694-5a88-43e4-aa87-45d952644dcc -- POST / 200 420.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,692 mnist_classifier_MNISTClassifier e3knvfvk de47d067-5c78-484a-a173-983b21fa3df1 -- POST / 200 419.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,692 mnist_classifier_MNISTClassifier e3knvfvk 1fd8da65-29a9-41ef-b936-c09fce86236e -- POST / 200 412.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,693 mnist_classifier_MNISTClassifier e3knvfvk 8106ca48-731d-42de-ae05-6c13fa9d1cd9 -- POST / 200 414.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,694 mnist_classifier_MNISTClassifier e3knvfvk 19df7605-32da-4bb1-93f1-818e226e8d7e -- POST / 200 411.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,694 mnist_classifier_MNISTClassifier e3knvfvk 0ff8598c-f415-4bb8-aa24-4310f9cef665 -- POST / 200 411.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,726 mnist_classifier_MNISTClassifier e3knvfvk d86a3093-f1ea-4da3-9256-66c40df5ec7f -- POST / 200 442.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,727 mnist_classifier_MNISTClassifier e3knvfvk 26907c7c-02f2-47e3-a489-e5c8eedbfe17 -- POST / 200 440.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,728 mnist_classifier_MNISTClassifier e3knvfvk 7bad53c9-37c2-4edd-a286-0b11ce6ebb49 -- POST / 200 444.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,736 mnist_classifier_MNISTClassifier e3knvfvk 388c1265-d145-4d67-bd8d-daee23b75f4c -- POST / 200 448.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,737 mnist_classifier_MNISTClassifier e3knvfvk 813ffc9a-96e9-4661-a23b-648b728510bd -- POST / 200 450.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,738 mnist_classifier_MNISTClassifier e3knvfvk 54652aef-5813-40d2-8a82-aa34670b71f2 -- POST / 200 448.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,738 mnist_classifier_MNISTClassifier e3knvfvk 7dc990b9-7bcd-4162-9307-cb48038afd32 -- POST / 200 444.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,738 mnist_classifier_MNISTClassifier e3knvfvk 44f07bc2-45bb-4613-bab3-b34997b6fe5e -- POST / 200 443.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,739 mnist_classifier_MNISTClassifier e3knvfvk 920e8c85-2bb0-4301-b930-ecf86e73cf03 -- POST / 200 442.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,739 mnist_classifier_MNISTClassifier e3knvfvk dd5f3af6-a4ab-4cf9-81a1-c06f948b3d04 -- POST / 200 441.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,739 mnist_classifier_MNISTClassifier e3knvfvk f0a57173-a237-4d4e-88ce-0e224b8f49ba -- POST / 200 441.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,740 mnist_classifier_MNISTClassifier e3knvfvk fb289aee-e920-4f1b-8b43-30a5e4bab337 -- POST / 200 439.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,740 mnist_classifier_MNISTClassifier e3knvfvk 924b540a-7787-4440-b409-fb116ea03578 -- POST / 200 439.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,742 mnist_classifier_MNISTClassifier e3knvfvk c26edb2c-351e-4f2e-8e52-d1deee01bc29 -- POST / 200 441.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,742 mnist_classifier_MNISTClassifier e3knvfvk c3649340-14ed-489e-89ed-d86615dfdc10 -- POST / 200 440.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,743 mnist_classifier_MNISTClassifier e3knvfvk 09361ebf-f1fe-4d9f-9e6d-3a00fba3a9de -- POST / 200 440.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,743 mnist_classifier_MNISTClassifier e3knvfvk 2e060740-5497-4266-8159-cdcc895bd7ec -- POST / 200 439.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,743 mnist_classifier_MNISTClassifier e3knvfvk ffabcb0f-0fd2-4b1c-9785-32a787c8b63b -- POST / 200 438.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,744 mnist_classifier_MNISTClassifier e3knvfvk 79456d44-8dc6-4ddf-ba60-39bafbcd2076 -- POST / 200 438.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,744 mnist_classifier_MNISTClassifier e3knvfvk 6821d252-9498-4ae0-9c34-574925a10794 -- POST / 200 438.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,745 mnist_classifier_MNISTClassifier e3knvfvk 22e67a03-409a-45d2-a6be-c353cc879aa8 -- POST / 200 367.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,745 mnist_classifier_MNISTClassifier e3knvfvk 41dbd536-ec7c-4b65-a7ee-141f5fa39055 -- POST / 200 367.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,747 mnist_classifier_MNISTClassifier e3knvfvk 00a52540-2c3f-4975-896d-2a3270eaa602 -- POST / 200 368.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,748 mnist_classifier_MNISTClassifier e3knvfvk c3237188-ee2e-4546-abd7-f29a1a298fb2 -- POST / 200 368.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,749 mnist_classifier_MNISTClassifier e3knvfvk 351f694f-b0cc-417c-a71f-20f513f57db5 -- POST / 200 369.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,753 mnist_classifier_MNISTClassifier e3knvfvk 2a0cc9fb-640e-45ad-8d31-3919e8705cd7 -- POST / 200 372.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,754 mnist_classifier_MNISTClassifier e3knvfvk a7dd7005-7d8b-4e3d-90e8-41f84dc7fe3d -- POST / 200 373.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,755 mnist_classifier_MNISTClassifier e3knvfvk 8cb0f5ec-8c51-42a6-ad94-7a811ffe8d7c -- POST / 200 373.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,758 mnist_classifier_MNISTClassifier e3knvfvk a1fd9b2b-b128-493c-9018-6e205d970095 -- POST / 200 374.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,759 mnist_classifier_MNISTClassifier e3knvfvk 71ae7382-7ba3-4643-8bb7-890855c428d1 -- POST / 200 374.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,759 mnist_classifier_MNISTClassifier e3knvfvk d5b4ae9f-f253-46aa-823e-bb5b5676dd42 -- POST / 200 374.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,759 mnist_classifier_MNISTClassifier e3knvfvk 56e34353-38bc-4d40-8e06-4e31b9266050 -- POST / 200 374.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,760 mnist_classifier_MNISTClassifier e3knvfvk fefe2d94-92da-4fbf-a8d0-816d0eead60d -- POST / 200 374.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,760 mnist_classifier_MNISTClassifier e3knvfvk 5a77df47-27c6-447c-b278-1a721c7da62e -- POST / 200 375.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,761 mnist_classifier_MNISTClassifier e3knvfvk 24373514-62d3-451d-8bc7-4b8e0ff9b828 -- POST / 200 374.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,764 mnist_classifier_MNISTClassifier e3knvfvk c83e8ff4-15cc-44ee-83ad-b02874b83d63 -- POST / 200 374.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,765 mnist_classifier_MNISTClassifier e3knvfvk 1cb80829-5e9d-4ca2-9d63-5d921ac1e544 -- POST / 200 376.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,765 mnist_classifier_MNISTClassifier e3knvfvk 1a515793-6ba5-43b1-883d-fa174b2f7164 -- POST / 200 375.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,766 mnist_classifier_MNISTClassifier e3knvfvk 5a4ecf20-b976-47a0-8a20-6349e4bf87a4 -- POST / 200 377.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,767 mnist_classifier_MNISTClassifier e3knvfvk 976c2ece-019e-4995-8641-f14baf8d9de4 -- POST / 200 376.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,767 mnist_classifier_MNISTClassifier e3knvfvk c87bc2c1-3d3f-46cd-bd8c-fcb51a8ac94a -- POST / 200 376.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,768 mnist_classifier_MNISTClassifier e3knvfvk 471a31f0-a9d3-44ab-9b94-f1fe0d79c13d -- POST / 200 375.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,768 mnist_classifier_MNISTClassifier e3knvfvk 448c229b-ee76-4f8c-902f-97f688ade0d5 -- POST / 200 375.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,803 mnist_classifier_MNISTClassifier e3knvfvk 7c10ed8a-4dd1-4685-b0e4-40f60875bf5d -- POST / 200 409.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,826 mnist_classifier_MNISTClassifier e3knvfvk efa4b22f-49bb-4f94-b806-f1e04733667a -- POST / 200 424.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,827 mnist_classifier_MNISTClassifier e3knvfvk 5e6ecae2-5b1d-4f1e-adf0-49aa01c4055c -- POST / 200 424.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,829 mnist_classifier_MNISTClassifier e3knvfvk 86fd68d5-3a00-41a2-90ed-38129ce88ae5 -- POST / 200 426.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,830 mnist_classifier_MNISTClassifier e3knvfvk 4854e4d9-0895-4c93-9cd3-c64680c799e5 -- POST / 200 425.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,830 mnist_classifier_MNISTClassifier e3knvfvk 70db56c4-e41d-4d5d-9249-5a468ece0f5d -- POST / 200 425.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,831 mnist_classifier_MNISTClassifier e3knvfvk f8bb8cd1-3d63-4773-98e1-61e59fbceeae -- POST / 200 421.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,832 mnist_classifier_MNISTClassifier e3knvfvk bb22811b-b024-43ef-ad7c-bdfaebce269c -- POST / 200 417.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,833 mnist_classifier_MNISTClassifier e3knvfvk 330664a1-2860-4a31-8a83-3280918e11f0 -- POST / 200 416.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,834 mnist_classifier_MNISTClassifier e3knvfvk 4dc66968-0900-4ff5-a55a-33a1472e163b -- POST / 200 417.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,834 mnist_classifier_MNISTClassifier e3knvfvk 95642973-1470-4a6d-a4ca-b69fd60a716c -- POST / 200 416.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,834 mnist_classifier_MNISTClassifier e3knvfvk baed452a-75f8-4896-ad45-0d7cf2b2b02b -- POST / 200 415.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,834 mnist_classifier_MNISTClassifier e3knvfvk 9ed17b3b-f8e3-454f-a1df-ffc1e519f12b -- POST / 200 415.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,835 mnist_classifier_MNISTClassifier e3knvfvk 5f055c8b-ec9c-45a6-a32d-6a9432f62436 -- POST / 200 412.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,835 mnist_classifier_MNISTClassifier e3knvfvk 4bd1f5ab-83b8-4699-9137-161383eb71dc -- POST / 200 413.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,835 mnist_classifier_MNISTClassifier e3knvfvk 381f4c50-ece3-45c9-be63-a68fbfda4268 -- POST / 200 351.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,836 mnist_classifier_MNISTClassifier e3knvfvk f383f41c-18e0-4965-85bf-925d3673470c -- POST / 200 204.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,837 mnist_classifier_MNISTClassifier e3knvfvk ff929ccb-634b-4c8d-a564-5a51f86808a2 -- POST / 200 203.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,837 mnist_classifier_MNISTClassifier e3knvfvk 235d5c09-6195-4e00-8f7c-bd4fb25237dd -- POST / 200 203.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,837 mnist_classifier_MNISTClassifier e3knvfvk d2f24ca2-26c4-428e-9d3b-11d09c9bb7b7 -- POST / 200 203.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,837 mnist_classifier_MNISTClassifier e3knvfvk 5f5779df-0bc0-4e5c-acdd-3770251e243f -- POST / 200 179.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,838 mnist_classifier_MNISTClassifier e3knvfvk 85b112ab-bbe9-4001-bbb6-07615a94feb1 -- POST / 200 147.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,838 mnist_classifier_MNISTClassifier e3knvfvk 55cf15a8-2f4f-466f-b140-fa1b58b649fc -- POST / 200 179.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,840 mnist_classifier_MNISTClassifier e3knvfvk 7a27a69a-6259-4082-ac1c-690ecbeb88f7 -- POST / 200 165.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,956 mnist_classifier_MNISTClassifier e3knvfvk 8421b798-0a66-4d38-bbb3-a03bd376b24e -- POST / 200 265.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,958 mnist_classifier_MNISTClassifier e3knvfvk 11c73bd0-2995-43cc-b942-1ceaf337acaa -- POST / 200 267.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,959 mnist_classifier_MNISTClassifier e3knvfvk c2c744c3-4492-4ae4-ab17-a1309b95debc -- POST / 200 268.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,960 mnist_classifier_MNISTClassifier e3knvfvk 756b3be7-7776-4819-8688-6eb89b2b0a60 -- POST / 200 260.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,961 mnist_classifier_MNISTClassifier e3knvfvk 9c1c980d-b9f3-4a5a-8796-9b62c62077c2 -- POST / 200 269.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,962 mnist_classifier_MNISTClassifier e3knvfvk 79190926-1107-44c7-a795-daf81aa636be -- POST / 200 264.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,963 mnist_classifier_MNISTClassifier e3knvfvk 21bfc7fd-f8a6-4d95-8360-9b6ee65d29cf -- POST / 200 264.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,964 mnist_classifier_MNISTClassifier e3knvfvk 36888b33-4063-4030-896a-8fa2cd07ab00 -- POST / 200 260.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,964 mnist_classifier_MNISTClassifier e3knvfvk e51fbd16-b572-4310-99b7-5936d39d62b4 -- POST / 200 264.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,965 mnist_classifier_MNISTClassifier e3knvfvk 13a24e00-3c60-4e16-bc1f-fa36a981388e -- POST / 200 260.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,966 mnist_classifier_MNISTClassifier e3knvfvk 760f94c9-4a12-4cfe-893b-9ce93f3907f0 -- POST / 200 265.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,967 mnist_classifier_MNISTClassifier e3knvfvk b2ec423f-ea71-4fb0-88d9-f05aa3dae1d9 -- POST / 200 265.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,967 mnist_classifier_MNISTClassifier e3knvfvk 1f626531-815e-4aa7-8c4d-7231356dc4ce -- POST / 200 265.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,971 mnist_classifier_MNISTClassifier e3knvfvk 729ebb13-a03d-4e38-8898-f54098479434 -- POST / 200 268.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,972 mnist_classifier_MNISTClassifier e3knvfvk 34ab2bf3-ab1e-4891-96bd-096f52ec5f59 -- POST / 200 269.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,974 mnist_classifier_MNISTClassifier e3knvfvk b0fea6f4-e3e3-4795-b966-37a3bff6c21f -- POST / 200 271.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,976 mnist_classifier_MNISTClassifier e3knvfvk c3d2f926-377b-48f8-b625-8e0d921b1362 -- POST / 200 269.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,978 mnist_classifier_MNISTClassifier e3knvfvk f57cf7fa-2ab3-45d8-b300-cab7cf6832b7 -- POST / 200 271.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,979 mnist_classifier_MNISTClassifier e3knvfvk 27c8cd3d-447c-4fba-b324-e44790957377 -- POST / 200 272.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,989 mnist_classifier_MNISTClassifier e3knvfvk cc90b0fd-289f-4e97-bcdb-5932ac54bfd4 -- POST / 200 282.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,994 mnist_classifier_MNISTClassifier e3knvfvk 31519d14-ee74-4bd2-a393-b0a5952e8327 -- POST / 200 286.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,995 mnist_classifier_MNISTClassifier e3knvfvk 3463fa84-325c-4c3c-b273-b9ee15e40eed -- POST / 200 213.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,995 mnist_classifier_MNISTClassifier e3knvfvk f9fdbe89-71bb-43f5-b890-b18d6ca76720 -- POST / 200 218.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,996 mnist_classifier_MNISTClassifier e3knvfvk 53d09414-622b-4dbe-8bbb-19f4c171df77 -- POST / 200 272.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,997 mnist_classifier_MNISTClassifier e3knvfvk 77acbe66-bf7e-41dc-b78e-f70f9824dd88 -- POST / 200 273.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,998 mnist_classifier_MNISTClassifier e3knvfvk f532c07b-bd36-4790-86a7-8d4931b478ab -- POST / 200 272.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,998 mnist_classifier_MNISTClassifier e3knvfvk 1c1e3e28-d1cf-44a1-9928-e7d278ac7d45 -- POST / 200 261.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,998 mnist_classifier_MNISTClassifier e3knvfvk f4aee6dd-8171-49b6-a7e1-9774a8904be6 -- POST / 200 234.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,999 mnist_classifier_MNISTClassifier e3knvfvk 83ea8874-a6a6-45cb-99e2-777d9297fc8d -- POST / 200 228.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:02,999 mnist_classifier_MNISTClassifier e3knvfvk 4c29c49c-918e-424b-85e1-9af43e1af422 -- POST / 200 226.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,000 mnist_classifier_MNISTClassifier e3knvfvk 7bb90e8a-956b-4fa4-8c3f-ee795981807c -- POST / 200 227.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,000 mnist_classifier_MNISTClassifier e3knvfvk d68506c2-a5db-4a45-9dc4-c29e82af4014 -- POST / 200 225.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,001 mnist_classifier_MNISTClassifier e3knvfvk d12196b1-3d35-466f-b94e-360ca12f5fa7 -- POST / 200 225.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,001 mnist_classifier_MNISTClassifier e3knvfvk cf468676-86a1-4869-a065-df77aa8b0aca -- POST / 200 220.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,002 mnist_classifier_MNISTClassifier e3knvfvk 12fe671d-4885-46f9-8ac0-4bec6f99da3b -- POST / 200 224.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,003 mnist_classifier_MNISTClassifier e3knvfvk 49274d2a-5147-4a60-b396-5d7f98da153f -- POST / 200 224.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,004 mnist_classifier_MNISTClassifier e3knvfvk ef98072e-3a32-40db-94a4-25bb57cdfb25 -- POST / 200 224.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,012 mnist_classifier_MNISTClassifier e3knvfvk 1bcbe521-4610-48b0-a647-e85c22654d40 -- POST / 200 232.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,013 mnist_classifier_MNISTClassifier e3knvfvk 906177a8-7586-48ce-9204-ecd45a80d7e7 -- POST / 200 230.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,013 mnist_classifier_MNISTClassifier e3knvfvk 79d87353-757f-4034-a857-3dc6188487cf -- POST / 200 230.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,015 mnist_classifier_MNISTClassifier e3knvfvk 9f81435f-7fd2-4384-8dd2-3e12696ade73 -- POST / 200 232.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,015 mnist_classifier_MNISTClassifier e3knvfvk a139cd26-4dbd-4d1b-8691-1b7539729071 -- POST / 200 223.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,096 mnist_classifier_MNISTClassifier e3knvfvk c4b44aff-9555-43da-852d-07cd4be5854c -- POST / 200 308.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,105 mnist_classifier_MNISTClassifier e3knvfvk beca946b-7d70-4a4f-9b9d-e3cd876e1e04 -- POST / 200 315.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,106 mnist_classifier_MNISTClassifier e3knvfvk 84f70474-a37c-43b3-bf33-dc954973e0a5 -- POST / 200 313.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,106 mnist_classifier_MNISTClassifier e3knvfvk 6d9996de-09f4-4099-a525-3ddcd0283658 -- POST / 200 312.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,107 mnist_classifier_MNISTClassifier e3knvfvk 5355865e-012a-4453-8f71-6d75ffd5e095 -- POST / 200 263.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,107 mnist_classifier_MNISTClassifier e3knvfvk a9b2d8cd-1946-4add-a8b7-a625c4fb52d0 -- POST / 200 263.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,107 mnist_classifier_MNISTClassifier e3knvfvk 5c3e4769-9947-43e3-a52c-77e0c7317cef -- POST / 200 263.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,108 mnist_classifier_MNISTClassifier e3knvfvk 491424c2-6e9e-40a1-8f0e-bdaa2f086e55 -- POST / 200 263.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,108 mnist_classifier_MNISTClassifier e3knvfvk 0beb6211-0f56-40a1-9bdf-791334fafed7 -- POST / 200 263.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,109 mnist_classifier_MNISTClassifier e3knvfvk f5ea95d1-0526-4db7-b3b2-f4d05787f6b1 -- POST / 200 263.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,109 mnist_classifier_MNISTClassifier e3knvfvk f6aa46eb-e1e8-481f-bcc1-72538f32e415 -- POST / 200 264.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,110 mnist_classifier_MNISTClassifier e3knvfvk d7cbce89-81b3-4aff-9276-0614daac8ed9 -- POST / 200 264.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,110 mnist_classifier_MNISTClassifier e3knvfvk 5bfdfa9c-2eb8-4d3c-ab72-85dd1e1561a9 -- POST / 200 264.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,110 mnist_classifier_MNISTClassifier e3knvfvk faeebf04-0656-4b03-9eaa-1ccb8a8d0d9f -- POST / 200 258.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,114 mnist_classifier_MNISTClassifier e3knvfvk c8ab9239-2998-47b6-94c3-134133ec2843 -- POST / 200 261.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,116 mnist_classifier_MNISTClassifier e3knvfvk c67d6178-4905-454e-8e0f-a379beaa534b -- POST / 200 263.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,116 mnist_classifier_MNISTClassifier e3knvfvk 9009d4d1-0613-4acb-bcf8-668f7d2585d9 -- POST / 200 263.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,118 mnist_classifier_MNISTClassifier e3knvfvk 5d073867-d5f9-48f6-99d8-e459867ccfd7 -- POST / 200 263.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,118 mnist_classifier_MNISTClassifier e3knvfvk 480dde5a-3257-4ae7-bd4d-09da8bd2ab63 -- POST / 200 263.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,119 mnist_classifier_MNISTClassifier e3knvfvk a54c1f6c-f82a-471b-8be2-6d1c5133923e -- POST / 200 263.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,120 mnist_classifier_MNISTClassifier e3knvfvk dec9c7b3-e719-4ce9-b48b-2eea3ec9be23 -- POST / 200 261.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,124 mnist_classifier_MNISTClassifier e3knvfvk eb3bcf4b-e6db-480b-ba35-4fba44732a65 -- POST / 200 263.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,124 mnist_classifier_MNISTClassifier e3knvfvk e26b6e95-40b8-42b5-9a63-fb133f1116c9 -- POST / 200 263.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,125 mnist_classifier_MNISTClassifier e3knvfvk 4712d9ad-9910-4eca-813c-e843ed71a742 -- POST / 200 262.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,128 mnist_classifier_MNISTClassifier e3knvfvk c0b9254d-6880-4b51-9bea-9688cd3f13ac -- POST / 200 262.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,130 mnist_classifier_MNISTClassifier e3knvfvk fb4f6d62-bf32-401e-9ee5-08c88bb01991 -- POST / 200 264.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,130 mnist_classifier_MNISTClassifier e3knvfvk 7c2d4ec4-925d-4005-be17-0be5b159e861 -- POST / 200 265.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,131 mnist_classifier_MNISTClassifier e3knvfvk 19167962-1753-4788-8188-cf3c2afd853d -- POST / 200 263.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,131 mnist_classifier_MNISTClassifier e3knvfvk b2ece194-0460-4980-824d-9dbefcec8dce -- POST / 200 264.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,132 mnist_classifier_MNISTClassifier e3knvfvk 8978ae06-a1e9-45ef-b59e-e1e664a74667 -- POST / 200 259.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,132 mnist_classifier_MNISTClassifier e3knvfvk baa12155-f004-4da3-a4b3-44b6f50f2915 -- POST / 200 264.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,132 mnist_classifier_MNISTClassifier e3knvfvk 63bdc0b8-a77b-458f-8374-dc0f41906dfa -- POST / 200 257.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,137 mnist_classifier_MNISTClassifier e3knvfvk c09bf57d-c80b-4832-8d5f-09ca81c15dd9 -- POST / 200 262.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,142 mnist_classifier_MNISTClassifier e3knvfvk b63605d6-eb5b-4f1d-8a85-0f8f0f4b39bd -- POST / 200 273.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,142 mnist_classifier_MNISTClassifier e3knvfvk 7f119cea-db3a-4226-bb55-b0aae3adea0f -- POST / 200 253.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4653) INFO 2026-05-20 04:38:03,143 mnist_classifier_MNISTClassifier e3knvfvk 8588d7e6-d299-43ab-96c7-d116e39d1171 -- POST / 200 247.5ms
Processed 1000 requests in 4.90 seconds
Throughput: 204.01 requests/second

Ray Serve automatically buffers and load balances requests across the replicas.

Fault tolerance

In production, process and machine failures are inevitable. Ray Serve is designed so that each major component in the Serve stack (the controller, replicas, and proxies) can fail and recover while your application continues to handle traffic.

Serve can also recover from larger infrastructure failures, such as entire nodes or pods failing. Serve can even recover from head node failures, or the entire head pod if deploying on KubeRay.

For more information about Ray Serve’s fault tolerance, see the Ray Serve fault-tolerance guide.

Monitor the deployment

Monitoring is critical when running large-scale deployments. The Ray dashboard displays Serve metrics like request throughput, latency, and error rates. It also shows cluster resource usage, replica status, and overall deployment health in real time. The dashboard also lets you inspect logs from individual replicas across the cluster.

For debugging, Ray offers distributed debugging tools that let you attach a debugger to running replicas across the cluster. For more information, see the Ray Serve monitoring documentation.

Conclusion

In this tutorial, you:

• Deployed a PyTorch model using Ray Serve with production best practices.

• Enabled dynamic request batching to optimize performance.

• Configured autoscaling and fractional GPU allocation to efficiently scale across a cluster.

• Tested the service with concurrent asynchronous requests.

Further reading

Ray Serve has more production features that are out of scope for this tutorial but are worth checking out:

• Specialized large language model (LLM) serving APIs that handle complexities like managing key-value (KV) caches and continuous batching.

• Model multiplexing to dynamically load and serve many different models on the same deployment. This is useful for serving per-user fine-tuned models, for example.

• Composed deployments to orchestrate multiple deployments into a single app.

For more information, see the Ray Serve documentation and Ray Serve examples.