beginner/serving_tutorial

Run in Google Colab

Colab

Download Notebook

Notebook

View on GitHub

GitHub

Serve PyTorch models at scale with Ray Serve

Author: Ricardo Decal

This tutorial shows how to deploy a PyTorch model using Ray Serve with production-ready features.

What you will learn

• How to create a production-ready PyTorch model deployment that can scale to thousands of nodes and GPUs

• How to configure an HTTP endpoint for the deployment using FastAPI

• Enable dynamic request batching for higher throughput

• Configure autoscaling and per-replica CPU/GPU resource allocation

• Load test the service with concurrent requests and monitor it with the Ray dashboard

• How Ray Serve deployments can self-heal from failures

• Ray Serve’s advanced features like model multiplexing and model composition.

Prerequisites

• PyTorch v2.9+ and torchvision

• Ray Serve (ray[serve]) v2.52.1+

• A GPU is recommended for higher throughput but is not required

Ray Serve is a scalable framework for serving machine learning models in production. It’s built on top of Ray, which is a unified framework for scaling AI and Python applications that simplifies the complexities of distributed computing. Ray is also open source and part of the PyTorch Foundation.

Setup

To install the dependencies, run:

pip install "ray[serve]" torch torchvision

Start by importing the required libraries:

import asyncio
import time
from typing import Any

from fastapi import FastAPI
from pydantic import BaseModel
import aiohttp
import numpy as np
import torch
import torch.nn as nn
from ray import serve
from torchvision.transforms import v2

Define a PyTorch model

Define a simple convolutional neural network for the MNIST digit classification dataset:

class MNISTNet(nn.Module):
    def __init__(self):
        super().__init__()
        self.conv1 = nn.Conv2d(1, 32, 3, 1)
        self.dropout1 = nn.Dropout(0.25)
        self.conv2 = nn.Conv2d(32, 64, 3, 1)
        self.fc1 = nn.Linear(9216, 128)
        self.dropout2 = nn.Dropout(0.5)
        self.fc2 = nn.Linear(128, 10)

    def forward(self, x):
        x = self.conv1(x)
        x = nn.functional.relu(x)
        x = self.conv2(x)
        x = nn.functional.relu(x)
        x = nn.functional.max_pool2d(x, 2)
        x = self.dropout1(x)
        x = torch.flatten(x, 1)
        x = self.fc1(x)
        x = nn.functional.relu(x)
        x = self.dropout2(x)
        x = self.fc2(x)
        return nn.functional.log_softmax(x, dim=1)

Define the Ray Serve deployment

To deploy this model with Ray Serve, wrap the model in a Python class and decorate it with @serve.deployment.

Processing requests in batches is more efficient than processing requests one by one, especially when using GPUs. Ray Serve provides built-in support for dynamic request batching, where individual incoming requests are opportunistically batched. Enable dynamic batching using the @serve.batch decorator as shown in the following code:

app = FastAPI()

class ImageRequest(BaseModel):  # Used for request validation and generating API documentation
    image: list[list[float]] | list[list[list[float]]]  # 2D or 3D array

@serve.deployment
@serve.ingress(app)
class MNISTClassifier:
    def __init__(self):
        self.device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
        self.model = MNISTNet().to(self.device)
        # Define the transformation pipeline for the input images.
        self.transform = v2.Compose([
            v2.ToImage(),
            v2.ToDtype(torch.float32, scale=True),
            # Mean and standard deviation of the MNIST training subset.
            v2.Normalize(mean=[0.1307], std=[0.3013]),
        ])

        self.model.eval()

    # batch_wait_timeout_s is the maximum time to wait for a full batch,
    # trading off latency for throughput.
    @serve.batch(max_batch_size=128, batch_wait_timeout_s=0.1)
    async def predict_batch(self, images: list[np.ndarray]) -> list[dict[str, Any]]:
        # Stack all images into a single tensor.
        batch_tensor = torch.cat([
            self.transform(img).unsqueeze(0)
            for img in images
        ]).to(self.device).float()

        # Single forward pass on the entire batch at once.
        with torch.no_grad():
            logits = self.model(batch_tensor)
            predictions = torch.argmax(logits, dim=1).cpu().numpy()

        # Unbatch the results and preserve their original order.
        return [
            {
                "predicted_label": int(pred),
                "logits": logit.cpu().numpy().tolist()
            }
            for pred, logit in zip(predictions, logits)
        ]

    @app.post("/")
    async def handle_request(self, request: ImageRequest):
        """Handle an incoming HTTP request using FastAPI.

        Inputs are automatically validated using the Pydantic model.
        """
        # Process the single request.
        image_array = np.array(request.image)

        # Ray Serve's @serve.batch automatically batches requests.
        result = await self.predict_batch(image_array)

        return result

This is a FastAPI app, which extends Ray Serve with features like automatic request validation with Pydantic, auto-generated OpenAPI-style API documentation, and more.

Configure autoscaling and resource allocation

In production, traffic can vary significantly. Ray Serve’s autoscaling feature automatically adjusts the number of replicas based on traffic load, ensuring you have enough capacity during peaks while saving resources during quiet periods. Ray Serve scales to very large deployments with thousands of nodes and replicas.

You can also specify resource allocation per replica, such as the number of CPUs or GPUs. Ray Serve handles the orchestration of these resources across your cluster. Ray also supports fractional GPUs, allowing multiple replicas to share a single GPU when models are small enough to fit in memory together.

The following is a sample configuration with autoscaling and resource allocation:

num_cpus_per_replica = 1
num_gpus_per_replica = 1  # Set to 0 to run the model on CPUs instead of GPUs.
mnist_app = MNISTClassifier.options(
    autoscaling_config={
        "target_ongoing_requests": 50,  # Target 50 ongoing requests per replica.
        "min_replicas": 1,              # Keep at least 1 replica alive.
        "max_replicas": 80,             # Scale up to 80 replicas to maintain target_ongoing_requests.
        "upscale_delay_s": 5,           # Wait 5s before scaling up.
        "downscale_delay_s": 30,        # Wait 30s before scaling down.
    },
    # Max invocations to handle_request per replica to process simultaneously.
    # Requests exceeding this limit are queued by the router until capacity is available.
    max_ongoing_requests=200,
    # Max queue size for requests that exceed max_ongoing_requests.
    # If the queue is full, future requests are backpressured with errors until space is available.
    # -1 means the queue can grow until cluster memory is exhausted.
    max_queued_requests=-1,
    # Set the resources per replica.
    ray_actor_options={"num_cpus": num_cpus_per_replica, "num_gpus": num_gpus_per_replica}
).bind()

The app is ready to deploy. Suppose you ran this on a cluster of 10 machines, each with 4 GPUs. With num_gpus=0.5, Ray schedules 2 replicas per GPU, giving you 80 replicas across the cluster. This configuration permits the deployment to elastically scale up to 80 replicas as needed to handle traffic spikes and scale back down to 1 replica when traffic subsides.

Test the endpoint with concurrent requests

To deploy the app, use the serve.run function:

# Start the Ray Serve application.
handle = serve.run(mnist_app, name="mnist_classifier")

2026-08-25 19:54:41,337 WARNING services.py:2213 -- WARNING: The object store is using /tmp/ray instead of /dev/shm because /dev/shm has only 2147471360 bytes available. This will harm performance! You may be able to free up space by deleting files in /dev/shm. If you are inside a Docker container, you can increase /dev/shm size by passing '--shm-size=10.24gb' to 'docker run' (or add it to the run_options list in a Ray cluster config). Make sure to set this to more than 30% of available RAM.
2026-08-25 19:54:42,507 INFO worker.py:2003 -- Started a local Ray instance. View the dashboard at 127.0.0.1:8265
/usr/local/lib/python3.10/dist-packages/ray/_private/worker.py:2051: FutureWarning: Tip: In future versions of Ray, Ray will no longer override accelerator visible devices env var if num_gpus=0 or num_gpus=None (default). To enable this behavior and turn off this error message, set RAY_ACCEL_ENV_VAR_OVERRIDE_ON_ZERO=0
  warnings.warn(
(ProxyActor pid=5041) INFO 2026-08-25 19:54:45,051 proxy 172.17.0.2 -- Proxy starting on node 6ee299ccf36fc5bb15aab1c5b722e8c229377861b51ffd251dc7c30f (HTTP port: 8000).
INFO 2026-08-25 19:54:45,121 serve 4224 -- Started Serve in namespace "serve".
(ProxyActor pid=5041) INFO 2026-08-25 19:54:45,117 proxy 172.17.0.2 -- Got updated endpoints: {}.
(ServeController pid=5035) INFO 2026-08-25 19:54:45,215 controller 5035 -- Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
(ServeController pid=5035) INFO 2026-08-25 19:54:45,215 controller 5035 -- Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
(ProxyActor pid=5041) INFO 2026-08-25 19:54:45,219 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
(ProxyActor pid=5041) INFO 2026-08-25 19:54:45,226 proxy 172.17.0.2 -- Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x7fdfec5ce2c0>.
(ServeController pid=5035) INFO 2026-08-25 19:54:45,320 controller 5035 -- Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
(ProxyActor pid=5041) INFO 2026-08-25 19:54:49,439 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=[])}.
INFO 2026-08-25 19:54:50,244 serve 4224 -- Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

You will see output similar to:

Started Serve in namespace "serve".
Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
Proxy starting on node ... (HTTP port: 8000).
Got updated endpoints: {}.
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x73a53c52c250>.
Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=['/', '/docs', '/docs/oauth2-redirect', '/openapi.json', '/redoc'])}.
Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

The app is now listening for requests on port 8000.

To test the deployment, you can send many requests concurrently using aiohttp. The following code demonstrates how to send 1000 concurrent requests to the app:

async def send_single_request(session, url, data):
    async with session.post(url, json=data) as response:
        return await response.json()

async def send_concurrent_requests(num_requests):
    image = np.random.rand(28, 28).tolist()

    print(f"Sending {num_requests} concurrent requests...")
    async with aiohttp.ClientSession() as session:
        tasks = [
            send_single_request(session, url="http://localhost:8000/", data={"image": image})
            for _ in range(num_requests)
        ]
        responses = await asyncio.gather(*tasks)

    return responses

# Run the concurrent requests.
start_time = time.time()
responses = asyncio.run(send_concurrent_requests(1000))
elapsed = time.time() - start_time

print(f"Processed {len(responses)} requests in {elapsed:.2f} seconds")
print(f"Throughput: {len(responses)/elapsed:.2f} requests/second")

Sending 1000 concurrent requests...
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,358 mnist_classifier_MNISTClassifier tpxhiw6a 9e89687e-cd0a-433b-a375-5621879aeb59 -- POST / 200 443.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,360 mnist_classifier_MNISTClassifier tpxhiw6a 0927ee5f-d7d5-47bf-82c2-ea020ae60332 -- POST / 200 440.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,364 mnist_classifier_MNISTClassifier tpxhiw6a ae78c08e-8f59-4f28-bd65-9529146d4014 -- POST / 200 444.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,366 mnist_classifier_MNISTClassifier tpxhiw6a 361f9dc7-7a94-406c-b9ef-2e316c451ca2 -- POST / 200 444.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,366 mnist_classifier_MNISTClassifier tpxhiw6a c865fdf2-5ef1-45ee-8ef7-dbf5a57de427 -- POST / 200 444.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,367 mnist_classifier_MNISTClassifier tpxhiw6a 06b692c5-27ee-45e1-b093-5e7f8f89dc57 -- POST / 200 442.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,367 mnist_classifier_MNISTClassifier tpxhiw6a 0e0953ac-5f67-4ff1-9187-bd067ce8b32d -- POST / 200 439.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,368 mnist_classifier_MNISTClassifier tpxhiw6a f79f54dc-869e-4e8d-949c-c3322be3daa4 -- POST / 200 439.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,369 mnist_classifier_MNISTClassifier tpxhiw6a 0f85bb32-a825-4601-b8a5-5d249e4555f2 -- POST / 200 440.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,369 mnist_classifier_MNISTClassifier tpxhiw6a 9717dda1-e8f2-433d-bcf2-ee8c804be6c4 -- POST / 200 439.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,369 mnist_classifier_MNISTClassifier tpxhiw6a daea92f7-fa4d-477d-9a8b-30e9344a84d2 -- POST / 200 439.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,372 mnist_classifier_MNISTClassifier tpxhiw6a 62337d35-7d33-477f-a1a7-307cb66d31ee -- POST / 200 440.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,372 mnist_classifier_MNISTClassifier tpxhiw6a 5e3b359d-997b-49c0-9d3c-f796ada04567 -- POST / 200 441.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,373 mnist_classifier_MNISTClassifier tpxhiw6a 504aec1d-2cbb-46d3-b973-e3f20cfa9569 -- POST / 200 438.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,374 mnist_classifier_MNISTClassifier tpxhiw6a 5ddc33f3-6ce5-4d6e-8860-c238b32667d7 -- POST / 200 438.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,375 mnist_classifier_MNISTClassifier tpxhiw6a 0fc547b5-7c62-434e-8d78-d1c9c2ac6c86 -- POST / 200 438.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,375 mnist_classifier_MNISTClassifier tpxhiw6a b5daf38b-1276-4536-88b6-1392b5347551 -- POST / 200 438.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,375 mnist_classifier_MNISTClassifier tpxhiw6a e20f07a2-28f5-4526-8917-0e535fef1668 -- POST / 200 436.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,376 mnist_classifier_MNISTClassifier tpxhiw6a d9029bd7-c0fa-4cc7-b838-a61d90b66b96 -- POST / 200 433.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,376 mnist_classifier_MNISTClassifier tpxhiw6a 217d3712-18c7-4356-9893-c6e2e08614a3 -- POST / 200 434.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,377 mnist_classifier_MNISTClassifier tpxhiw6a a947f700-a4f7-40ab-9963-0593ea2fc3b5 -- POST / 200 434.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,378 mnist_classifier_MNISTClassifier tpxhiw6a 32746cf0-d155-4c76-8bbf-f1f416fdf07f -- POST / 200 435.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,379 mnist_classifier_MNISTClassifier tpxhiw6a 0743e15a-15d3-4e8b-8c92-0fdf3bf0b1d6 -- POST / 200 433.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,379 mnist_classifier_MNISTClassifier tpxhiw6a d753fc03-c2fe-423a-ae57-80ad4812cedf -- POST / 200 432.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,380 mnist_classifier_MNISTClassifier tpxhiw6a bf18931d-e31f-4719-9f5b-6be2d5c799bf -- POST / 200 432.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,380 mnist_classifier_MNISTClassifier tpxhiw6a 40781161-6265-4507-bf64-e9e5083214f2 -- POST / 200 431.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,380 mnist_classifier_MNISTClassifier tpxhiw6a b6d5f313-c089-402e-a926-b305fb2e3c96 -- POST / 200 431.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,579 mnist_classifier_MNISTClassifier tpxhiw6a e15beb69-1718-44e5-b490-8fb39aac0a53 -- POST / 200 628.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,581 mnist_classifier_MNISTClassifier tpxhiw6a 306020e2-dc12-4e79-98e2-b9a4b764913c -- POST / 200 630.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,582 mnist_classifier_MNISTClassifier tpxhiw6a a36c46f8-d58a-4f1d-90c8-eb4cf5f72a82 -- POST / 200 631.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,583 mnist_classifier_MNISTClassifier tpxhiw6a a3c5b170-0262-49f0-baf5-36dfe3533b1a -- POST / 200 631.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,585 mnist_classifier_MNISTClassifier tpxhiw6a 53aac8c4-d29f-4430-b535-7bc7ebb20024 -- POST / 200 631.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,585 mnist_classifier_MNISTClassifier tpxhiw6a 5e86263f-3d95-4d73-9192-b75d96b66fcc -- POST / 200 631.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,590 mnist_classifier_MNISTClassifier tpxhiw6a 52da6919-3350-475a-817b-cecd92a3d97d -- POST / 200 636.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,591 mnist_classifier_MNISTClassifier tpxhiw6a e1adb5ea-f5be-435c-9dfb-1d29db502794 -- POST / 200 636.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,592 mnist_classifier_MNISTClassifier tpxhiw6a 0df191f6-136a-4bf1-bf4c-9d599be9d691 -- POST / 200 636.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,593 mnist_classifier_MNISTClassifier tpxhiw6a a3e6f631-c258-4857-8738-29e1554523b5 -- POST / 200 635.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,594 mnist_classifier_MNISTClassifier tpxhiw6a 791f7210-bf3c-4a7f-b498-cdb14fa2bfbd -- POST / 200 636.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,595 mnist_classifier_MNISTClassifier tpxhiw6a 8de2360c-073f-4967-9f03-b152a81e75e4 -- POST / 200 637.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,598 mnist_classifier_MNISTClassifier tpxhiw6a 7d32f288-ccd1-4217-86b7-ddcb0caa62cb -- POST / 200 639.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,599 mnist_classifier_MNISTClassifier tpxhiw6a 298bba2c-18cb-4fe8-889b-4649b64262fb -- POST / 200 637.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,601 mnist_classifier_MNISTClassifier tpxhiw6a 935c6372-3cb4-4072-8d23-f0d369836736 -- POST / 200 636.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,603 mnist_classifier_MNISTClassifier tpxhiw6a 9c1a2532-4004-4755-9370-99ccfa52bd6e -- POST / 200 639.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,604 mnist_classifier_MNISTClassifier tpxhiw6a 598892bd-d97a-4bd9-a2c7-ef8feccf993e -- POST / 200 639.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,605 mnist_classifier_MNISTClassifier tpxhiw6a 5c91a2f2-6caf-4400-855f-19fc39347575 -- POST / 200 638.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,606 mnist_classifier_MNISTClassifier tpxhiw6a 8fee77e4-257a-493f-a40a-b968064cab78 -- POST / 200 638.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,607 mnist_classifier_MNISTClassifier tpxhiw6a c47779db-387c-409f-bd2f-40af3842bd69 -- POST / 200 638.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,664 mnist_classifier_MNISTClassifier tpxhiw6a cda6766d-3e14-4307-b1ce-c4801597324f -- POST / 200 693.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,664 mnist_classifier_MNISTClassifier tpxhiw6a 13c1bf89-4ea5-42dd-b14c-ffd33ae34420 -- POST / 200 694.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,666 mnist_classifier_MNISTClassifier tpxhiw6a 75c442ef-18e2-4e2f-a381-712a99afaf34 -- POST / 200 694.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,668 mnist_classifier_MNISTClassifier tpxhiw6a 9f90d8f4-9e4c-42fc-af71-3c8b90e451ad -- POST / 200 696.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,669 mnist_classifier_MNISTClassifier tpxhiw6a a92ccf59-e4dc-4718-bfc4-847dc4187099 -- POST / 200 696.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,670 mnist_classifier_MNISTClassifier tpxhiw6a 78ead141-b175-43fa-8d5a-c61d7545c5a8 -- POST / 200 696.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,670 mnist_classifier_MNISTClassifier tpxhiw6a dc4b0d9f-2c1d-473d-bdac-9dd0fd59759f -- POST / 200 695.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,671 mnist_classifier_MNISTClassifier tpxhiw6a a129d862-acdc-4e3e-bfca-62e27cdd1057 -- POST / 200 694.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,671 mnist_classifier_MNISTClassifier tpxhiw6a b567aa4c-ee5e-45ef-81e6-c60cfbc17928 -- POST / 200 694.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,672 mnist_classifier_MNISTClassifier tpxhiw6a 960d230c-3cfd-4ce4-af05-a8c46f625566 -- POST / 200 694.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,673 mnist_classifier_MNISTClassifier tpxhiw6a 59cc2158-a109-4b0e-9f88-574ec4e84b4e -- POST / 200 694.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,673 mnist_classifier_MNISTClassifier tpxhiw6a da2bf469-606a-42c5-851f-5772b954b84a -- POST / 200 693.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,673 mnist_classifier_MNISTClassifier tpxhiw6a d0780277-9c8b-445a-b4b5-d2b4c4c9fec0 -- POST / 200 691.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,674 mnist_classifier_MNISTClassifier tpxhiw6a 5df84b2d-4bc9-4f7d-9141-42a11240df3e -- POST / 200 691.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,683 mnist_classifier_MNISTClassifier tpxhiw6a cbc749f9-28a6-4042-ae89-24782626dd3a -- POST / 200 698.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,687 mnist_classifier_MNISTClassifier tpxhiw6a 0a8317a2-d2ed-49bb-b30a-a78733aaed21 -- POST / 200 701.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,689 mnist_classifier_MNISTClassifier tpxhiw6a 9d2615b6-d801-488a-bfc8-119d65f53d51 -- POST / 200 705.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,694 mnist_classifier_MNISTClassifier tpxhiw6a a82fa28d-25ae-4589-85cd-53bdeb1a634f -- POST / 200 708.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,696 mnist_classifier_MNISTClassifier tpxhiw6a 9424b751-6384-4cb1-9ccb-4fc61fa40ec3 -- POST / 200 709.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,697 mnist_classifier_MNISTClassifier tpxhiw6a 3d66795f-ae3d-4dd7-9ce2-90eff499a105 -- POST / 200 707.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,697 mnist_classifier_MNISTClassifier tpxhiw6a 37f3a9b4-d736-4f92-8cf7-65cb964e9746 -- POST / 200 711.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,697 mnist_classifier_MNISTClassifier tpxhiw6a 30f48545-e862-416f-a00c-c674769a9fa6 -- POST / 200 708.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,698 mnist_classifier_MNISTClassifier tpxhiw6a 0f39b2e6-9034-4020-a031-8fc5657bffb5 -- POST / 200 708.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,698 mnist_classifier_MNISTClassifier tpxhiw6a ddf10159-dc69-4dbf-a3f1-1a913bd2e61d -- POST / 200 703.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,698 mnist_classifier_MNISTClassifier tpxhiw6a e6dfcc2f-78e7-409d-a6b7-e3745f0558f4 -- POST / 200 703.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,699 mnist_classifier_MNISTClassifier tpxhiw6a 6c57b63c-47be-4ad5-b07c-ed7d6d88430b -- POST / 200 703.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,699 mnist_classifier_MNISTClassifier tpxhiw6a 6a129078-80d6-4f32-9e69-43673676aa2a -- POST / 200 700.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,699 mnist_classifier_MNISTClassifier tpxhiw6a d8926563-e68e-4cfa-a630-d2c42986116a -- POST / 200 700.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,699 mnist_classifier_MNISTClassifier tpxhiw6a ff91f275-8404-4466-ae9b-1d7c18edaf62 -- POST / 200 700.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,700 mnist_classifier_MNISTClassifier tpxhiw6a a8e896ee-d121-4384-8e2e-4393126da7c1 -- POST / 200 700.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,700 mnist_classifier_MNISTClassifier tpxhiw6a 77ffefc7-101d-4d2e-9315-663f8f1d7b95 -- POST / 200 700.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,701 mnist_classifier_MNISTClassifier tpxhiw6a b58f79e7-91cf-4f29-bab1-f5eadf9eca42 -- POST / 200 699.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,701 mnist_classifier_MNISTClassifier tpxhiw6a 5a6f521c-f0e5-47f5-8f0b-0dddb3b5fba1 -- POST / 200 699.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,758 mnist_classifier_MNISTClassifier tpxhiw6a e7a46fd2-6af8-43fc-acaf-76c27504168f -- POST / 200 756.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,759 mnist_classifier_MNISTClassifier tpxhiw6a b63ec613-c424-4cac-ac4d-a68084f3b48b -- POST / 200 755.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,760 mnist_classifier_MNISTClassifier tpxhiw6a 544af838-c1f4-4b2c-aafd-c472d8f9a51b -- POST / 200 755.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,760 mnist_classifier_MNISTClassifier tpxhiw6a fa5f73c7-700d-4a32-a01c-80700ad84617 -- POST / 200 756.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,761 mnist_classifier_MNISTClassifier tpxhiw6a d1185ffe-3a04-4f0d-b669-784bfb755535 -- POST / 200 754.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,762 mnist_classifier_MNISTClassifier tpxhiw6a ab1bfd9f-3eed-4c11-8cc7-765da6ec8163 -- POST / 200 755.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,762 mnist_classifier_MNISTClassifier tpxhiw6a 50cc148b-a865-4529-9ef1-68594fba6ae6 -- POST / 200 753.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,763 mnist_classifier_MNISTClassifier tpxhiw6a 188ef49c-0df0-435c-9b77-fcb2b849a22d -- POST / 200 753.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,764 mnist_classifier_MNISTClassifier tpxhiw6a 9a963a47-40f9-4ac9-a9d0-d69f1c8a4c6e -- POST / 200 753.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,767 mnist_classifier_MNISTClassifier tpxhiw6a a2a0f906-79b0-43f4-ba5a-7b9b5987bde0 -- POST / 200 754.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,773 mnist_classifier_MNISTClassifier tpxhiw6a 59033730-9d67-4a4c-9e4f-3e1f7881d307 -- POST / 200 760.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,773 mnist_classifier_MNISTClassifier tpxhiw6a 740c8cdb-8ff0-4dbc-a4ea-bf21d27a6b3d -- POST / 200 759.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,774 mnist_classifier_MNISTClassifier tpxhiw6a f612d086-e351-4969-960d-ec62045b6305 -- POST / 200 759.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,775 mnist_classifier_MNISTClassifier tpxhiw6a 545a257f-bdcd-4fa1-bfec-6886cea6e71a -- POST / 200 758.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,776 mnist_classifier_MNISTClassifier tpxhiw6a 845b0455-a037-45ab-9977-fdeca00dd502 -- POST / 200 757.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,776 mnist_classifier_MNISTClassifier tpxhiw6a 2e9bc3ef-1b2a-4bf4-93f8-cdea484ddd2a -- POST / 200 756.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,777 mnist_classifier_MNISTClassifier tpxhiw6a 51837c68-227c-460e-858d-7212cec74588 -- POST / 200 752.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,780 mnist_classifier_MNISTClassifier tpxhiw6a 6ac5195c-51b1-44c5-84ff-e27dcc2d47bf -- POST / 200 759.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,781 mnist_classifier_MNISTClassifier tpxhiw6a fc0c959d-404b-4b0d-8cac-c0b815393c86 -- POST / 200 760.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,782 mnist_classifier_MNISTClassifier tpxhiw6a 435e23fb-db99-44f0-92d1-87b33616dfaa -- POST / 200 757.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,782 mnist_classifier_MNISTClassifier tpxhiw6a 5fc5a741-2f82-40dc-b0db-c3933f428ef8 -- POST / 200 426.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,783 mnist_classifier_MNISTClassifier tpxhiw6a badcfb59-74d0-4b28-b780-a9a6f86e19a5 -- POST / 200 428.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,785 mnist_classifier_MNISTClassifier tpxhiw6a fceb566f-9a9d-4837-998e-79269afe75f3 -- POST / 200 403.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,786 mnist_classifier_MNISTClassifier tpxhiw6a af77808f-b502-4f34-84ae-b1cfbe9505b3 -- POST / 200 400.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,787 mnist_classifier_MNISTClassifier tpxhiw6a 8624fccc-f615-45fe-8eca-c27ea15c62f7 -- POST / 200 397.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,787 mnist_classifier_MNISTClassifier tpxhiw6a 7993616b-b73c-4171-a2a6-8b786bdca52a -- POST / 200 400.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,788 mnist_classifier_MNISTClassifier tpxhiw6a 26ce9385-3fb2-44ea-8a51-bdf36a4c6185 -- POST / 200 397.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,789 mnist_classifier_MNISTClassifier tpxhiw6a 68aa20fc-166f-4849-8429-77d0198dcc68 -- POST / 200 398.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,790 mnist_classifier_MNISTClassifier tpxhiw6a e6c9dfa4-a928-46ae-b7f0-9aea7465a69b -- POST / 200 393.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,791 mnist_classifier_MNISTClassifier tpxhiw6a cfb5b9c4-468b-4a8a-bf80-e47bcbc5ca00 -- POST / 200 398.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,792 mnist_classifier_MNISTClassifier tpxhiw6a 4d6af676-eafe-4185-ab87-dd7876d3a13e -- POST / 200 398.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,812 mnist_classifier_MNISTClassifier tpxhiw6a b2593511-e56f-4c66-81e7-00d3a146d01c -- POST / 200 417.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,813 mnist_classifier_MNISTClassifier tpxhiw6a b6176870-f004-46de-86e7-c5aa08be68c5 -- POST / 200 417.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,813 mnist_classifier_MNISTClassifier tpxhiw6a 51fb6045-7d02-4ad6-a2ab-8958f2669500 -- POST / 200 415.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,818 mnist_classifier_MNISTClassifier tpxhiw6a f2afa0f6-a7b1-45f6-8dc7-a12d058a9aec -- POST / 200 419.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,818 mnist_classifier_MNISTClassifier tpxhiw6a 4c47e3ae-df6a-483c-bad4-fcb852665f21 -- POST / 200 420.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,819 mnist_classifier_MNISTClassifier tpxhiw6a 777bf539-5031-44d0-8633-d14b1d20c9bd -- POST / 200 420.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,819 mnist_classifier_MNISTClassifier tpxhiw6a 2fa485b1-5e07-428c-8b95-e722d72b9b1d -- POST / 200 418.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,820 mnist_classifier_MNISTClassifier tpxhiw6a c2bc4095-33ce-4b6d-90ea-cfcac348010a -- POST / 200 420.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,821 mnist_classifier_MNISTClassifier tpxhiw6a fb543c12-44ca-4821-903e-1c43609ead36 -- POST / 200 419.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,822 mnist_classifier_MNISTClassifier tpxhiw6a 3c231686-9f72-46fd-8a9c-bfb5ef8941ba -- POST / 200 419.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,822 mnist_classifier_MNISTClassifier tpxhiw6a 26254978-3229-4733-a1d3-88c2a78ff929 -- POST / 200 419.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,826 mnist_classifier_MNISTClassifier tpxhiw6a 9ea0b6ac-c66c-4c47-9a0e-b1a2527bc41f -- POST / 200 422.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,827 mnist_classifier_MNISTClassifier tpxhiw6a f0385a0f-f0e6-4f49-a2f1-0a024ff4b8b8 -- POST / 200 423.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,831 mnist_classifier_MNISTClassifier tpxhiw6a cfb126f4-8c25-48f5-9c98-38a7e9cc4012 -- POST / 200 426.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,833 mnist_classifier_MNISTClassifier tpxhiw6a 9cad5225-8fb5-4af0-af23-715e3fac1830 -- POST / 200 427.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,834 mnist_classifier_MNISTClassifier tpxhiw6a 270552ae-450d-4615-9fe8-b4a17c09ae0f -- POST / 200 427.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,835 mnist_classifier_MNISTClassifier tpxhiw6a 61dfe8a8-0141-4cf4-a757-9f8d7b042ee4 -- POST / 200 237.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,835 mnist_classifier_MNISTClassifier tpxhiw6a 446c15b4-c3b0-4550-9cfb-7d020c148edf -- POST / 200 237.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,925 mnist_classifier_MNISTClassifier tpxhiw6a e3a04db2-3e7f-427b-b2f1-28200f0f2658 -- POST / 200 303.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,928 mnist_classifier_MNISTClassifier tpxhiw6a 193d9c84-0009-483e-a2bc-142cdf3cbe7d -- POST / 200 307.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,929 mnist_classifier_MNISTClassifier tpxhiw6a 74ecc0ab-4f06-4201-a0c2-3e30c9cd8867 -- POST / 200 321.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,929 mnist_classifier_MNISTClassifier tpxhiw6a ec7d76a5-a56c-47c2-9467-f033ea3fd1e1 -- POST / 200 313.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,930 mnist_classifier_MNISTClassifier tpxhiw6a 9ce6f54b-ece4-4035-b40a-8f7ab9d75802 -- POST / 200 312.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,931 mnist_classifier_MNISTClassifier tpxhiw6a 43d2d567-463b-4cab-9b55-6d8d5cdfa530 -- POST / 200 309.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,939 mnist_classifier_MNISTClassifier tpxhiw6a be95ce8e-3bb6-4ddc-99ce-94bbd400ceb7 -- POST / 200 318.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,940 mnist_classifier_MNISTClassifier tpxhiw6a 2104d62f-b97a-4ca4-9616-0c2e539b9afc -- POST / 200 319.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,942 mnist_classifier_MNISTClassifier tpxhiw6a 45d74f77-9229-42b8-aa42-804dc7636068 -- POST / 200 320.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,943 mnist_classifier_MNISTClassifier tpxhiw6a 1d3bf096-b464-405a-9a39-2cdd789b3d42 -- POST / 200 320.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,943 mnist_classifier_MNISTClassifier tpxhiw6a 9337a197-0ff7-47b1-a76b-2639c58a7597 -- POST / 200 320.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,943 mnist_classifier_MNISTClassifier tpxhiw6a 567a9737-6d14-4c1b-b916-068fb2523149 -- POST / 200 321.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,945 mnist_classifier_MNISTClassifier tpxhiw6a 871d84fa-d39f-41c9-a000-2c5fc19a47dd -- POST / 200 321.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,946 mnist_classifier_MNISTClassifier tpxhiw6a a7e3950f-e5c8-46a3-9dd2-e1d83fb19e81 -- POST / 200 321.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,948 mnist_classifier_MNISTClassifier tpxhiw6a 1c34b2c0-59a0-48c5-abb8-687b2aac5dda -- POST / 200 322.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,949 mnist_classifier_MNISTClassifier tpxhiw6a fc215fd7-80cc-473e-8c0c-917f4e2f8f39 -- POST / 200 318.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,949 mnist_classifier_MNISTClassifier tpxhiw6a c2ec01c3-0121-439e-8579-4b9f5cc3b8af -- POST / 200 317.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,950 mnist_classifier_MNISTClassifier tpxhiw6a 238ef2e9-13ce-4243-83bc-db59f5517519 -- POST / 200 322.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,955 mnist_classifier_MNISTClassifier tpxhiw6a 9ef09a2f-3353-47ad-b3aa-476687d9acf0 -- POST / 200 292.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,960 mnist_classifier_MNISTClassifier tpxhiw6a ae48ed38-7d70-4086-916e-aa5f06f19a7b -- POST / 200 258.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,960 mnist_classifier_MNISTClassifier tpxhiw6a 0b72e7e1-c065-49af-91c8-25b87c7b76af -- POST / 200 256.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,962 mnist_classifier_MNISTClassifier tpxhiw6a a717525f-accf-4953-a1c7-3a353fc45bf3 -- POST / 200 306.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,962 mnist_classifier_MNISTClassifier tpxhiw6a c5ae0a65-2667-4ec7-89b2-139e5aff9bd5 -- POST / 200 305.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,963 mnist_classifier_MNISTClassifier tpxhiw6a 579152f0-1dba-4532-b27c-94e98e67e2f2 -- POST / 200 257.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,965 mnist_classifier_MNISTClassifier tpxhiw6a b9989f71-c1fa-4a48-ba8b-498ff7e88ac3 -- POST / 200 258.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,969 mnist_classifier_MNISTClassifier tpxhiw6a 239a618a-16b9-4bc6-85f1-9420d159c166 -- POST / 200 261.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,970 mnist_classifier_MNISTClassifier tpxhiw6a 43cdac1b-f11d-453e-ad5f-762ea394f2ef -- POST / 200 262.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,972 mnist_classifier_MNISTClassifier tpxhiw6a 51299d7e-6082-470b-943d-ef078d1b1da0 -- POST / 200 263.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,973 mnist_classifier_MNISTClassifier tpxhiw6a f6e4cd39-054f-4ba2-b17c-b03639c34b9b -- POST / 200 263.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,981 mnist_classifier_MNISTClassifier tpxhiw6a 366e9a18-0e0a-4d58-977d-45114ffa9bca -- POST / 200 269.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,987 mnist_classifier_MNISTClassifier tpxhiw6a 87d35347-196c-4d48-ad81-727ca6cff98b -- POST / 200 275.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,988 mnist_classifier_MNISTClassifier tpxhiw6a 3050eb99-a758-45c5-b294-a5839309ea13 -- POST / 200 277.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,989 mnist_classifier_MNISTClassifier tpxhiw6a 7bce614d-782b-424d-8f99-d7b252e3f80a -- POST / 200 276.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,989 mnist_classifier_MNISTClassifier tpxhiw6a 8a1e95f5-b205-4c0c-9395-b9eed831714d -- POST / 200 276.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,990 mnist_classifier_MNISTClassifier tpxhiw6a 5d2f7b88-b60e-4834-8476-5425083c8d55 -- POST / 200 276.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,991 mnist_classifier_MNISTClassifier tpxhiw6a 828ddea6-86bc-4fb6-abba-f66a952ea17f -- POST / 200 263.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,992 mnist_classifier_MNISTClassifier tpxhiw6a 136efee0-ea48-4fda-8cdf-e5f92b0f534f -- POST / 200 262.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,992 mnist_classifier_MNISTClassifier tpxhiw6a 2e1cda62-d676-405c-99dd-5558c2ec79ad -- POST / 200 260.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,993 mnist_classifier_MNISTClassifier tpxhiw6a 155248ef-617e-4313-903e-dd5598847423 -- POST / 200 259.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,993 mnist_classifier_MNISTClassifier tpxhiw6a 68088e4d-b346-4a31-b988-a930cb75a520 -- POST / 200 257.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,995 mnist_classifier_MNISTClassifier tpxhiw6a 34c7c84c-08c0-48a4-8732-63a66c2c0101 -- POST / 200 259.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,996 mnist_classifier_MNISTClassifier tpxhiw6a 12db3662-7096-4c05-bec9-34ecb6628fb7 -- POST / 200 260.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,997 mnist_classifier_MNISTClassifier tpxhiw6a b8218697-2011-429a-bab0-b00ab792dc4c -- POST / 200 260.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,997 mnist_classifier_MNISTClassifier tpxhiw6a 2bf22793-eed8-4f9b-b98d-e7d669aaebb0 -- POST / 200 260.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:51,998 mnist_classifier_MNISTClassifier tpxhiw6a 1a8cf2a4-a113-4f5a-ba9a-9c618c86e0d3 -- POST / 200 260.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,000 mnist_classifier_MNISTClassifier tpxhiw6a 3a1ed35b-16d8-4bd1-980f-fde3ce437506 -- POST / 200 263.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,000 mnist_classifier_MNISTClassifier tpxhiw6a 19ef6341-2127-46ca-82e7-7e454f5a1f88 -- POST / 200 261.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,001 mnist_classifier_MNISTClassifier tpxhiw6a 14c2b05a-8c96-4327-a9dd-b587ff696512 -- POST / 200 263.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,004 mnist_classifier_MNISTClassifier tpxhiw6a f7c24578-00e9-4d16-93e5-9590ccf485b7 -- POST / 200 265.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,004 mnist_classifier_MNISTClassifier tpxhiw6a ac2451c2-4180-4d90-99c9-ae23a905225e -- POST / 200 265.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,071 mnist_classifier_MNISTClassifier tpxhiw6a a42072f7-b413-4f08-9da4-7fc061947c8d -- POST / 200 332.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,077 mnist_classifier_MNISTClassifier tpxhiw6a 1a013860-e30e-49a3-8849-fcc2a37b6494 -- POST / 200 297.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,078 mnist_classifier_MNISTClassifier tpxhiw6a 55e809df-e4e5-40ff-b0a2-90edef8363d8 -- POST / 200 298.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,079 mnist_classifier_MNISTClassifier tpxhiw6a b2051a84-d9fe-47ee-9c22-65dfb8b2bac2 -- POST / 200 299.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,079 mnist_classifier_MNISTClassifier tpxhiw6a 15cd0893-f94a-4f43-851c-3c527beeb523 -- POST / 200 299.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,080 mnist_classifier_MNISTClassifier tpxhiw6a 67c26422-2577-49ff-8e64-e3a823d21700 -- POST / 200 268.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,081 mnist_classifier_MNISTClassifier tpxhiw6a 404fb459-379d-4ad9-9a2e-49d6f2d9953b -- POST / 200 243.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,082 mnist_classifier_MNISTClassifier tpxhiw6a 93336e14-4985-4ad7-99b6-27af891b3db5 -- POST / 200 240.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,082 mnist_classifier_MNISTClassifier tpxhiw6a 41692a7b-36ea-40ef-a7fe-b646876742a9 -- POST / 200 239.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,083 mnist_classifier_MNISTClassifier tpxhiw6a 45d72a8f-6f76-489f-b9fb-c8e863c0660b -- POST / 200 238.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,084 mnist_classifier_MNISTClassifier tpxhiw6a e27f1448-41aa-4765-adf0-d24ef13472b3 -- POST / 200 238.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,085 mnist_classifier_MNISTClassifier tpxhiw6a a13b825a-f9f3-4c56-86d6-68c400c57dc7 -- POST / 200 238.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,087 mnist_classifier_MNISTClassifier tpxhiw6a 9d53c255-c34c-4f1c-8c71-e036879f27fe -- POST / 200 239.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,088 mnist_classifier_MNISTClassifier tpxhiw6a c2d5b0bb-f30c-4dab-af05-7adada66a496 -- POST / 200 240.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,089 mnist_classifier_MNISTClassifier tpxhiw6a f88b3103-7d14-4d8f-9270-d6cc09a416fa -- POST / 200 240.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,089 mnist_classifier_MNISTClassifier tpxhiw6a cc7af858-e0d0-41e2-8419-dc1ed1848694 -- POST / 200 240.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,090 mnist_classifier_MNISTClassifier tpxhiw6a 455f1f21-f299-4a2d-bd8f-af8b2015c9a8 -- POST / 200 239.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,091 mnist_classifier_MNISTClassifier tpxhiw6a 1b9bb1f4-0185-46fb-8752-410cfae13627 -- POST / 200 238.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,092 mnist_classifier_MNISTClassifier tpxhiw6a eb603f22-1954-418c-ba98-61638f57f487 -- POST / 200 238.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,092 mnist_classifier_MNISTClassifier tpxhiw6a 4556a2d7-9ffb-4ab4-8f51-c49123e595b8 -- POST / 200 236.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,092 mnist_classifier_MNISTClassifier tpxhiw6a 74b12be1-3bb2-4229-83a1-64aa897313e6 -- POST / 200 236.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,092 mnist_classifier_MNISTClassifier tpxhiw6a 1e974496-d777-42db-86e7-6cfad9250245 -- POST / 200 235.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,093 mnist_classifier_MNISTClassifier tpxhiw6a 527412a5-93de-4845-b7c4-77739b060acf -- POST / 200 236.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,100 mnist_classifier_MNISTClassifier tpxhiw6a 604d6b65-17a9-43df-9333-23f9b1085f55 -- POST / 200 242.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,102 mnist_classifier_MNISTClassifier tpxhiw6a c9a8adb5-5edf-45c7-b4b2-c17892c86083 -- POST / 200 244.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,108 mnist_classifier_MNISTClassifier tpxhiw6a fd9a072d-09b5-4fc9-8540-a523b90de368 -- POST / 200 250.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,109 mnist_classifier_MNISTClassifier tpxhiw6a 3a2b3753-9b15-441f-b6b7-0d80c7ed1fa6 -- POST / 200 250.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,110 mnist_classifier_MNISTClassifier tpxhiw6a 1219c105-f1d4-4972-907b-dfa2575f1ac8 -- POST / 200 250.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,111 mnist_classifier_MNISTClassifier tpxhiw6a c503f528-3e1c-406d-9e3a-987d6046f696 -- POST / 200 249.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,111 mnist_classifier_MNISTClassifier tpxhiw6a 47150543-5f01-4831-b56b-93902c38fd99 -- POST / 200 248.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,114 mnist_classifier_MNISTClassifier tpxhiw6a 8ab250c1-e30d-452e-ad97-e5fadf426363 -- POST / 200 252.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,115 mnist_classifier_MNISTClassifier tpxhiw6a bec07427-d50c-4bf4-a712-b6aa6495313f -- POST / 200 253.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,116 mnist_classifier_MNISTClassifier tpxhiw6a a89aa0fb-da07-4ecc-b1d4-917a881bc6ea -- POST / 200 252.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,116 mnist_classifier_MNISTClassifier tpxhiw6a b156a15a-3c7e-4451-9167-4c0c749c9e05 -- POST / 200 252.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,121 mnist_classifier_MNISTClassifier tpxhiw6a 77f21a35-8aef-46c1-b3c3-98ef66d8c523 -- POST / 200 256.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,122 mnist_classifier_MNISTClassifier tpxhiw6a dbac8b8e-54e0-462d-b963-4d4ba0f1125c -- POST / 200 257.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,123 mnist_classifier_MNISTClassifier tpxhiw6a 44e71b67-6b1a-429e-aa8e-dfd79b93d3fe -- POST / 200 256.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,123 mnist_classifier_MNISTClassifier tpxhiw6a 2342bc97-addc-43f8-a9ea-95f357ff2eff -- POST / 200 256.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,123 mnist_classifier_MNISTClassifier tpxhiw6a 55aaa83d-570f-4cce-aa90-d08a9c2835ea -- POST / 200 251.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,124 mnist_classifier_MNISTClassifier tpxhiw6a 41e296fa-baad-4c4e-a174-3a701a8f915f -- POST / 200 251.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,124 mnist_classifier_MNISTClassifier tpxhiw6a c26c700f-b1c4-4d98-b948-955995003d3d -- POST / 200 250.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,125 mnist_classifier_MNISTClassifier tpxhiw6a 2998bf76-89d8-4b85-8cd9-e43621475055 -- POST / 200 250.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,125 mnist_classifier_MNISTClassifier tpxhiw6a da34323b-5333-4292-926c-9a0d1782ed69 -- POST / 200 249.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,126 mnist_classifier_MNISTClassifier tpxhiw6a 26c83eae-0e42-42e1-90d4-0d354c12f879 -- POST / 200 249.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,127 mnist_classifier_MNISTClassifier tpxhiw6a 7ac74dbc-9663-4c99-9c76-2b29d0e43a14 -- POST / 200 247.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,128 mnist_classifier_MNISTClassifier tpxhiw6a bfdc3ba1-549b-4275-b241-4045dd3b77c0 -- POST / 200 245.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,130 mnist_classifier_MNISTClassifier tpxhiw6a 4e8a6459-995c-4d09-9359-34509126c949 -- POST / 200 246.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,130 mnist_classifier_MNISTClassifier tpxhiw6a 516e66d5-8842-450b-b0ad-61c0d0e82bf8 -- POST / 200 244.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,130 mnist_classifier_MNISTClassifier tpxhiw6a 39a266f8-0f8f-42eb-b8c0-a124bc0c3aa8 -- POST / 200 232.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,131 mnist_classifier_MNISTClassifier tpxhiw6a 44827726-b193-4192-a6b3-d82010e332d3 -- POST / 200 231.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,240 mnist_classifier_MNISTClassifier tpxhiw6a 0af0fea0-7f09-403c-bddd-f3306773f59f -- POST / 200 233.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,243 mnist_classifier_MNISTClassifier tpxhiw6a fc4bc6fa-0e90-4ab2-822e-448b8136b0aa -- POST / 200 270.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,244 mnist_classifier_MNISTClassifier tpxhiw6a a486ce54-f007-4709-b392-df801a691b2c -- POST / 200 236.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,246 mnist_classifier_MNISTClassifier tpxhiw6a 951009aa-8e3f-4737-94fd-0ffd6b8d34be -- POST / 200 255.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,247 mnist_classifier_MNISTClassifier tpxhiw6a 524fb0b3-7b9f-4f6c-b649-22726e459532 -- POST / 200 251.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,251 mnist_classifier_MNISTClassifier tpxhiw6a b1be5b6f-fe88-42c0-a7ab-39e9057eb0ca -- POST / 200 249.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,253 mnist_classifier_MNISTClassifier tpxhiw6a ea43fffb-2d38-4602-838c-3891b5cb4a6d -- POST / 200 248.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,254 mnist_classifier_MNISTClassifier tpxhiw6a 4de01102-40c6-4d05-8ce5-4efc7d5de365 -- POST / 200 245.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,259 mnist_classifier_MNISTClassifier tpxhiw6a a9385940-7c6c-4dc5-96b4-cea91e815a2a -- POST / 200 247.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,267 mnist_classifier_MNISTClassifier tpxhiw6a 94ebadfd-1bb2-4657-b913-262a12278b28 -- POST / 200 252.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,269 mnist_classifier_MNISTClassifier tpxhiw6a e25b1e03-84a9-4580-87f1-550da2748fa3 -- POST / 200 255.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,271 mnist_classifier_MNISTClassifier tpxhiw6a efd4b13c-058b-405d-adc5-b64296934b48 -- POST / 200 258.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,274 mnist_classifier_MNISTClassifier tpxhiw6a 3de7fefb-1146-4988-b607-e432c2f32993 -- POST / 200 259.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,275 mnist_classifier_MNISTClassifier tpxhiw6a 37d6f3f9-e136-45f7-ae9c-320ae04d1c9c -- POST / 200 259.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,276 mnist_classifier_MNISTClassifier tpxhiw6a 85e26c01-5c71-4609-992d-ddc48d3bea2a -- POST / 200 259.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,277 mnist_classifier_MNISTClassifier tpxhiw6a 4490f2ad-90e2-4c29-94b7-9bc073e35261 -- POST / 200 259.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,279 mnist_classifier_MNISTClassifier tpxhiw6a d6db3c3b-3177-4ead-a568-4fd4afcd6698 -- POST / 200 256.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,284 mnist_classifier_MNISTClassifier tpxhiw6a bb2c8390-346c-41a8-bc1f-322d9065dcc8 -- POST / 200 265.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,286 mnist_classifier_MNISTClassifier tpxhiw6a 5b081c25-dafa-40fe-93c4-835ecff47f12 -- POST / 200 263.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,287 mnist_classifier_MNISTClassifier tpxhiw6a 602dcd02-e5fc-4ca9-9a10-5a225fd3d275 -- POST / 200 262.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,288 mnist_classifier_MNISTClassifier tpxhiw6a ecb59f23-efa8-465f-902e-4813ef1b0a7e -- POST / 200 262.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,289 mnist_classifier_MNISTClassifier tpxhiw6a fdd944df-8b8b-433f-aa52-60a4b07c193d -- POST / 200 264.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,290 mnist_classifier_MNISTClassifier tpxhiw6a dc5e5407-34ff-4919-b409-b22c541cdd33 -- POST / 200 263.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,290 mnist_classifier_MNISTClassifier tpxhiw6a bd32c8dd-0d33-463e-b4ca-9e63b12fc235 -- POST / 200 260.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,291 mnist_classifier_MNISTClassifier tpxhiw6a fa51f9c8-106b-4eb6-9551-902439c5b5e0 -- POST / 200 260.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,291 mnist_classifier_MNISTClassifier tpxhiw6a 8e24c692-e0f3-4b08-9736-d8315e108992 -- POST / 200 265.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,292 mnist_classifier_MNISTClassifier tpxhiw6a b02859b2-26fc-464b-9d73-943cddf9d8a4 -- POST / 200 264.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,292 mnist_classifier_MNISTClassifier tpxhiw6a a897d685-e3f1-4cbc-b1d1-cc804af9d9b2 -- POST / 200 263.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,295 mnist_classifier_MNISTClassifier tpxhiw6a d5bb7710-1216-466a-abe7-61aaaff3a20d -- POST / 200 265.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,296 mnist_classifier_MNISTClassifier tpxhiw6a 7f257a88-2414-44d4-96e5-c135c580d112 -- POST / 200 266.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,300 mnist_classifier_MNISTClassifier tpxhiw6a 60e51eaa-c175-4190-b36c-df19418d686c -- POST / 200 269.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,302 mnist_classifier_MNISTClassifier tpxhiw6a 745b86e8-042f-49ae-9c01-3fc9f635bf6f -- POST / 200 268.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,303 mnist_classifier_MNISTClassifier tpxhiw6a e880b037-17df-4707-b517-1574ec851a9a -- POST / 200 269.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,303 mnist_classifier_MNISTClassifier tpxhiw6a 77ffecce-3bb6-405a-89e1-90ea7f97b428 -- POST / 200 269.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,307 mnist_classifier_MNISTClassifier tpxhiw6a 932dd03c-0c41-42fa-a374-9e07a7c9a4ac -- POST / 200 272.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,310 mnist_classifier_MNISTClassifier tpxhiw6a 707ab0c2-a40c-4fbc-a663-c916c795e66f -- POST / 200 275.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,544 mnist_classifier_MNISTClassifier tpxhiw6a 842f1d3b-af6f-42f9-b4e3-32ada39a61d2 -- POST / 200 507.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,544 mnist_classifier_MNISTClassifier tpxhiw6a 90da61c8-05f5-4e34-bb3d-ea65116b54c7 -- POST / 200 509.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,545 mnist_classifier_MNISTClassifier tpxhiw6a b8d9006b-ffa8-4588-988f-006ac22afc73 -- POST / 200 501.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,546 mnist_classifier_MNISTClassifier tpxhiw6a 58425383-8764-44f0-ad8d-4155c098b88d -- POST / 200 507.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,547 mnist_classifier_MNISTClassifier tpxhiw6a 6de01b51-5f2e-4665-8ebd-c0c5d6de5fc3 -- POST / 200 502.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,548 mnist_classifier_MNISTClassifier tpxhiw6a 54172879-b8e3-4216-aad6-6ca512178b1a -- POST / 200 502.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,550 mnist_classifier_MNISTClassifier tpxhiw6a cd782379-2a97-4c92-83a0-bf1822c08f37 -- POST / 200 503.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,552 mnist_classifier_MNISTClassifier tpxhiw6a 7c7a4f23-64a0-4a09-b6d3-96a0fe2b6a3b -- POST / 200 499.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,565 mnist_classifier_MNISTClassifier tpxhiw6a 8974cb67-5930-4e4a-ae2f-f1f87b7dff38 -- POST / 200 511.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,566 mnist_classifier_MNISTClassifier tpxhiw6a 0b836d82-369d-441b-b9fd-1c45c9140b53 -- POST / 200 494.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,566 mnist_classifier_MNISTClassifier tpxhiw6a 4296a011-92ab-42e8-91df-ba1795ce5ead -- POST / 200 489.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,566 mnist_classifier_MNISTClassifier tpxhiw6a 0c6e557c-1114-4c76-9851-8ff0d6d2c471 -- POST / 200 497.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,566 mnist_classifier_MNISTClassifier tpxhiw6a 74d10855-837a-48b5-86e8-37af0fd2c32f -- POST / 200 489.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,567 mnist_classifier_MNISTClassifier tpxhiw6a 03dd039e-0b3e-4cb5-8e3a-de24ac9ca231 -- POST / 200 479.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,567 mnist_classifier_MNISTClassifier tpxhiw6a 48a5b5b4-8ec3-4acd-a739-6210de4e63d5 -- POST / 200 432.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,567 mnist_classifier_MNISTClassifier tpxhiw6a ffda4f04-b392-4a3f-ae1a-82cf1c2bc642 -- POST / 200 432.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,567 mnist_classifier_MNISTClassifier tpxhiw6a 99a23b4d-2e89-40dd-918e-51e2604d56ca -- POST / 200 430.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,568 mnist_classifier_MNISTClassifier tpxhiw6a fe9be34b-ec17-4924-a3b2-9de753ebb35c -- POST / 200 429.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,569 mnist_classifier_MNISTClassifier tpxhiw6a 600b870e-4bf7-4159-a0b1-f1b1457ebb4c -- POST / 200 429.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,570 mnist_classifier_MNISTClassifier tpxhiw6a 50300b45-44a7-4852-aed2-38915cc8b7a2 -- POST / 200 428.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,570 mnist_classifier_MNISTClassifier tpxhiw6a 74d90473-8f14-486d-9d7b-1ab64b13bc93 -- POST / 200 427.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,571 mnist_classifier_MNISTClassifier tpxhiw6a 844e6a20-48c4-4dbb-8771-be3e05fdc5b4 -- POST / 200 427.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,575 mnist_classifier_MNISTClassifier tpxhiw6a a4e96d9c-4b3e-4aff-91f9-9c624d1f048a -- POST / 200 431.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,576 mnist_classifier_MNISTClassifier tpxhiw6a b398d45c-9c22-4994-b1df-f16e323e812b -- POST / 200 430.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,576 mnist_classifier_MNISTClassifier tpxhiw6a 29d75831-3196-4936-b873-c601f89d22c4 -- POST / 200 431.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,577 mnist_classifier_MNISTClassifier tpxhiw6a d62a4c30-8005-4db4-92e7-eea6049154d4 -- POST / 200 430.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,577 mnist_classifier_MNISTClassifier tpxhiw6a 7d1cd562-f6e8-43d8-9885-85e00cb593b4 -- POST / 200 405.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,578 mnist_classifier_MNISTClassifier tpxhiw6a a9e3b49f-7a18-442d-8bd0-a6bdde13e5a9 -- POST / 200 407.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,579 mnist_classifier_MNISTClassifier tpxhiw6a 5076e1b1-ad27-4085-9ee1-22c705208f9f -- POST / 200 405.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,580 mnist_classifier_MNISTClassifier tpxhiw6a fbad99c2-2cea-47d6-a46d-47c0af50c53b -- POST / 200 408.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,580 mnist_classifier_MNISTClassifier tpxhiw6a 147f163a-2a74-4608-950f-ddae6b7ccd41 -- POST / 200 405.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,580 mnist_classifier_MNISTClassifier tpxhiw6a 977b50fc-9a3a-4809-b141-188f7cb8b7de -- POST / 200 404.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,581 mnist_classifier_MNISTClassifier tpxhiw6a 570f9c98-5b5b-4efc-a38d-9c54c123ce80 -- POST / 200 404.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,581 mnist_classifier_MNISTClassifier tpxhiw6a 0f2aa451-a1e6-45ee-b19d-968ad7f6ea5f -- POST / 200 404.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,582 mnist_classifier_MNISTClassifier tpxhiw6a 1288cb06-c332-4253-bdd2-3b366148a247 -- POST / 200 404.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,582 mnist_classifier_MNISTClassifier tpxhiw6a 101db2a6-95e2-473d-baff-6275f47d9816 -- POST / 200 404.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,583 mnist_classifier_MNISTClassifier tpxhiw6a cbc2bfe0-59fb-41ef-ae29-c1e96630f1ab -- POST / 200 404.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,584 mnist_classifier_MNISTClassifier tpxhiw6a 623cab0d-0d8b-4e1a-932f-efeb974eec54 -- POST / 200 404.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,585 mnist_classifier_MNISTClassifier tpxhiw6a 982b2fea-ea5e-46ef-9fb8-e797f17bb448 -- POST / 200 404.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,585 mnist_classifier_MNISTClassifier tpxhiw6a b92d00c8-7242-4ea0-89f5-be305ddcd3b0 -- POST / 200 403.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,586 mnist_classifier_MNISTClassifier tpxhiw6a 3bf85e03-faef-4a05-9f6f-cf3ae11a9877 -- POST / 200 401.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,586 mnist_classifier_MNISTClassifier tpxhiw6a 1f0e5001-b361-4c18-8695-c854a18fede6 -- POST / 200 404.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,587 mnist_classifier_MNISTClassifier tpxhiw6a f51d06d8-4366-4f75-a6f0-9691705aea74 -- POST / 200 399.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,587 mnist_classifier_MNISTClassifier tpxhiw6a 952ffca2-d3d9-48bb-a4d4-519decc623ea -- POST / 200 404.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,587 mnist_classifier_MNISTClassifier tpxhiw6a 4e97e3b6-fd9d-4039-8cae-fa058a930d58 -- POST / 200 399.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,587 mnist_classifier_MNISTClassifier tpxhiw6a 6cc809ea-4cc9-456a-b4b6-26c679d02ca1 -- POST / 200 399.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,588 mnist_classifier_MNISTClassifier tpxhiw6a 7b1549fe-6736-4181-915a-83df66d0b31d -- POST / 200 400.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,588 mnist_classifier_MNISTClassifier tpxhiw6a 58ebf322-c460-4910-8581-63b10f21cf92 -- POST / 200 400.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,679 mnist_classifier_MNISTClassifier tpxhiw6a 2e0394a0-2f87-4ef2-99c9-d54147b5d324 -- POST / 200 490.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,680 mnist_classifier_MNISTClassifier tpxhiw6a 02b9cf00-003c-4816-99d1-c97b81c3f129 -- POST / 200 491.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,682 mnist_classifier_MNISTClassifier tpxhiw6a b6a566d2-e795-403b-9c9d-37cf37be46b9 -- POST / 200 489.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,684 mnist_classifier_MNISTClassifier tpxhiw6a 6d879a41-1fb8-4577-b34a-2a2006af7299 -- POST / 200 490.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,689 mnist_classifier_MNISTClassifier tpxhiw6a 06e127b3-0d17-42f9-b7b5-96e5f76566f3 -- POST / 200 494.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,690 mnist_classifier_MNISTClassifier tpxhiw6a a091c50a-5cf6-4088-adf0-3b48e999a8e0 -- POST / 200 494.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,691 mnist_classifier_MNISTClassifier tpxhiw6a 11a35eba-7c61-45b8-95d4-0bd9a5b684c6 -- POST / 200 495.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,693 mnist_classifier_MNISTClassifier tpxhiw6a c6da3795-98dc-4964-84ce-9ddbdaed44f0 -- POST / 200 496.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,693 mnist_classifier_MNISTClassifier tpxhiw6a 7a802f85-27b5-4db9-bec3-3df1858ff3e3 -- POST / 200 495.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,694 mnist_classifier_MNISTClassifier tpxhiw6a d553fb77-e5da-4470-977d-d9ff56afeada -- POST / 200 496.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,695 mnist_classifier_MNISTClassifier tpxhiw6a d68e6a46-ac4f-4ac7-8dc0-3329a5c2f611 -- POST / 200 494.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,696 mnist_classifier_MNISTClassifier tpxhiw6a ae5ea3da-1372-4b82-9571-828fe0773d6e -- POST / 200 490.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,699 mnist_classifier_MNISTClassifier tpxhiw6a 0df12447-7715-4df9-bd97-fb6cbec543d1 -- POST / 200 491.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,703 mnist_classifier_MNISTClassifier tpxhiw6a b9d09a92-980f-4306-8742-8df085e732a2 -- POST / 200 494.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,706 mnist_classifier_MNISTClassifier tpxhiw6a e86c6611-832a-4246-b6f8-2da0b0d87131 -- POST / 200 497.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,707 mnist_classifier_MNISTClassifier tpxhiw6a c804ac18-88c4-4947-bff7-360675a34f6d -- POST / 200 498.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,707 mnist_classifier_MNISTClassifier tpxhiw6a 9346f36d-1d1f-4f26-85d0-8f907c414cf0 -- POST / 200 452.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,707 mnist_classifier_MNISTClassifier tpxhiw6a 8a6c9d64-2751-452b-8dd4-c4f32782142d -- POST / 200 452.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,708 mnist_classifier_MNISTClassifier tpxhiw6a 8f38983c-fc2c-45ba-9250-e6ff24ed56eb -- POST / 200 439.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,714 mnist_classifier_MNISTClassifier tpxhiw6a bc34a696-288a-4f97-8952-22e8bb1adae0 -- POST / 200 431.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,716 mnist_classifier_MNISTClassifier tpxhiw6a 45d6f1a4-3685-46e1-94ca-00382155ef44 -- POST / 200 432.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,719 mnist_classifier_MNISTClassifier tpxhiw6a 0f23176d-3d56-40a4-9209-c52adbef5130 -- POST / 200 435.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,721 mnist_classifier_MNISTClassifier tpxhiw6a 73b4dc2a-b9cd-48ec-b521-7b5d3174e5d8 -- POST / 200 425.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,721 mnist_classifier_MNISTClassifier tpxhiw6a 69fad657-eee9-45f0-8b6b-9295bba0689d -- POST / 200 425.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,721 mnist_classifier_MNISTClassifier tpxhiw6a d59b30a5-8f37-403f-b49e-fcffdb433d5e -- POST / 200 414.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,722 mnist_classifier_MNISTClassifier tpxhiw6a 740e5f0f-79e2-4105-b689-f3ee9c4cb91e -- POST / 200 406.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,722 mnist_classifier_MNISTClassifier tpxhiw6a f00521b0-d59c-4de5-b34a-ae35f01cca36 -- POST / 200 404.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,722 mnist_classifier_MNISTClassifier tpxhiw6a da60268f-6033-4c7f-be31-3f1f5ecfb6b3 -- POST / 200 404.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,722 mnist_classifier_MNISTClassifier tpxhiw6a a6fc31c8-5962-450c-9cbf-62f79ae36ef4 -- POST / 200 403.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,723 mnist_classifier_MNISTClassifier tpxhiw6a 3b018f88-9d23-48cb-9ab7-e948a22d2f64 -- POST / 200 402.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,723 mnist_classifier_MNISTClassifier tpxhiw6a 4d0cfd80-a354-43bc-9f23-e04580dd759e -- POST / 200 394.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,723 mnist_classifier_MNISTClassifier tpxhiw6a db670ad0-bf88-43f8-a401-7fcd2b68eeab -- POST / 200 402.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,724 mnist_classifier_MNISTClassifier tpxhiw6a 75e9efa9-cb9c-4573-8106-ae3d634d11dd -- POST / 200 392.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,724 mnist_classifier_MNISTClassifier tpxhiw6a a0da5ac6-f26d-41a7-8545-f55cfac8e332 -- POST / 200 392.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,725 mnist_classifier_MNISTClassifier tpxhiw6a 110b3fda-4055-433c-a66a-38854a788612 -- POST / 200 392.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,726 mnist_classifier_MNISTClassifier tpxhiw6a fea6a4bb-2d62-4c68-a91f-83a417675e86 -- POST / 200 393.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,789 mnist_classifier_MNISTClassifier tpxhiw6a 8e2cdc70-6c3b-419f-9fa4-9ad45f7187bc -- POST / 200 456.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,791 mnist_classifier_MNISTClassifier tpxhiw6a a42ca329-3921-464d-8e1a-11649416703f -- POST / 200 456.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,795 mnist_classifier_MNISTClassifier tpxhiw6a aa696f08-bab8-4183-bc17-34d09af81cc0 -- POST / 200 459.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,795 mnist_classifier_MNISTClassifier tpxhiw6a b6bd8bef-c80b-4574-8ef1-da186bc10fed -- POST / 200 459.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,796 mnist_classifier_MNISTClassifier tpxhiw6a 65fd3edb-0b43-4431-bbf7-e030d5a620e7 -- POST / 200 460.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,798 mnist_classifier_MNISTClassifier tpxhiw6a 402d4ed3-1ba1-4020-9103-aa0756dee78b -- POST / 200 461.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,798 mnist_classifier_MNISTClassifier tpxhiw6a e3114070-cddb-4a33-9f46-0fee263b3b88 -- POST / 200 465.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,799 mnist_classifier_MNISTClassifier tpxhiw6a d911e4a9-a40a-4c96-aaef-ee8a86a206f6 -- POST / 200 461.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,799 mnist_classifier_MNISTClassifier tpxhiw6a dcc83eaa-d754-4329-ae65-bb4eeec2434e -- POST / 200 462.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,799 mnist_classifier_MNISTClassifier tpxhiw6a 51f3cd6d-c1dd-4f7b-85f5-ff2597408c69 -- POST / 200 462.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,801 mnist_classifier_MNISTClassifier tpxhiw6a 49ce7b43-af88-4ac2-b485-febffed678bb -- POST / 200 464.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,802 mnist_classifier_MNISTClassifier tpxhiw6a eb6f5cff-8c3f-4386-a0b9-7935185f0644 -- POST / 200 456.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,803 mnist_classifier_MNISTClassifier tpxhiw6a 0de0fc8f-ee0a-4052-b716-17ab54684269 -- POST / 200 456.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,804 mnist_classifier_MNISTClassifier tpxhiw6a e81bc1fb-fdc1-44f1-9606-1b1acd68c59f -- POST / 200 304.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,818 mnist_classifier_MNISTClassifier tpxhiw6a 774a2dec-524c-490a-890f-6d54d5e9449b -- POST / 200 319.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,821 mnist_classifier_MNISTClassifier tpxhiw6a f4924b02-24e5-41a4-bd87-48778aea5764 -- POST / 200 321.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,821 mnist_classifier_MNISTClassifier tpxhiw6a 9c2201be-7578-464a-946c-b8f3600f1451 -- POST / 200 285.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,822 mnist_classifier_MNISTClassifier tpxhiw6a ec0e34b8-d849-4ccb-b8ce-baab95082787 -- POST / 200 291.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,822 mnist_classifier_MNISTClassifier tpxhiw6a b8b1e2b0-650f-4477-9d7c-960b2795fd76 -- POST / 200 289.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,823 mnist_classifier_MNISTClassifier tpxhiw6a c3e1fe00-b6bd-4c4c-bde7-d7ec0f01356c -- POST / 200 287.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,824 mnist_classifier_MNISTClassifier tpxhiw6a c21e16f2-9a58-4c53-8c2e-15f848220c65 -- POST / 200 283.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,824 mnist_classifier_MNISTClassifier tpxhiw6a 4278b518-af79-4666-bd53-eb1b2b43c506 -- POST / 200 249.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,825 mnist_classifier_MNISTClassifier tpxhiw6a cd5d45f6-ae9f-475c-b493-221f15bd6358 -- POST / 200 232.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,826 mnist_classifier_MNISTClassifier tpxhiw6a e1165500-2f21-42f4-a80b-c1ca26885c6b -- POST / 200 226.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,826 mnist_classifier_MNISTClassifier tpxhiw6a 65352e76-6be1-4db9-ae9f-515996406095 -- POST / 200 225.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,827 mnist_classifier_MNISTClassifier tpxhiw6a 953537b3-27f0-40c2-a49b-3c05db9eaadf -- POST / 200 225.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,828 mnist_classifier_MNISTClassifier tpxhiw6a f1fdad17-e6ea-435c-9ff2-bf1b69d08133 -- POST / 200 225.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,828 mnist_classifier_MNISTClassifier tpxhiw6a 5fd23460-8dbd-4eaa-8b17-4ab21002f5e8 -- POST / 200 226.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,829 mnist_classifier_MNISTClassifier tpxhiw6a d945d7ef-399d-4c7d-8fe8-f31d137b4081 -- POST / 200 226.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,832 mnist_classifier_MNISTClassifier tpxhiw6a 7ee5d504-f7d6-4822-913e-a24d7cb21027 -- POST / 200 228.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,833 mnist_classifier_MNISTClassifier tpxhiw6a e184ea7a-676c-4f1e-b4eb-d6d8dc9988fc -- POST / 200 229.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,835 mnist_classifier_MNISTClassifier tpxhiw6a a8857a35-7495-489b-9312-fdc2ffca9409 -- POST / 200 229.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,836 mnist_classifier_MNISTClassifier tpxhiw6a e2a7e6e9-2554-4343-9729-3cc1fc9e6086 -- POST / 200 230.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,837 mnist_classifier_MNISTClassifier tpxhiw6a fcc0bf9e-fd72-4054-a224-7d3bff0ede64 -- POST / 200 230.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,839 mnist_classifier_MNISTClassifier tpxhiw6a ed4ce1f7-973d-48ec-b5f4-d28ca1628df8 -- POST / 200 231.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,839 mnist_classifier_MNISTClassifier tpxhiw6a 76bcdb94-af89-446c-8912-5cc8c3efcc32 -- POST / 200 230.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,840 mnist_classifier_MNISTClassifier tpxhiw6a ec781756-a3ee-4621-97be-47df51fc1fab -- POST / 200 230.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,935 mnist_classifier_MNISTClassifier tpxhiw6a 1a4fc94b-26e7-4a35-bbbe-5053321f3864 -- POST / 200 324.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,948 mnist_classifier_MNISTClassifier tpxhiw6a f834d2e5-4921-47ad-85bb-0f28c3a3199a -- POST / 200 334.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,949 mnist_classifier_MNISTClassifier tpxhiw6a 3ba46fe7-aacc-4788-9f23-add51e898b6f -- POST / 200 330.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,950 mnist_classifier_MNISTClassifier tpxhiw6a 2773761d-e99e-4d1a-81f2-971b664cd9bf -- POST / 200 335.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,951 mnist_classifier_MNISTClassifier tpxhiw6a bc5552dc-f998-412f-971e-691920d9f315 -- POST / 200 332.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,952 mnist_classifier_MNISTClassifier tpxhiw6a de97e1fb-099f-4095-9d32-1ca5906298a0 -- POST / 200 331.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,952 mnist_classifier_MNISTClassifier tpxhiw6a e88311cf-5017-4a31-a874-92c636671b42 -- POST / 200 337.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,952 mnist_classifier_MNISTClassifier tpxhiw6a 3a9d3de7-ff0e-492c-b5b7-367cfd1d7e61 -- POST / 200 336.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,953 mnist_classifier_MNISTClassifier tpxhiw6a c739539c-5850-4ce4-b3a3-081943e3ee8f -- POST / 200 334.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,953 mnist_classifier_MNISTClassifier tpxhiw6a bc41b34d-ffc7-4f02-af5b-75aed6eb7cde -- POST / 200 331.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,953 mnist_classifier_MNISTClassifier tpxhiw6a 5e1730fc-e5ff-4951-8bf3-ac56a4e3d872 -- POST / 200 331.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,954 mnist_classifier_MNISTClassifier tpxhiw6a e582a6b6-4751-4fc5-a764-be549797506a -- POST / 200 331.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,955 mnist_classifier_MNISTClassifier tpxhiw6a 3e51faac-a0fb-48ca-9aa1-0b96b108faa4 -- POST / 200 323.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,955 mnist_classifier_MNISTClassifier tpxhiw6a 1c26afd2-dfc7-410c-a754-c6d38be4ed83 -- POST / 200 331.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,955 mnist_classifier_MNISTClassifier tpxhiw6a 2ac51b4f-6765-494a-822d-94ce9f3e338a -- POST / 200 328.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,958 mnist_classifier_MNISTClassifier tpxhiw6a 4a30c004-18e4-4af3-bf7f-7f3f99d247c3 -- POST / 200 328.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,959 mnist_classifier_MNISTClassifier tpxhiw6a 24d7ce14-7d53-41ad-8bdd-56e768892ae2 -- POST / 200 327.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,959 mnist_classifier_MNISTClassifier tpxhiw6a 9dd878ee-cff4-4c86-86e8-3f5e8ec35bd3 -- POST / 200 326.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,959 mnist_classifier_MNISTClassifier tpxhiw6a edbbe93c-cd20-4949-8ab1-e2a02d857cb2 -- POST / 200 324.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,960 mnist_classifier_MNISTClassifier tpxhiw6a b9fa59cf-8878-4ed2-ab95-a9a333d12489 -- POST / 200 325.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,961 mnist_classifier_MNISTClassifier tpxhiw6a 72f3d241-9da0-48ef-b47f-b89491d0fedc -- POST / 200 325.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,961 mnist_classifier_MNISTClassifier tpxhiw6a e6f31a51-4c78-413f-8626-4c7b43814e27 -- POST / 200 325.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,962 mnist_classifier_MNISTClassifier tpxhiw6a a6fc8182-5a3a-4073-be84-3963e22dbf05 -- POST / 200 322.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,963 mnist_classifier_MNISTClassifier tpxhiw6a c37fd360-42e3-4080-9bde-f4751e1c1455 -- POST / 200 321.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,964 mnist_classifier_MNISTClassifier tpxhiw6a bcd6113e-cd3f-4888-866a-1bfce0321476 -- POST / 200 314.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,966 mnist_classifier_MNISTClassifier tpxhiw6a 9767fa45-2a5e-4a43-93d9-edeb004f1ea3 -- POST / 200 304.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,967 mnist_classifier_MNISTClassifier tpxhiw6a 5811b38a-f133-4ba4-bec3-46e2b8d52648 -- POST / 200 226.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,968 mnist_classifier_MNISTClassifier tpxhiw6a 612ccbb4-f875-44fc-8f8d-bfef583cf497 -- POST / 200 226.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,969 mnist_classifier_MNISTClassifier tpxhiw6a 323da14b-285e-475a-9b99-5583ac54ba2d -- POST / 200 307.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,970 mnist_classifier_MNISTClassifier tpxhiw6a c86811a2-ab56-41e2-ae6e-0a77e088b20d -- POST / 200 241.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,970 mnist_classifier_MNISTClassifier tpxhiw6a d0892c37-58af-49f0-a4f7-aaa392cfb413 -- POST / 200 238.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,985 mnist_classifier_MNISTClassifier tpxhiw6a 52eaea30-686e-46dc-917e-56c146d27cca -- POST / 200 252.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,989 mnist_classifier_MNISTClassifier tpxhiw6a 1b41d988-f32c-4f4f-b600-cadae2486d90 -- POST / 200 253.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,989 mnist_classifier_MNISTClassifier tpxhiw6a b1908675-54a4-4e71-9cc1-72f87aba5121 -- POST / 200 253.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,989 mnist_classifier_MNISTClassifier tpxhiw6a be488fc0-7092-4e94-81f2-ce3c05215dee -- POST / 200 253.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,990 mnist_classifier_MNISTClassifier tpxhiw6a 89796043-70ab-4924-b8f8-d19bbb42b475 -- POST / 200 252.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,991 mnist_classifier_MNISTClassifier tpxhiw6a 4d32c252-f69c-4bab-94a6-6a27f0a98f7e -- POST / 200 253.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,991 mnist_classifier_MNISTClassifier tpxhiw6a 952694b0-663d-4aed-b0e9-ad6a81de6341 -- POST / 200 253.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,993 mnist_classifier_MNISTClassifier tpxhiw6a aef4b25c-9f3a-418e-8a71-500a07da7d01 -- POST / 200 253.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:52,994 mnist_classifier_MNISTClassifier tpxhiw6a 2f585115-ab00-43ee-8d0c-54ce16119387 -- POST / 200 253.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,094 mnist_classifier_MNISTClassifier tpxhiw6a 4ef925ad-9a71-46c0-9180-6d8cbe3a92b7 -- POST / 200 350.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,095 mnist_classifier_MNISTClassifier tpxhiw6a dfbbd4b9-dbab-434f-9d80-484cfd3d1cf6 -- POST / 200 352.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,098 mnist_classifier_MNISTClassifier tpxhiw6a de14a48b-83ef-4c32-a701-1597b257de94 -- POST / 200 354.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,099 mnist_classifier_MNISTClassifier tpxhiw6a 9b585acb-1896-4ff9-b232-7ddb6c7f55c8 -- POST / 200 354.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,100 mnist_classifier_MNISTClassifier tpxhiw6a 7c20981f-e8a4-4f09-8fe4-a1ff95e7396a -- POST / 200 353.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,112 mnist_classifier_MNISTClassifier tpxhiw6a 6a17c425-0c25-40b6-9b28-26486b722b79 -- POST / 200 364.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,113 mnist_classifier_MNISTClassifier tpxhiw6a c06e7740-72ed-4857-98a7-80c5dfacc008 -- POST / 200 365.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,113 mnist_classifier_MNISTClassifier tpxhiw6a 2565c80e-13d0-44d5-b924-74fc087d482c -- POST / 200 365.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,114 mnist_classifier_MNISTClassifier tpxhiw6a 4a6e1e06-6920-4c87-8c58-fe6690b850b7 -- POST / 200 365.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,114 mnist_classifier_MNISTClassifier tpxhiw6a 1b37a8da-6a62-4075-98e1-ababbddbf8b8 -- POST / 200 364.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,116 mnist_classifier_MNISTClassifier tpxhiw6a 4428290e-2de5-41bf-813d-34b8a5d8e170 -- POST / 200 365.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,116 mnist_classifier_MNISTClassifier tpxhiw6a 83b7e0d3-62ae-4c1a-bffc-5bdbc60fc582 -- POST / 200 365.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,116 mnist_classifier_MNISTClassifier tpxhiw6a 593a3879-9c7d-44f2-a5ed-14e9c8d9f043 -- POST / 200 363.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,117 mnist_classifier_MNISTClassifier tpxhiw6a aa5d9db6-5463-49d1-b7ff-a6aff18fcbcd -- POST / 200 364.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,117 mnist_classifier_MNISTClassifier tpxhiw6a f4830e52-ffbf-4b80-b8c2-8294d6caad48 -- POST / 200 364.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,117 mnist_classifier_MNISTClassifier tpxhiw6a 73191811-b4b1-46b1-ab00-e64b6bc4a03b -- POST / 200 271.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,118 mnist_classifier_MNISTClassifier tpxhiw6a 9a454802-90f5-4019-ac7b-f1db0d4e840a -- POST / 200 270.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,118 mnist_classifier_MNISTClassifier tpxhiw6a b8f85bbc-6873-4ce2-822a-b11e36f5e4a9 -- POST / 200 270.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,118 mnist_classifier_MNISTClassifier tpxhiw6a 5ab508af-52a4-4a3e-a8cf-f3d8924657f3 -- POST / 200 269.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,118 mnist_classifier_MNISTClassifier tpxhiw6a 2a61d746-697b-4c4b-8e9a-e9fc63f07ca9 -- POST / 200 269.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,119 mnist_classifier_MNISTClassifier tpxhiw6a 64d34b33-4073-4bd2-9403-27ce19dd5770 -- POST / 200 269.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,119 mnist_classifier_MNISTClassifier tpxhiw6a 5eb0f441-95d9-4271-8e2d-b9a4f855f112 -- POST / 200 268.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,119 mnist_classifier_MNISTClassifier tpxhiw6a 85cbe19a-4514-4940-b7a5-6a4de2863cf4 -- POST / 200 265.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,122 mnist_classifier_MNISTClassifier tpxhiw6a b0d9a95c-542b-485b-937f-8dea2e9f50bb -- POST / 200 267.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,123 mnist_classifier_MNISTClassifier tpxhiw6a d5a1d16f-352f-4365-af78-2873d4af03e7 -- POST / 200 267.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,123 mnist_classifier_MNISTClassifier tpxhiw6a e1094be2-5040-4ed8-b66f-f2e4643c969f -- POST / 200 266.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,124 mnist_classifier_MNISTClassifier tpxhiw6a d0f0bc4b-cf29-40fe-aed4-e66909addb6a -- POST / 200 267.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,125 mnist_classifier_MNISTClassifier tpxhiw6a 08e3f28e-18b8-4abf-9c3c-4d6f3cfe9741 -- POST / 200 265.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,125 mnist_classifier_MNISTClassifier tpxhiw6a a8d34ee8-ff13-435b-b771-55ffa928e4a3 -- POST / 200 262.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,125 mnist_classifier_MNISTClassifier tpxhiw6a f0e49821-7a58-451e-9b03-e3ee9c11158b -- POST / 200 258.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,126 mnist_classifier_MNISTClassifier tpxhiw6a 0e5b0a26-ac15-4acf-9b91-1cbec3afac49 -- POST / 200 258.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,126 mnist_classifier_MNISTClassifier tpxhiw6a c72887d5-4364-44c1-9e42-fd7437c024b7 -- POST / 200 257.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,126 mnist_classifier_MNISTClassifier tpxhiw6a be3ee7ac-a048-4de4-a430-5bd67e469ae7 -- POST / 200 257.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,127 mnist_classifier_MNISTClassifier tpxhiw6a 4f9fe028-fa00-433b-afc0-f54aa6d6e541 -- POST / 200 256.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,127 mnist_classifier_MNISTClassifier tpxhiw6a 3180a0eb-fe13-423c-aa36-fb6c49ebe8dc -- POST / 200 256.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,127 mnist_classifier_MNISTClassifier tpxhiw6a ffa28425-d08a-4fc5-ab37-707e9714ee06 -- POST / 200 254.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,127 mnist_classifier_MNISTClassifier tpxhiw6a 2dadcb77-4675-471c-93e6-c80b91eddbb7 -- POST / 200 254.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,128 mnist_classifier_MNISTClassifier tpxhiw6a 703059ec-42df-4462-84d2-40055203043a -- POST / 200 254.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,128 mnist_classifier_MNISTClassifier tpxhiw6a 6e2a53f5-fde4-4e12-a5a9-26e930c18914 -- POST / 200 254.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,129 mnist_classifier_MNISTClassifier tpxhiw6a c35ad98d-6c02-447a-b0cf-5a3dc132b8d0 -- POST / 200 253.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,129 mnist_classifier_MNISTClassifier tpxhiw6a b6819347-dfc9-4683-9b0f-078177d24878 -- POST / 200 253.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,129 mnist_classifier_MNISTClassifier tpxhiw6a 3086fac0-5a0d-40de-a1cb-4e17c1544091 -- POST / 200 253.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,130 mnist_classifier_MNISTClassifier tpxhiw6a 182a63a4-6fae-4f16-97e6-fe4cd6d3a504 -- POST / 200 253.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,131 mnist_classifier_MNISTClassifier tpxhiw6a 1be7b5a9-bbb0-4929-8caf-665af85cbd13 -- POST / 200 252.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,131 mnist_classifier_MNISTClassifier tpxhiw6a c42fe6cb-c358-4a35-927b-db980189f616 -- POST / 200 252.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,131 mnist_classifier_MNISTClassifier tpxhiw6a 3197f7f2-fdc3-4f1e-8563-89a6feb3074f -- POST / 200 252.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,133 mnist_classifier_MNISTClassifier tpxhiw6a 2bfe0842-d54f-4201-89b0-6d135a64c870 -- POST / 200 253.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,133 mnist_classifier_MNISTClassifier tpxhiw6a 88fbbd3b-de42-44a0-b975-08e7ce0ccdb4 -- POST / 200 252.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,134 mnist_classifier_MNISTClassifier tpxhiw6a 8744a103-88da-4c9d-bb41-04d51fe1f66e -- POST / 200 252.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,135 mnist_classifier_MNISTClassifier tpxhiw6a 98e11df0-67e6-4f2d-b632-1d1ebf16dd6f -- POST / 200 253.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,136 mnist_classifier_MNISTClassifier tpxhiw6a 6490433f-5719-41f8-8665-4f1e721fc966 -- POST / 200 254.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,137 mnist_classifier_MNISTClassifier tpxhiw6a 6d212b6b-113b-474d-af2b-80ecc7fb12e2 -- POST / 200 254.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,145 mnist_classifier_MNISTClassifier tpxhiw6a ec71df19-fe6f-4e37-a941-046a2a338f87 -- POST / 200 262.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,148 mnist_classifier_MNISTClassifier tpxhiw6a 7e6aa006-2dae-4385-8d96-5199871679ea -- POST / 200 264.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,149 mnist_classifier_MNISTClassifier tpxhiw6a 5e278656-dd62-4b1e-a555-fbb495c43881 -- POST / 200 261.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,150 mnist_classifier_MNISTClassifier tpxhiw6a 7616e3c3-0f4a-4b71-a0d0-3059fd90efbf -- POST / 200 259.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,150 mnist_classifier_MNISTClassifier tpxhiw6a eaec57b8-ccd6-4e7e-ac40-0d46160d5479 -- POST / 200 259.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,151 mnist_classifier_MNISTClassifier tpxhiw6a 19769505-564c-4c23-b5eb-36de95bb7816 -- POST / 200 258.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,151 mnist_classifier_MNISTClassifier tpxhiw6a 4bff2871-99de-4346-b82c-f6c542e466e1 -- POST / 200 257.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,152 mnist_classifier_MNISTClassifier tpxhiw6a bb58095b-3c28-4705-a249-e0986a56eebe -- POST / 200 257.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,433 mnist_classifier_MNISTClassifier tpxhiw6a e9ddb835-9096-42e1-9569-8391e2f29678 -- POST / 200 475.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,435 mnist_classifier_MNISTClassifier tpxhiw6a 668d64c6-23d3-4ce2-ab3f-2bb94d59b2f7 -- POST / 200 440.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,436 mnist_classifier_MNISTClassifier tpxhiw6a aeead60d-ef42-4a3d-b945-709f53df1e3a -- POST / 200 439.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,436 mnist_classifier_MNISTClassifier tpxhiw6a a9a1f3e7-982a-4ab1-a5fb-80c243d32376 -- POST / 200 428.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,436 mnist_classifier_MNISTClassifier tpxhiw6a 8b86ba18-412e-4bf4-985f-5edb8919d459 -- POST / 200 428.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,436 mnist_classifier_MNISTClassifier tpxhiw6a d0a0411d-c073-43d9-8bf9-ebb10c79d0ba -- POST / 200 427.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,437 mnist_classifier_MNISTClassifier tpxhiw6a 795e913a-7a78-434d-8773-2fd8963cf9f5 -- POST / 200 427.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,439 mnist_classifier_MNISTClassifier tpxhiw6a bbe1d079-52c6-4175-825a-dcc3dfec5cf0 -- POST / 200 427.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,439 mnist_classifier_MNISTClassifier tpxhiw6a a3f1e71b-9609-493c-a09c-3ac0a383ed03 -- POST / 200 428.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,440 mnist_classifier_MNISTClassifier tpxhiw6a 1cff5563-a173-4bdb-a201-14f1c2e268be -- POST / 200 428.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,440 mnist_classifier_MNISTClassifier tpxhiw6a 072c6847-a235-434d-a2ce-c2f739a32a18 -- POST / 200 428.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,441 mnist_classifier_MNISTClassifier tpxhiw6a 4bce7ea8-a795-4369-b5b9-d4e83bec41cb -- POST / 200 428.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,442 mnist_classifier_MNISTClassifier tpxhiw6a d2bbf694-6bd1-4399-9fb4-6c96085c75ab -- POST / 200 428.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,447 mnist_classifier_MNISTClassifier tpxhiw6a 63110a6c-7d46-46a8-a30a-fba6432e642c -- POST / 200 432.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,448 mnist_classifier_MNISTClassifier tpxhiw6a d47bc55b-d951-4127-addc-d50292702e9c -- POST / 200 432.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,449 mnist_classifier_MNISTClassifier tpxhiw6a eb2fff1f-a176-4a29-a545-a274ce166cfc -- POST / 200 432.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,449 mnist_classifier_MNISTClassifier tpxhiw6a f06fde91-76ed-4ef4-87d1-39ce2047f2be -- POST / 200 432.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,450 mnist_classifier_MNISTClassifier tpxhiw6a 4d433ef0-52d0-493a-af46-35fe1c5f2e6d -- POST / 200 432.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,455 mnist_classifier_MNISTClassifier tpxhiw6a 5d64b993-d31d-44dd-a3bf-f3c61d1b5503 -- POST / 200 436.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,455 mnist_classifier_MNISTClassifier tpxhiw6a 22282f0b-b867-466f-b6f2-14c9e0dff969 -- POST / 200 436.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,456 mnist_classifier_MNISTClassifier tpxhiw6a b82a0198-a7e5-441f-90ad-868ffedf3fe0 -- POST / 200 435.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,456 mnist_classifier_MNISTClassifier tpxhiw6a bf0c7a24-f49d-400b-af7f-4e8a76e92f0f -- POST / 200 435.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,457 mnist_classifier_MNISTClassifier tpxhiw6a 11662d47-2254-4993-87a4-ca23e97e58db -- POST / 200 435.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,458 mnist_classifier_MNISTClassifier tpxhiw6a cef98ecb-6b4a-4653-8887-e8d346511798 -- POST / 200 435.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,458 mnist_classifier_MNISTClassifier tpxhiw6a 003fe3f7-8973-4459-87c7-0113b99d455a -- POST / 200 436.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,458 mnist_classifier_MNISTClassifier tpxhiw6a 118190db-28ca-4b31-b8c3-6744aa7ecbb0 -- POST / 200 434.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,459 mnist_classifier_MNISTClassifier tpxhiw6a 913210dd-d27c-4b81-b4ec-1a42b8f816f9 -- POST / 200 434.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,459 mnist_classifier_MNISTClassifier tpxhiw6a 141955eb-85e4-4014-87cc-08918b8aeb17 -- POST / 200 433.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,460 mnist_classifier_MNISTClassifier tpxhiw6a 5db85033-f9e9-4b5a-b0c7-18ec3b7ebb2b -- POST / 200 434.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,461 mnist_classifier_MNISTClassifier tpxhiw6a 2be33161-e65e-4931-a73c-22f815f93f03 -- POST / 200 435.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,462 mnist_classifier_MNISTClassifier tpxhiw6a 49b9dcb1-8856-43d1-9e9e-d7c541bd8868 -- POST / 200 432.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,462 mnist_classifier_MNISTClassifier tpxhiw6a 7ab8b0ba-9224-435f-b132-13e8dccd9919 -- POST / 200 431.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,463 mnist_classifier_MNISTClassifier tpxhiw6a c0e63d87-56e4-421b-a11b-fd23355d3776 -- POST / 200 431.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,464 mnist_classifier_MNISTClassifier tpxhiw6a a18b62b0-c82c-4f24-aa72-0e9215f3072f -- POST / 200 431.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,465 mnist_classifier_MNISTClassifier tpxhiw6a 4ed9581c-e059-408e-80a3-0e703886d915 -- POST / 200 428.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,466 mnist_classifier_MNISTClassifier tpxhiw6a b6410a0c-4e48-4fae-a88a-0497b726434b -- POST / 200 430.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,466 mnist_classifier_MNISTClassifier tpxhiw6a 83b790f4-7ab3-488b-9ceb-e3da8d7c8c63 -- POST / 200 429.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,466 mnist_classifier_MNISTClassifier tpxhiw6a f27c3308-edc9-40fa-915d-2b3b335b9cc7 -- POST / 200 428.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,467 mnist_classifier_MNISTClassifier tpxhiw6a 2ac9a574-f1f8-4517-a351-958e1d34ae6a -- POST / 200 428.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,471 mnist_classifier_MNISTClassifier tpxhiw6a 87eca367-f378-4574-bd7f-ea5eedb5b2a3 -- POST / 200 432.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,475 mnist_classifier_MNISTClassifier tpxhiw6a f5afa416-e810-4ebf-ad43-1129ec38fcfd -- POST / 200 392.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,480 mnist_classifier_MNISTClassifier tpxhiw6a d4f1c2dc-62b0-41ac-98bc-73fd1ccd0d59 -- POST / 200 396.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,483 mnist_classifier_MNISTClassifier tpxhiw6a 4c8f75bb-1b87-4956-8609-3777a5869e04 -- POST / 200 398.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,484 mnist_classifier_MNISTClassifier tpxhiw6a e3b020f5-e4a3-4fb1-924d-6cab20b8e341 -- POST / 200 339.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,485 mnist_classifier_MNISTClassifier tpxhiw6a 1c41fbdd-aada-4ef9-9219-e0b00841b859 -- POST / 200 340.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,485 mnist_classifier_MNISTClassifier tpxhiw6a 631da89a-b08f-45df-81e5-338c19552ae2 -- POST / 200 332.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,486 mnist_classifier_MNISTClassifier tpxhiw6a 104e9e29-f718-4af4-bf8a-fc81b31a8384 -- POST / 200 333.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,543 mnist_classifier_MNISTClassifier tpxhiw6a 42d58942-af45-447f-ad66-333da58d7149 -- POST / 200 383.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,547 mnist_classifier_MNISTClassifier tpxhiw6a 32dcb60e-5513-422b-8ae4-51f43f9db4d8 -- POST / 200 388.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,548 mnist_classifier_MNISTClassifier tpxhiw6a be5a8b7c-cd67-4bea-b3e3-451b27537ee0 -- POST / 200 386.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,548 mnist_classifier_MNISTClassifier tpxhiw6a 018adef7-36c4-4eaa-8ff1-cef71065a44c -- POST / 200 385.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,548 mnist_classifier_MNISTClassifier tpxhiw6a 394171b3-1326-45ce-963c-42e14b453698 -- POST / 200 385.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,549 mnist_classifier_MNISTClassifier tpxhiw6a 6357f7fa-6830-4915-b442-1636c2e70044 -- POST / 200 385.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,551 mnist_classifier_MNISTClassifier tpxhiw6a 045240d1-730c-4cad-abcb-340c5ad8f538 -- POST / 200 387.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,553 mnist_classifier_MNISTClassifier tpxhiw6a a2920671-5570-4cba-b747-0f2ee3590fa3 -- POST / 200 387.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,553 mnist_classifier_MNISTClassifier tpxhiw6a 990317b4-9c93-4cfd-bf4c-fe9ae5b0714d -- POST / 200 387.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,554 mnist_classifier_MNISTClassifier tpxhiw6a 020e2031-cbdc-46af-a46d-b1e4ec6b15d2 -- POST / 200 387.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,556 mnist_classifier_MNISTClassifier tpxhiw6a e3e8ac8b-e335-4cbb-9607-d4b366113427 -- POST / 200 389.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,559 mnist_classifier_MNISTClassifier tpxhiw6a 585a7b8b-2293-45c6-8dbb-f8ecd763d243 -- POST / 200 391.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,559 mnist_classifier_MNISTClassifier tpxhiw6a ff02b19f-d2e0-4e80-93e3-2c49cd3c74d2 -- POST / 200 392.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,561 mnist_classifier_MNISTClassifier tpxhiw6a d6f17783-546c-41f5-bf5c-2f054444aaed -- POST / 200 392.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,564 mnist_classifier_MNISTClassifier tpxhiw6a 1f67eadb-a8c4-4b54-a934-1d34a93a8593 -- POST / 200 392.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,564 mnist_classifier_MNISTClassifier tpxhiw6a 9fad1082-e6c5-4bcc-9cd9-624275f5f3fd -- POST / 200 392.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,571 mnist_classifier_MNISTClassifier tpxhiw6a 1dbcce90-32d9-4757-8431-f7b97a8c3e94 -- POST / 200 397.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,572 mnist_classifier_MNISTClassifier tpxhiw6a c43f6ff6-bfe3-449d-998d-8fb8556b96e6 -- POST / 200 398.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,574 mnist_classifier_MNISTClassifier tpxhiw6a ca5b2660-f46e-479c-a9ae-dd02c7f97832 -- POST / 200 398.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,575 mnist_classifier_MNISTClassifier tpxhiw6a 6a38852c-087d-453b-be4f-c843f070362c -- POST / 200 398.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,579 mnist_classifier_MNISTClassifier tpxhiw6a 2e319a19-cdfa-47b4-bf70-2e1cc15bc5ae -- POST / 200 398.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,579 mnist_classifier_MNISTClassifier tpxhiw6a 390196b6-8d77-4a20-af99-734aad66d503 -- POST / 200 397.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,580 mnist_classifier_MNISTClassifier tpxhiw6a 9b848366-cd8c-4611-8abf-153f1d378b6c -- POST / 200 397.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,581 mnist_classifier_MNISTClassifier tpxhiw6a 4fb4d23e-1d49-4533-820e-2be167774022 -- POST / 200 398.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,582 mnist_classifier_MNISTClassifier tpxhiw6a 828b45b8-1581-47a6-a325-df47f006dc79 -- POST / 200 396.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,585 mnist_classifier_MNISTClassifier tpxhiw6a c6899453-2443-4728-891e-a3082bd722f6 -- POST / 200 398.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,587 mnist_classifier_MNISTClassifier tpxhiw6a 31d7fc09-22ce-4d11-b253-22ca9586ad54 -- POST / 200 400.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,587 mnist_classifier_MNISTClassifier tpxhiw6a f8fed341-0603-4218-aa4b-58ca9ab90dfa -- POST / 200 400.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,588 mnist_classifier_MNISTClassifier tpxhiw6a fa4acbe4-fb41-430b-908d-29c8565fec68 -- POST / 200 399.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,588 mnist_classifier_MNISTClassifier tpxhiw6a 12226fb5-b6ea-45ba-a17c-0beedc75b1da -- POST / 200 399.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,589 mnist_classifier_MNISTClassifier tpxhiw6a 4569f542-e869-42fe-9d0b-ea3b371656df -- POST / 200 399.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,590 mnist_classifier_MNISTClassifier tpxhiw6a 539e9927-06d5-4666-b85a-12919e632db7 -- POST / 200 398.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,591 mnist_classifier_MNISTClassifier tpxhiw6a 8c428eb2-769d-4be1-a91b-415d67f35856 -- POST / 200 398.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,592 mnist_classifier_MNISTClassifier tpxhiw6a f5adc868-895d-4218-9708-6a78f801b156 -- POST / 200 398.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,594 mnist_classifier_MNISTClassifier tpxhiw6a aaf1478a-4aa5-4735-a094-b8fab49ddc64 -- POST / 200 400.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,594 mnist_classifier_MNISTClassifier tpxhiw6a 62e81ff0-90e9-4873-a0f9-853172d764d0 -- POST / 200 399.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,595 mnist_classifier_MNISTClassifier tpxhiw6a 2c88e110-ce6c-40e3-9c28-510cbed607d4 -- POST / 200 395.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,595 mnist_classifier_MNISTClassifier tpxhiw6a 0a5368bd-9e94-48f0-a735-aeb6ad9d79a0 -- POST / 200 394.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,596 mnist_classifier_MNISTClassifier tpxhiw6a 24a69f96-0517-41eb-af79-6a781250b33f -- POST / 200 393.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,598 mnist_classifier_MNISTClassifier tpxhiw6a c712f472-fba1-49f5-a06a-c165b773f9ed -- POST / 200 389.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,598 mnist_classifier_MNISTClassifier tpxhiw6a 23039b02-10b1-49c1-b3e7-d130a4b85e24 -- POST / 200 224.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,603 mnist_classifier_MNISTClassifier tpxhiw6a e1874199-b6b5-42a9-936c-f5026ed66339 -- POST / 200 228.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,604 mnist_classifier_MNISTClassifier tpxhiw6a 7e5c19cf-9a3f-422e-a885-bffd91f832a9 -- POST / 200 227.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,694 mnist_classifier_MNISTClassifier tpxhiw6a a10abb22-cb7c-4928-8984-f8964dd735c4 -- POST / 200 319.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,695 mnist_classifier_MNISTClassifier tpxhiw6a 0617b625-12f2-427e-b894-2a91a8834b00 -- POST / 200 320.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,697 mnist_classifier_MNISTClassifier tpxhiw6a 100a6f68-ca29-4451-800a-6f87ced030d6 -- POST / 200 322.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,698 mnist_classifier_MNISTClassifier tpxhiw6a 0e5560bf-2504-4996-be67-26f90178694f -- POST / 200 323.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,701 mnist_classifier_MNISTClassifier tpxhiw6a 1b004012-c886-497d-9c21-a92d7b2f24c6 -- POST / 200 326.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,702 mnist_classifier_MNISTClassifier tpxhiw6a 5b995044-123c-4a19-8ed4-59862e81cd71 -- POST / 200 326.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,702 mnist_classifier_MNISTClassifier tpxhiw6a 1bba08aa-dd70-458c-9aa3-473423f87339 -- POST / 200 326.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,704 mnist_classifier_MNISTClassifier tpxhiw6a 667daddc-97e5-4e64-a0a5-35494d846153 -- POST / 200 328.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,705 mnist_classifier_MNISTClassifier tpxhiw6a a8b155c3-89a4-4a8d-81df-596ad9f090fa -- POST / 200 329.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,706 mnist_classifier_MNISTClassifier tpxhiw6a bccc3bfe-3db0-4770-b53b-4871a9a0cc8e -- POST / 200 328.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,707 mnist_classifier_MNISTClassifier tpxhiw6a d28ec5e3-f3a5-48cd-9649-d78b976fa3b1 -- POST / 200 285.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,709 mnist_classifier_MNISTClassifier tpxhiw6a 840baf79-a1d4-4478-92fb-e23caeacbe46 -- POST / 200 288.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,713 mnist_classifier_MNISTClassifier tpxhiw6a e39740f3-78d9-40b5-aa68-53f3d953a025 -- POST / 200 290.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,722 mnist_classifier_MNISTClassifier tpxhiw6a 1d74f918-d545-4a52-b0c6-0151cba2d4b9 -- POST / 200 235.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,723 mnist_classifier_MNISTClassifier tpxhiw6a a5060703-8207-490c-a205-5478bf5208ad -- POST / 200 297.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,723 mnist_classifier_MNISTClassifier tpxhiw6a e2738dbc-9444-4ed6-ae06-61558ccf7a0c -- POST / 200 235.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,724 mnist_classifier_MNISTClassifier tpxhiw6a 9efcd1a6-2bd7-4b2d-a805-5b78cc6b93b7 -- POST / 200 236.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,725 mnist_classifier_MNISTClassifier tpxhiw6a a01597b5-5cc5-4737-860d-1e0c848ca5a6 -- POST / 200 298.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,726 mnist_classifier_MNISTClassifier tpxhiw6a a894afc7-031d-419a-965e-6b3d25ef8fb2 -- POST / 200 294.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,732 mnist_classifier_MNISTClassifier tpxhiw6a c08d4f58-bf9d-4bbd-a8a0-9137be7b5eaa -- POST / 200 267.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,739 mnist_classifier_MNISTClassifier tpxhiw6a 324a7e00-456e-4bab-9811-0e96fcfd0c77 -- POST / 200 259.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,741 mnist_classifier_MNISTClassifier tpxhiw6a 62e07c6a-69a7-45c8-9b80-90fab53943c7 -- POST / 200 243.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,743 mnist_classifier_MNISTClassifier tpxhiw6a c4cf8116-5684-4d38-8b36-89b859de6c22 -- POST / 200 254.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,745 mnist_classifier_MNISTClassifier tpxhiw6a 43db1f69-42b0-462b-9d72-245cf36f074d -- POST / 200 256.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,746 mnist_classifier_MNISTClassifier tpxhiw6a e1220466-c943-40d2-9804-4499b2fc6222 -- POST / 200 256.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,747 mnist_classifier_MNISTClassifier tpxhiw6a 1123372e-40be-4d5c-8379-7773b5cb0234 -- POST / 200 257.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,750 mnist_classifier_MNISTClassifier tpxhiw6a 1309a117-07f5-4752-b085-d6d7515d91b4 -- POST / 200 260.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,751 mnist_classifier_MNISTClassifier tpxhiw6a 90d82e6e-49c4-4118-8267-8c3ff1f91bdd -- POST / 200 261.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,753 mnist_classifier_MNISTClassifier tpxhiw6a 1b4da860-8622-4812-9832-76d6d517e72f -- POST / 200 259.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,754 mnist_classifier_MNISTClassifier tpxhiw6a 9246b27b-8169-4fc2-892b-76482e0b647c -- POST / 200 260.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,756 mnist_classifier_MNISTClassifier tpxhiw6a 7ee575c8-9258-4b91-8953-2b5a35c221d2 -- POST / 200 260.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,757 mnist_classifier_MNISTClassifier tpxhiw6a 7b861c4d-6dd4-4a51-bec0-dccd1c21d65a -- POST / 200 260.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,757 mnist_classifier_MNISTClassifier tpxhiw6a d8e93cec-e673-46a2-a792-c355387158de -- POST / 200 259.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,758 mnist_classifier_MNISTClassifier tpxhiw6a 4fdcb5cb-0a23-4faa-9576-e822b181ee2d -- POST / 200 255.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,759 mnist_classifier_MNISTClassifier tpxhiw6a 8bc03855-f8ea-43f4-a151-2437323b2220 -- POST / 200 257.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,824 mnist_classifier_MNISTClassifier tpxhiw6a b2de6afc-29d6-43ea-9066-14de6c0f58f2 -- POST / 200 319.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,827 mnist_classifier_MNISTClassifier tpxhiw6a 89ce954c-4103-4fa3-892b-424ce16ed511 -- POST / 200 324.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,828 mnist_classifier_MNISTClassifier tpxhiw6a 05b62de1-39b3-4a07-ba19-0573e7be43ea -- POST / 200 324.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,829 mnist_classifier_MNISTClassifier tpxhiw6a 6189d17a-1973-4851-9dd9-2a12b8794ca5 -- POST / 200 322.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,829 mnist_classifier_MNISTClassifier tpxhiw6a 4d397291-65dc-4cde-bdaa-0ccf21b4de25 -- POST / 200 317.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,830 mnist_classifier_MNISTClassifier tpxhiw6a af3e9525-e297-403d-8201-48b2fdb69a6d -- POST / 200 312.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,832 mnist_classifier_MNISTClassifier tpxhiw6a a5cf177b-6bfe-43c9-8e8f-1f3c5d6aa588 -- POST / 200 318.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,833 mnist_classifier_MNISTClassifier tpxhiw6a 9cad664b-24aa-4538-92f7-817b01075e2e -- POST / 200 315.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,835 mnist_classifier_MNISTClassifier tpxhiw6a c9cc9918-9dd2-4a8c-aa25-5274822a731f -- POST / 200 316.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,835 mnist_classifier_MNISTClassifier tpxhiw6a d2d1a2d7-12d8-47fa-b0bd-84c57696257f -- POST / 200 310.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,836 mnist_classifier_MNISTClassifier tpxhiw6a c953fa1c-1747-4bc4-be9e-105ae423d1f8 -- POST / 200 300.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,837 mnist_classifier_MNISTClassifier tpxhiw6a 0afea38d-2da3-409a-9c86-8daceb7fcfb8 -- POST / 200 301.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,838 mnist_classifier_MNISTClassifier tpxhiw6a b4fc849d-d0bc-4bfc-b2dc-e2386c26c4a5 -- POST / 200 302.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,838 mnist_classifier_MNISTClassifier tpxhiw6a 0b8a159f-5b8a-45d7-a2df-9962651df80c -- POST / 200 300.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,839 mnist_classifier_MNISTClassifier tpxhiw6a 74395541-5839-4c6e-91f4-94f4f8c72ffe -- POST / 200 277.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,843 mnist_classifier_MNISTClassifier tpxhiw6a e7514161-f968-4518-8e4a-491d17a09fac -- POST / 200 269.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,847 mnist_classifier_MNISTClassifier tpxhiw6a cdf9a87d-92f5-4304-b52c-d0897940ecf0 -- POST / 200 273.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,847 mnist_classifier_MNISTClassifier tpxhiw6a 77427311-a1fe-4b27-aee6-843e6800be8b -- POST / 200 274.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,849 mnist_classifier_MNISTClassifier tpxhiw6a 315b5b8f-bb31-4569-b371-d9cff3717ee2 -- POST / 200 275.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,851 mnist_classifier_MNISTClassifier tpxhiw6a 55624454-f0d6-4b94-8895-e6dbb86c037a -- POST / 200 276.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,852 mnist_classifier_MNISTClassifier tpxhiw6a 7aaa38e7-2fb3-4e6e-87c4-f1ece0eafb2a -- POST / 200 262.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,852 mnist_classifier_MNISTClassifier tpxhiw6a 89e82e19-ab35-40ab-89ba-e9110c2602ea -- POST / 200 258.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,853 mnist_classifier_MNISTClassifier tpxhiw6a 9002feb6-e3c1-4bf6-b1fc-0fd4fb79e294 -- POST / 200 279.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,853 mnist_classifier_MNISTClassifier tpxhiw6a b0e485f8-8df1-4378-bded-7914b5674353 -- POST / 200 248.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,856 mnist_classifier_MNISTClassifier tpxhiw6a f56c1033-1378-4c82-89fb-f8f4fe7119c3 -- POST / 200 241.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,856 mnist_classifier_MNISTClassifier tpxhiw6a a175b5c6-7998-4192-9436-5d756ad54999 -- POST / 200 237.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,857 mnist_classifier_MNISTClassifier tpxhiw6a ed2e2b0a-4033-4aad-afe2-e86321dee851 -- POST / 200 240.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,858 mnist_classifier_MNISTClassifier tpxhiw6a 76252a20-84f8-4cb3-a5a8-ae75038c3881 -- POST / 200 240.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,859 mnist_classifier_MNISTClassifier tpxhiw6a 5b5e20f1-e8d8-40ad-9663-772189fbd115 -- POST / 200 239.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,860 mnist_classifier_MNISTClassifier tpxhiw6a d63e2a07-0559-4cca-b9f9-84c9a07c7d2e -- POST / 200 239.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,863 mnist_classifier_MNISTClassifier tpxhiw6a d1b39a81-123d-47d8-ae0a-58cf24c5760f -- POST / 200 242.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,864 mnist_classifier_MNISTClassifier tpxhiw6a 90a8f0c6-b7b1-40f5-af30-61b1fdfabfa2 -- POST / 200 243.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,865 mnist_classifier_MNISTClassifier tpxhiw6a c3fdd7d9-7d79-450e-aede-2b3e47adfd0e -- POST / 200 242.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,871 mnist_classifier_MNISTClassifier tpxhiw6a d5941897-4de8-4aec-a572-4f20f17e9bde -- POST / 200 243.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,872 mnist_classifier_MNISTClassifier tpxhiw6a f62357ea-b8b3-4a61-8c4e-73807d961140 -- POST / 200 246.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,874 mnist_classifier_MNISTClassifier tpxhiw6a 67e43463-0efd-45cf-9806-dd7731102fe9 -- POST / 200 248.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,875 mnist_classifier_MNISTClassifier tpxhiw6a a190010f-7259-475e-a8ca-efdd7a6d4c5b -- POST / 200 251.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,876 mnist_classifier_MNISTClassifier tpxhiw6a 2f906286-777b-4d16-8d2f-45a27f223d2d -- POST / 200 248.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,876 mnist_classifier_MNISTClassifier tpxhiw6a ce38be0e-3618-4c0b-8a99-0512327fb2ad -- POST / 200 248.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,877 mnist_classifier_MNISTClassifier tpxhiw6a 55d53a4d-b28c-4a52-bcaf-1f3a3a992d88 -- POST / 200 240.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,877 mnist_classifier_MNISTClassifier tpxhiw6a 56cabd52-11b9-44f9-943c-ddba85ce0fd3 -- POST / 200 243.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,877 mnist_classifier_MNISTClassifier tpxhiw6a 918e27bc-c218-4ae7-9b65-2ccdbb944df3 -- POST / 200 243.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,877 mnist_classifier_MNISTClassifier tpxhiw6a 8726f48f-c3e2-4ee0-b988-e24560494e17 -- POST / 200 242.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,877 mnist_classifier_MNISTClassifier tpxhiw6a 03f1b3bc-2e68-4f6c-a902-1bb9351ce18d -- POST / 200 238.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,878 mnist_classifier_MNISTClassifier tpxhiw6a c3cfc625-8cb2-4278-8441-e7e71616277b -- POST / 200 241.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,878 mnist_classifier_MNISTClassifier tpxhiw6a f18ec6b4-27ec-4366-aaa0-8a211de326b3 -- POST / 200 241.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,878 mnist_classifier_MNISTClassifier tpxhiw6a 4b1bd4a3-10fe-41a9-9057-52fb951f62ea -- POST / 200 240.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,922 mnist_classifier_MNISTClassifier tpxhiw6a 8402bcd8-6b1a-4a1a-91e8-92a8a3192368 -- POST / 200 266.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,923 mnist_classifier_MNISTClassifier tpxhiw6a f5514c4b-335e-431c-ab68-959b3573e775 -- POST / 200 280.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,923 mnist_classifier_MNISTClassifier tpxhiw6a 27e363fc-fd7f-4253-bf78-b3b78848fe63 -- POST / 200 270.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,924 mnist_classifier_MNISTClassifier tpxhiw6a 91c6137c-4e97-4047-af83-d4e037294b63 -- POST / 200 268.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,925 mnist_classifier_MNISTClassifier tpxhiw6a 03771fac-a998-4278-9bf8-2fe16d1d688d -- POST / 200 276.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,928 mnist_classifier_MNISTClassifier tpxhiw6a 0f7aa5cc-5e8e-45f7-9273-8781ab5dbf73 -- POST / 200 264.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,930 mnist_classifier_MNISTClassifier tpxhiw6a c9560c2d-e387-43d8-9b40-eb673555cbe9 -- POST / 200 259.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,932 mnist_classifier_MNISTClassifier tpxhiw6a 9d238538-3e09-4656-8061-133da6eda079 -- POST / 200 259.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,934 mnist_classifier_MNISTClassifier tpxhiw6a b766edab-77fb-44b5-b587-bb541e81bc10 -- POST / 200 261.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,936 mnist_classifier_MNISTClassifier tpxhiw6a cb4be240-a200-4d2a-bea7-f496bb792d8e -- POST / 200 263.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,937 mnist_classifier_MNISTClassifier tpxhiw6a f4b0dac4-9121-405b-b3e6-5c791f1501f5 -- POST / 200 262.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,939 mnist_classifier_MNISTClassifier tpxhiw6a b16eb866-bc3f-498e-acb7-0fad4307e870 -- POST / 200 263.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,940 mnist_classifier_MNISTClassifier tpxhiw6a 3f6521e1-4186-497d-955a-8fb557010cbb -- POST / 200 263.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:53,940 mnist_classifier_MNISTClassifier tpxhiw6a 08fd49ae-4600-4828-b18b-38354ba6f502 -- POST / 200 263.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,003 mnist_classifier_MNISTClassifier tpxhiw6a fe4407f9-2877-4823-84de-efa9d9b9d790 -- POST / 200 281.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,005 mnist_classifier_MNISTClassifier tpxhiw6a c90ed915-eeea-4355-88b0-ca93c245e280 -- POST / 200 272.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,007 mnist_classifier_MNISTClassifier tpxhiw6a bbb24c28-96e0-4b7f-8834-c037e851e600 -- POST / 200 246.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,008 mnist_classifier_MNISTClassifier tpxhiw6a f6a69c9e-d536-45ba-8fb7-3e8869775347 -- POST / 200 245.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,009 mnist_classifier_MNISTClassifier tpxhiw6a 497d3699-f19a-4d7e-978e-403f50eb2afa -- POST / 200 244.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,012 mnist_classifier_MNISTClassifier tpxhiw6a f0a075c4-0ee6-4691-8cf3-dff8cff2c588 -- POST / 200 246.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,016 mnist_classifier_MNISTClassifier tpxhiw6a 6ba330ae-da9f-4e8d-93d7-53fead13d4d4 -- POST / 200 244.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,017 mnist_classifier_MNISTClassifier tpxhiw6a 1d9ba143-bb8d-478c-aacc-fe233189ac32 -- POST / 200 250.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,019 mnist_classifier_MNISTClassifier tpxhiw6a 250087b4-40d0-40cd-9bf9-938494f8b497 -- POST / 200 248.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,019 mnist_classifier_MNISTClassifier tpxhiw6a e3c256f9-6560-4d25-9318-355f4808325c -- POST / 200 248.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,020 mnist_classifier_MNISTClassifier tpxhiw6a f33badd2-570d-4693-852b-541030994a76 -- POST / 200 247.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,022 mnist_classifier_MNISTClassifier tpxhiw6a 256b7b22-bb97-46d8-a49e-3024555e03fa -- POST / 200 249.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,024 mnist_classifier_MNISTClassifier tpxhiw6a 7b84b460-3eda-4692-9fc1-956273df30a6 -- POST / 200 249.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,026 mnist_classifier_MNISTClassifier tpxhiw6a 8e19eb87-647e-4dad-9a4b-8c5498788696 -- POST / 200 252.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,026 mnist_classifier_MNISTClassifier tpxhiw6a ba7577dd-f73b-49fc-9c56-1ef44c1062cc -- POST / 200 251.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,027 mnist_classifier_MNISTClassifier tpxhiw6a e0866c4a-3a06-4adb-8b20-6b1a8593f5ae -- POST / 200 251.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,151 mnist_classifier_MNISTClassifier tpxhiw6a 81d3db9c-28ac-422f-83bd-69caf8838680 -- POST / 200 370.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,157 mnist_classifier_MNISTClassifier tpxhiw6a ec5741d7-ec39-4145-bbbf-ab3eafa3f8c6 -- POST / 200 378.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,158 mnist_classifier_MNISTClassifier tpxhiw6a 86067cc2-785f-43bb-a7d1-5f6e50644dfc -- POST / 200 379.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,158 mnist_classifier_MNISTClassifier tpxhiw6a 5a8e1191-eddf-4ba6-bab6-e762a164eee9 -- POST / 200 379.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,158 mnist_classifier_MNISTClassifier tpxhiw6a 73778814-bdcf-4673-b974-92029b6961cb -- POST / 200 378.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,159 mnist_classifier_MNISTClassifier tpxhiw6a 61cad2c3-8b1a-4f8d-9741-f67f2065d7fc -- POST / 200 378.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,159 mnist_classifier_MNISTClassifier tpxhiw6a 1ea8b465-bfbf-4bc1-81fc-3fe93da1844d -- POST / 200 376.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,159 mnist_classifier_MNISTClassifier tpxhiw6a 2330aa5d-0dd2-419d-9521-7159c9b2b834 -- POST / 200 379.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,160 mnist_classifier_MNISTClassifier tpxhiw6a 3c472abf-f90a-467d-889e-cfb25c83b245 -- POST / 200 377.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,160 mnist_classifier_MNISTClassifier tpxhiw6a 3f27b545-2dbe-416f-aac5-f01c76d2f1dc -- POST / 200 376.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,160 mnist_classifier_MNISTClassifier tpxhiw6a 451158b7-4e02-4c1e-aba9-541cfe6a4cbc -- POST / 200 375.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,161 mnist_classifier_MNISTClassifier tpxhiw6a 589f1d71-9020-43eb-b0a8-7f15bead9ddb -- POST / 200 376.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,161 mnist_classifier_MNISTClassifier tpxhiw6a 3e62727a-5a14-449b-9204-f76970469745 -- POST / 200 373.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,161 mnist_classifier_MNISTClassifier tpxhiw6a 26c290b4-5470-46a3-9d60-476f8aaaeaa3 -- POST / 200 373.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,161 mnist_classifier_MNISTClassifier tpxhiw6a cb18c615-a36c-4ef3-97a6-ff67be2ca50d -- POST / 200 371.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,162 mnist_classifier_MNISTClassifier tpxhiw6a 994a9f5e-aa0a-4009-9387-722a470047ce -- POST / 200 368.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,162 mnist_classifier_MNISTClassifier tpxhiw6a 14497ed7-4387-491a-8ead-7d1c9654a416 -- POST / 200 368.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,163 mnist_classifier_MNISTClassifier tpxhiw6a 383df585-3427-41d2-8d17-4de038532856 -- POST / 200 368.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,163 mnist_classifier_MNISTClassifier tpxhiw6a 10331a5e-1ff4-49a1-89ce-688a5cb2870d -- POST / 200 368.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,164 mnist_classifier_MNISTClassifier tpxhiw6a ffba9cec-6de9-40d8-8583-073d50fa3bec -- POST / 200 366.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,165 mnist_classifier_MNISTClassifier tpxhiw6a d49948b0-14cf-495b-8622-4bea822f1b21 -- POST / 200 364.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,165 mnist_classifier_MNISTClassifier tpxhiw6a f842fda5-f010-42bb-b7e2-0ea48bae39f9 -- POST / 200 364.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,167 mnist_classifier_MNISTClassifier tpxhiw6a 9045e97d-05c6-4428-966c-04ba830b0650 -- POST / 200 365.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,167 mnist_classifier_MNISTClassifier tpxhiw6a 62fcf418-c461-4c41-86b8-3d6ccc81ee03 -- POST / 200 324.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,167 mnist_classifier_MNISTClassifier tpxhiw6a b2ee3ef6-fcad-4c93-8bd4-cf829b72b344 -- POST / 200 324.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,168 mnist_classifier_MNISTClassifier tpxhiw6a ea343c3a-4411-4349-b21e-3f58f39c31b7 -- POST / 200 307.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,168 mnist_classifier_MNISTClassifier tpxhiw6a 44becab3-38ca-48e0-b4dc-89597ba0c5ee -- POST / 200 285.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,168 mnist_classifier_MNISTClassifier tpxhiw6a d0fc6bf0-b6ac-4be3-a071-9b36cfe96bb7 -- POST / 200 308.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,169 mnist_classifier_MNISTClassifier tpxhiw6a efe31713-8c63-4a6e-a1e6-05fed12ec3cd -- POST / 200 295.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,169 mnist_classifier_MNISTClassifier tpxhiw6a a9789645-d93f-4e20-a528-d9719c42d5de -- POST / 200 290.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,170 mnist_classifier_MNISTClassifier tpxhiw6a a7896a32-8b24-4602-ae19-cdf2db8088c4 -- POST / 200 290.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,171 mnist_classifier_MNISTClassifier tpxhiw6a 38d751ba-2a59-498f-b477-8bfa08c4bcf5 -- POST / 200 291.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,171 mnist_classifier_MNISTClassifier tpxhiw6a 98da864b-af07-4ca0-8d0c-6583ef975bf7 -- POST / 200 291.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,172 mnist_classifier_MNISTClassifier tpxhiw6a 705962ce-88a4-412f-b31f-1ee51baf44b4 -- POST / 200 291.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,173 mnist_classifier_MNISTClassifier tpxhiw6a d51ee5a2-c9a4-4da6-98b7-bcc2bac1918f -- POST / 200 290.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,174 mnist_classifier_MNISTClassifier tpxhiw6a 138d09e9-c381-4fee-a4a9-a1886e6a56ca -- POST / 200 282.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,175 mnist_classifier_MNISTClassifier tpxhiw6a f8f0efee-4dce-4545-8908-f773920dc939 -- POST / 200 291.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,176 mnist_classifier_MNISTClassifier tpxhiw6a e824950b-0dd0-47bd-badb-58c770eae9e6 -- POST / 200 292.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,176 mnist_classifier_MNISTClassifier tpxhiw6a eaa382fa-33d4-478c-85ff-898059a0110c -- POST / 200 292.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,177 mnist_classifier_MNISTClassifier tpxhiw6a 733359c2-9e35-4249-b82e-855806d1bb7c -- POST / 200 284.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,177 mnist_classifier_MNISTClassifier tpxhiw6a 61624c56-a0ec-4174-9351-007e00d4f79a -- POST / 200 283.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,178 mnist_classifier_MNISTClassifier tpxhiw6a f59e941f-d20f-4aab-8dd4-2bb1652533d0 -- POST / 200 283.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,178 mnist_classifier_MNISTClassifier tpxhiw6a 46539b3b-5a17-4539-a8e4-2a1766d2733e -- POST / 200 283.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,179 mnist_classifier_MNISTClassifier tpxhiw6a 019b1f82-98cf-46cc-9b4e-3af99a3cc805 -- POST / 200 274.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,179 mnist_classifier_MNISTClassifier tpxhiw6a dc7a0a62-2973-44f4-b2aa-e43c2b8e06c9 -- POST / 200 274.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,180 mnist_classifier_MNISTClassifier tpxhiw6a 68b9db50-904c-41ad-9f04-bc7afd5ec3ef -- POST / 200 274.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,180 mnist_classifier_MNISTClassifier tpxhiw6a 02bffd70-6d67-4662-a82f-932a2a86f4ea -- POST / 200 273.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,181 mnist_classifier_MNISTClassifier tpxhiw6a cbe29ad7-697d-4200-ae92-fc45c0fd19c3 -- POST / 200 243.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,184 mnist_classifier_MNISTClassifier tpxhiw6a d7cdfb65-3340-4d45-9d95-a2a2f6612b8e -- POST / 200 245.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,185 mnist_classifier_MNISTClassifier tpxhiw6a a1db572b-f6e1-4b17-a671-caa4d6a0334c -- POST / 200 247.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,191 mnist_classifier_MNISTClassifier tpxhiw6a 58736fde-8b3a-4bb2-9d47-7f6316866124 -- POST / 200 252.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,191 mnist_classifier_MNISTClassifier tpxhiw6a f5765344-135a-462f-a7f3-97ec92238e40 -- POST / 200 252.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,192 mnist_classifier_MNISTClassifier tpxhiw6a a3eb8b52-6ff2-4721-806e-61e3858d0b13 -- POST / 200 252.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,192 mnist_classifier_MNISTClassifier tpxhiw6a 6f859db0-962a-4fdd-b3d7-3ac36c3b35be -- POST / 200 239.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,192 mnist_classifier_MNISTClassifier tpxhiw6a 00edad91-28d7-44b1-b497-00755a3b33ac -- POST / 200 244.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,192 mnist_classifier_MNISTClassifier tpxhiw6a 356bbe39-4992-4cca-8e99-7e1f5f732d51 -- POST / 200 243.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,192 mnist_classifier_MNISTClassifier tpxhiw6a cc32f424-3c21-45e5-a060-8edb17b3c7b2 -- POST / 200 240.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,197 mnist_classifier_MNISTClassifier tpxhiw6a 8c50e4d4-faaf-4f5a-af93-b6aa7a6e0735 -- POST / 200 243.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,417 mnist_classifier_MNISTClassifier tpxhiw6a f87bcd2a-562a-4d34-8359-c8a980be1e0d -- POST / 200 463.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,418 mnist_classifier_MNISTClassifier tpxhiw6a 9830c405-aeb3-495c-9864-787a757e2e84 -- POST / 200 464.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,419 mnist_classifier_MNISTClassifier tpxhiw6a 8538c500-b069-47e1-aeb4-2e17cfafe0b3 -- POST / 200 460.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,419 mnist_classifier_MNISTClassifier tpxhiw6a 4f6b2360-e946-45f7-8d04-d679e3dddc08 -- POST / 200 460.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,420 mnist_classifier_MNISTClassifier tpxhiw6a a0ab9332-95b0-4a35-9abe-463faf16f1ac -- POST / 200 461.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,421 mnist_classifier_MNISTClassifier tpxhiw6a b1f4e56f-51fe-47da-bd70-df64fcdd9609 -- POST / 200 460.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,423 mnist_classifier_MNISTClassifier tpxhiw6a 75604f16-e411-4ea2-a815-73950baf3d3a -- POST / 200 462.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,428 mnist_classifier_MNISTClassifier tpxhiw6a 18bbdd08-748c-4ee5-b65f-f25186af842f -- POST / 200 466.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,433 mnist_classifier_MNISTClassifier tpxhiw6a 69507763-1619-48db-95da-64ffdb254ea6 -- POST / 200 470.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,433 mnist_classifier_MNISTClassifier tpxhiw6a a7dee3f6-e14c-4451-9e1a-dc921e1351d0 -- POST / 200 471.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,434 mnist_classifier_MNISTClassifier tpxhiw6a 6902a129-f6fb-4d73-bfad-370253c5e218 -- POST / 200 471.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,434 mnist_classifier_MNISTClassifier tpxhiw6a ae728231-e790-4a62-bb1b-1060402064cf -- POST / 200 471.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,439 mnist_classifier_MNISTClassifier tpxhiw6a bd671f4a-e6b0-4428-abc2-6bb06044791a -- POST / 200 473.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,439 mnist_classifier_MNISTClassifier tpxhiw6a e927a94b-a11b-4cb4-b9f9-59747559eb1e -- POST / 200 471.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,440 mnist_classifier_MNISTClassifier tpxhiw6a fc8deaa3-000c-4f59-b9b2-0d4c62e1006e -- POST / 200 467.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,441 mnist_classifier_MNISTClassifier tpxhiw6a 196ac375-f9a6-44ce-8592-36c2275df6b8 -- POST / 200 466.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,442 mnist_classifier_MNISTClassifier tpxhiw6a a0f1e011-5b84-4e98-9a34-6e90863f55a9 -- POST / 200 467.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,443 mnist_classifier_MNISTClassifier tpxhiw6a 857c5fdd-f8c4-4408-8e17-1ea4ab97f8b3 -- POST / 200 467.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,444 mnist_classifier_MNISTClassifier tpxhiw6a 0908e93e-799b-4e14-ad5c-0964e3d1e05c -- POST / 200 467.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,445 mnist_classifier_MNISTClassifier tpxhiw6a 252bc71c-383b-401c-b800-74861d5bd585 -- POST / 200 465.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,447 mnist_classifier_MNISTClassifier tpxhiw6a c2d9a2b2-d2cc-433c-8446-5f64886103e6 -- POST / 200 460.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,450 mnist_classifier_MNISTClassifier tpxhiw6a 12ccecff-1563-4b3e-996a-489fc62fef36 -- POST / 200 462.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,451 mnist_classifier_MNISTClassifier tpxhiw6a c307b82d-1f9e-4b3e-b4c1-b91708f2f6df -- POST / 200 462.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,452 mnist_classifier_MNISTClassifier tpxhiw6a 81335bb0-2ce6-4f9b-9bc0-40c107304f9e -- POST / 200 462.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,454 mnist_classifier_MNISTClassifier tpxhiw6a a6732553-6c27-469f-8fc3-ac08faeba909 -- POST / 200 455.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,456 mnist_classifier_MNISTClassifier tpxhiw6a d59aac7d-3b16-4b79-90a9-e597524a1531 -- POST / 200 454.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,461 mnist_classifier_MNISTClassifier tpxhiw6a 2ac4a8e7-c1ba-4b02-a054-1c5cc9dfec65 -- POST / 200 442.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,463 mnist_classifier_MNISTClassifier tpxhiw6a 489ed6d2-5c0a-4544-8f2b-009b4366feef -- POST / 200 428.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,465 mnist_classifier_MNISTClassifier tpxhiw6a 69828f45-269f-4ee4-806f-7f7f9d8cd845 -- POST / 200 426.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,468 mnist_classifier_MNISTClassifier tpxhiw6a d2441651-999e-47a2-883f-e4f079858d7f -- POST / 200 428.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,470 mnist_classifier_MNISTClassifier tpxhiw6a 2ca320e2-3347-4122-a8e3-4b090cf2a3c3 -- POST / 200 430.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,472 mnist_classifier_MNISTClassifier tpxhiw6a 5ba6b61a-a75c-41f3-839d-1d72e2c6771b -- POST / 200 431.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,472 mnist_classifier_MNISTClassifier tpxhiw6a 6d2f813b-64f0-43d3-acc4-acd4f0f00e71 -- POST / 200 427.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,473 mnist_classifier_MNISTClassifier tpxhiw6a ec844b65-eb6f-411f-b638-e67f4c38fe17 -- POST / 200 426.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,474 mnist_classifier_MNISTClassifier tpxhiw6a fb6b34d3-3daa-4cab-b36e-c5eed5e5969a -- POST / 200 426.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,476 mnist_classifier_MNISTClassifier tpxhiw6a d7ff89ef-860d-4b0f-8046-8ed0c4aabd7d -- POST / 200 426.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,476 mnist_classifier_MNISTClassifier tpxhiw6a 7cbc893c-d66d-46aa-bb74-0c22b7d65ee4 -- POST / 200 426.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,479 mnist_classifier_MNISTClassifier tpxhiw6a 7c814951-a53f-4c88-9ba6-2e1dca724108 -- POST / 200 429.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,482 mnist_classifier_MNISTClassifier tpxhiw6a fbc28560-d34a-48b2-9edc-25584355b066 -- POST / 200 431.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,483 mnist_classifier_MNISTClassifier tpxhiw6a 0d67bfbe-2624-4db8-a9e9-738a0db8b7a3 -- POST / 200 430.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,483 mnist_classifier_MNISTClassifier tpxhiw6a 7f519e11-1b20-403b-8b12-506fee5de54a -- POST / 200 426.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,484 mnist_classifier_MNISTClassifier tpxhiw6a 33be5c60-800d-4c7d-a7f4-d59c604bdd00 -- POST / 200 423.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,607 mnist_classifier_MNISTClassifier tpxhiw6a 2f67473d-12b4-47ad-a636-b72d393dd89c -- POST / 200 433.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,614 mnist_classifier_MNISTClassifier tpxhiw6a 4bd93d89-d131-4d05-9a9d-54236b3c036b -- POST / 200 433.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,622 mnist_classifier_MNISTClassifier tpxhiw6a 14b8378f-b356-4ded-a8a0-92c282cc244f -- POST / 200 482.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,623 mnist_classifier_MNISTClassifier tpxhiw6a ea9be1b6-b74d-48ea-9a15-4d88c368165e -- POST / 200 479.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,626 mnist_classifier_MNISTClassifier tpxhiw6a 8b78adcf-5f2d-4822-b26d-2dd6cd7137ec -- POST / 200 444.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,626 mnist_classifier_MNISTClassifier tpxhiw6a 3f84060d-be1a-49a2-bb86-4b6172d17b0e -- POST / 200 444.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,627 mnist_classifier_MNISTClassifier tpxhiw6a 5138994a-02eb-4082-a8e9-1c60f31600b4 -- POST / 200 445.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,627 mnist_classifier_MNISTClassifier tpxhiw6a 094fa1ac-ede5-477a-9aea-3ca8ca8471ba -- POST / 200 442.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,628 mnist_classifier_MNISTClassifier tpxhiw6a 45311b45-7968-4af5-b9d0-16d5a1240f54 -- POST / 200 426.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,628 mnist_classifier_MNISTClassifier tpxhiw6a 1c6eabc1-e1cb-4be2-bd9e-9cb7c706d3b8 -- POST / 200 423.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,629 mnist_classifier_MNISTClassifier tpxhiw6a f86f825f-3fdc-4f45-b0bf-cc6b17a809c2 -- POST / 200 421.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,630 mnist_classifier_MNISTClassifier tpxhiw6a 9d5bae43-8ab5-41f4-b000-4f8eb13562cd -- POST / 200 422.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,631 mnist_classifier_MNISTClassifier tpxhiw6a d6f25c2a-7c66-4949-8035-257bc681fde8 -- POST / 200 422.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,632 mnist_classifier_MNISTClassifier tpxhiw6a 286b571d-ec7a-4d2b-9d54-c749b3466edc -- POST / 200 423.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,633 mnist_classifier_MNISTClassifier tpxhiw6a 08231717-e623-4415-8388-03cbd1c41b75 -- POST / 200 422.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,634 mnist_classifier_MNISTClassifier tpxhiw6a e4659ff1-ca5c-462c-8fd5-4985be65afa0 -- POST / 200 423.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,643 mnist_classifier_MNISTClassifier tpxhiw6a effa8da9-8def-435a-b136-377c438b3058 -- POST / 200 431.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,643 mnist_classifier_MNISTClassifier tpxhiw6a 18687b45-7ba9-4da9-b937-cba26cd58f56 -- POST / 200 432.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,644 mnist_classifier_MNISTClassifier tpxhiw6a b493db70-20a0-482c-a99b-d0984848acad -- POST / 200 282.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,644 mnist_classifier_MNISTClassifier tpxhiw6a 4995830e-87cc-4591-876a-d6f00f74daf7 -- POST / 200 432.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,645 mnist_classifier_MNISTClassifier tpxhiw6a 7edd1ca5-fa29-42bf-a8ed-7ed3b7cc5a76 -- POST / 200 289.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,646 mnist_classifier_MNISTClassifier tpxhiw6a a7b30b74-972a-4804-990b-545f8608b8a8 -- POST / 200 290.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,647 mnist_classifier_MNISTClassifier tpxhiw6a 99173d46-5a5d-40f2-b3f5-24bdc5d72d65 -- POST / 200 281.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,647 mnist_classifier_MNISTClassifier tpxhiw6a e517c59b-7d35-4b0c-ad38-0bf9c063547f -- POST / 200 284.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,647 mnist_classifier_MNISTClassifier tpxhiw6a c4bd4770-39e5-4eca-b2dd-54d8ad87f49a -- POST / 200 284.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,648 mnist_classifier_MNISTClassifier tpxhiw6a 740da92a-27bb-4350-9618-5a26eba70547 -- POST / 200 282.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,648 mnist_classifier_MNISTClassifier tpxhiw6a fa07f583-51c8-4954-81a0-e9c86b2976b7 -- POST / 200 284.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,648 mnist_classifier_MNISTClassifier tpxhiw6a a72d41e8-639c-4735-80d8-e7eee84ef13e -- POST / 200 283.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,649 mnist_classifier_MNISTClassifier tpxhiw6a d73aa38a-c718-4c25-9775-37757bca8ca0 -- POST / 200 283.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,649 mnist_classifier_MNISTClassifier tpxhiw6a 0653495f-ea2b-4666-a8d4-1fbfb4ab3b02 -- POST / 200 283.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,650 mnist_classifier_MNISTClassifier tpxhiw6a ce86e5b1-e6d5-4527-9d1b-988553a1bf0d -- POST / 200 284.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,650 mnist_classifier_MNISTClassifier tpxhiw6a d4355c80-642d-48cd-927d-9a8b0a488c1b -- POST / 200 284.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,650 mnist_classifier_MNISTClassifier tpxhiw6a 003d7561-4b8d-4356-a272-b194ce096898 -- POST / 200 284.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,651 mnist_classifier_MNISTClassifier tpxhiw6a 2c3bd09d-8707-40fe-80d0-4ed8160843e1 -- POST / 200 284.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,651 mnist_classifier_MNISTClassifier tpxhiw6a 74709c1e-a217-43bb-8e3e-52841a41a449 -- POST / 200 284.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,652 mnist_classifier_MNISTClassifier tpxhiw6a c68c9c9d-59f5-485a-9a46-44ba62d13586 -- POST / 200 285.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,652 mnist_classifier_MNISTClassifier tpxhiw6a 1d371195-75c8-4849-8fcf-fc8e29de34f1 -- POST / 200 284.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,653 mnist_classifier_MNISTClassifier tpxhiw6a 87175cb3-6bf2-4c8e-848d-494e3837ebe6 -- POST / 200 286.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,654 mnist_classifier_MNISTClassifier tpxhiw6a e9b5a7b4-9b8c-4c6d-acf7-99c1e14e4995 -- POST / 200 286.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,654 mnist_classifier_MNISTClassifier tpxhiw6a 46891c28-8954-4656-9322-272ed1a798c6 -- POST / 200 286.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,655 mnist_classifier_MNISTClassifier tpxhiw6a a3a03bc1-7c89-436d-8af4-750a307b2a99 -- POST / 200 284.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,656 mnist_classifier_MNISTClassifier tpxhiw6a 50a45324-e704-40c3-8046-47b69929d4d8 -- POST / 200 287.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,656 mnist_classifier_MNISTClassifier tpxhiw6a e7107b4f-6df8-4820-a5dc-00c595977a9c -- POST / 200 286.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,657 mnist_classifier_MNISTClassifier tpxhiw6a 005de69d-ea12-4a78-bc45-6d170991f494 -- POST / 200 285.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,657 mnist_classifier_MNISTClassifier tpxhiw6a ecfab5d0-fd96-43f3-a60f-08a133f0ac80 -- POST / 200 285.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,658 mnist_classifier_MNISTClassifier tpxhiw6a 31d410d3-3fd7-43ed-bec8-076673b2dc0f -- POST / 200 284.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,659 mnist_classifier_MNISTClassifier tpxhiw6a 1d779cc2-7ad5-4bb9-8a12-7572abed6911 -- POST / 200 285.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,659 mnist_classifier_MNISTClassifier tpxhiw6a 88120c74-1415-49a2-99fe-b862760b9fa4 -- POST / 200 285.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,660 mnist_classifier_MNISTClassifier tpxhiw6a 293f40ad-03b4-48ca-8113-02ebf2a32953 -- POST / 200 285.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,664 mnist_classifier_MNISTClassifier tpxhiw6a 158cff90-c245-424c-bd2c-edef933f9076 -- POST / 200 288.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,664 mnist_classifier_MNISTClassifier tpxhiw6a be3993c3-8fdf-449b-a9d9-56a5aa239db6 -- POST / 200 288.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,665 mnist_classifier_MNISTClassifier tpxhiw6a 1955d5bd-a22e-4db6-bbc9-d2a808e02ac0 -- POST / 200 288.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,671 mnist_classifier_MNISTClassifier tpxhiw6a 6fe86592-6c5a-4a72-98e7-46923e981f58 -- POST / 200 290.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,739 mnist_classifier_MNISTClassifier tpxhiw6a ed9d4018-bdc1-43b9-8e1c-a8dce4f5ef34 -- POST / 200 362.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,740 mnist_classifier_MNISTClassifier tpxhiw6a 1a9c14f5-ce01-4495-b106-2f7776289759 -- POST / 200 359.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,742 mnist_classifier_MNISTClassifier tpxhiw6a c6408ec5-a880-4f95-9b6a-8f3fb66613ae -- POST / 200 360.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,743 mnist_classifier_MNISTClassifier tpxhiw6a 8439696f-ae38-4ec8-94fb-80db5926e39e -- POST / 200 361.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,744 mnist_classifier_MNISTClassifier tpxhiw6a a3535a6f-5c30-43a5-b10c-2a96f7c2f880 -- POST / 200 362.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,746 mnist_classifier_MNISTClassifier tpxhiw6a 23e08bc9-d6d3-4a8a-a4b3-eae608098da2 -- POST / 200 267.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,747 mnist_classifier_MNISTClassifier tpxhiw6a edc1f090-eeb8-474d-89aa-06d1e646b9bc -- POST / 200 319.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,752 mnist_classifier_MNISTClassifier tpxhiw6a 8af2f74c-6207-4850-a170-0ec276b11cd7 -- POST / 200 324.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,754 mnist_classifier_MNISTClassifier tpxhiw6a f20ce275-aaec-4ccf-ba8c-91408746ba79 -- POST / 200 326.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,755 mnist_classifier_MNISTClassifier tpxhiw6a 273dc76f-3078-41e1-a30b-79acb0f582c1 -- POST / 200 300.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,756 mnist_classifier_MNISTClassifier tpxhiw6a 92be720e-e21b-42f4-8f35-6d0b1ea96e8c -- POST / 200 267.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,757 mnist_classifier_MNISTClassifier tpxhiw6a c21d7643-2e7d-46d7-b4d6-c6f457fc6bde -- POST / 200 267.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,757 mnist_classifier_MNISTClassifier tpxhiw6a a79b6e6e-c402-411b-b793-a9028e933d5d -- POST / 200 266.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,758 mnist_classifier_MNISTClassifier tpxhiw6a 2514c966-10dc-467a-acb0-9f6444cd583f -- POST / 200 265.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,758 mnist_classifier_MNISTClassifier tpxhiw6a d6897aff-8d9b-46df-93e6-e5dd3050f0d5 -- POST / 200 265.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,758 mnist_classifier_MNISTClassifier tpxhiw6a bbbc06a0-29c8-4452-9ef9-bac46a222a7f -- POST / 200 263.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,759 mnist_classifier_MNISTClassifier tpxhiw6a 24f9eb3c-5f67-4ca3-82a7-d307af8bc9be -- POST / 200 262.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,759 mnist_classifier_MNISTClassifier tpxhiw6a 20ba53b6-b13c-4ac4-93f9-f9c880803d1a -- POST / 200 262.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,760 mnist_classifier_MNISTClassifier tpxhiw6a 072c08c3-6cca-4023-aa84-fc434ab6dc73 -- POST / 200 263.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,761 mnist_classifier_MNISTClassifier tpxhiw6a ccea4e97-9068-4862-8240-76872104fb88 -- POST / 200 261.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,763 mnist_classifier_MNISTClassifier tpxhiw6a a69d4453-7c5e-4645-a200-1ddbd3dc8f8b -- POST / 200 263.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,764 mnist_classifier_MNISTClassifier tpxhiw6a caa350d2-12c5-4693-aac3-3895ebf1c6a6 -- POST / 200 263.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,764 mnist_classifier_MNISTClassifier tpxhiw6a f7aee7b9-7e2c-41e6-a1d1-515d23eb5ad8 -- POST / 200 262.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,764 mnist_classifier_MNISTClassifier tpxhiw6a 5683b717-0286-4fb6-8457-d31b4d102175 -- POST / 200 261.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,766 mnist_classifier_MNISTClassifier tpxhiw6a 840b6f28-80d0-47fc-bb20-7c4eafacbfff -- POST / 200 259.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,766 mnist_classifier_MNISTClassifier tpxhiw6a bc7cc373-e892-4a9e-819a-eb70f130aaf5 -- POST / 200 260.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,766 mnist_classifier_MNISTClassifier tpxhiw6a d78bcb17-f80b-4b53-ad6c-04f703e5972b -- POST / 200 257.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,768 mnist_classifier_MNISTClassifier tpxhiw6a 9e9b3f1a-dd50-48b7-8872-93634491cf73 -- POST / 200 258.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,770 mnist_classifier_MNISTClassifier tpxhiw6a 93d6f4f8-9b12-4ac0-aeed-daea69c1b1bb -- POST / 200 259.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,770 mnist_classifier_MNISTClassifier tpxhiw6a c8d729da-403f-4068-b178-79c19b8d985c -- POST / 200 259.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,771 mnist_classifier_MNISTClassifier tpxhiw6a d071a867-2674-441d-b5ab-d2b1c323f7da -- POST / 200 261.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,778 mnist_classifier_MNISTClassifier tpxhiw6a f3729b42-29d3-4909-9d39-1953815f3110 -- POST / 200 265.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,791 mnist_classifier_MNISTClassifier tpxhiw6a b17e6074-e478-4346-9b63-ccb68997e484 -- POST / 200 278.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,792 mnist_classifier_MNISTClassifier tpxhiw6a 88feadc2-e528-4efe-891c-42c7a6ffb2c1 -- POST / 200 277.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,792 mnist_classifier_MNISTClassifier tpxhiw6a 00ebec9e-4140-40f9-bebf-3d9004de74cd -- POST / 200 277.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,793 mnist_classifier_MNISTClassifier tpxhiw6a 63e084ee-8483-453d-ad60-6b835c1f9492 -- POST / 200 278.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,793 mnist_classifier_MNISTClassifier tpxhiw6a 31d4d4a7-56bc-4ae1-ab11-6c19f186bf04 -- POST / 200 277.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,793 mnist_classifier_MNISTClassifier tpxhiw6a cd7a248e-7194-43ee-9f6d-01031a98aeda -- POST / 200 276.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,799 mnist_classifier_MNISTClassifier tpxhiw6a 2ba87844-3f8e-4089-b1e2-745bd4f635fd -- POST / 200 281.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,800 mnist_classifier_MNISTClassifier tpxhiw6a be730b4f-71c7-4836-9ca5-7692e9507cc0 -- POST / 200 281.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,800 mnist_classifier_MNISTClassifier tpxhiw6a b1ae8c86-9aee-4a64-abb1-86a36e361b13 -- POST / 200 282.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,801 mnist_classifier_MNISTClassifier tpxhiw6a 0fa81602-b53d-458c-a6af-12e48170dd53 -- POST / 200 278.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,801 mnist_classifier_MNISTClassifier tpxhiw6a 66c9cc53-15e7-4c5c-a3b8-e12e0a23c905 -- POST / 200 276.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,802 mnist_classifier_MNISTClassifier tpxhiw6a 78ce6029-dbc8-4f66-a48f-2ecca73f4cb5 -- POST / 200 276.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,803 mnist_classifier_MNISTClassifier tpxhiw6a 14405997-a7ab-4ad3-adbc-d7a57801108d -- POST / 200 275.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,803 mnist_classifier_MNISTClassifier tpxhiw6a 8b9c29c6-9a2d-48fd-9ded-74d53db3d049 -- POST / 200 274.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,803 mnist_classifier_MNISTClassifier tpxhiw6a 356a79d0-6136-4815-9da7-34cd4d0f351f -- POST / 200 274.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,914 mnist_classifier_MNISTClassifier tpxhiw6a d55e4605-751a-4cb1-b158-6a5cb763a1ca -- POST / 200 315.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,916 mnist_classifier_MNISTClassifier tpxhiw6a 933dee3e-207e-4094-b9cc-8a9432ab566a -- POST / 200 315.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,919 mnist_classifier_MNISTClassifier tpxhiw6a 774e2607-1ca5-4dbd-8edd-4fa313563c72 -- POST / 200 273.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,920 mnist_classifier_MNISTClassifier tpxhiw6a 6be81d7c-7909-4e76-84b5-78cf96096a65 -- POST / 200 249.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,920 mnist_classifier_MNISTClassifier tpxhiw6a b1d9f7c6-5d7e-4a6e-bd79-db6e02e92649 -- POST / 200 242.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,921 mnist_classifier_MNISTClassifier tpxhiw6a d4bc3f2b-115d-4a0d-a8e9-73927136060f -- POST / 200 246.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,922 mnist_classifier_MNISTClassifier tpxhiw6a 11ac04a6-423a-466a-8b78-c51cfa99690f -- POST / 200 250.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,922 mnist_classifier_MNISTClassifier tpxhiw6a e6bab7c3-b2c8-4761-b6ba-98f10b398547 -- POST / 200 248.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,922 mnist_classifier_MNISTClassifier tpxhiw6a 138e0827-1a86-4d6f-ab64-96f47cbaec98 -- POST / 200 243.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,924 mnist_classifier_MNISTClassifier tpxhiw6a 99d7068e-e07e-4841-9f55-67fb832265fa -- POST / 200 248.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,927 mnist_classifier_MNISTClassifier tpxhiw6a 2b43389e-c4ba-4518-b7de-f3d9498cb5be -- POST / 200 250.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,929 mnist_classifier_MNISTClassifier tpxhiw6a d52eff0b-f2cc-4d82-86a9-d10cbb7b8886 -- POST / 200 247.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,934 mnist_classifier_MNISTClassifier tpxhiw6a bdca4158-49b3-4ba4-88e1-bb8551901bc0 -- POST / 200 251.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,934 mnist_classifier_MNISTClassifier tpxhiw6a 260704c0-481a-4ef3-b5da-5de540ecf176 -- POST / 200 251.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,935 mnist_classifier_MNISTClassifier tpxhiw6a d91118de-44ef-432d-ba32-a920be2a61bd -- POST / 200 251.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,936 mnist_classifier_MNISTClassifier tpxhiw6a a2c24bb1-0884-429a-9f9a-6216bc5747a8 -- POST / 200 250.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,939 mnist_classifier_MNISTClassifier tpxhiw6a 618695ae-97b0-43ef-a312-e85295bd951c -- POST / 200 253.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,939 mnist_classifier_MNISTClassifier tpxhiw6a 3867d3c2-5f4f-4b31-a70c-ecbaf052aa15 -- POST / 200 253.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,943 mnist_classifier_MNISTClassifier tpxhiw6a 1f213368-ca1f-4b95-ad59-1368eedf5a37 -- POST / 200 255.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,943 mnist_classifier_MNISTClassifier tpxhiw6a 420003a5-5b17-44c8-be45-e681d3a7d7b8 -- POST / 200 254.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,944 mnist_classifier_MNISTClassifier tpxhiw6a bad4c23a-19ac-4767-9c90-55374c5d83c2 -- POST / 200 252.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,944 mnist_classifier_MNISTClassifier tpxhiw6a 96fe6751-9637-465d-9a55-019efb4a0bdf -- POST / 200 252.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,948 mnist_classifier_MNISTClassifier tpxhiw6a b6037d1f-43f0-4c57-8a2c-ed031648d7e1 -- POST / 200 257.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,950 mnist_classifier_MNISTClassifier tpxhiw6a 5c0c514b-cd7b-4010-ad74-2a54b1b03890 -- POST / 200 260.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,952 mnist_classifier_MNISTClassifier tpxhiw6a 4fcfbc00-639f-46e7-a73c-b8123b2286cc -- POST / 200 260.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,953 mnist_classifier_MNISTClassifier tpxhiw6a 2c073b76-95a8-4982-83be-678882f179d3 -- POST / 200 260.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,954 mnist_classifier_MNISTClassifier tpxhiw6a 07a4320f-fbcc-412f-a967-af33818d4f5f -- POST / 200 260.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,956 mnist_classifier_MNISTClassifier tpxhiw6a 0fd89608-2c30-48c6-bbac-0abc895d913a -- POST / 200 261.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,957 mnist_classifier_MNISTClassifier tpxhiw6a 1fdaae73-be94-48cd-9525-a733376d36d4 -- POST / 200 261.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,959 mnist_classifier_MNISTClassifier tpxhiw6a 052ac294-2281-4f49-9060-11a7603cbd41 -- POST / 200 264.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,960 mnist_classifier_MNISTClassifier tpxhiw6a b9dd70d5-325b-4d6b-a5ff-f4d077fbb205 -- POST / 200 263.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,963 mnist_classifier_MNISTClassifier tpxhiw6a f273102a-6137-4e49-a2f3-d88f8ada506d -- POST / 200 247.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,963 mnist_classifier_MNISTClassifier tpxhiw6a 85fbae86-f6ed-475c-ac5d-ada18cd411d1 -- POST / 200 266.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,965 mnist_classifier_MNISTClassifier tpxhiw6a 36683941-b688-4f35-8576-963f06ca99b3 -- POST / 200 267.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,970 mnist_classifier_MNISTClassifier tpxhiw6a 4a8720e2-6f3b-4096-a24e-7a9156eaec3d -- POST / 200 254.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,971 mnist_classifier_MNISTClassifier tpxhiw6a a2fc0114-3f88-469c-a15c-2dfabe621ec8 -- POST / 200 272.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,971 mnist_classifier_MNISTClassifier tpxhiw6a 1ef5a303-6415-4343-8ca4-6a4876e63150 -- POST / 200 271.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,974 mnist_classifier_MNISTClassifier tpxhiw6a 35384328-9218-4df3-ab1f-4631057b321d -- POST / 200 274.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,974 mnist_classifier_MNISTClassifier tpxhiw6a 6a20d960-cad4-4cad-8410-6e0a81cad4d5 -- POST / 200 273.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,974 mnist_classifier_MNISTClassifier tpxhiw6a 6076b96b-7a10-4a7b-bed1-bf6df939ba78 -- POST / 200 272.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,978 mnist_classifier_MNISTClassifier tpxhiw6a c1b795aa-a6fc-4701-a160-3e556a5da6fa -- POST / 200 276.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,979 mnist_classifier_MNISTClassifier tpxhiw6a 0bf3b06c-5ba2-47e4-9570-9f649b058d3a -- POST / 200 277.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:54,982 mnist_classifier_MNISTClassifier tpxhiw6a 0769a59b-e437-4c40-95a9-10f9de054355 -- POST / 200 278.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,030 mnist_classifier_MNISTClassifier tpxhiw6a ac3f67e8-f9db-4c40-9325-7f50dd72afe3 -- POST / 200 325.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,032 mnist_classifier_MNISTClassifier tpxhiw6a 09b01d9d-1b3d-4d86-a295-0f59abf0ecb2 -- POST / 200 325.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,033 mnist_classifier_MNISTClassifier tpxhiw6a 600f65cc-4c2e-4ea7-a768-de3ddc0a271c -- POST / 200 325.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,034 mnist_classifier_MNISTClassifier tpxhiw6a a9b0e87e-ab4b-409c-8be1-80c7bc82d7d4 -- POST / 200 327.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,036 mnist_classifier_MNISTClassifier tpxhiw6a 6d32fed3-578c-4550-b00c-60c4ee86663c -- POST / 200 327.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,042 mnist_classifier_MNISTClassifier tpxhiw6a c6a8eef6-8359-44b5-88f2-043d6eecc263 -- POST / 200 331.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,044 mnist_classifier_MNISTClassifier tpxhiw6a 24461602-9481-4178-a992-798b79084256 -- POST / 200 333.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,046 mnist_classifier_MNISTClassifier tpxhiw6a 71e71af0-891e-4519-a9d2-7282d3eb7c3b -- POST / 200 330.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,047 mnist_classifier_MNISTClassifier tpxhiw6a f872bc1d-8134-4d68-8392-fb614608c476 -- POST / 200 328.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,048 mnist_classifier_MNISTClassifier tpxhiw6a 39e504b1-9110-458f-abd0-0eb1403fc36e -- POST / 200 328.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,049 mnist_classifier_MNISTClassifier tpxhiw6a 2842f965-a5fd-4ebf-aec6-46aa293c76f4 -- POST / 200 295.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,050 mnist_classifier_MNISTClassifier tpxhiw6a 6db75346-8ae0-4822-9def-abd7bf6e145c -- POST / 200 244.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,052 mnist_classifier_MNISTClassifier tpxhiw6a 6a4c638f-dc76-47ce-bd13-13523b48509b -- POST / 200 242.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,053 mnist_classifier_MNISTClassifier tpxhiw6a a9b11c57-1748-4133-b9d7-0ff01a9433c9 -- POST / 200 243.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,054 mnist_classifier_MNISTClassifier tpxhiw6a b9909a90-bea6-4b9c-8b60-077c5843887f -- POST / 200 242.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,055 mnist_classifier_MNISTClassifier tpxhiw6a c4770041-5aa7-4fd6-828e-bc15a43352bb -- POST / 200 241.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,055 mnist_classifier_MNISTClassifier tpxhiw6a f12868d7-76bc-4d92-b5e8-522844189842 -- POST / 200 241.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,056 mnist_classifier_MNISTClassifier tpxhiw6a 6f68a022-27d4-4324-8b4d-a719284daf64 -- POST / 200 239.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,056 mnist_classifier_MNISTClassifier tpxhiw6a 87c4ccb1-8691-4060-9962-2e230ff3c9ea -- POST / 200 241.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,056 mnist_classifier_MNISTClassifier tpxhiw6a 8c1caa25-a084-4236-99f0-9c450456b2e9 -- POST / 200 240.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,057 mnist_classifier_MNISTClassifier tpxhiw6a 405ca188-704a-409b-bfc0-c80698504510 -- POST / 200 240.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,058 mnist_classifier_MNISTClassifier tpxhiw6a f5ec947e-60c7-495e-9636-3326c991ca98 -- POST / 200 241.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,059 mnist_classifier_MNISTClassifier tpxhiw6a 1e139814-de4c-4b69-96bc-8b1dfccdacc7 -- POST / 200 241.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,060 mnist_classifier_MNISTClassifier tpxhiw6a f2103e08-62b8-4d26-9531-30563d570a0c -- POST / 200 240.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,060 mnist_classifier_MNISTClassifier tpxhiw6a 6c7d2f92-4964-43ae-8551-dd0ecc615cfc -- POST / 200 239.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,061 mnist_classifier_MNISTClassifier tpxhiw6a fb1cb540-c082-40ac-805b-106f6df7ac0a -- POST / 200 237.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,061 mnist_classifier_MNISTClassifier tpxhiw6a 557478df-1145-4149-a65a-71f3cd794944 -- POST / 200 238.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,061 mnist_classifier_MNISTClassifier tpxhiw6a dff76178-9062-4d07-8591-285bf51c04a9 -- POST / 200 238.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,062 mnist_classifier_MNISTClassifier tpxhiw6a aa603ff3-3561-41c6-a50a-e91a60ab954e -- POST / 200 238.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,062 mnist_classifier_MNISTClassifier tpxhiw6a dfcc2449-7795-4f3f-9fab-0f1902196260 -- POST / 200 237.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,063 mnist_classifier_MNISTClassifier tpxhiw6a 65d1e3d4-ac73-4fee-8d22-4d0ea855a78e -- POST / 200 238.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,063 mnist_classifier_MNISTClassifier tpxhiw6a 138e2c8f-dd55-48bb-942a-a29ce9f3d351 -- POST / 200 238.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,064 mnist_classifier_MNISTClassifier tpxhiw6a 57eeebc2-da52-4cac-b39d-c95af1b178be -- POST / 200 237.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,065 mnist_classifier_MNISTClassifier tpxhiw6a 7d2c0e14-2e0e-4780-bc9e-dbb3fa1ae867 -- POST / 200 233.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,066 mnist_classifier_MNISTClassifier tpxhiw6a 1d90d951-7dcb-4696-9175-d15fcae2ad1f -- POST / 200 234.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,066 mnist_classifier_MNISTClassifier tpxhiw6a 4dcb7396-6419-4dd8-bdf5-15b6c8786315 -- POST / 200 230.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,067 mnist_classifier_MNISTClassifier tpxhiw6a f797e12c-5203-48e6-b8e1-5448a6a08b85 -- POST / 200 230.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,067 mnist_classifier_MNISTClassifier tpxhiw6a 03f7ccfb-72ef-45c0-a6b9-7e25190dc93c -- POST / 200 229.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,068 mnist_classifier_MNISTClassifier tpxhiw6a 077c8979-b3b6-4498-a2f2-d5fc31c05ebd -- POST / 200 221.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,069 mnist_classifier_MNISTClassifier tpxhiw6a a49c7ce4-6a88-4ace-97ec-5ac040cdf4cf -- POST / 200 220.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,069 mnist_classifier_MNISTClassifier tpxhiw6a 90785b1f-993c-4600-9ab2-4bbc2eecc9f9 -- POST / 200 216.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,073 mnist_classifier_MNISTClassifier tpxhiw6a 846b2402-0f40-4aa6-8cab-df580e59bd77 -- POST / 200 219.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,073 mnist_classifier_MNISTClassifier tpxhiw6a ac433103-cb74-4b2a-9822-e46495e133b1 -- POST / 200 218.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,075 mnist_classifier_MNISTClassifier tpxhiw6a a652d460-1fd9-48ef-b8e9-84dbd9e201d2 -- POST / 200 224.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,075 mnist_classifier_MNISTClassifier tpxhiw6a 9939cc6a-bbf8-47a7-995c-30bb308a0552 -- POST / 200 220.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,076 mnist_classifier_MNISTClassifier tpxhiw6a 0811719e-4659-4604-bb11-9dc930ff7fda -- POST / 200 217.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,076 mnist_classifier_MNISTClassifier tpxhiw6a 2f47cacb-8527-405c-a230-1acb29b27b2a -- POST / 200 219.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,076 mnist_classifier_MNISTClassifier tpxhiw6a 120ac1a7-c6d0-47ae-a9ef-07358f16375a -- POST / 200 216.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,077 mnist_classifier_MNISTClassifier tpxhiw6a 3a71f4b8-445f-4d5c-942a-f551b0c57377 -- POST / 200 215.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,077 mnist_classifier_MNISTClassifier tpxhiw6a 4e74de9f-5c19-47cc-892d-e6d518c43748 -- POST / 200 215.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,078 mnist_classifier_MNISTClassifier tpxhiw6a 2d755485-c6e8-42ac-8663-3cd0a8aabcf3 -- POST / 200 215.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,078 mnist_classifier_MNISTClassifier tpxhiw6a 46645cf3-7f88-4b34-a348-48764a1332cf -- POST / 200 211.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,078 mnist_classifier_MNISTClassifier tpxhiw6a ed3a855f-424a-4d7e-8dec-6c93d03208ae -- POST / 200 214.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,078 mnist_classifier_MNISTClassifier tpxhiw6a dc8ec97f-6c16-43e9-a993-7f588fb649ab -- POST / 200 209.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,078 mnist_classifier_MNISTClassifier tpxhiw6a 8fc6c5ff-c8c1-45c6-b39b-4cdab59995bd -- POST / 200 203.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,078 mnist_classifier_MNISTClassifier tpxhiw6a 65b02627-be0a-47eb-9158-9dbd0f3a724d -- POST / 200 207.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5042) INFO 2026-08-25 19:54:55,079 mnist_classifier_MNISTClassifier tpxhiw6a 199aa9dc-07be-4dbf-9ac2-3616db95b812 -- POST / 200 204.4ms
Processed 1000 requests in 4.92 seconds
Throughput: 203.40 requests/second

Ray Serve automatically buffers and load balances requests across the replicas.

Fault tolerance

In production, process and machine failures are inevitable. Ray Serve is designed so that each major component in the Serve stack (the controller, replicas, and proxies) can fail and recover while your application continues to handle traffic.

Serve can also recover from larger infrastructure failures, such as entire nodes or pods failing. Serve can even recover from head node failures, or the entire head pod if deploying on KubeRay.

For more information about Ray Serve’s fault tolerance, see the Ray Serve fault-tolerance guide.

Monitor the deployment

Monitoring is critical when running large-scale deployments. The Ray dashboard displays Serve metrics like request throughput, latency, and error rates. It also shows cluster resource usage, replica status, and overall deployment health in real time. The dashboard also lets you inspect logs from individual replicas across the cluster.

For debugging, Ray offers distributed debugging tools that let you attach a debugger to running replicas across the cluster. For more information, see the Ray Serve monitoring documentation.

Conclusion

In this tutorial, you:

• Deployed a PyTorch model using Ray Serve with production best practices.

• Enabled dynamic request batching to optimize performance.

• Configured autoscaling and fractional GPU allocation to efficiently scale across a cluster.

• Tested the service with concurrent asynchronous requests.

Further reading

Ray Serve has more production features that are out of scope for this tutorial but are worth checking out:

• Specialized large language model (LLM) serving APIs that handle complexities like managing key-value (KV) caches and continuous batching.

• Model multiplexing to dynamically load and serve many different models on the same deployment. This is useful for serving per-user fine-tuned models, for example.

• Composed deployments to orchestrate multiple deployments into a single app.

For more information, see the Ray Serve documentation and Ray Serve examples.