beginner/serving_tutorial

Run in Google Colab

Colab

Download Notebook

Notebook

View on GitHub

GitHub

Serve PyTorch models at scale with Ray Serve

Author: Ricardo Decal

This tutorial shows how to deploy a PyTorch model using Ray Serve with production-ready features.

What you will learn

• How to create a production-ready PyTorch model deployment that can scale to thousands of nodes and GPUs

• How to configure an HTTP endpoint for the deployment using FastAPI

• Enable dynamic request batching for higher throughput

• Configure autoscaling and per-replica CPU/GPU resource allocation

• Load test the service with concurrent requests and monitor it with the Ray dashboard

• How Ray Serve deployments can self-heal from failures

• Ray Serve’s advanced features like model multiplexing and model composition.

Prerequisites

• PyTorch v2.9+ and torchvision

• Ray Serve (ray[serve]) v2.52.1+

• A GPU is recommended for higher throughput but is not required

Ray Serve is a scalable framework for serving machine learning models in production. It’s built on top of Ray, which is a unified framework for scaling AI and Python applications that simplifies the complexities of distributed computing. Ray is also open source and part of the PyTorch Foundation.

Setup

To install the dependencies, run:

pip install "ray[serve]" torch torchvision

Start by importing the required libraries:

import asyncio
import time
from typing import Any

from fastapi import FastAPI
from pydantic import BaseModel
import aiohttp
import numpy as np
import torch
import torch.nn as nn
from ray import serve
from torchvision.transforms import v2

Define a PyTorch model

Define a simple convolutional neural network for the MNIST digit classification dataset:

class MNISTNet(nn.Module):
    def __init__(self):
        super().__init__()
        self.conv1 = nn.Conv2d(1, 32, 3, 1)
        self.dropout1 = nn.Dropout(0.25)
        self.conv2 = nn.Conv2d(32, 64, 3, 1)
        self.fc1 = nn.Linear(9216, 128)
        self.dropout2 = nn.Dropout(0.5)
        self.fc2 = nn.Linear(128, 10)

    def forward(self, x):
        x = self.conv1(x)
        x = nn.functional.relu(x)
        x = self.conv2(x)
        x = nn.functional.relu(x)
        x = nn.functional.max_pool2d(x, 2)
        x = self.dropout1(x)
        x = torch.flatten(x, 1)
        x = self.fc1(x)
        x = nn.functional.relu(x)
        x = self.dropout2(x)
        x = self.fc2(x)
        return nn.functional.log_softmax(x, dim=1)

Define the Ray Serve deployment

To deploy this model with Ray Serve, wrap the model in a Python class and decorate it with @serve.deployment.

Processing requests in batches is more efficient than processing requests one by one, especially when using GPUs. Ray Serve provides built-in support for dynamic request batching, where individual incoming requests are opportunistically batched. Enable dynamic batching using the @serve.batch decorator as shown in the following code:

app = FastAPI()

class ImageRequest(BaseModel):  # Used for request validation and generating API documentation
    image: list[list[float]] | list[list[list[float]]]  # 2D or 3D array

@serve.deployment
@serve.ingress(app)
class MNISTClassifier:
    def __init__(self):
        self.device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
        self.model = MNISTNet().to(self.device)
        # Define the transformation pipeline for the input images.
        self.transform = v2.Compose([
            v2.ToImage(),
            v2.ToDtype(torch.float32, scale=True),
            # Mean and standard deviation of the MNIST training subset.
            v2.Normalize(mean=[0.1307], std=[0.3013]),
        ])

        self.model.eval()

    # batch_wait_timeout_s is the maximum time to wait for a full batch,
    # trading off latency for throughput.
    @serve.batch(max_batch_size=128, batch_wait_timeout_s=0.1)
    async def predict_batch(self, images: list[np.ndarray]) -> list[dict[str, Any]]:
        # Stack all images into a single tensor.
        batch_tensor = torch.cat([
            self.transform(img).unsqueeze(0)
            for img in images
        ]).to(self.device).float()

        # Single forward pass on the entire batch at once.
        with torch.no_grad():
            logits = self.model(batch_tensor)
            predictions = torch.argmax(logits, dim=1).cpu().numpy()

        # Unbatch the results and preserve their original order.
        return [
            {
                "predicted_label": int(pred),
                "logits": logit.cpu().numpy().tolist()
            }
            for pred, logit in zip(predictions, logits)
        ]

    @app.post("/")
    async def handle_request(self, request: ImageRequest):
        """Handle an incoming HTTP request using FastAPI.

        Inputs are automatically validated using the Pydantic model.
        """
        # Process the single request.
        image_array = np.array(request.image)

        # Ray Serve's @serve.batch automatically batches requests.
        result = await self.predict_batch(image_array)

        return result

This is a FastAPI app, which extends Ray Serve with features like automatic request validation with Pydantic, auto-generated OpenAPI-style API documentation, and more.

Configure autoscaling and resource allocation

In production, traffic can vary significantly. Ray Serve’s autoscaling feature automatically adjusts the number of replicas based on traffic load, ensuring you have enough capacity during peaks while saving resources during quiet periods. Ray Serve scales to very large deployments with thousands of nodes and replicas.

You can also specify resource allocation per replica, such as the number of CPUs or GPUs. Ray Serve handles the orchestration of these resources across your cluster. Ray also supports fractional GPUs, allowing multiple replicas to share a single GPU when models are small enough to fit in memory together.

The following is a sample configuration with autoscaling and resource allocation:

num_cpus_per_replica = 1
num_gpus_per_replica = 1  # Set to 0 to run the model on CPUs instead of GPUs.
mnist_app = MNISTClassifier.options(
    autoscaling_config={
        "target_ongoing_requests": 50,  # Target 50 ongoing requests per replica.
        "min_replicas": 1,              # Keep at least 1 replica alive.
        "max_replicas": 80,             # Scale up to 80 replicas to maintain target_ongoing_requests.
        "upscale_delay_s": 5,           # Wait 5s before scaling up.
        "downscale_delay_s": 30,        # Wait 30s before scaling down.
    },
    # Max invocations to handle_request per replica to process simultaneously.
    # Requests exceeding this limit are queued by the router until capacity is available.
    max_ongoing_requests=200,
    # Max queue size for requests that exceed max_ongoing_requests.
    # If the queue is full, future requests are backpressured with errors until space is available.
    # -1 means the queue can grow until cluster memory is exhausted.
    max_queued_requests=-1,
    # Set the resources per replica.
    ray_actor_options={"num_cpus": num_cpus_per_replica, "num_gpus": num_gpus_per_replica}
).bind()

The app is ready to deploy. Suppose you ran this on a cluster of 10 machines, each with 4 GPUs. With num_gpus=0.5, Ray schedules 2 replicas per GPU, giving you 80 replicas across the cluster. This configuration permits the deployment to elastically scale up to 80 replicas as needed to handle traffic spikes and scale back down to 1 replica when traffic subsides.

Test the endpoint with concurrent requests

To deploy the app, use the serve.run function:

# Start the Ray Serve application.
handle = serve.run(mnist_app, name="mnist_classifier")

2026-10-09 01:15:15,434 WARNING services.py:2213 -- WARNING: The object store is using /tmp/ray instead of /dev/shm because /dev/shm has only 2147471360 bytes available. This will harm performance! You may be able to free up space by deleting files in /dev/shm. If you are inside a Docker container, you can increase /dev/shm size by passing '--shm-size=10.24gb' to 'docker run' (or add it to the run_options list in a Ray cluster config). Make sure to set this to more than 30% of available RAM.
2026-10-09 01:15:16,608 INFO worker.py:2003 -- Started a local Ray instance. View the dashboard at 127.0.0.1:8265
/usr/local/lib/python3.10/dist-packages/ray/_private/worker.py:2051: FutureWarning: Tip: In future versions of Ray, Ray will no longer override accelerator visible devices env var if num_gpus=0 or num_gpus=None (default). To enable this behavior and turn off this error message, set RAY_ACCEL_ENV_VAR_OVERRIDE_ON_ZERO=0
  warnings.warn(
INFO 2026-10-09 01:15:19,085 serve 4224 -- Started Serve in namespace "serve".
(ProxyActor pid=5035) INFO 2026-10-09 01:15:19,014 proxy 172.17.0.2 -- Proxy starting on node 1cdfbba93fe7ded1d7d8267d99960472c1b9196d0b2835de5c205305 (HTTP port: 8000).
(ProxyActor pid=5035) INFO 2026-10-09 01:15:19,082 proxy 172.17.0.2 -- Got updated endpoints: {}.
(ServeController pid=5033) INFO 2026-10-09 01:15:19,132 controller 5033 -- Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
(ServeController pid=5033) INFO 2026-10-09 01:15:19,133 controller 5033 -- Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
(ProxyActor pid=5035) INFO 2026-10-09 01:15:19,136 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
(ProxyActor pid=5035) INFO 2026-10-09 01:15:19,143 proxy 172.17.0.2 -- Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x7fd55d73efe0>.
(ServeController pid=5033) INFO 2026-10-09 01:15:19,237 controller 5033 -- Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
(ProxyActor pid=5035) INFO 2026-10-09 01:15:23,458 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=[])}.
INFO 2026-10-09 01:15:24,209 serve 4224 -- Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

You will see output similar to:

Started Serve in namespace "serve".
Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
Proxy starting on node ... (HTTP port: 8000).
Got updated endpoints: {}.
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x73a53c52c250>.
Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=['/', '/docs', '/docs/oauth2-redirect', '/openapi.json', '/redoc'])}.
Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

The app is now listening for requests on port 8000.

To test the deployment, you can send many requests concurrently using aiohttp. The following code demonstrates how to send 1000 concurrent requests to the app:

async def send_single_request(session, url, data):
    async with session.post(url, json=data) as response:
        return await response.json()

async def send_concurrent_requests(num_requests):
    image = np.random.rand(28, 28).tolist()

    print(f"Sending {num_requests} concurrent requests...")
    async with aiohttp.ClientSession() as session:
        tasks = [
            send_single_request(session, url="http://localhost:8000/", data={"image": image})
            for _ in range(num_requests)
        ]
        responses = await asyncio.gather(*tasks)

    return responses

# Run the concurrent requests.
start_time = time.time()
responses = asyncio.run(send_concurrent_requests(1000))
elapsed = time.time() - start_time

print(f"Processed {len(responses)} requests in {elapsed:.2f} seconds")
print(f"Throughput: {len(responses)/elapsed:.2f} requests/second")

Sending 1000 concurrent requests...
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,534 mnist_classifier_MNISTClassifier 70lfsay7 0a16e60a-aba1-4f6d-be1c-65f28647e6af -- POST / 200 614.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,535 mnist_classifier_MNISTClassifier 70lfsay7 788f3ae9-6a93-4a5f-86b8-427cd76cc568 -- POST / 200 614.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,538 mnist_classifier_MNISTClassifier 70lfsay7 0f0779d2-813f-4e52-9855-2e45d4f721b6 -- POST / 200 615.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,539 mnist_classifier_MNISTClassifier 70lfsay7 754ebbb5-e7fb-4f13-bdaf-84591ffca848 -- POST / 200 615.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,539 mnist_classifier_MNISTClassifier 70lfsay7 bb67d5ea-4079-487a-a83a-9b0e2eca86a2 -- POST / 200 617.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,539 mnist_classifier_MNISTClassifier 70lfsay7 f59652c1-4a42-4ff4-863f-5f456bda34d2 -- POST / 200 615.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,540 mnist_classifier_MNISTClassifier 70lfsay7 719eef66-ecc1-4a9e-8d0d-a4ed4a720b0c -- POST / 200 615.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,540 mnist_classifier_MNISTClassifier 70lfsay7 ef756abb-166e-4fea-b729-6396c2108e87 -- POST / 200 612.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,541 mnist_classifier_MNISTClassifier 70lfsay7 d34fccb5-a111-4cc2-9e49-45efac72949c -- POST / 200 611.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,542 mnist_classifier_MNISTClassifier 70lfsay7 f6042352-e90c-4a71-a801-ee8a511a4d2f -- POST / 200 613.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,543 mnist_classifier_MNISTClassifier 70lfsay7 1021621a-e881-4cda-8460-1db0f5df05d6 -- POST / 200 612.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,544 mnist_classifier_MNISTClassifier 70lfsay7 443ab410-dafb-4838-9b96-55406da0e18b -- POST / 200 612.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,546 mnist_classifier_MNISTClassifier 70lfsay7 b99a642c-98fb-416c-8e53-ef7afe1006a5 -- POST / 200 612.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,548 mnist_classifier_MNISTClassifier 70lfsay7 38001331-24e2-4664-86b2-3c29187fc9e8 -- POST / 200 613.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,548 mnist_classifier_MNISTClassifier 70lfsay7 671acc01-b2b9-432e-94a0-4fe20d562c64 -- POST / 200 613.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,549 mnist_classifier_MNISTClassifier 70lfsay7 19aa0c15-7dbe-406a-b625-de5e52e33ea5 -- POST / 200 612.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,550 mnist_classifier_MNISTClassifier 70lfsay7 36f9fe72-0385-4aee-9fe4-3fa9aed34dcd -- POST / 200 610.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,554 mnist_classifier_MNISTClassifier 70lfsay7 4ee0e6dc-a9c6-4279-bd17-4ee6c3b30cc1 -- POST / 200 615.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,555 mnist_classifier_MNISTClassifier 70lfsay7 fe8992c9-df29-4d8c-9c7f-78645f38218f -- POST / 200 613.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,556 mnist_classifier_MNISTClassifier 70lfsay7 5dab1ef6-a643-4a7d-88c7-320a07b1b8ad -- POST / 200 613.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,556 mnist_classifier_MNISTClassifier 70lfsay7 53116e7b-6a5f-4dba-be0e-f131c29a53d9 -- POST / 200 613.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,556 mnist_classifier_MNISTClassifier 70lfsay7 075bd539-592b-4eb4-bdf8-ec9bbcd50f74 -- POST / 200 611.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,557 mnist_classifier_MNISTClassifier 70lfsay7 439b0b08-e70e-4fdd-a335-c17bc863b71a -- POST / 200 610.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,558 mnist_classifier_MNISTClassifier 70lfsay7 15d87b19-6a54-4404-92ce-1492f6c77745 -- POST / 200 609.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,559 mnist_classifier_MNISTClassifier 70lfsay7 0e90bc9f-155f-482c-8907-5a5cd9c06d9f -- POST / 200 610.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,561 mnist_classifier_MNISTClassifier 70lfsay7 a975d779-b805-4c2d-bda4-d5ca517e6850 -- POST / 200 611.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,565 mnist_classifier_MNISTClassifier 70lfsay7 c2a022ff-9ad5-43ef-b5ce-e6175cf4822f -- POST / 200 612.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,566 mnist_classifier_MNISTClassifier 70lfsay7 4250f900-b301-4d28-af30-38e91ce2c1d8 -- POST / 200 611.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,567 mnist_classifier_MNISTClassifier 70lfsay7 cfc29ad2-2f95-4a0a-b423-bdac5d51e22e -- POST / 200 611.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,567 mnist_classifier_MNISTClassifier 70lfsay7 76ee7120-1039-4b13-9cf2-ea25d9ee9a6a -- POST / 200 611.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,568 mnist_classifier_MNISTClassifier 70lfsay7 0db0f65b-4040-41c5-a355-861c7df2c956 -- POST / 200 610.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,568 mnist_classifier_MNISTClassifier 70lfsay7 23ca6ad9-0f12-4b5f-b6f4-5da074fa4bff -- POST / 200 608.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,568 mnist_classifier_MNISTClassifier 70lfsay7 0ab82837-a85b-491d-b314-72e08a5c9c67 -- POST / 200 606.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,570 mnist_classifier_MNISTClassifier 70lfsay7 69ca10f1-405d-4994-a4b3-12bbde1e098b -- POST / 200 607.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,572 mnist_classifier_MNISTClassifier 70lfsay7 07cf8416-6c52-47db-b71f-6f52cebe086a -- POST / 200 610.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,573 mnist_classifier_MNISTClassifier 70lfsay7 7da48617-6f8f-4c68-8a40-121136290310 -- POST / 200 610.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,576 mnist_classifier_MNISTClassifier 70lfsay7 7024ca2e-d527-414b-bbfb-b390efec08a6 -- POST / 200 612.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,576 mnist_classifier_MNISTClassifier 70lfsay7 105b531d-b1c9-4911-a308-ebab5b6cecac -- POST / 200 611.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,577 mnist_classifier_MNISTClassifier 70lfsay7 7cb5ba41-6994-493e-b414-70ab9acb37af -- POST / 200 611.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,578 mnist_classifier_MNISTClassifier 70lfsay7 a73ae8ae-3115-44e3-aa0b-b8546fc1ed42 -- POST / 200 611.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,640 mnist_classifier_MNISTClassifier 70lfsay7 1053213a-56e5-4c67-aa0b-074458359bd8 -- POST / 200 672.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,641 mnist_classifier_MNISTClassifier 70lfsay7 691720ff-cd27-4ce1-bd13-50da7636480c -- POST / 200 673.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,642 mnist_classifier_MNISTClassifier 70lfsay7 0030f2cd-981c-4514-8903-fad0450cd609 -- POST / 200 673.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,642 mnist_classifier_MNISTClassifier 70lfsay7 dae103f8-74e8-4edc-9617-13564da61509 -- POST / 200 668.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,643 mnist_classifier_MNISTClassifier 70lfsay7 afbf5a5c-a4ed-4573-be4e-39dda3899dec -- POST / 200 667.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,643 mnist_classifier_MNISTClassifier 70lfsay7 18d4dc48-5aea-4f4b-8eb3-62a5e335f7d6 -- POST / 200 667.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,644 mnist_classifier_MNISTClassifier 70lfsay7 8ba84a50-aa66-42c3-aa3c-dfe3378f5df5 -- POST / 200 665.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,645 mnist_classifier_MNISTClassifier 70lfsay7 88216341-de63-432c-829a-c2a2c56bb571 -- POST / 200 663.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,646 mnist_classifier_MNISTClassifier 70lfsay7 28b991fe-da5e-4b2e-b010-a1f7c62efa41 -- POST / 200 663.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,646 mnist_classifier_MNISTClassifier 70lfsay7 f2cdbf79-bb92-4607-9221-916b5f7a6bb3 -- POST / 200 663.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,648 mnist_classifier_MNISTClassifier 70lfsay7 8c2a9b7a-218d-4ebe-af31-5a5f300a4af0 -- POST / 200 662.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,688 mnist_classifier_MNISTClassifier 70lfsay7 dca606ad-1b6e-4329-8831-55a98926c015 -- POST / 200 702.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,689 mnist_classifier_MNISTClassifier 70lfsay7 b6ac43f8-1322-448a-b2ad-058606aef9a5 -- POST / 200 702.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,689 mnist_classifier_MNISTClassifier 70lfsay7 c5c9347f-d46e-4d89-acc0-e09e29a712a0 -- POST / 200 701.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,690 mnist_classifier_MNISTClassifier 70lfsay7 06609997-9027-45b3-a999-4e0af7a5921d -- POST / 200 701.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,690 mnist_classifier_MNISTClassifier 70lfsay7 04c7d8c2-8232-4a38-80c0-8fba20891370 -- POST / 200 699.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,692 mnist_classifier_MNISTClassifier 70lfsay7 ef34d4fe-4074-46f0-b808-3afc41a2e9d7 -- POST / 200 700.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,692 mnist_classifier_MNISTClassifier 70lfsay7 46ea2d44-0fe3-48bb-af2a-e85f0bc4464c -- POST / 200 697.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,693 mnist_classifier_MNISTClassifier 70lfsay7 ae52ac5b-2855-4df2-b2e4-2db2b35d42f6 -- POST / 200 700.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,695 mnist_classifier_MNISTClassifier 70lfsay7 c3fd938d-9fa2-4bf3-b5b5-402070a0f528 -- POST / 200 702.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,699 mnist_classifier_MNISTClassifier 70lfsay7 a736efa1-8fc9-4909-819c-e7a331fcd3b9 -- POST / 200 703.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,700 mnist_classifier_MNISTClassifier 70lfsay7 25e4265e-858a-4be1-abe5-1c79e157c497 -- POST / 200 701.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,702 mnist_classifier_MNISTClassifier 70lfsay7 ac87ea57-27ce-4da6-aa8e-3173b5c3bdbb -- POST / 200 703.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,704 mnist_classifier_MNISTClassifier 70lfsay7 09e4ae13-c3ac-4fff-8302-95aea1b91363 -- POST / 200 704.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,706 mnist_classifier_MNISTClassifier 70lfsay7 b7cae4fe-92fc-48bc-9628-d552169cb093 -- POST / 200 705.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,708 mnist_classifier_MNISTClassifier 70lfsay7 3fdb15cc-7d6c-4c85-8f5b-ab46b1890245 -- POST / 200 706.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,708 mnist_classifier_MNISTClassifier 70lfsay7 61de781b-d32f-4697-bddd-14d585ef5d6c -- POST / 200 706.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,709 mnist_classifier_MNISTClassifier 70lfsay7 d0325f32-c92e-421e-9bb5-7f339e34bcb5 -- POST / 200 705.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,709 mnist_classifier_MNISTClassifier 70lfsay7 c84a8591-e170-4ffe-b2e1-8e5e9730eac7 -- POST / 200 703.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,713 mnist_classifier_MNISTClassifier 70lfsay7 fb48c72f-13d5-45bb-93d7-52ec258ec13c -- POST / 200 706.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,714 mnist_classifier_MNISTClassifier 70lfsay7 b217c535-08d8-4a58-94cc-f7afa75980a3 -- POST / 200 707.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,716 mnist_classifier_MNISTClassifier 70lfsay7 497d5164-b983-492b-b5d5-1594b08e187f -- POST / 200 705.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,719 mnist_classifier_MNISTClassifier 70lfsay7 ea233c7c-ad73-4d09-87d5-6ae7d1d07a08 -- POST / 200 703.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,720 mnist_classifier_MNISTClassifier 70lfsay7 90b6f6fd-ef3e-4ae3-8d51-afee21a21a1f -- POST / 200 702.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,736 mnist_classifier_MNISTClassifier 70lfsay7 e72a5c31-0e97-4d6a-bf06-5cd9547276ca -- POST / 200 717.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,739 mnist_classifier_MNISTClassifier 70lfsay7 257c023e-8f7a-4dcd-b4ab-c6c245daa237 -- POST / 200 720.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,744 mnist_classifier_MNISTClassifier 70lfsay7 5fcd0bfb-9704-4811-93f2-0f0b2c00fafb -- POST / 200 725.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,747 mnist_classifier_MNISTClassifier 70lfsay7 f814e046-3bb7-4319-b34c-5be0d0895e54 -- POST / 200 726.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,748 mnist_classifier_MNISTClassifier 70lfsay7 6525aeec-b635-48e1-bc42-05cfedd2dcc7 -- POST / 200 726.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,749 mnist_classifier_MNISTClassifier 70lfsay7 4a0de6c7-8ac8-4138-bc37-21b070f24ab1 -- POST / 200 729.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,749 mnist_classifier_MNISTClassifier 70lfsay7 683cbe20-d6f2-41f7-834a-d6db14f71056 -- POST / 200 724.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,750 mnist_classifier_MNISTClassifier 70lfsay7 e488e613-43fe-40ff-afae-6ad4d986ee8b -- POST / 200 724.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,750 mnist_classifier_MNISTClassifier 70lfsay7 475c5093-fcef-404b-a4dc-d5f10ff874f3 -- POST / 200 724.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,751 mnist_classifier_MNISTClassifier 70lfsay7 11c5f938-f6ac-4225-8ac4-aafa74a99ff8 -- POST / 200 723.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,751 mnist_classifier_MNISTClassifier 70lfsay7 fc6b2a12-e7bf-4973-87dc-d69bd8735797 -- POST / 200 718.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,752 mnist_classifier_MNISTClassifier 70lfsay7 493e3d98-7fb4-41e4-aa9d-cf6db6df048b -- POST / 200 724.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,752 mnist_classifier_MNISTClassifier 70lfsay7 937c9d37-1969-4bd6-9508-89879e5da151 -- POST / 200 723.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,754 mnist_classifier_MNISTClassifier 70lfsay7 3d2f545f-5bb0-45c1-afb7-11cd3f814440 -- POST / 200 724.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,754 mnist_classifier_MNISTClassifier 70lfsay7 b1299ab5-94b7-4085-bcc8-b5d921b81b40 -- POST / 200 717.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,754 mnist_classifier_MNISTClassifier 70lfsay7 689ba596-30be-4930-a40d-13cba0499667 -- POST / 200 720.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,756 mnist_classifier_MNISTClassifier 70lfsay7 aa9155d0-c114-434e-a692-58ddc6f87884 -- POST / 200 719.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,757 mnist_classifier_MNISTClassifier 70lfsay7 bf6da342-03d3-44b6-b46b-40c9efeb05e8 -- POST / 200 719.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,758 mnist_classifier_MNISTClassifier 70lfsay7 d0194fa9-22e2-4036-87b2-7124540d38f5 -- POST / 200 718.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,758 mnist_classifier_MNISTClassifier 70lfsay7 d1d9b3da-5d47-4213-b5ec-649ef5547683 -- POST / 200 721.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,758 mnist_classifier_MNISTClassifier 70lfsay7 7c0b2d3c-73ce-415b-8990-5c20997da9de -- POST / 200 718.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,759 mnist_classifier_MNISTClassifier 70lfsay7 d28061bd-e945-42d4-9e6a-9a3274a72edc -- POST / 200 717.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,760 mnist_classifier_MNISTClassifier 70lfsay7 03c62ca7-f069-4e1e-824e-2b4d25c557b8 -- POST / 200 718.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,761 mnist_classifier_MNISTClassifier 70lfsay7 91e6c994-c21c-4741-9c76-23df8a85536b -- POST / 200 718.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,810 mnist_classifier_MNISTClassifier 70lfsay7 8be9a0ba-6d0f-42e1-a843-aae84dd5071f -- POST / 200 767.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,813 mnist_classifier_MNISTClassifier 70lfsay7 945fc683-99e0-4866-ac98-c4c37c572fdb -- POST / 200 770.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,816 mnist_classifier_MNISTClassifier 70lfsay7 3c50f6d2-6d0c-4508-b1bb-94d37b13def0 -- POST / 200 290.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,818 mnist_classifier_MNISTClassifier 70lfsay7 2d67c515-cd75-48f7-87de-a15359d8857f -- POST / 200 297.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,818 mnist_classifier_MNISTClassifier 70lfsay7 9ed195b1-d9cb-4399-9b71-2ba0487e1dde -- POST / 200 297.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,819 mnist_classifier_MNISTClassifier 70lfsay7 d94c0284-ece5-4145-9b4f-9795955b8651 -- POST / 200 271.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,821 mnist_classifier_MNISTClassifier 70lfsay7 82b3246a-fc3e-4dcf-8c4b-698e2db8f889 -- POST / 200 287.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,823 mnist_classifier_MNISTClassifier 70lfsay7 39eb8eda-8276-404c-9231-5652898c7925 -- POST / 200 288.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,823 mnist_classifier_MNISTClassifier 70lfsay7 d14e3fe8-3119-4dab-8ec1-4bc257622392 -- POST / 200 275.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,824 mnist_classifier_MNISTClassifier 70lfsay7 94397214-947f-4aca-86af-5d67ee7d2f6c -- POST / 200 275.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,824 mnist_classifier_MNISTClassifier 70lfsay7 58a2840f-6766-40ef-9b54-920164d1e173 -- POST / 200 259.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,826 mnist_classifier_MNISTClassifier 70lfsay7 ab434703-821b-4cf8-a579-d0c72f8973bf -- POST / 200 240.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,827 mnist_classifier_MNISTClassifier 70lfsay7 62c18f78-05a8-41ae-9dcf-897c8937f793 -- POST / 200 251.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,828 mnist_classifier_MNISTClassifier 70lfsay7 5e7bc4a3-9cf3-4084-aa78-c74ab79335c4 -- POST / 200 242.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,830 mnist_classifier_MNISTClassifier 70lfsay7 0d8ff72b-1a17-4733-9118-33d2b6838aaa -- POST / 200 248.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,833 mnist_classifier_MNISTClassifier 70lfsay7 8a5380fb-504b-4c12-abef-89f56637476f -- POST / 200 248.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,834 mnist_classifier_MNISTClassifier 70lfsay7 1ef02f2b-428e-4321-9189-cfa1b121378a -- POST / 200 246.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,836 mnist_classifier_MNISTClassifier 70lfsay7 657a8c60-2e8c-4d23-8145-7088152d13a8 -- POST / 200 248.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,837 mnist_classifier_MNISTClassifier 70lfsay7 a7f82b3b-f3fe-430d-85c7-30d81906b715 -- POST / 200 248.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,839 mnist_classifier_MNISTClassifier 70lfsay7 044f93b1-1329-4935-a19d-4f502af9bf2b -- POST / 200 249.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,846 mnist_classifier_MNISTClassifier 70lfsay7 df37f29c-53fd-480d-b5cb-f3f0d5106d31 -- POST / 200 256.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,847 mnist_classifier_MNISTClassifier 70lfsay7 80b8ee8c-d462-4401-9210-c1342a566a01 -- POST / 200 256.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,848 mnist_classifier_MNISTClassifier 70lfsay7 f2b37735-f869-4875-9466-af21f40cfc4c -- POST / 200 256.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,852 mnist_classifier_MNISTClassifier 70lfsay7 a96c1aac-aac3-4a4f-b5df-93d7eaf614e7 -- POST / 200 260.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,852 mnist_classifier_MNISTClassifier 70lfsay7 0fa0dd47-2cab-4767-951b-53fcae50d61b -- POST / 200 260.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,853 mnist_classifier_MNISTClassifier 70lfsay7 ec0e7b59-2266-47a3-84a3-6664ccebd2e8 -- POST / 200 259.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,853 mnist_classifier_MNISTClassifier 70lfsay7 a53b4d2a-3251-446f-bb33-b2e3544d0686 -- POST / 200 242.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,854 mnist_classifier_MNISTClassifier 70lfsay7 4495fe92-a7a8-4339-8361-104c3351f5a9 -- POST / 200 261.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,855 mnist_classifier_MNISTClassifier 70lfsay7 8ebec9d2-f5a2-4d37-97d4-b7bb670c0f41 -- POST / 200 258.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,855 mnist_classifier_MNISTClassifier 70lfsay7 25073c30-6228-45e4-b03c-2607cac5ca3a -- POST / 200 243.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,856 mnist_classifier_MNISTClassifier 70lfsay7 0b7416eb-58ea-4839-8f74-7d775f234f3e -- POST / 200 238.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,857 mnist_classifier_MNISTClassifier 70lfsay7 7dbc5f77-67a0-4c0f-bbc4-15956a71065b -- POST / 200 217.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,857 mnist_classifier_MNISTClassifier 70lfsay7 3aee97fb-130d-4682-b96a-b2b0d1449a20 -- POST / 200 205.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,858 mnist_classifier_MNISTClassifier 70lfsay7 93d0d7e7-fba7-4e4a-9cee-8535c7a294d6 -- POST / 200 238.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,858 mnist_classifier_MNISTClassifier 70lfsay7 ad220ed9-8cec-4dc5-b295-ae82adbebee2 -- POST / 200 235.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,858 mnist_classifier_MNISTClassifier 70lfsay7 1d5953c9-e0b4-4d20-a4ab-ce6ec07efc3d -- POST / 200 235.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,861 mnist_classifier_MNISTClassifier 70lfsay7 8d65aadc-953e-4b2a-93e0-ae882ea49741 -- POST / 200 221.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,865 mnist_classifier_MNISTClassifier 70lfsay7 81e8dd13-ea23-4b95-b7c3-c8042cf39ff1 -- POST / 200 212.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,867 mnist_classifier_MNISTClassifier 70lfsay7 e5d1756c-7787-4bdc-b9e3-881a08d98e6a -- POST / 200 214.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,965 mnist_classifier_MNISTClassifier 70lfsay7 738fd3c1-e7d7-4dfa-a6d0-7dc88b2d1164 -- POST / 200 313.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,967 mnist_classifier_MNISTClassifier 70lfsay7 da12c050-6627-4ee7-be47-38707aeb354d -- POST / 200 297.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,968 mnist_classifier_MNISTClassifier 70lfsay7 cff2855e-1ece-499d-acb8-2eb03f1d806d -- POST / 200 297.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,968 mnist_classifier_MNISTClassifier 70lfsay7 c5522580-cfbe-499f-845a-3ceb88e76704 -- POST / 200 315.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,969 mnist_classifier_MNISTClassifier 70lfsay7 0057eb62-c8e4-450b-8c68-a8f62ea62c7a -- POST / 200 315.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,971 mnist_classifier_MNISTClassifier 70lfsay7 2a198f53-ca38-4a76-9e76-76d56537768c -- POST / 200 308.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,972 mnist_classifier_MNISTClassifier 70lfsay7 a3c96052-6f00-40b3-b71a-8c73cde51705 -- POST / 200 308.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,972 mnist_classifier_MNISTClassifier 70lfsay7 01fe0e6c-4f9a-4004-ae79-9a4b0cc7e771 -- POST / 200 307.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,976 mnist_classifier_MNISTClassifier 70lfsay7 e28904fb-e50d-4d63-b3c8-251e5ef69b19 -- POST / 200 310.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,977 mnist_classifier_MNISTClassifier 70lfsay7 1de8fe80-4b48-4d7a-9087-befdcda2ecc6 -- POST / 200 309.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,977 mnist_classifier_MNISTClassifier 70lfsay7 f6ae45fd-fa6c-4cc6-86f1-c521d3072309 -- POST / 200 308.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,978 mnist_classifier_MNISTClassifier 70lfsay7 ede350a2-fdb1-4fba-a9ff-b9e7d63c57d0 -- POST / 200 309.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,980 mnist_classifier_MNISTClassifier 70lfsay7 179c96ea-d16c-4346-8474-9678ef61eb94 -- POST / 200 310.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,980 mnist_classifier_MNISTClassifier 70lfsay7 b3333a78-b304-494d-8be7-ec4b2e9e8a62 -- POST / 200 310.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,984 mnist_classifier_MNISTClassifier 70lfsay7 ca1ac3a5-dd04-4092-a6b1-c16db0d045f2 -- POST / 200 215.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,985 mnist_classifier_MNISTClassifier 70lfsay7 b49bcdc2-a6b4-4f93-96df-604c13ba4ed8 -- POST / 200 281.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,987 mnist_classifier_MNISTClassifier 70lfsay7 f9a26ba6-cbb1-4e75-8330-fc2068ba9348 -- POST / 200 274.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,988 mnist_classifier_MNISTClassifier 70lfsay7 dbad19dd-6fbf-4aed-ac9f-a61a48d55561 -- POST / 200 273.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,993 mnist_classifier_MNISTClassifier 70lfsay7 a6e393d0-79a1-4db8-b1be-08b255c2a5d4 -- POST / 200 249.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:25,997 mnist_classifier_MNISTClassifier 70lfsay7 c019461b-c689-4654-b3ef-c3d8a61e8d01 -- POST / 200 244.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,001 mnist_classifier_MNISTClassifier 70lfsay7 a606311c-1006-4a37-aacb-30fc428b6135 -- POST / 200 239.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,003 mnist_classifier_MNISTClassifier 70lfsay7 e13fab84-90b8-4da6-a0ff-1819e0c5014a -- POST / 200 240.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,004 mnist_classifier_MNISTClassifier 70lfsay7 94d14e4e-cb1e-40ad-af69-ad5e865e32c2 -- POST / 200 238.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,005 mnist_classifier_MNISTClassifier 70lfsay7 4d1cddb5-760e-45a6-a71b-9a1e7626ba99 -- POST / 200 236.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,005 mnist_classifier_MNISTClassifier 70lfsay7 e7e5ecb0-7a2c-49ae-816d-36e8ee06ec66 -- POST / 200 235.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,006 mnist_classifier_MNISTClassifier 70lfsay7 083ac607-b3ca-46e8-b664-8202d66a2186 -- POST / 200 235.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,007 mnist_classifier_MNISTClassifier 70lfsay7 de37a556-ae78-4cf1-9c76-1824e2f26a0d -- POST / 200 236.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,008 mnist_classifier_MNISTClassifier 70lfsay7 274fd551-9652-4841-90db-8ff996aab71d -- POST / 200 231.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,011 mnist_classifier_MNISTClassifier 70lfsay7 2505c375-1932-4e35-90f6-b80d10489e98 -- POST / 200 235.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,013 mnist_classifier_MNISTClassifier 70lfsay7 372d5f98-f514-4e58-83bb-b410af448fcf -- POST / 200 235.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,015 mnist_classifier_MNISTClassifier 70lfsay7 2a19325c-666f-4a3e-bee0-2825b97c8cd4 -- POST / 200 239.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,017 mnist_classifier_MNISTClassifier 70lfsay7 69c5efdf-e7d3-425a-9c50-bc3c22839b30 -- POST / 200 245.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,017 mnist_classifier_MNISTClassifier 70lfsay7 9e3b4ee5-cf61-49d8-94b5-8179acf086c4 -- POST / 200 244.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,019 mnist_classifier_MNISTClassifier 70lfsay7 1e65cc6a-655b-4be5-b0a1-ed32e062cef7 -- POST / 200 245.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,020 mnist_classifier_MNISTClassifier 70lfsay7 9115c3fc-dfdf-47e1-868f-876b5e3d786d -- POST / 200 245.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,021 mnist_classifier_MNISTClassifier 70lfsay7 863b50c8-6eb0-4fe9-a2a1-b4a27aa65dc4 -- POST / 200 245.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,026 mnist_classifier_MNISTClassifier 70lfsay7 3494b6ec-3721-4410-8d89-c5e2bed7e6d6 -- POST / 200 250.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,029 mnist_classifier_MNISTClassifier 70lfsay7 1f31ce86-4553-4cec-a7be-161cc323e688 -- POST / 200 250.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,090 mnist_classifier_MNISTClassifier 70lfsay7 e5a6413a-9220-481b-ac14-e32a57c36aa8 -- POST / 200 311.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,091 mnist_classifier_MNISTClassifier 70lfsay7 4c115dde-5684-426e-aa03-4856674e8ed7 -- POST / 200 312.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,094 mnist_classifier_MNISTClassifier 70lfsay7 b4465599-709d-4eea-b0d2-12ea1207a94a -- POST / 200 314.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,095 mnist_classifier_MNISTClassifier 70lfsay7 851efeaa-a19b-45de-94c1-0a10a6fd8da2 -- POST / 200 315.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,099 mnist_classifier_MNISTClassifier 70lfsay7 9f47a2c6-7272-4fe6-8098-3dfd53dd0249 -- POST / 200 315.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,101 mnist_classifier_MNISTClassifier 70lfsay7 f54a0555-6f9d-4670-82b0-ca457e653b53 -- POST / 200 315.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,103 mnist_classifier_MNISTClassifier 70lfsay7 1eb5364f-0f92-4a0a-b7bc-bea0f938143a -- POST / 200 316.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,104 mnist_classifier_MNISTClassifier 70lfsay7 2b88c13a-d9f4-4df8-9c92-8476d5f5ce44 -- POST / 200 236.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,105 mnist_classifier_MNISTClassifier 70lfsay7 44b43c4e-a61e-4d14-bd91-46e87bb030c6 -- POST / 200 233.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,106 mnist_classifier_MNISTClassifier 70lfsay7 7f8a5655-43a7-4c40-8ba7-980306d2803c -- POST / 200 235.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,107 mnist_classifier_MNISTClassifier 70lfsay7 67c371ab-a627-4e22-b2aa-94cf4a1dc7dc -- POST / 200 300.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,107 mnist_classifier_MNISTClassifier 70lfsay7 5bd3a08d-b97e-46c1-9a38-3bed104b3ed6 -- POST / 200 299.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,109 mnist_classifier_MNISTClassifier 70lfsay7 8c3b5752-c405-42bc-b12a-dc31f7a5ffbe -- POST / 200 298.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,112 mnist_classifier_MNISTClassifier 70lfsay7 9107dc98-b4f9-4059-8ad8-f3853d5ccfb1 -- POST / 200 295.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,114 mnist_classifier_MNISTClassifier 70lfsay7 78ade377-9bda-4461-a243-568748382398 -- POST / 200 292.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,117 mnist_classifier_MNISTClassifier 70lfsay7 99b0e160-3db9-4ce7-a279-db6341f7651b -- POST / 200 295.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,127 mnist_classifier_MNISTClassifier 70lfsay7 f0f0a89d-5119-4b50-94f7-f0db14dd89f8 -- POST / 200 304.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,129 mnist_classifier_MNISTClassifier 70lfsay7 8283523c-0ea6-46be-a1ed-9beade17864e -- POST / 200 295.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,130 mnist_classifier_MNISTClassifier 70lfsay7 4c035aa4-59b6-4abd-9554-428b7975031b -- POST / 200 295.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,130 mnist_classifier_MNISTClassifier 70lfsay7 26ab99f8-e9c0-4abe-9df8-9c63b624b859 -- POST / 200 278.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,130 mnist_classifier_MNISTClassifier 70lfsay7 2b9dee4e-086c-4f8c-b0e0-1f37c1421dc1 -- POST / 200 270.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,131 mnist_classifier_MNISTClassifier 70lfsay7 fac39e8c-2381-4c0b-99f5-695c6808b62d -- POST / 200 270.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,131 mnist_classifier_MNISTClassifier 70lfsay7 b77415ac-e7f0-4107-a486-0dfa348d809a -- POST / 200 271.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,132 mnist_classifier_MNISTClassifier 70lfsay7 390de66c-2408-495b-bd72-985db880940c -- POST / 200 270.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,132 mnist_classifier_MNISTClassifier 70lfsay7 b5151f8d-0515-4d49-a3f3-ec21f9c79fe9 -- POST / 200 259.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,134 mnist_classifier_MNISTClassifier 70lfsay7 e4926332-eb06-4830-84a6-9e481016b9da -- POST / 200 259.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,136 mnist_classifier_MNISTClassifier 70lfsay7 a1ab0774-8a3c-456b-83cf-6187921bc460 -- POST / 200 256.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,139 mnist_classifier_MNISTClassifier 70lfsay7 01e33764-1376-4cca-8e77-a1769f3c9775 -- POST / 200 258.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,140 mnist_classifier_MNISTClassifier 70lfsay7 d27258e8-88ea-49b0-a293-b998cd1c0124 -- POST / 200 258.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,140 mnist_classifier_MNISTClassifier 70lfsay7 20adbe70-7df9-4927-96fb-928abee358f0 -- POST / 200 256.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,141 mnist_classifier_MNISTClassifier 70lfsay7 af4c51b7-5763-4134-be55-7c9ff9716f2a -- POST / 200 256.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,143 mnist_classifier_MNISTClassifier 70lfsay7 83ead1c9-755c-49b5-a9ce-018b45dcdb30 -- POST / 200 258.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,144 mnist_classifier_MNISTClassifier 70lfsay7 115f6773-9955-4068-abfd-6cb9ec4c3fab -- POST / 200 257.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,144 mnist_classifier_MNISTClassifier 70lfsay7 3fb923bb-a057-4de1-b6ae-9d3e96e8d54d -- POST / 200 257.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,145 mnist_classifier_MNISTClassifier 70lfsay7 9ad67113-aa2c-41dd-9d62-7059a39f0027 -- POST / 200 256.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,149 mnist_classifier_MNISTClassifier 70lfsay7 d9899d42-0e46-484f-9e92-7b700a24ae08 -- POST / 200 259.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,150 mnist_classifier_MNISTClassifier 70lfsay7 872e95ec-0c6d-45cb-9a4e-88a44e1fa3b4 -- POST / 200 260.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,152 mnist_classifier_MNISTClassifier 70lfsay7 1948936e-14e2-42d8-abbe-03cf15873caa -- POST / 200 262.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,152 mnist_classifier_MNISTClassifier 70lfsay7 bfbc6aba-5a47-4687-b251-3a5bd6c1989c -- POST / 200 263.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,239 mnist_classifier_MNISTClassifier 70lfsay7 e3c2813e-8916-4bc2-b6c8-e79c2aeb37d0 -- POST / 200 340.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,240 mnist_classifier_MNISTClassifier 70lfsay7 9a58dfdf-c17e-438c-841f-c83548bb318d -- POST / 200 350.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,241 mnist_classifier_MNISTClassifier 70lfsay7 53d2358a-84e7-4c4b-aa0a-585498e8284b -- POST / 200 341.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,243 mnist_classifier_MNISTClassifier 70lfsay7 e97af7fd-0d6f-4ea5-8532-d55dff4283ef -- POST / 200 326.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,243 mnist_classifier_MNISTClassifier 70lfsay7 60f24056-e84e-4576-bdf4-f14d5d0e1eb4 -- POST / 200 324.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,244 mnist_classifier_MNISTClassifier 70lfsay7 76387d50-b7d0-49ae-a4c8-7571b4b5f8ac -- POST / 200 330.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,246 mnist_classifier_MNISTClassifier 70lfsay7 f5366360-8d94-47a6-a7bd-113befcd83a7 -- POST / 200 331.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,247 mnist_classifier_MNISTClassifier 70lfsay7 b5239f23-2053-4971-9926-477ef4f0dd16 -- POST / 200 328.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,248 mnist_classifier_MNISTClassifier 70lfsay7 375d39a1-45aa-4700-9bfc-3526fa234d53 -- POST / 200 329.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,248 mnist_classifier_MNISTClassifier 70lfsay7 8471e9e3-2374-4672-bbe1-b2d864863cf4 -- POST / 200 327.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,250 mnist_classifier_MNISTClassifier 70lfsay7 09a41381-82d5-4ad5-b79e-83a58ab93cf5 -- POST / 200 323.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,250 mnist_classifier_MNISTClassifier 70lfsay7 2fce1d00-895d-477a-8e65-8108b86e5dce -- POST / 200 323.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,254 mnist_classifier_MNISTClassifier 70lfsay7 5ebd2806-0ce6-472f-b38f-a63fa41f6ae7 -- POST / 200 322.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,254 mnist_classifier_MNISTClassifier 70lfsay7 6bfccf36-962d-4bec-b92a-efda439b1c25 -- POST / 200 321.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,254 mnist_classifier_MNISTClassifier 70lfsay7 fc86d987-83bd-4b99-b016-dd61b46c7cad -- POST / 200 321.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,256 mnist_classifier_MNISTClassifier 70lfsay7 36c40f36-2edb-415b-8331-b82894486b47 -- POST / 200 323.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,258 mnist_classifier_MNISTClassifier 70lfsay7 06958bfe-76b8-49e5-a317-69b45e113927 -- POST / 200 324.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,258 mnist_classifier_MNISTClassifier 70lfsay7 3b30336c-8915-4e85-8967-dcf73ee04f18 -- POST / 200 323.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,258 mnist_classifier_MNISTClassifier 70lfsay7 8f1e5589-2e92-4e82-9b46-0540c0b10612 -- POST / 200 315.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,259 mnist_classifier_MNISTClassifier 70lfsay7 546fc273-732b-4548-a7d0-a68db4f4597b -- POST / 200 324.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,260 mnist_classifier_MNISTClassifier 70lfsay7 9cb48311-42c1-49db-81d5-d10109945591 -- POST / 200 315.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,264 mnist_classifier_MNISTClassifier 70lfsay7 1ca4c179-c2b1-41cf-b087-917ae08c37ee -- POST / 200 321.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,264 mnist_classifier_MNISTClassifier 70lfsay7 ac002fb4-6fce-4c67-b34d-dc80e681c5d9 -- POST / 200 318.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,265 mnist_classifier_MNISTClassifier 70lfsay7 90e966a6-99bc-4bcb-9d7b-64902a33bde0 -- POST / 200 223.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,265 mnist_classifier_MNISTClassifier 70lfsay7 bc1d4108-8efc-4393-876a-e55d708f2976 -- POST / 200 281.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,266 mnist_classifier_MNISTClassifier 70lfsay7 01fd2279-fb09-4fa1-8b4b-90d1df3c1a26 -- POST / 200 281.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,266 mnist_classifier_MNISTClassifier 70lfsay7 2d029956-f3c4-49c3-9107-1a66a29cfae3 -- POST / 200 268.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,267 mnist_classifier_MNISTClassifier 70lfsay7 e7e0c206-e19f-4cd1-99e2-ac29dd00fda6 -- POST / 200 251.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,268 mnist_classifier_MNISTClassifier 70lfsay7 1a3806c6-3cca-4048-b1e9-8a5fa2919c04 -- POST / 200 239.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,270 mnist_classifier_MNISTClassifier 70lfsay7 9e7d9170-ea2b-41ae-a0da-fc3e626cb1ca -- POST / 200 237.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,272 mnist_classifier_MNISTClassifier 70lfsay7 7f8e155b-824d-42ed-8b31-61833e864c72 -- POST / 200 237.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,272 mnist_classifier_MNISTClassifier 70lfsay7 43be15d3-9022-4dcf-b0b8-04eed0a2b1ca -- POST / 200 238.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,273 mnist_classifier_MNISTClassifier 70lfsay7 b2759f39-4264-4e8a-bf84-0e26bd239787 -- POST / 200 237.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,273 mnist_classifier_MNISTClassifier 70lfsay7 32bc9a47-0a3d-472d-9486-d3f01cd00139 -- POST / 200 235.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,274 mnist_classifier_MNISTClassifier 70lfsay7 2a590328-c715-44c8-9ab5-ec6c9801c26f -- POST / 200 235.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,276 mnist_classifier_MNISTClassifier 70lfsay7 d14e3286-c213-4f10-bc66-30f76396fdb7 -- POST / 200 236.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,278 mnist_classifier_MNISTClassifier 70lfsay7 f3e5b685-27c6-4979-98a0-d708d35f470b -- POST / 200 237.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,280 mnist_classifier_MNISTClassifier 70lfsay7 8d7572dc-16ca-400d-905a-a21bfa543f3d -- POST / 200 238.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,281 mnist_classifier_MNISTClassifier 70lfsay7 74496623-c7c4-4984-80a4-d25144984acd -- POST / 200 229.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,281 mnist_classifier_MNISTClassifier 70lfsay7 330682d6-46e5-47eb-b66a-59fcd6291286 -- POST / 200 236.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,281 mnist_classifier_MNISTClassifier 70lfsay7 4d349944-ee85-4853-b946-d67e45a0f1c8 -- POST / 200 234.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,281 mnist_classifier_MNISTClassifier 70lfsay7 a2f4a110-a642-42d5-9005-67ccf923bb56 -- POST / 200 234.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,282 mnist_classifier_MNISTClassifier 70lfsay7 44649c7d-db36-47a1-908f-52ba0f99ecef -- POST / 200 230.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,282 mnist_classifier_MNISTClassifier 70lfsay7 56ceac6e-d104-4e17-a11a-329b60ac4819 -- POST / 200 230.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,282 mnist_classifier_MNISTClassifier 70lfsay7 49fbfe87-f1cb-4817-b798-af9c9c0f9390 -- POST / 200 224.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,528 mnist_classifier_MNISTClassifier 70lfsay7 f4e2cbde-8dbd-46d1-8a1d-287e0c5f2256 -- POST / 200 470.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,530 mnist_classifier_MNISTClassifier 70lfsay7 e1793f56-f65d-425b-8b9f-f5271e07919c -- POST / 200 469.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,530 mnist_classifier_MNISTClassifier 70lfsay7 590cd5e5-030c-4828-818b-177e090032cf -- POST / 200 467.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,530 mnist_classifier_MNISTClassifier 70lfsay7 c108f2ec-51b8-4281-a879-37700c9f40d0 -- POST / 200 469.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,531 mnist_classifier_MNISTClassifier 70lfsay7 00915f6e-8678-449b-b2ae-dfd2ac3f224b -- POST / 200 467.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,532 mnist_classifier_MNISTClassifier 70lfsay7 2fa415d7-dcfd-444c-b240-4a763e98760d -- POST / 200 468.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,533 mnist_classifier_MNISTClassifier 70lfsay7 42fa5abe-dd23-438c-b49e-459f964977d2 -- POST / 200 470.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,534 mnist_classifier_MNISTClassifier 70lfsay7 9bb7dbee-1993-4252-9abc-b3be8fac25fd -- POST / 200 470.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,534 mnist_classifier_MNISTClassifier 70lfsay7 5c5c02aa-a494-42cd-906e-05ec09afd881 -- POST / 200 468.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,534 mnist_classifier_MNISTClassifier 70lfsay7 540b54e2-e465-461a-a06a-0e1682c7cc4b -- POST / 200 469.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,535 mnist_classifier_MNISTClassifier 70lfsay7 57f78d09-bf65-4b0b-95b5-e884f8304eb0 -- POST / 200 467.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,535 mnist_classifier_MNISTClassifier 70lfsay7 a0c6b1d9-538e-423c-93a9-71e6c8d9c548 -- POST / 200 468.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,538 mnist_classifier_MNISTClassifier 70lfsay7 d6062a79-4f56-41d5-9bb0-efb7fcd66c37 -- POST / 200 470.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,540 mnist_classifier_MNISTClassifier 70lfsay7 5f6a4646-0a33-4967-b261-2f417ad22efd -- POST / 200 471.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,542 mnist_classifier_MNISTClassifier 70lfsay7 9e805e9f-52f8-4e15-a255-bf3593abe09e -- POST / 200 473.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,545 mnist_classifier_MNISTClassifier 70lfsay7 c642010d-9a3b-4bc2-b306-05c23fbcbdbc -- POST / 200 466.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,546 mnist_classifier_MNISTClassifier 70lfsay7 c2337ff9-c8a1-424a-93c5-403003c0f43d -- POST / 200 437.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,547 mnist_classifier_MNISTClassifier 70lfsay7 3a67ea16-d80a-4e53-9e54-0e117e589d1f -- POST / 200 364.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,549 mnist_classifier_MNISTClassifier 70lfsay7 0c25876a-c9e8-444d-9269-5a578cd1cd05 -- POST / 200 406.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,550 mnist_classifier_MNISTClassifier 70lfsay7 9f50201b-9b19-4728-9336-ba244e3cb17e -- POST / 200 389.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,551 mnist_classifier_MNISTClassifier 70lfsay7 f4247f71-5f99-4faf-8c43-017b181bec40 -- POST / 200 389.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,552 mnist_classifier_MNISTClassifier 70lfsay7 e88f36a3-83de-4663-8ad5-9f2654445017 -- POST / 200 389.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,554 mnist_classifier_MNISTClassifier 70lfsay7 c3fd4aa8-1003-4dbf-8251-6f32b88ce71e -- POST / 200 387.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,643 mnist_classifier_MNISTClassifier 70lfsay7 21bb7bde-5590-4b07-9466-b8e774dfe6bd -- POST / 200 476.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,648 mnist_classifier_MNISTClassifier 70lfsay7 d0f9c6d7-0993-47e1-b65d-bebeecf32d8b -- POST / 200 479.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,650 mnist_classifier_MNISTClassifier 70lfsay7 464429f8-9caa-4398-940d-2c1ae82f481f -- POST / 200 481.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,651 mnist_classifier_MNISTClassifier 70lfsay7 19cd8cd8-1e41-4fca-b1c5-21e35db4fb3d -- POST / 200 479.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,652 mnist_classifier_MNISTClassifier 70lfsay7 3eaf97b6-ef2a-4c4f-b938-29664ead53e3 -- POST / 200 479.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,658 mnist_classifier_MNISTClassifier 70lfsay7 4e570e26-90a4-4aed-84f5-02a03e7cf90e -- POST / 200 483.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,659 mnist_classifier_MNISTClassifier 70lfsay7 9aa81062-bd96-43f3-8256-2f5553a94c3a -- POST / 200 483.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,659 mnist_classifier_MNISTClassifier 70lfsay7 1e33d0b9-e3b8-47ba-92ae-051d9f58f413 -- POST / 200 484.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,659 mnist_classifier_MNISTClassifier 70lfsay7 6cc103a6-e65c-4890-9bf9-0f04ef5e84cc -- POST / 200 484.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,660 mnist_classifier_MNISTClassifier 70lfsay7 dd935ec5-e02e-4d2c-9325-c1112827080f -- POST / 200 481.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,661 mnist_classifier_MNISTClassifier 70lfsay7 caa723b1-c752-4df6-a18a-69f8f017e6f9 -- POST / 200 481.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,661 mnist_classifier_MNISTClassifier 70lfsay7 c7f10590-2b16-4861-8338-6954c3f9dd14 -- POST / 200 481.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,664 mnist_classifier_MNISTClassifier 70lfsay7 70a7188c-35b0-4614-83c1-cbbb7ce1029d -- POST / 200 483.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,664 mnist_classifier_MNISTClassifier 70lfsay7 8c7bb654-4e3d-44a7-8406-001271a43b11 -- POST / 200 483.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,664 mnist_classifier_MNISTClassifier 70lfsay7 53a6c413-74d9-4a8a-a3d6-71306d8126c3 -- POST / 200 481.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,665 mnist_classifier_MNISTClassifier 70lfsay7 c4621df3-1354-4fcc-9f11-f467ffdd7a62 -- POST / 200 478.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,665 mnist_classifier_MNISTClassifier 70lfsay7 30435465-ee4a-4dbb-ab75-5b49d983778f -- POST / 200 482.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,665 mnist_classifier_MNISTClassifier 70lfsay7 b7463641-c5bf-4665-be89-7cba945e384a -- POST / 200 482.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,665 mnist_classifier_MNISTClassifier 70lfsay7 64636c7f-c40f-43a9-805a-46dfc0e85b72 -- POST / 200 478.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,666 mnist_classifier_MNISTClassifier 70lfsay7 155be4c8-d7e1-4341-b204-bac8193482d5 -- POST / 200 459.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,666 mnist_classifier_MNISTClassifier 70lfsay7 027bea3c-77f8-4845-b91e-1b5d2be115ad -- POST / 200 478.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,669 mnist_classifier_MNISTClassifier 70lfsay7 7edea5b4-0713-44ab-9c29-b8df8c3dac15 -- POST / 200 460.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,670 mnist_classifier_MNISTClassifier 70lfsay7 e7b1b29a-6543-49c6-b2f2-5ca7b10aa1b8 -- POST / 200 482.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,670 mnist_classifier_MNISTClassifier 70lfsay7 5559b1a0-3ace-486f-927f-f115be30a9a1 -- POST / 200 481.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,670 mnist_classifier_MNISTClassifier 70lfsay7 b170b2f6-ad2c-4374-a525-bf26cd1d2851 -- POST / 200 481.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,671 mnist_classifier_MNISTClassifier 70lfsay7 5c6f79ed-e5cd-490a-9cf4-68f53cf1768e -- POST / 200 481.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,672 mnist_classifier_MNISTClassifier 70lfsay7 ae0cde07-6fa8-4748-945f-f2893711e878 -- POST / 200 478.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,672 mnist_classifier_MNISTClassifier 70lfsay7 6803fc52-7475-4e71-a8d0-47ff79bf3271 -- POST / 200 475.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,673 mnist_classifier_MNISTClassifier 70lfsay7 fc37af21-ca18-4f06-9376-a444032d9a02 -- POST / 200 473.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,673 mnist_classifier_MNISTClassifier 70lfsay7 23a36bcc-3827-4486-882a-ae791114402c -- POST / 200 473.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,673 mnist_classifier_MNISTClassifier 70lfsay7 86d567da-244d-4a41-a5b1-6dd20633403c -- POST / 200 473.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,674 mnist_classifier_MNISTClassifier 70lfsay7 957bb403-f78c-4a36-bfe0-a875955a2265 -- POST / 200 468.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,674 mnist_classifier_MNISTClassifier 70lfsay7 a7ae6f73-7234-422c-a5a2-01d1b19ca990 -- POST / 200 404.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,675 mnist_classifier_MNISTClassifier 70lfsay7 2be3190a-1465-4640-9f18-faee99153532 -- POST / 200 396.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,675 mnist_classifier_MNISTClassifier 70lfsay7 e5448d27-6d9e-41d9-b3d6-e4961564d1e3 -- POST / 200 392.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,676 mnist_classifier_MNISTClassifier 70lfsay7 6c0cfdf2-cd4a-4041-87c3-f3c7d4067421 -- POST / 200 391.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,677 mnist_classifier_MNISTClassifier 70lfsay7 47e52240-bfd7-4e0d-98c3-ffd564b11af8 -- POST / 200 389.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,677 mnist_classifier_MNISTClassifier 70lfsay7 66b083c9-0680-466a-86d9-619d129ef7cb -- POST / 200 389.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,678 mnist_classifier_MNISTClassifier 70lfsay7 8f0baab9-acfb-471f-8ab5-8720c5b1d6d6 -- POST / 200 389.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,678 mnist_classifier_MNISTClassifier 70lfsay7 1c2f44cd-ba78-440b-870e-b29ae791a432 -- POST / 200 388.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,679 mnist_classifier_MNISTClassifier 70lfsay7 eaaaefcb-08de-4236-9858-15ae47b3834a -- POST / 200 387.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,679 mnist_classifier_MNISTClassifier 70lfsay7 576592a9-dcd5-441a-96de-f136ec46b933 -- POST / 200 388.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,680 mnist_classifier_MNISTClassifier 70lfsay7 74840b9b-a512-47f8-a679-c9f56f336da8 -- POST / 200 386.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,680 mnist_classifier_MNISTClassifier 70lfsay7 5af4439d-1d2d-4f6a-aa35-b5015b1c6b94 -- POST / 200 385.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,680 mnist_classifier_MNISTClassifier 70lfsay7 6f88cfa7-9b4c-4319-81bc-f78d4268d08a -- POST / 200 219.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,681 mnist_classifier_MNISTClassifier 70lfsay7 d7e2975e-d54d-465d-9af7-c957594c0de7 -- POST / 200 217.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,681 mnist_classifier_MNISTClassifier 70lfsay7 36df963a-0dcd-4549-a622-4d7fe090837a -- POST / 200 218.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,682 mnist_classifier_MNISTClassifier 70lfsay7 32f49865-eb1a-43dd-94dc-1d32071b597a -- POST / 200 218.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,682 mnist_classifier_MNISTClassifier 70lfsay7 9b6c2e27-aafe-44b3-ad01-130a15030f1e -- POST / 200 218.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,687 mnist_classifier_MNISTClassifier 70lfsay7 c01e8a7b-1eee-4490-97c5-b87dd839dd48 -- POST / 200 223.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,693 mnist_classifier_MNISTClassifier 70lfsay7 e0e36dc8-bff4-49d1-9c1d-cf4757ac3cfa -- POST / 200 228.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,693 mnist_classifier_MNISTClassifier 70lfsay7 f96597a3-2338-4409-adc0-9c4e0406185f -- POST / 200 228.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,693 mnist_classifier_MNISTClassifier 70lfsay7 d0266a6a-6689-40c2-90bc-146e7b538605 -- POST / 200 228.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,739 mnist_classifier_MNISTClassifier 70lfsay7 0d0ec6ed-eb27-4fab-a726-7d39e9f64858 -- POST / 200 272.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,746 mnist_classifier_MNISTClassifier 70lfsay7 327cef27-33ae-4b35-93b3-b41ff9282a0a -- POST / 200 281.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,747 mnist_classifier_MNISTClassifier 70lfsay7 fc69f2c3-fa50-4dbf-9b8c-b3abbf45146e -- POST / 200 281.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,747 mnist_classifier_MNISTClassifier 70lfsay7 80a800d3-fbc0-42f9-9f8e-2b7b36bf0c96 -- POST / 200 272.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,748 mnist_classifier_MNISTClassifier 70lfsay7 ca2cc3ae-1dd7-4a64-ad64-c66656b62025 -- POST / 200 281.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,749 mnist_classifier_MNISTClassifier 70lfsay7 a7140b54-783e-4122-8592-fea451d0c3ab -- POST / 200 281.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,750 mnist_classifier_MNISTClassifier 70lfsay7 4d9737e7-67c3-43ef-8f39-7f41f80fd6ff -- POST / 200 281.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,750 mnist_classifier_MNISTClassifier 70lfsay7 c792f951-fe64-4f5c-9dfa-ab11295b3844 -- POST / 200 281.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,750 mnist_classifier_MNISTClassifier 70lfsay7 4142e963-1101-44c1-9cc3-109ba27beb67 -- POST / 200 279.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,750 mnist_classifier_MNISTClassifier 70lfsay7 41d45bc8-e58b-4b41-87e9-c3654d14de2e -- POST / 200 277.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,751 mnist_classifier_MNISTClassifier 70lfsay7 e58bc439-1fa7-4b59-9c3a-ca0c13854814 -- POST / 200 277.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,751 mnist_classifier_MNISTClassifier 70lfsay7 79e8b18f-6e8f-4d3c-9c5f-cb8714875a0d -- POST / 200 276.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,752 mnist_classifier_MNISTClassifier 70lfsay7 b82dc41e-5f96-44db-8e7f-65db0d935baf -- POST / 200 275.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,754 mnist_classifier_MNISTClassifier 70lfsay7 a90cc25d-9cd1-4dcc-a8b6-ec7eabe9da1e -- POST / 200 276.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,755 mnist_classifier_MNISTClassifier 70lfsay7 08589788-2b95-406c-b568-c501a6ca50e1 -- POST / 200 276.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,755 mnist_classifier_MNISTClassifier 70lfsay7 3aea8a95-f4b3-4df0-b365-ab4a9e1c406b -- POST / 200 275.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,755 mnist_classifier_MNISTClassifier 70lfsay7 9c48d9b8-3246-4a6a-929e-6e930cf75571 -- POST / 200 275.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,756 mnist_classifier_MNISTClassifier 70lfsay7 822624c8-79ec-42b4-bd0f-5b1e5a6d4078 -- POST / 200 275.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,756 mnist_classifier_MNISTClassifier 70lfsay7 eb4a4785-f31f-447b-b7c1-6fc97745441b -- POST / 200 274.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,756 mnist_classifier_MNISTClassifier 70lfsay7 9a2afc4c-7cba-4c02-905d-51fe7a2de05e -- POST / 200 273.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,756 mnist_classifier_MNISTClassifier 70lfsay7 03ba4cea-15a1-49b7-a1d6-57bf916dbbae -- POST / 200 273.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,757 mnist_classifier_MNISTClassifier 70lfsay7 b88c6800-c8e2-48a9-8dd2-0b20a0a05c32 -- POST / 200 272.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,757 mnist_classifier_MNISTClassifier 70lfsay7 897340ef-4439-479d-9ae5-6a291b6f8f36 -- POST / 200 272.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,758 mnist_classifier_MNISTClassifier 70lfsay7 81812634-5c07-4008-917d-0156e39fc100 -- POST / 200 272.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,758 mnist_classifier_MNISTClassifier 70lfsay7 a7efe889-98a0-43b2-90df-2e83e473c4f2 -- POST / 200 239.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,758 mnist_classifier_MNISTClassifier 70lfsay7 579aef70-3554-475e-bc2e-020162542b7a -- POST / 200 204.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,759 mnist_classifier_MNISTClassifier 70lfsay7 758659f9-5d06-4808-ab31-c7b8f809dca5 -- POST / 200 198.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,759 mnist_classifier_MNISTClassifier 70lfsay7 acb2cf71-2df4-4c13-bbaa-67ad4669684a -- POST / 200 197.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,759 mnist_classifier_MNISTClassifier 70lfsay7 716dbe69-9ecc-4e40-8ec9-119aac360d6f -- POST / 200 197.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,760 mnist_classifier_MNISTClassifier 70lfsay7 01451e98-276d-4bd0-87df-28eae7cd9c4c -- POST / 200 196.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,761 mnist_classifier_MNISTClassifier 70lfsay7 ac81f0d6-80e0-4a23-9566-75f8185e2d11 -- POST / 200 196.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,762 mnist_classifier_MNISTClassifier 70lfsay7 1af03fd4-fb6d-4c27-be43-0e7d41b48f19 -- POST / 200 196.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,762 mnist_classifier_MNISTClassifier 70lfsay7 5bc4751d-5784-4d88-90db-44d0e5d653b5 -- POST / 200 193.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,763 mnist_classifier_MNISTClassifier 70lfsay7 1ae91e63-72f0-4dbf-80b0-b095d207208a -- POST / 200 193.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,763 mnist_classifier_MNISTClassifier 70lfsay7 14d37ccd-1759-4969-a086-e8d2ba35146a -- POST / 200 193.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,763 mnist_classifier_MNISTClassifier 70lfsay7 3e343003-f4d3-4493-92fa-fad6af012c92 -- POST / 200 193.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,764 mnist_classifier_MNISTClassifier 70lfsay7 7c56b15a-fb14-4fd2-b9d8-021ba1a8f163 -- POST / 200 192.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,764 mnist_classifier_MNISTClassifier 70lfsay7 b1486906-2ec1-4fc9-b2e1-137efa8dfaef -- POST / 200 191.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,764 mnist_classifier_MNISTClassifier 70lfsay7 ac1a76ab-790a-4f2d-ac7d-65453a4d41ce -- POST / 200 189.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,765 mnist_classifier_MNISTClassifier 70lfsay7 3acc9e8d-5566-458b-8572-907d7ba43cb5 -- POST / 200 188.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,767 mnist_classifier_MNISTClassifier 70lfsay7 d9a55b71-cc38-4236-9b8b-8fd482a414f6 -- POST / 200 187.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,767 mnist_classifier_MNISTClassifier 70lfsay7 d770005d-b819-4b0c-97ce-23209dfd0633 -- POST / 200 187.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,768 mnist_classifier_MNISTClassifier 70lfsay7 98334e8a-3d55-4067-9939-25ba906339da -- POST / 200 188.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,769 mnist_classifier_MNISTClassifier 70lfsay7 a3afee46-7c0e-4d03-96fe-d2cdb9d731ef -- POST / 200 187.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,769 mnist_classifier_MNISTClassifier 70lfsay7 105a826a-f581-4df3-b534-ef290b55d633 -- POST / 200 187.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,770 mnist_classifier_MNISTClassifier 70lfsay7 7b2b7d33-ed6d-4996-bda5-5ff446d18f61 -- POST / 200 187.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,771 mnist_classifier_MNISTClassifier 70lfsay7 ee4eef10-aee9-4a15-a9d4-c9bbf49f363a -- POST / 200 188.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,902 mnist_classifier_MNISTClassifier 70lfsay7 e2004840-ef4c-411d-9521-f4aaa43d8587 -- POST / 200 267.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,905 mnist_classifier_MNISTClassifier 70lfsay7 e1d08038-04ef-4d0b-8268-c6e4fbfc27c8 -- POST / 200 218.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,908 mnist_classifier_MNISTClassifier 70lfsay7 6db44d8c-92d3-4f6f-af29-87dfe03db364 -- POST / 200 221.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,908 mnist_classifier_MNISTClassifier 70lfsay7 22c6a262-4cd4-498b-a318-82952368ec50 -- POST / 200 221.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,909 mnist_classifier_MNISTClassifier 70lfsay7 b13b32be-789b-46e2-bb34-8bdbe9aedfb4 -- POST / 200 222.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,910 mnist_classifier_MNISTClassifier 70lfsay7 e6e2b2b3-4e2a-4e6c-94d1-dcc7303ac3f5 -- POST / 200 223.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,911 mnist_classifier_MNISTClassifier 70lfsay7 fc7c7e6c-9de6-4639-83ec-69c75f35558f -- POST / 200 217.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,912 mnist_classifier_MNISTClassifier 70lfsay7 95678162-e672-4a1f-92dd-27037ca0897a -- POST / 200 211.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,914 mnist_classifier_MNISTClassifier 70lfsay7 002ceb29-cefc-4d2b-adab-c1ba50db8e6d -- POST / 200 213.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,915 mnist_classifier_MNISTClassifier 70lfsay7 9cd36846-ba49-42d0-ac0a-bd80ebfa4c51 -- POST / 200 215.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,916 mnist_classifier_MNISTClassifier 70lfsay7 eb937904-bf38-4145-b244-9bc60dc3743b -- POST / 200 216.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,916 mnist_classifier_MNISTClassifier 70lfsay7 66cf2f1a-5bf2-4451-8650-42a03458548f -- POST / 200 216.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,917 mnist_classifier_MNISTClassifier 70lfsay7 49cb5bcb-fc03-4162-bda0-b380e7713b92 -- POST / 200 216.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,918 mnist_classifier_MNISTClassifier 70lfsay7 b30903f6-6267-4afe-88c1-62f198bb76cc -- POST / 200 217.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,918 mnist_classifier_MNISTClassifier 70lfsay7 bea81d04-618e-44ed-92b9-c06490aa0c91 -- POST / 200 217.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,919 mnist_classifier_MNISTClassifier 70lfsay7 eab8d9f5-068d-456c-b4fe-8c66a0069d78 -- POST / 200 217.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:26,919 mnist_classifier_MNISTClassifier 70lfsay7 af7d7ac5-957e-4bcc-8b58-6fd54a8996d2 -- POST / 200 217.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,049 mnist_classifier_MNISTClassifier 70lfsay7 2b3640eb-7ca7-4d9d-9603-220127cfe3e8 -- POST / 200 347.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,058 mnist_classifier_MNISTClassifier 70lfsay7 f9ef5a25-b0ac-419b-8732-212968ba4d35 -- POST / 200 356.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,059 mnist_classifier_MNISTClassifier 70lfsay7 af095873-b710-41b6-ab9f-7a32cb0d20c7 -- POST / 200 358.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,059 mnist_classifier_MNISTClassifier 70lfsay7 ab3fb942-b07d-4be6-92fb-14a0e5620bd1 -- POST / 200 357.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,059 mnist_classifier_MNISTClassifier 70lfsay7 765fd163-3604-4a9f-9964-eadf33ddac9e -- POST / 200 357.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,060 mnist_classifier_MNISTClassifier 70lfsay7 9c60b3af-a8f5-46f5-bb24-3ff1a35067a0 -- POST / 200 357.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,060 mnist_classifier_MNISTClassifier 70lfsay7 2afad40c-54d2-48ce-a379-d5c7fb8dc697 -- POST / 200 357.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,060 mnist_classifier_MNISTClassifier 70lfsay7 27b4d65a-b9bf-4b48-a3e8-b019775dfa81 -- POST / 200 357.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,061 mnist_classifier_MNISTClassifier 70lfsay7 16c1ac10-4d09-4945-a2c7-b26717f669af -- POST / 200 356.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,061 mnist_classifier_MNISTClassifier 70lfsay7 dbd3a10c-9d9b-4d97-9681-dd4002f13ba5 -- POST / 200 354.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,061 mnist_classifier_MNISTClassifier 70lfsay7 94252788-3783-4dee-88a1-7c1e25d53576 -- POST / 200 354.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,062 mnist_classifier_MNISTClassifier 70lfsay7 6ecbba51-20bb-4ea2-98af-8c42086d3f34 -- POST / 200 354.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,062 mnist_classifier_MNISTClassifier 70lfsay7 a06d753a-63e4-4977-811e-79638fdcf835 -- POST / 200 353.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,062 mnist_classifier_MNISTClassifier 70lfsay7 c0a25448-8884-472b-acd2-c0d7d8a16710 -- POST / 200 353.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,062 mnist_classifier_MNISTClassifier 70lfsay7 02b1f679-e9c9-4b00-977c-33313aea111e -- POST / 200 353.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,063 mnist_classifier_MNISTClassifier 70lfsay7 ff26c558-85cb-41fb-bd8a-04929ea7be00 -- POST / 200 345.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,063 mnist_classifier_MNISTClassifier 70lfsay7 f432c347-33f5-4776-a5ad-ed9df005d105 -- POST / 200 345.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,063 mnist_classifier_MNISTClassifier 70lfsay7 a974e1d3-3074-4558-b3ed-fcd571cb7fff -- POST / 200 345.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,063 mnist_classifier_MNISTClassifier 70lfsay7 dae3c388-fe72-46ba-aeb4-d4e9b41a15dc -- POST / 200 303.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,063 mnist_classifier_MNISTClassifier 70lfsay7 a2183deb-4780-49a0-b6aa-66e9ecb1864f -- POST / 200 303.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,064 mnist_classifier_MNISTClassifier 70lfsay7 b78ada59-43ab-4a63-a429-60157a127fd3 -- POST / 200 302.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,064 mnist_classifier_MNISTClassifier 70lfsay7 157e856d-adbe-424b-9a94-3ef8bafb13ed -- POST / 200 302.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,065 mnist_classifier_MNISTClassifier 70lfsay7 46d852b7-5666-4c7d-acc6-2e2034b43da9 -- POST / 200 303.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,066 mnist_classifier_MNISTClassifier 70lfsay7 d00e2dd6-830f-4e57-ba96-56a7e3f5ddf8 -- POST / 200 280.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,066 mnist_classifier_MNISTClassifier 70lfsay7 9db8d945-65f9-42db-8c67-07d41bd57871 -- POST / 200 278.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,067 mnist_classifier_MNISTClassifier 70lfsay7 f489a256-2e79-47ea-9448-c0697e535fb2 -- POST / 200 271.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,067 mnist_classifier_MNISTClassifier 70lfsay7 1b543ecf-7565-45c4-955c-8058be4c05dc -- POST / 200 270.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,067 mnist_classifier_MNISTClassifier 70lfsay7 62126b7b-f549-4acb-acc5-5a629b019eaa -- POST / 200 268.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,068 mnist_classifier_MNISTClassifier 70lfsay7 58096a44-3388-497c-92c5-8156fb346b27 -- POST / 200 265.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,068 mnist_classifier_MNISTClassifier 70lfsay7 f7e52e7e-f6be-4c64-a8eb-065f22cd3fe0 -- POST / 200 269.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,069 mnist_classifier_MNISTClassifier 70lfsay7 fcebde4d-646e-49c4-b093-ce5b43dbddb5 -- POST / 200 266.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,069 mnist_classifier_MNISTClassifier 70lfsay7 4284c9ed-11b8-459c-b570-b8dfe15698b5 -- POST / 200 270.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,070 mnist_classifier_MNISTClassifier 70lfsay7 70f157c0-7866-4639-8594-5b66773b5c1f -- POST / 200 270.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,071 mnist_classifier_MNISTClassifier 70lfsay7 76b76412-61b2-442b-a416-2ea00a46a0f2 -- POST / 200 270.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,071 mnist_classifier_MNISTClassifier 70lfsay7 40678612-855e-45f4-bfb0-fad6283087b4 -- POST / 200 270.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,071 mnist_classifier_MNISTClassifier 70lfsay7 2f9beabf-6179-4f75-89db-c885ca11dc5d -- POST / 200 269.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,072 mnist_classifier_MNISTClassifier 70lfsay7 f277764e-9895-43db-805f-1ae3d1c522f1 -- POST / 200 256.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,072 mnist_classifier_MNISTClassifier 70lfsay7 baee44a4-894a-41d7-afe2-cb42aecd0975 -- POST / 200 256.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,073 mnist_classifier_MNISTClassifier 70lfsay7 78bb8462-5ab2-4e89-9a33-9bfd1862a646 -- POST / 200 254.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,076 mnist_classifier_MNISTClassifier 70lfsay7 f646b2b2-4e3f-478f-a928-67012cb1e85d -- POST / 200 255.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,077 mnist_classifier_MNISTClassifier 70lfsay7 49cd9b32-603e-45a3-9480-bbcc1705cb47 -- POST / 200 252.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,077 mnist_classifier_MNISTClassifier 70lfsay7 e8d0f741-8c94-4be5-b6ff-5a4b5adcde41 -- POST / 200 249.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,078 mnist_classifier_MNISTClassifier 70lfsay7 b7b14b14-b07e-4cc7-97b0-7ee2bee62563 -- POST / 200 242.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,078 mnist_classifier_MNISTClassifier 70lfsay7 c676b0b8-22e3-4461-887c-e094a5662de4 -- POST / 200 240.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,079 mnist_classifier_MNISTClassifier 70lfsay7 fd8272dc-53f2-4fcf-8a7d-b57709673f75 -- POST / 200 239.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,079 mnist_classifier_MNISTClassifier 70lfsay7 c2d41ed5-0085-42f5-a886-4560f120eba9 -- POST / 200 236.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,080 mnist_classifier_MNISTClassifier 70lfsay7 321ebc3a-5646-4ffe-b5b2-1b437c2bdf7d -- POST / 200 239.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,080 mnist_classifier_MNISTClassifier 70lfsay7 b73bbc1b-22ed-47e5-9410-9318e2e70511 -- POST / 200 236.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,081 mnist_classifier_MNISTClassifier 70lfsay7 dda700a7-ac0a-456e-a58a-0c58266fb3e9 -- POST / 200 236.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,081 mnist_classifier_MNISTClassifier 70lfsay7 1657f889-9af1-404d-8192-a77755207896 -- POST / 200 235.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,082 mnist_classifier_MNISTClassifier 70lfsay7 185399fd-83c9-464e-aacb-7da270092fac -- POST / 200 233.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,082 mnist_classifier_MNISTClassifier 70lfsay7 aed88d51-cbe7-4205-98fd-89538390d394 -- POST / 200 231.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,083 mnist_classifier_MNISTClassifier 70lfsay7 e780c074-4b68-42b1-9419-0e70b5944b4a -- POST / 200 230.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,084 mnist_classifier_MNISTClassifier 70lfsay7 068f0982-da82-4251-bf19-309da0acd838 -- POST / 200 231.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,087 mnist_classifier_MNISTClassifier 70lfsay7 d4dd9b14-c4eb-4572-89ee-82d86285bc9b -- POST / 200 233.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,089 mnist_classifier_MNISTClassifier 70lfsay7 b50ae98c-dbe5-4023-ae98-8ae353301743 -- POST / 200 233.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,089 mnist_classifier_MNISTClassifier 70lfsay7 7867ba27-b6b6-489b-844a-2326af1241cb -- POST / 200 234.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,092 mnist_classifier_MNISTClassifier 70lfsay7 3e0dd8a6-a7ab-4dd9-8f4a-eeb7824f4a7e -- POST / 200 236.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,093 mnist_classifier_MNISTClassifier 70lfsay7 bebd68db-c71c-4f94-9f1d-0807d8d9d309 -- POST / 200 237.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,094 mnist_classifier_MNISTClassifier 70lfsay7 4b289014-6356-4f73-a725-8cc43d2acc06 -- POST / 200 237.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,096 mnist_classifier_MNISTClassifier 70lfsay7 2419362c-4ebd-499a-9baf-bd57390a9759 -- POST / 200 237.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,096 mnist_classifier_MNISTClassifier 70lfsay7 b9624c25-2f34-4a44-9224-1d948434d125 -- POST / 200 237.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,096 mnist_classifier_MNISTClassifier 70lfsay7 86b75102-fcc0-4509-a391-56a2c54097ce -- POST / 200 237.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,149 mnist_classifier_MNISTClassifier 70lfsay7 b7ed442e-16d1-415f-8304-4e217789fc67 -- POST / 200 290.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,167 mnist_classifier_MNISTClassifier 70lfsay7 110872c9-ace3-48a3-b4c1-ab29e680eb1e -- POST / 200 303.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,169 mnist_classifier_MNISTClassifier 70lfsay7 5dcfa722-c405-4ec4-9c22-997eb25b8496 -- POST / 200 305.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,169 mnist_classifier_MNISTClassifier 70lfsay7 90be848b-a0ea-4ad3-9fa2-0bfe12430066 -- POST / 200 309.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,175 mnist_classifier_MNISTClassifier 70lfsay7 b8f518ad-5d3c-4b25-86d3-ff4f87027248 -- POST / 200 308.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,175 mnist_classifier_MNISTClassifier 70lfsay7 e2787e90-7bd5-4505-8c68-a2f8ece7cf89 -- POST / 200 302.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,175 mnist_classifier_MNISTClassifier 70lfsay7 13fd6532-86b9-469a-a332-b13087180335 -- POST / 200 306.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,176 mnist_classifier_MNISTClassifier 70lfsay7 13d630ed-6c1f-4747-90e1-59ca8bdf102b -- POST / 200 296.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,176 mnist_classifier_MNISTClassifier 70lfsay7 15dee7bf-4992-4bce-a1dc-ec0bcfedac22 -- POST / 200 306.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,176 mnist_classifier_MNISTClassifier 70lfsay7 bb2e7be4-da8f-45a9-be09-13ab16488d42 -- POST / 200 296.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,177 mnist_classifier_MNISTClassifier 70lfsay7 dca6a8d0-4657-4213-a2ff-3f2e7a674e1a -- POST / 200 297.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,177 mnist_classifier_MNISTClassifier 70lfsay7 447231fd-c5d4-4ead-906d-38f5c8ede42d -- POST / 200 296.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,177 mnist_classifier_MNISTClassifier 70lfsay7 6cc4f4b5-7f06-4915-ba7a-58ea7cf64b4e -- POST / 200 295.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,178 mnist_classifier_MNISTClassifier 70lfsay7 9453fea0-01d3-493d-847d-e0692fdbd008 -- POST / 200 294.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,178 mnist_classifier_MNISTClassifier 70lfsay7 11f7249a-7e3d-4dfa-97bf-b3e53f536a16 -- POST / 200 294.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,178 mnist_classifier_MNISTClassifier 70lfsay7 8d0d675f-e250-4b90-900e-5eff5b7ec3aa -- POST / 200 292.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,178 mnist_classifier_MNISTClassifier 70lfsay7 28eea668-2e90-4a66-84bf-42b12357934a -- POST / 200 291.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,178 mnist_classifier_MNISTClassifier 70lfsay7 67075e59-ec5c-4bde-94f2-dc405e1ea7ea -- POST / 200 291.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,178 mnist_classifier_MNISTClassifier 70lfsay7 d8d62b38-d862-4c6a-a0d8-4f1c2f3d6dac -- POST / 200 291.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,179 mnist_classifier_MNISTClassifier 70lfsay7 d9d79ddf-10db-4e55-bcc8-1b6f570649ce -- POST / 200 290.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,179 mnist_classifier_MNISTClassifier 70lfsay7 fbb5c463-2707-4427-aa9c-997288a2819f -- POST / 200 242.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,179 mnist_classifier_MNISTClassifier 70lfsay7 1a911232-9b81-416a-be0d-864ae43bda50 -- POST / 200 231.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,179 mnist_classifier_MNISTClassifier 70lfsay7 82835bc6-9616-4da7-878c-3a4fdb68a4dc -- POST / 200 230.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,179 mnist_classifier_MNISTClassifier 70lfsay7 211eba29-560c-4c6a-b0c5-64631978df3f -- POST / 200 229.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,179 mnist_classifier_MNISTClassifier 70lfsay7 9146cfac-fa5e-4d43-8f40-e4377eec3e44 -- POST / 200 228.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,180 mnist_classifier_MNISTClassifier 70lfsay7 f6926db4-e9e3-4eee-872e-7a030e8c754c -- POST / 200 227.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,180 mnist_classifier_MNISTClassifier 70lfsay7 6423aacd-5dfb-48c6-a090-f0efd29968b7 -- POST / 200 225.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,180 mnist_classifier_MNISTClassifier 70lfsay7 151b81c2-3c24-4e42-a156-e42e3e9ecefb -- POST / 200 224.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,180 mnist_classifier_MNISTClassifier 70lfsay7 53347ea0-6a3c-4999-80b9-7c067b798084 -- POST / 200 223.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,180 mnist_classifier_MNISTClassifier 70lfsay7 225eeae1-f4f5-4c7e-af61-cb6d6f80ec5a -- POST / 200 223.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,181 mnist_classifier_MNISTClassifier 70lfsay7 99816873-0f1e-41a0-b462-ca3da5c19308 -- POST / 200 221.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,181 mnist_classifier_MNISTClassifier 70lfsay7 14778b39-e62a-47cf-b40a-5ddec89d3121 -- POST / 200 219.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,181 mnist_classifier_MNISTClassifier 70lfsay7 d6e339d0-4a28-49f6-abae-0910e51d8129 -- POST / 200 219.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,183 mnist_classifier_MNISTClassifier 70lfsay7 b3d1f0c5-2647-4143-8ed1-4899c471846f -- POST / 200 220.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,184 mnist_classifier_MNISTClassifier 70lfsay7 26f73b0f-e51e-4ede-bfbf-8f98434e9948 -- POST / 200 220.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,184 mnist_classifier_MNISTClassifier 70lfsay7 aa985518-e059-4ddc-a2cc-6a6deeaa77d9 -- POST / 200 220.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,185 mnist_classifier_MNISTClassifier 70lfsay7 0d664310-5d2c-488e-aaf8-b194a3e05d39 -- POST / 200 219.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,446 mnist_classifier_MNISTClassifier 70lfsay7 b1436db3-da6c-48ef-b56d-bd20ffcbc458 -- POST / 200 403.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,450 mnist_classifier_MNISTClassifier 70lfsay7 e200cb97-3acd-4ebd-9233-ee15be5b422a -- POST / 200 405.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,451 mnist_classifier_MNISTClassifier 70lfsay7 b46b1386-74ac-4370-ac76-76eef60317c1 -- POST / 200 362.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,451 mnist_classifier_MNISTClassifier 70lfsay7 ca0a5bda-20e9-4b5b-b720-fb34bf7390a3 -- POST / 200 353.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,454 mnist_classifier_MNISTClassifier 70lfsay7 cdf0c82c-5d44-4f97-ba54-c7270fdf7153 -- POST / 200 355.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,458 mnist_classifier_MNISTClassifier 70lfsay7 37a9ccda-4fe3-4e94-a98e-dc6547368fa6 -- POST / 200 358.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,615 mnist_classifier_MNISTClassifier 70lfsay7 c0d08fc7-4377-4383-a792-98a2d9e0a7df -- POST / 200 512.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,616 mnist_classifier_MNISTClassifier 70lfsay7 401da76e-76db-4cdb-9342-281ad7c8a4e3 -- POST / 200 511.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,617 mnist_classifier_MNISTClassifier 70lfsay7 df0daffa-974c-40f9-ac3a-cf0fe8e27485 -- POST / 200 511.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,617 mnist_classifier_MNISTClassifier 70lfsay7 b2b2e41a-5d38-42a1-90e9-e835d66d81b8 -- POST / 200 509.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,618 mnist_classifier_MNISTClassifier 70lfsay7 2ff2714f-19d3-44d5-887f-f485f2130682 -- POST / 200 508.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,619 mnist_classifier_MNISTClassifier 70lfsay7 201905fe-414f-4242-bbcd-57982a8ad204 -- POST / 200 509.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,619 mnist_classifier_MNISTClassifier 70lfsay7 1c8aa579-e356-4110-bd4a-69e9c367f769 -- POST / 200 509.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,620 mnist_classifier_MNISTClassifier 70lfsay7 ccece0ed-749d-4f2e-bdbc-49bb88070f7d -- POST / 200 508.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,620 mnist_classifier_MNISTClassifier 70lfsay7 5b301b75-ef99-4188-94f6-2182b388b3db -- POST / 200 508.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,621 mnist_classifier_MNISTClassifier 70lfsay7 e8212ebb-df65-4182-ae44-f145f5b9c81f -- POST / 200 509.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,622 mnist_classifier_MNISTClassifier 70lfsay7 46ce7be3-bc9e-452a-90e0-88206e3175c2 -- POST / 200 510.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,623 mnist_classifier_MNISTClassifier 70lfsay7 cee63dda-7bef-43a7-bdab-80eab2e4aac7 -- POST / 200 509.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,624 mnist_classifier_MNISTClassifier 70lfsay7 e74fba04-858c-4570-a128-b618a2bc638c -- POST / 200 510.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,624 mnist_classifier_MNISTClassifier 70lfsay7 6e25222b-4884-4751-9ca4-696c872b1e6b -- POST / 200 509.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,626 mnist_classifier_MNISTClassifier 70lfsay7 609aa37c-c577-4d16-b172-86c4d94b9995 -- POST / 200 510.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,627 mnist_classifier_MNISTClassifier 70lfsay7 37b6d071-bd6c-4cff-8602-07c0667c7d4d -- POST / 200 511.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,628 mnist_classifier_MNISTClassifier 70lfsay7 3c291c1b-e182-433f-bf0c-79b987feeeaa -- POST / 200 512.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,629 mnist_classifier_MNISTClassifier 70lfsay7 27b6e543-c10a-4cdc-ae1f-bff07e30f64f -- POST / 200 512.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,630 mnist_classifier_MNISTClassifier 70lfsay7 3b9335ae-f567-4045-ba7c-4dccbc57712d -- POST / 200 512.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,630 mnist_classifier_MNISTClassifier 70lfsay7 7478381a-dad6-443f-a80c-dff83448c6ea -- POST / 200 513.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,630 mnist_classifier_MNISTClassifier 70lfsay7 4f51db4d-1c34-4aa7-9988-62e53fe6b38a -- POST / 200 512.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,631 mnist_classifier_MNISTClassifier 70lfsay7 e807e91e-b0e3-48da-ba62-64d6fc7de0a6 -- POST / 200 513.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,631 mnist_classifier_MNISTClassifier 70lfsay7 7afd8987-473f-4583-83b4-bc31dbd6017f -- POST / 200 509.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,631 mnist_classifier_MNISTClassifier 70lfsay7 21042bac-3282-4656-acc1-84ea9c6d560e -- POST / 200 509.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,631 mnist_classifier_MNISTClassifier 70lfsay7 7d93bc18-09b2-4bd4-a38c-8a91f0892af3 -- POST / 200 500.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,632 mnist_classifier_MNISTClassifier 70lfsay7 8927e1a2-e29c-4d5c-bef9-1353cb6f5d66 -- POST / 200 509.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,632 mnist_classifier_MNISTClassifier 70lfsay7 4dcf8917-b4d8-4a4a-a32c-dfafba043269 -- POST / 200 507.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,633 mnist_classifier_MNISTClassifier 70lfsay7 fa13af01-d998-4f9c-8c08-bc9d2269bcb1 -- POST / 200 502.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,633 mnist_classifier_MNISTClassifier 70lfsay7 c97eb08d-d7c7-4c87-aabf-2e217b5ce595 -- POST / 200 485.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,634 mnist_classifier_MNISTClassifier 70lfsay7 f4135649-cd9d-4de0-9b2f-7acf9e77ffc2 -- POST / 200 484.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,634 mnist_classifier_MNISTClassifier 70lfsay7 3467ae45-8cc3-4f9b-b13d-6fe43a765a7d -- POST / 200 447.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,635 mnist_classifier_MNISTClassifier 70lfsay7 0061a273-abcb-48b2-8f6b-b46beddea0ee -- POST / 200 448.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,636 mnist_classifier_MNISTClassifier 70lfsay7 004a6e6c-53ff-4f38-a6ea-f07136ae7aa3 -- POST / 200 448.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,637 mnist_classifier_MNISTClassifier 70lfsay7 c1f0ccd8-bad3-464f-a145-c0931ba9e42e -- POST / 200 448.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,638 mnist_classifier_MNISTClassifier 70lfsay7 db0483cc-2839-4a8b-b916-d978b92c5fc2 -- POST / 200 439.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,639 mnist_classifier_MNISTClassifier 70lfsay7 d58a0d4a-6323-4a87-b11e-4706e2204b01 -- POST / 200 440.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,639 mnist_classifier_MNISTClassifier 70lfsay7 982b0ddd-f723-4c4a-99d3-1aa0f40a0ec1 -- POST / 200 440.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,640 mnist_classifier_MNISTClassifier 70lfsay7 a0243cf1-625b-4ad4-ac26-dee30c99a872 -- POST / 200 440.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,641 mnist_classifier_MNISTClassifier 70lfsay7 fe143ccb-d90a-46bc-8874-c3724bbe0196 -- POST / 200 438.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,641 mnist_classifier_MNISTClassifier 70lfsay7 47fa6a3b-0688-4672-adf9-f19eb22265a9 -- POST / 200 438.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,641 mnist_classifier_MNISTClassifier 70lfsay7 16a3281a-4ca4-4696-a034-43a59ab87137 -- POST / 200 438.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,642 mnist_classifier_MNISTClassifier 70lfsay7 7eed71fb-6733-407f-8446-73e3d64baeb7 -- POST / 200 438.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,642 mnist_classifier_MNISTClassifier 70lfsay7 55c9f187-c908-4c27-9551-72c24c4ecde6 -- POST / 200 438.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,643 mnist_classifier_MNISTClassifier 70lfsay7 4f2c984a-9aed-43e3-892c-7ead223947b1 -- POST / 200 286.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,644 mnist_classifier_MNISTClassifier 70lfsay7 f2dbb134-45b6-41c8-95ce-b00cf2868e9b -- POST / 200 286.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,644 mnist_classifier_MNISTClassifier 70lfsay7 569f13b6-1d7f-4139-840e-830b16eda8b3 -- POST / 200 287.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,644 mnist_classifier_MNISTClassifier 70lfsay7 d099b2fa-9df6-4d23-8f6e-91d8ad240a85 -- POST / 200 284.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,645 mnist_classifier_MNISTClassifier 70lfsay7 9570ea9a-fdde-41b6-8b48-827812c04b9c -- POST / 200 283.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,646 mnist_classifier_MNISTClassifier 70lfsay7 456ac792-5b33-44bb-b7f0-3e035c55dfd3 -- POST / 200 284.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,647 mnist_classifier_MNISTClassifier 70lfsay7 4d11f131-c0af-4631-96bb-95ebbf031e2f -- POST / 200 284.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,647 mnist_classifier_MNISTClassifier 70lfsay7 8a1c5e65-0c1a-4f5e-8c64-b231b5f0e2e3 -- POST / 200 284.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,649 mnist_classifier_MNISTClassifier 70lfsay7 f1f3cfd3-0d41-436d-b7f8-9d61c8847351 -- POST / 200 274.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,681 mnist_classifier_MNISTClassifier 70lfsay7 35b6c063-f792-4f3a-bfbe-4bb44cdaac03 -- POST / 200 317.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,681 mnist_classifier_MNISTClassifier 70lfsay7 2ecb6c6e-b566-46be-959b-b495bafdaee0 -- POST / 200 315.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,681 mnist_classifier_MNISTClassifier 70lfsay7 c8df876d-3e9b-4c1c-bf0c-4dad486f2285 -- POST / 200 315.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,682 mnist_classifier_MNISTClassifier 70lfsay7 31f65f68-b688-45a5-9266-4974b5b73e32 -- POST / 200 314.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,682 mnist_classifier_MNISTClassifier 70lfsay7 4e371264-0652-4c11-ad00-a2fa9d7cb61d -- POST / 200 312.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,682 mnist_classifier_MNISTClassifier 70lfsay7 af6b552f-8fde-4d90-acde-b69818084583 -- POST / 200 312.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,682 mnist_classifier_MNISTClassifier 70lfsay7 30dbd26f-a4ca-4faa-a936-23ae9ee6b450 -- POST / 200 312.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,682 mnist_classifier_MNISTClassifier 70lfsay7 07eb5b49-1504-4cbf-8f4c-765ce74fadac -- POST / 200 312.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,683 mnist_classifier_MNISTClassifier 70lfsay7 bbb7f55a-2109-4ed7-bc30-fe379599f697 -- POST / 200 308.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,684 mnist_classifier_MNISTClassifier 70lfsay7 cbf6bdba-281f-4a74-875a-39c0c23ea4ea -- POST / 200 308.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,684 mnist_classifier_MNISTClassifier 70lfsay7 799cb1f5-1f78-4b3e-a33b-23f1a1c8ac5b -- POST / 200 312.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,684 mnist_classifier_MNISTClassifier 70lfsay7 8ec930e3-e067-4a51-a39a-919b2843463b -- POST / 200 312.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,687 mnist_classifier_MNISTClassifier 70lfsay7 6d905295-106b-4404-8238-7787059adda4 -- POST / 200 315.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,687 mnist_classifier_MNISTClassifier 70lfsay7 cfc6ce2f-f643-4496-a60a-2ee2fce41572 -- POST / 200 315.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,687 mnist_classifier_MNISTClassifier 70lfsay7 7014e123-d80a-4750-8adc-b3d1b80a4f33 -- POST / 200 314.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,688 mnist_classifier_MNISTClassifier 70lfsay7 e17680e3-614a-4ce9-a768-57d7c6143b76 -- POST / 200 314.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,688 mnist_classifier_MNISTClassifier 70lfsay7 adb50fce-1464-4445-b34f-daeea347c98e -- POST / 200 314.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,688 mnist_classifier_MNISTClassifier 70lfsay7 c6134e57-dea2-492d-879e-3d7936b4c209 -- POST / 200 312.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,689 mnist_classifier_MNISTClassifier 70lfsay7 f4332bb4-570d-4252-a719-a1f3eaede236 -- POST / 200 313.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,689 mnist_classifier_MNISTClassifier 70lfsay7 898bc756-66a9-4cfe-b702-8dfc94ec572b -- POST / 200 312.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,689 mnist_classifier_MNISTClassifier 70lfsay7 2c4ad2eb-109b-45ca-b011-95427c880a12 -- POST / 200 312.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,690 mnist_classifier_MNISTClassifier 70lfsay7 b8ac9d38-d78e-473a-a0d9-793ed8e90b9b -- POST / 200 312.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,690 mnist_classifier_MNISTClassifier 70lfsay7 7159a4c2-a9e4-4544-a360-f71118ca4f19 -- POST / 200 311.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,690 mnist_classifier_MNISTClassifier 70lfsay7 7c70eff0-b532-4c43-8a79-7b20dd60cf55 -- POST / 200 311.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,690 mnist_classifier_MNISTClassifier 70lfsay7 6a0f87c2-169e-4835-9369-c678bbc8be1d -- POST / 200 309.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,690 mnist_classifier_MNISTClassifier 70lfsay7 0eb18a0e-c77f-4148-b3dc-18e37758b49d -- POST / 200 308.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,691 mnist_classifier_MNISTClassifier 70lfsay7 f33c3137-bcc0-483f-9e19-76ac3e0d4e80 -- POST / 200 308.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,691 mnist_classifier_MNISTClassifier 70lfsay7 361dad0f-d7bc-4701-b834-04246ce4af36 -- POST / 200 307.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,691 mnist_classifier_MNISTClassifier 70lfsay7 1382dac8-7a04-46c6-8c84-e1d1728f427b -- POST / 200 306.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,691 mnist_classifier_MNISTClassifier 70lfsay7 1f795bb5-34ed-4af9-b8ea-c6767d45c5aa -- POST / 200 305.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,691 mnist_classifier_MNISTClassifier 70lfsay7 45a90a29-da0f-4dc7-a09f-f982d9dbf6ff -- POST / 200 303.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,691 mnist_classifier_MNISTClassifier 70lfsay7 80a706c4-c6c9-402c-80bf-c2fdc51b75f2 -- POST / 200 303.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,691 mnist_classifier_MNISTClassifier 70lfsay7 3dc65b2a-f2e9-40cf-9dc1-25961be3ee56 -- POST / 200 302.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,692 mnist_classifier_MNISTClassifier 70lfsay7 67adef82-e014-43a2-bc53-987c40663fc5 -- POST / 200 302.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,692 mnist_classifier_MNISTClassifier 70lfsay7 b36c8874-3cae-4777-b1b0-41fbc74f864d -- POST / 200 302.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,692 mnist_classifier_MNISTClassifier 70lfsay7 8b76dccd-be42-4a6c-894e-5899a69928ca -- POST / 200 302.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,692 mnist_classifier_MNISTClassifier 70lfsay7 4973f387-cd36-4b39-ba4a-6fa29e1edbee -- POST / 200 302.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,692 mnist_classifier_MNISTClassifier 70lfsay7 662a013f-ef4d-4681-bc07-81a54b7ba787 -- POST / 200 301.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,692 mnist_classifier_MNISTClassifier 70lfsay7 b851a891-2297-46f3-b17a-9d14390efe5d -- POST / 200 300.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,692 mnist_classifier_MNISTClassifier 70lfsay7 7079e8ed-5196-4944-943d-4d0eecc688a6 -- POST / 200 300.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,697 mnist_classifier_MNISTClassifier 70lfsay7 033c19bb-ce77-49cb-a4f8-125c423e50ac -- POST / 200 305.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,700 mnist_classifier_MNISTClassifier 70lfsay7 b319a1a8-2b0a-4cc2-9fdd-eba5d49ecba3 -- POST / 200 306.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,701 mnist_classifier_MNISTClassifier 70lfsay7 8bbec86e-1a5a-4ecb-ae21-3750e995f25f -- POST / 200 237.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,705 mnist_classifier_MNISTClassifier 70lfsay7 4af734af-8639-4124-9970-7780f4fef0a7 -- POST / 200 240.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,706 mnist_classifier_MNISTClassifier 70lfsay7 d3b24861-e163-45de-84fc-3c3cbe1c715f -- POST / 200 239.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,710 mnist_classifier_MNISTClassifier 70lfsay7 fc075945-7c8a-4ab6-987e-57264f3838fe -- POST / 200 242.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,711 mnist_classifier_MNISTClassifier 70lfsay7 d5e2e1eb-7b85-47cb-b7a0-d7b6c64b6af3 -- POST / 200 242.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,713 mnist_classifier_MNISTClassifier 70lfsay7 42b5e084-6121-4e12-9dc1-d9a32d4fe4de -- POST / 200 243.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,906 mnist_classifier_MNISTClassifier 70lfsay7 46769636-5941-4068-ae1b-e3679691374a -- POST / 200 191.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,907 mnist_classifier_MNISTClassifier 70lfsay7 d07e671b-7263-47bc-b0d1-55e579400b4f -- POST / 200 281.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,908 mnist_classifier_MNISTClassifier 70lfsay7 99fc006e-2630-4e33-898c-ca5e5b261cc8 -- POST / 200 272.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,909 mnist_classifier_MNISTClassifier 70lfsay7 23736fa1-0a17-45af-ab32-2dddbec79b5c -- POST / 200 272.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,911 mnist_classifier_MNISTClassifier 70lfsay7 c20c3edb-4c82-46e9-a6ef-68617c38033e -- POST / 200 263.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,912 mnist_classifier_MNISTClassifier 70lfsay7 084f3fa3-8491-4a00-b539-a35bba752cb6 -- POST / 200 197.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,913 mnist_classifier_MNISTClassifier 70lfsay7 d9b6ecc7-ff29-48ef-9b79-a03cff105b3f -- POST / 200 193.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,917 mnist_classifier_MNISTClassifier 70lfsay7 ad79d1d1-0569-488d-909c-6c6f6ad4b270 -- POST / 200 202.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,922 mnist_classifier_MNISTClassifier 70lfsay7 72822a6a-58e4-43ef-ac33-e39487d43d0e -- POST / 200 195.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,923 mnist_classifier_MNISTClassifier 70lfsay7 6bbe6b2e-9bcd-4d04-aaac-e1e50c2ac48a -- POST / 200 199.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,927 mnist_classifier_MNISTClassifier 70lfsay7 426ee192-eb32-4055-b437-f72f86a96ecb -- POST / 200 199.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,930 mnist_classifier_MNISTClassifier 70lfsay7 b9d81b48-e7f7-4773-abcc-d6f15cc22aed -- POST / 200 201.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,930 mnist_classifier_MNISTClassifier 70lfsay7 f5cc9351-78e5-4459-b6b7-802d1d9330fd -- POST / 200 201.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,931 mnist_classifier_MNISTClassifier 70lfsay7 221a1797-6305-4c66-8a80-e7fed9ac5103 -- POST / 200 200.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,932 mnist_classifier_MNISTClassifier 70lfsay7 04efce7c-e5b5-4d30-a9c2-a778c970822f -- POST / 200 200.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,932 mnist_classifier_MNISTClassifier 70lfsay7 4d4855f0-9ff6-45dc-b57b-865312ad40e2 -- POST / 200 200.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,936 mnist_classifier_MNISTClassifier 70lfsay7 b77c31eb-51da-454e-ab54-4231a6299ae5 -- POST / 200 200.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,937 mnist_classifier_MNISTClassifier 70lfsay7 f8006f98-7b2a-4043-a6d6-fdc1d4bda7e9 -- POST / 200 203.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,938 mnist_classifier_MNISTClassifier 70lfsay7 03b44d78-e983-471d-ac9b-ff0c7e3acafa -- POST / 200 203.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,942 mnist_classifier_MNISTClassifier 70lfsay7 6f23edff-6659-44ca-a9b2-9a55d9836f7b -- POST / 200 210.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,945 mnist_classifier_MNISTClassifier 70lfsay7 2dfb831b-ed06-4e11-a30b-a34166d1508c -- POST / 200 211.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,946 mnist_classifier_MNISTClassifier 70lfsay7 e85d6153-2042-44d6-91c9-3c23b12eac65 -- POST / 200 212.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,949 mnist_classifier_MNISTClassifier 70lfsay7 7053239d-2e90-4afa-a0ba-cf237849b3b9 -- POST / 200 215.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,951 mnist_classifier_MNISTClassifier 70lfsay7 230da418-f030-473c-9837-d18ef1bf651a -- POST / 200 213.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,951 mnist_classifier_MNISTClassifier 70lfsay7 38da091d-ac87-4e9b-81a5-6ab8ae139870 -- POST / 200 213.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,952 mnist_classifier_MNISTClassifier 70lfsay7 ea1cb24f-7e9c-49a1-a337-0f4658108172 -- POST / 200 206.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:27,953 mnist_classifier_MNISTClassifier 70lfsay7 b8ce1828-d09a-428f-be4b-5f20f0db8570 -- POST / 200 213.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,026 mnist_classifier_MNISTClassifier 70lfsay7 f124e232-53da-4897-845d-4d34fc3f88d9 -- POST / 200 286.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,033 mnist_classifier_MNISTClassifier 70lfsay7 a98a5437-2baa-42bf-bc49-faa49701d5aa -- POST / 200 294.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,034 mnist_classifier_MNISTClassifier 70lfsay7 fb98417a-28c8-4388-8833-9e59750e0d52 -- POST / 200 287.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,035 mnist_classifier_MNISTClassifier 70lfsay7 e12dcfef-d3d8-4a17-b396-337f1c495f47 -- POST / 200 294.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,035 mnist_classifier_MNISTClassifier 70lfsay7 e9392250-3913-4d1c-88ca-44bee3aa98d2 -- POST / 200 293.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,036 mnist_classifier_MNISTClassifier 70lfsay7 ea88a1fd-2451-49cd-9ab7-e2f837a48fca -- POST / 200 292.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,037 mnist_classifier_MNISTClassifier 70lfsay7 8ad16ac6-4b2c-41af-af28-2c719ac0457f -- POST / 200 293.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,037 mnist_classifier_MNISTClassifier 70lfsay7 200dd87a-7a77-4c98-baa1-6a939c30eb7d -- POST / 200 293.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,038 mnist_classifier_MNISTClassifier 70lfsay7 f8779d4f-4e3b-4d28-b58e-363e50d37abd -- POST / 200 290.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,038 mnist_classifier_MNISTClassifier 70lfsay7 7ad52c5f-c479-49b3-92cb-a90ce832a8c9 -- POST / 200 291.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,039 mnist_classifier_MNISTClassifier 70lfsay7 5af1b19d-7d7b-4783-b72a-31431c874260 -- POST / 200 291.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,040 mnist_classifier_MNISTClassifier 70lfsay7 64b0fabd-0b74-4ef4-ab17-75ae0996f89a -- POST / 200 291.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,043 mnist_classifier_MNISTClassifier 70lfsay7 9c7dd3e8-f511-4b3c-a37d-6a2bff3cff5d -- POST / 200 293.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,045 mnist_classifier_MNISTClassifier 70lfsay7 2a1aa364-f81a-4e1d-9edd-206d7eac44a7 -- POST / 200 294.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,055 mnist_classifier_MNISTClassifier 70lfsay7 2d0fff0e-0f06-4e02-b079-c1298133b0f1 -- POST / 200 301.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,056 mnist_classifier_MNISTClassifier 70lfsay7 5a1b2c36-9427-4ee5-8b66-6c475393c79a -- POST / 200 303.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,056 mnist_classifier_MNISTClassifier 70lfsay7 e223132a-5d50-4c1e-807f-3fd33e74d9fc -- POST / 200 303.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,056 mnist_classifier_MNISTClassifier 70lfsay7 bc42363d-fd73-4145-88e7-8d819e8012c3 -- POST / 200 301.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,057 mnist_classifier_MNISTClassifier 70lfsay7 d3f544d8-7800-4123-b98a-a671076e27e2 -- POST / 200 301.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,059 mnist_classifier_MNISTClassifier 70lfsay7 3d5d66a9-aed8-4189-80ee-beaa159b4021 -- POST / 200 301.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,060 mnist_classifier_MNISTClassifier 70lfsay7 23d5ccda-d62f-4e41-bd86-502fd39fa138 -- POST / 200 300.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,061 mnist_classifier_MNISTClassifier 70lfsay7 cde447fd-072a-4ba2-abfe-cc8eaa8fa01d -- POST / 200 298.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,062 mnist_classifier_MNISTClassifier 70lfsay7 b38a97b6-382d-4afa-a140-e019fd3fa3e2 -- POST / 200 299.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,062 mnist_classifier_MNISTClassifier 70lfsay7 37fcd8b6-7e32-4e80-b48e-8bd35385aa6e -- POST / 200 300.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,063 mnist_classifier_MNISTClassifier 70lfsay7 60f4417f-2816-44ce-971c-4b6b0e18de92 -- POST / 200 299.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,063 mnist_classifier_MNISTClassifier 70lfsay7 51665c03-0f4e-4d4a-82a9-7a9e1cd8c4c3 -- POST / 200 298.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,064 mnist_classifier_MNISTClassifier 70lfsay7 816bc71c-eb3f-4f6d-b034-32bf4522d5a8 -- POST / 200 297.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,064 mnist_classifier_MNISTClassifier 70lfsay7 4fa2f834-de28-41bc-856f-6c4826adbca1 -- POST / 200 295.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,065 mnist_classifier_MNISTClassifier 70lfsay7 3083cb60-97dd-4478-99b3-1942ed6a4ddc -- POST / 200 296.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,067 mnist_classifier_MNISTClassifier 70lfsay7 74567452-f676-4cdc-b0eb-73dd10e5a139 -- POST / 200 297.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,068 mnist_classifier_MNISTClassifier 70lfsay7 434eb588-4b9a-4234-be72-5ae237fcb278 -- POST / 200 278.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,068 mnist_classifier_MNISTClassifier 70lfsay7 d6020b32-3036-49d1-b2e5-20bcedac9df6 -- POST / 200 277.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,069 mnist_classifier_MNISTClassifier 70lfsay7 4115ba32-0b80-43aa-b15c-1118ec0f51f2 -- POST / 200 274.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,070 mnist_classifier_MNISTClassifier 70lfsay7 e648dc8b-9c68-479f-b3a1-e6ef0a8876d8 -- POST / 200 271.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,072 mnist_classifier_MNISTClassifier 70lfsay7 104e7ade-17e2-4574-9f77-cbce93c845ac -- POST / 200 271.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,073 mnist_classifier_MNISTClassifier 70lfsay7 e37ba222-8c39-47fc-aaba-77ec3732ea9b -- POST / 200 273.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,076 mnist_classifier_MNISTClassifier 70lfsay7 546ad522-60a2-482c-a1ff-2dbe3f9a1247 -- POST / 200 269.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,077 mnist_classifier_MNISTClassifier 70lfsay7 1b17c706-bf8b-444c-a640-16e0e68f5cda -- POST / 200 275.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,077 mnist_classifier_MNISTClassifier 70lfsay7 18de7c42-f8b0-4653-96cd-cf96213bd6f8 -- POST / 200 265.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,077 mnist_classifier_MNISTClassifier 70lfsay7 4afea02d-0868-4ca0-bf7e-f56b5ca419fe -- POST / 200 274.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,077 mnist_classifier_MNISTClassifier 70lfsay7 9196b5a1-9887-4f5a-90b5-f2a0a2a770d1 -- POST / 200 264.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,340 mnist_classifier_MNISTClassifier 70lfsay7 57982650-1e64-4882-899e-f08bcb9d422b -- POST / 200 518.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,341 mnist_classifier_MNISTClassifier 70lfsay7 a4bbc953-6ab6-4fe9-ba9c-aed110a50bff -- POST / 200 522.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,341 mnist_classifier_MNISTClassifier 70lfsay7 1df01aa0-11d9-4c50-a04f-b0d1ec939874 -- POST / 200 520.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,342 mnist_classifier_MNISTClassifier 70lfsay7 425d20f4-3965-41c7-9d3f-405b1fec4ede -- POST / 200 520.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,342 mnist_classifier_MNISTClassifier 70lfsay7 cca198c0-43e5-4727-bd63-1cee93c2b94b -- POST / 200 519.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,342 mnist_classifier_MNISTClassifier 70lfsay7 e28f13de-6288-46a2-a918-35bf461a8a4a -- POST / 200 519.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,343 mnist_classifier_MNISTClassifier 70lfsay7 0bc8b0ad-2e7f-4b20-a72f-08169c8b74b5 -- POST / 200 518.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,343 mnist_classifier_MNISTClassifier 70lfsay7 494ba919-9d22-4946-b8a8-ecf6f4b7dd6a -- POST / 200 511.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,344 mnist_classifier_MNISTClassifier 70lfsay7 b64ca498-d759-45c5-8106-9d5df326f643 -- POST / 200 518.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,371 mnist_classifier_MNISTClassifier 70lfsay7 db847bbb-b8fe-494b-93d5-dbc9f611b0e7 -- POST / 200 546.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,372 mnist_classifier_MNISTClassifier 70lfsay7 23545c12-80f4-46b4-a531-3c23be1e5e77 -- POST / 200 544.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,372 mnist_classifier_MNISTClassifier 70lfsay7 e44dcbe2-cbd5-46ac-88ad-94de963048a3 -- POST / 200 543.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,374 mnist_classifier_MNISTClassifier 70lfsay7 1ebfe78c-c0d5-424e-8a93-085bf44a239a -- POST / 200 542.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,375 mnist_classifier_MNISTClassifier 70lfsay7 10c55c49-a0f3-42e8-bfb5-5c7cda607046 -- POST / 200 542.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,375 mnist_classifier_MNISTClassifier 70lfsay7 b5f5f0bb-5df3-426c-8763-d268d59d2434 -- POST / 200 539.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,375 mnist_classifier_MNISTClassifier 70lfsay7 8b356c5c-062f-4ebf-9b74-44ac05b62a8a -- POST / 200 534.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,376 mnist_classifier_MNISTClassifier 70lfsay7 de2a8c33-f0bf-48b2-8419-cddc55eee4e9 -- POST / 200 534.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,376 mnist_classifier_MNISTClassifier 70lfsay7 5eb7641b-e2d7-49b8-9038-24485f745988 -- POST / 200 534.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,376 mnist_classifier_MNISTClassifier 70lfsay7 c1cc7b5c-08f1-4857-a297-b2f21559fd6b -- POST / 200 532.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,376 mnist_classifier_MNISTClassifier 70lfsay7 3e3d587b-c599-4976-b0fa-30ccb36b83d8 -- POST / 200 532.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,376 mnist_classifier_MNISTClassifier 70lfsay7 ab177094-276d-4b08-a50d-131c256b83c4 -- POST / 200 529.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,376 mnist_classifier_MNISTClassifier 70lfsay7 57c172ce-7ef2-49f1-b90f-4ff17b95e510 -- POST / 200 529.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,377 mnist_classifier_MNISTClassifier 70lfsay7 1ba9de4f-9915-48c8-85d7-df1218f42851 -- POST / 200 528.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,377 mnist_classifier_MNISTClassifier 70lfsay7 80ac8320-cb25-4b73-ae8c-f45a5f2812a1 -- POST / 200 528.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,377 mnist_classifier_MNISTClassifier 70lfsay7 f89d3236-de05-4f33-bef7-9e07a45881e7 -- POST / 200 523.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,377 mnist_classifier_MNISTClassifier 70lfsay7 d4fdc1c0-56f3-4658-a3b3-4697cb76e581 -- POST / 200 523.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,377 mnist_classifier_MNISTClassifier 70lfsay7 058fa400-f900-429a-ac36-277c8fdac29f -- POST / 200 520.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,377 mnist_classifier_MNISTClassifier 70lfsay7 a09907ae-e121-4ab0-8044-575489a72636 -- POST / 200 517.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,377 mnist_classifier_MNISTClassifier 70lfsay7 a0d57d61-fba9-4e6b-b4e2-c9576d497fe3 -- POST / 200 513.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,378 mnist_classifier_MNISTClassifier 70lfsay7 306e757f-faca-42f2-aa33-8ba9c15ec455 -- POST / 200 513.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,378 mnist_classifier_MNISTClassifier 70lfsay7 b54179ed-877f-4007-ad19-1a6b108a3f23 -- POST / 200 510.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,378 mnist_classifier_MNISTClassifier 70lfsay7 03e0c5c3-6bc6-466f-8f19-86bbaa083c9d -- POST / 200 508.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,503 mnist_classifier_MNISTClassifier 70lfsay7 d346cbcf-4909-49b3-9279-afccef0893fc -- POST / 200 575.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,503 mnist_classifier_MNISTClassifier 70lfsay7 4d3de06f-e9fc-4b22-ac27-f6129d5d59bc -- POST / 200 567.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,504 mnist_classifier_MNISTClassifier 70lfsay7 cf431069-302f-4d6d-9de7-a660d2424a84 -- POST / 200 555.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,505 mnist_classifier_MNISTClassifier 70lfsay7 55d8a5e0-b5d7-483e-8ba8-eb80fde78686 -- POST / 200 553.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,506 mnist_classifier_MNISTClassifier 70lfsay7 7abd328e-4bee-4802-9109-702947e02673 -- POST / 200 550.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,506 mnist_classifier_MNISTClassifier 70lfsay7 a26d753d-6c58-452a-8626-25b131a01b4a -- POST / 200 549.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,507 mnist_classifier_MNISTClassifier 70lfsay7 93d091f3-59cc-4604-a351-664428cdd9b8 -- POST / 200 550.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,508 mnist_classifier_MNISTClassifier 70lfsay7 40ab71da-7a1f-4c1b-bc0b-409388c41a6f -- POST / 200 549.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,508 mnist_classifier_MNISTClassifier 70lfsay7 8f3fb392-0fce-4c48-9011-a3483c443b0a -- POST / 200 549.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,509 mnist_classifier_MNISTClassifier 70lfsay7 29ef9d48-476f-4ab4-9213-0aa448a18786 -- POST / 200 549.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,509 mnist_classifier_MNISTClassifier 70lfsay7 0cb1589f-6c13-477b-8423-40ee69fca682 -- POST / 200 542.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,509 mnist_classifier_MNISTClassifier 70lfsay7 8d90f075-3530-4323-b280-a349749b3542 -- POST / 200 540.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,510 mnist_classifier_MNISTClassifier 70lfsay7 664f794d-e781-49f6-93d8-b3443d2a8c7d -- POST / 200 540.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,511 mnist_classifier_MNISTClassifier 70lfsay7 715d0a03-5860-42f2-b285-d436cf9d1073 -- POST / 200 540.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,511 mnist_classifier_MNISTClassifier 70lfsay7 fd0276ff-3d13-4465-b3e3-3f3fe211b33a -- POST / 200 540.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,512 mnist_classifier_MNISTClassifier 70lfsay7 495a4ca4-b297-4b64-8c9f-ae02ea96f718 -- POST / 200 541.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,513 mnist_classifier_MNISTClassifier 70lfsay7 c1736f0d-9ae7-43a5-a211-839111ff4f9f -- POST / 200 540.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,513 mnist_classifier_MNISTClassifier 70lfsay7 5b3e95a1-54fe-4951-8b26-8f558ad1a020 -- POST / 200 539.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,514 mnist_classifier_MNISTClassifier 70lfsay7 92adbb7e-c050-45c2-9709-b69b72661868 -- POST / 200 539.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,515 mnist_classifier_MNISTClassifier 70lfsay7 e6070ca1-6821-4d21-8dcb-7b21c45ae7ff -- POST / 200 537.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,516 mnist_classifier_MNISTClassifier 70lfsay7 45c4c27b-fdfe-450b-bde3-1eb4f5ecf418 -- POST / 200 536.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,517 mnist_classifier_MNISTClassifier 70lfsay7 0cb94c36-5313-49da-a9a8-869fd18d94d2 -- POST / 200 528.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,518 mnist_classifier_MNISTClassifier 70lfsay7 0ad730ca-1895-4ca1-941b-9870d6420d0e -- POST / 200 528.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,520 mnist_classifier_MNISTClassifier 70lfsay7 9a8f339c-25a9-4d8e-a696-8812a5ce9aba -- POST / 200 527.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,520 mnist_classifier_MNISTClassifier 70lfsay7 b2e5610f-6fe7-425e-a2f0-1783866a15ec -- POST / 200 525.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,521 mnist_classifier_MNISTClassifier 70lfsay7 6f51896d-6854-4f46-b0a1-6d8c8579e366 -- POST / 200 526.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,522 mnist_classifier_MNISTClassifier 70lfsay7 5e6a52b1-2f27-4af5-a8ff-984278c7305f -- POST / 200 524.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,522 mnist_classifier_MNISTClassifier 70lfsay7 d11796a3-0501-4aea-9142-ff6f6abf0523 -- POST / 200 465.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,523 mnist_classifier_MNISTClassifier 70lfsay7 9fb30991-6c7e-4632-a82e-243be8b2b880 -- POST / 200 463.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,523 mnist_classifier_MNISTClassifier 70lfsay7 32519b89-0cec-4a98-a848-30b49cb11d0b -- POST / 200 456.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,524 mnist_classifier_MNISTClassifier 70lfsay7 a4467827-dd33-4705-afc9-b614a5598c38 -- POST / 200 450.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,524 mnist_classifier_MNISTClassifier 70lfsay7 22001952-cf2f-4298-a8ba-7e25bfb35e55 -- POST / 200 446.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,525 mnist_classifier_MNISTClassifier 70lfsay7 e8105ef7-e30c-4eec-ac81-c63dace2ec1f -- POST / 200 443.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,525 mnist_classifier_MNISTClassifier 70lfsay7 7950b39c-22fe-4595-a5bf-2cf2dcc0f330 -- POST / 200 438.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,525 mnist_classifier_MNISTClassifier 70lfsay7 615c7e5d-dffc-45cd-9057-b5e779c235ff -- POST / 200 438.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,526 mnist_classifier_MNISTClassifier 70lfsay7 c0e1552e-6c4f-4a7a-8d20-d007cc47e094 -- POST / 200 438.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,526 mnist_classifier_MNISTClassifier 70lfsay7 d5f370cb-6096-4a4f-9e7a-fcc065953f14 -- POST / 200 438.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,527 mnist_classifier_MNISTClassifier 70lfsay7 1bed6b8a-39e6-4625-8d2e-e359301f14db -- POST / 200 434.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,528 mnist_classifier_MNISTClassifier 70lfsay7 22b82434-3c65-4aae-9c5c-1b2dde475181 -- POST / 200 436.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,529 mnist_classifier_MNISTClassifier 70lfsay7 382bea9a-d589-4c84-a5f6-d04daaf3e408 -- POST / 200 436.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,538 mnist_classifier_MNISTClassifier 70lfsay7 91a965c5-5503-452b-a287-d785c3801ffe -- POST / 200 446.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,540 mnist_classifier_MNISTClassifier 70lfsay7 a5bb9ecd-45b2-4199-953f-2dc94999be3b -- POST / 200 446.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,540 mnist_classifier_MNISTClassifier 70lfsay7 f3d8ef16-ec25-4543-b72d-b6f556269b2d -- POST / 200 445.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,541 mnist_classifier_MNISTClassifier 70lfsay7 f857c7ac-1f4f-4155-adbe-d159d1ee95ce -- POST / 200 442.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,541 mnist_classifier_MNISTClassifier 70lfsay7 797d4eae-1e28-47ee-bf46-76fbd46d8e40 -- POST / 200 437.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,541 mnist_classifier_MNISTClassifier 70lfsay7 e9322a96-3dc8-4fb4-b58e-bd761689043e -- POST / 200 430.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,542 mnist_classifier_MNISTClassifier 70lfsay7 1a2e7ba1-755d-4a6f-b78b-10552ccd8b12 -- POST / 200 429.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,542 mnist_classifier_MNISTClassifier 70lfsay7 16d58eb0-8374-4a45-bce1-3c7934534aeb -- POST / 200 425.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,542 mnist_classifier_MNISTClassifier 70lfsay7 4f798631-1987-4fea-b82e-d12833d19d5d -- POST / 200 425.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,545 mnist_classifier_MNISTClassifier 70lfsay7 beaa4011-e6cf-4545-9ae5-646dd58a71e6 -- POST / 200 413.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,547 mnist_classifier_MNISTClassifier 70lfsay7 f03d3740-671d-4d57-9cbd-5209e637c43c -- POST / 200 251.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,547 mnist_classifier_MNISTClassifier 70lfsay7 c1cdef04-0a91-4a78-a29f-757cc2abad06 -- POST / 200 250.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,548 mnist_classifier_MNISTClassifier 70lfsay7 4c4ca307-c026-4864-a017-87ae621d9035 -- POST / 200 249.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,548 mnist_classifier_MNISTClassifier 70lfsay7 e75c29c9-9eae-442f-8fa7-37868f3cc273 -- POST / 200 249.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,548 mnist_classifier_MNISTClassifier 70lfsay7 d76777ca-9333-48fa-ac1e-648c3d34ab80 -- POST / 200 226.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,548 mnist_classifier_MNISTClassifier 70lfsay7 94466b4b-aafe-42e4-99c7-dd0525105d36 -- POST / 200 220.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,548 mnist_classifier_MNISTClassifier 70lfsay7 6253190a-344e-45ce-be55-1b0f977304f4 -- POST / 200 219.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,549 mnist_classifier_MNISTClassifier 70lfsay7 48e503c0-0f7b-4536-9221-fe6fc8588544 -- POST / 200 210.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,552 mnist_classifier_MNISTClassifier 70lfsay7 0e4d07c2-cf7e-4d89-90a7-06b1637583be -- POST / 200 215.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,555 mnist_classifier_MNISTClassifier 70lfsay7 eb71a6e8-99b5-405f-858a-0ae798c59018 -- POST / 200 176.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,555 mnist_classifier_MNISTClassifier 70lfsay7 96142c52-587c-417a-91df-c8b17ef8b3d7 -- POST / 200 165.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,557 mnist_classifier_MNISTClassifier 70lfsay7 7c5f7ae1-b634-4bab-a080-873c942f6397 -- POST / 200 166.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,558 mnist_classifier_MNISTClassifier 70lfsay7 24dc89e9-1d46-47f2-8e45-041eaeb88f50 -- POST / 200 153.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,559 mnist_classifier_MNISTClassifier 70lfsay7 ec2269c9-2d51-44b9-9f97-5fc3fcc1b7b2 -- POST / 200 154.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,561 mnist_classifier_MNISTClassifier 70lfsay7 1284e169-5e70-4e33-921f-1932dd9d92ef -- POST / 200 152.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,562 mnist_classifier_MNISTClassifier 70lfsay7 953a665e-a887-4673-8169-ef4c21b5f66a -- POST / 200 152.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,563 mnist_classifier_MNISTClassifier 70lfsay7 8b179056-7c0c-44e9-9fed-4779f4894107 -- POST / 200 153.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,563 mnist_classifier_MNISTClassifier 70lfsay7 6c929891-5766-42c0-aa54-e4a6d76f6e51 -- POST / 200 152.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,564 mnist_classifier_MNISTClassifier 70lfsay7 4b4a2637-3eb4-439a-8804-348d7835a92d -- POST / 200 153.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,567 mnist_classifier_MNISTClassifier 70lfsay7 bbfeb58e-4b23-489f-a99f-85485c4a8635 -- POST / 200 156.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,568 mnist_classifier_MNISTClassifier 70lfsay7 1689f5f5-1c07-4b12-a680-c37af52c0981 -- POST / 200 157.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,570 mnist_classifier_MNISTClassifier 70lfsay7 070fc6b7-a487-4ea1-8e3a-8303a9b501b3 -- POST / 200 158.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,570 mnist_classifier_MNISTClassifier 70lfsay7 3db9a273-5f2b-45ac-897b-2e45ec097a0c -- POST / 200 159.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,572 mnist_classifier_MNISTClassifier 70lfsay7 d8e803c1-f830-40a1-8f6e-f428ea700ef9 -- POST / 200 160.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,573 mnist_classifier_MNISTClassifier 70lfsay7 97011ad7-e735-4f1f-88b3-c9780e50bb82 -- POST / 200 161.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,573 mnist_classifier_MNISTClassifier 70lfsay7 c4b13a99-c57c-4906-901d-fd9e4c626b3b -- POST / 200 161.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,574 mnist_classifier_MNISTClassifier 70lfsay7 571f0ff4-0f30-47c9-bbf4-713422867a7e -- POST / 200 161.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,574 mnist_classifier_MNISTClassifier 70lfsay7 2dd1ff0c-cbfe-4a76-a7a0-ac898b325d8d -- POST / 200 161.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,574 mnist_classifier_MNISTClassifier 70lfsay7 46bee8d5-4929-47ed-af8c-c1a36af54558 -- POST / 200 161.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,576 mnist_classifier_MNISTClassifier 70lfsay7 be5f3877-9739-4c9e-989d-759b8a0fcd32 -- POST / 200 160.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,577 mnist_classifier_MNISTClassifier 70lfsay7 58482e3d-cbd9-44cd-ac70-07ee1d400495 -- POST / 200 160.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,578 mnist_classifier_MNISTClassifier 70lfsay7 58a611f0-468b-4421-84bf-052ab87f1cde -- POST / 200 161.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,578 mnist_classifier_MNISTClassifier 70lfsay7 c972c720-bbb3-4aea-b9f3-02b62ce6f173 -- POST / 200 161.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,578 mnist_classifier_MNISTClassifier 70lfsay7 83a88e79-d86b-4bb2-bc1a-e25653f650f1 -- POST / 200 159.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,578 mnist_classifier_MNISTClassifier 70lfsay7 a7fe65c2-ffc9-4e5d-8263-79091a346d17 -- POST / 200 159.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,578 mnist_classifier_MNISTClassifier 70lfsay7 346741bb-8636-4f44-a064-fb34c63f9364 -- POST / 200 159.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,580 mnist_classifier_MNISTClassifier 70lfsay7 a48ab769-b8ff-478a-b129-01bad6cf1b95 -- POST / 200 460.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,582 mnist_classifier_MNISTClassifier 70lfsay7 febe98f6-b3ca-48be-ad63-b266142f9483 -- POST / 200 458.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,584 mnist_classifier_MNISTClassifier 70lfsay7 ca5e2fd1-2de0-42bb-95ec-7fe0c667e1cf -- POST / 200 463.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,585 mnist_classifier_MNISTClassifier 70lfsay7 693f8f48-f71e-4523-b98a-013ca0e6f0f8 -- POST / 200 460.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,586 mnist_classifier_MNISTClassifier 70lfsay7 9522ce00-a4cc-4812-b525-24d2f0af0c65 -- POST / 200 463.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,587 mnist_classifier_MNISTClassifier 70lfsay7 ab28303e-d0a9-4cc5-bbbb-f21d5e8eb4b4 -- POST / 200 464.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,587 mnist_classifier_MNISTClassifier 70lfsay7 71f6cd8e-6a71-4703-b26e-6d4b05e2bc12 -- POST / 200 462.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,588 mnist_classifier_MNISTClassifier 70lfsay7 3adb2f49-4ca7-4e1c-8371-0748dc82dad8 -- POST / 200 461.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,588 mnist_classifier_MNISTClassifier 70lfsay7 dab2760a-8c63-40ad-af30-89b96510f87c -- POST / 200 462.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,589 mnist_classifier_MNISTClassifier 70lfsay7 75db2b6c-c61a-4310-b588-433ff82ac707 -- POST / 200 462.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,590 mnist_classifier_MNISTClassifier 70lfsay7 2bb75c43-3471-4499-b6e3-62e5a16fd2ff -- POST / 200 462.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,590 mnist_classifier_MNISTClassifier 70lfsay7 f3f03372-8b2a-4af9-acd3-3596287e676c -- POST / 200 460.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,590 mnist_classifier_MNISTClassifier 70lfsay7 a02928e2-c5ea-4ed8-b7bf-8b9f701d4844 -- POST / 200 460.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,591 mnist_classifier_MNISTClassifier 70lfsay7 77cf0b09-6a49-412a-918e-91182ad0c5f4 -- POST / 200 459.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,844 mnist_classifier_MNISTClassifier 70lfsay7 aa5341fe-cc79-4e7b-b007-f8aabaa70406 -- POST / 200 336.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,856 mnist_classifier_MNISTClassifier 70lfsay7 07c2b904-7608-4939-8cc3-01739249d84c -- POST / 200 340.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,856 mnist_classifier_MNISTClassifier 70lfsay7 95219887-58e5-4337-bf8c-a36e2065b45e -- POST / 200 338.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,856 mnist_classifier_MNISTClassifier 70lfsay7 81208eaa-9631-4780-951d-6198ea515027 -- POST / 200 335.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,857 mnist_classifier_MNISTClassifier 70lfsay7 1582f4d4-d46e-4c2d-86c6-6050b5250e33 -- POST / 200 312.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,857 mnist_classifier_MNISTClassifier 70lfsay7 85ad366a-c207-464b-942e-623956ce0f36 -- POST / 200 329.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,857 mnist_classifier_MNISTClassifier 70lfsay7 1c37f29f-350b-40ff-a4b6-c0bd8a8d3e56 -- POST / 200 329.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,857 mnist_classifier_MNISTClassifier 70lfsay7 bc3172a8-5a36-4a8c-b265-71c1493d0dd1 -- POST / 200 312.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,858 mnist_classifier_MNISTClassifier 70lfsay7 50b7778e-799b-4d56-bb34-d7db86b19cbe -- POST / 200 262.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,859 mnist_classifier_MNISTClassifier 70lfsay7 0239524a-38fe-46dd-85ed-d821e09a2c74 -- POST / 200 260.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,859 mnist_classifier_MNISTClassifier 70lfsay7 acfcf7bc-268e-465e-99e4-9da6c825761d -- POST / 200 196.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,859 mnist_classifier_MNISTClassifier 70lfsay7 e3a7ca5c-943e-4b3f-b3be-231e1cca2fe9 -- POST / 200 190.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,860 mnist_classifier_MNISTClassifier 70lfsay7 dd2b8f04-081e-43bf-b4db-d406aad2a396 -- POST / 200 261.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,860 mnist_classifier_MNISTClassifier 70lfsay7 911edb5b-b494-4c58-82db-19b2dc302348 -- POST / 200 260.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,860 mnist_classifier_MNISTClassifier 70lfsay7 2f620148-ce81-410e-98e7-f7f99b089a1a -- POST / 200 260.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,860 mnist_classifier_MNISTClassifier 70lfsay7 41672e8c-33fe-4b42-85fe-fd96d5fd12ad -- POST / 200 258.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,861 mnist_classifier_MNISTClassifier 70lfsay7 27521d0d-cd40-4678-b4d3-13eaa113affc -- POST / 200 257.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,861 mnist_classifier_MNISTClassifier 70lfsay7 ccc014db-ec35-4140-aa59-6de7e4a559c5 -- POST / 200 252.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,861 mnist_classifier_MNISTClassifier 70lfsay7 596d7107-b1c7-4fae-9208-d92d5bc53e68 -- POST / 200 252.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,861 mnist_classifier_MNISTClassifier 70lfsay7 8fc10888-6f6e-4328-a714-e0d9aba4c351 -- POST / 200 252.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,862 mnist_classifier_MNISTClassifier 70lfsay7 52aca445-dfca-4a11-88c0-2a06939655ff -- POST / 200 252.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,862 mnist_classifier_MNISTClassifier 70lfsay7 83920d52-0c27-4621-b79f-cc60677dd377 -- POST / 200 252.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,862 mnist_classifier_MNISTClassifier 70lfsay7 a7117a37-bd56-4753-ac04-58dd3cee31fa -- POST / 200 251.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,862 mnist_classifier_MNISTClassifier 70lfsay7 7cefd5ea-c30f-4645-adf0-089aaf3ca254 -- POST / 200 251.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,862 mnist_classifier_MNISTClassifier 70lfsay7 60f77f53-cff7-4441-81a0-d24432d064ee -- POST / 200 251.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,941 mnist_classifier_MNISTClassifier 70lfsay7 68c4e89c-6c9c-488e-bded-f30070bb870f -- POST / 200 329.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,947 mnist_classifier_MNISTClassifier 70lfsay7 b0a6119e-0205-437b-805b-3700a2c6a924 -- POST / 200 335.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,950 mnist_classifier_MNISTClassifier 70lfsay7 72df6fc6-1c04-4d37-8faf-0086abeb2541 -- POST / 200 337.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,950 mnist_classifier_MNISTClassifier 70lfsay7 e134a791-5d2f-4861-aa52-bf742782d038 -- POST / 200 338.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,951 mnist_classifier_MNISTClassifier 70lfsay7 94bf627a-9ce0-4041-84a8-1bcfe07872f9 -- POST / 200 338.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,952 mnist_classifier_MNISTClassifier 70lfsay7 a7ac0ce9-c382-4afc-a304-a9a16889961f -- POST / 200 339.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,952 mnist_classifier_MNISTClassifier 70lfsay7 50ca7a0f-fd0f-4969-88c2-c2f705d303c2 -- POST / 200 339.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,953 mnist_classifier_MNISTClassifier 70lfsay7 bc2f28af-f706-4fc8-b861-39edf18eadef -- POST / 200 340.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,953 mnist_classifier_MNISTClassifier 70lfsay7 d6d36101-b726-4243-9892-30905740a323 -- POST / 200 340.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,954 mnist_classifier_MNISTClassifier 70lfsay7 b9c7889a-0329-4486-9a3f-069ba7594a1c -- POST / 200 340.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,954 mnist_classifier_MNISTClassifier 70lfsay7 0e5128fa-1c31-4716-b127-d93b0abd5432 -- POST / 200 340.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,957 mnist_classifier_MNISTClassifier 70lfsay7 b6bab0eb-bc46-4634-a94d-e2e612f0f768 -- POST / 200 342.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,957 mnist_classifier_MNISTClassifier 70lfsay7 548aa835-2a96-44f1-909e-074dba545fa5 -- POST / 200 343.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,958 mnist_classifier_MNISTClassifier 70lfsay7 041619b6-b5e5-4350-b42e-c43d587cc5f9 -- POST / 200 343.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,958 mnist_classifier_MNISTClassifier 70lfsay7 25bbd148-2a17-4725-a47c-09f2a3282a58 -- POST / 200 343.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,959 mnist_classifier_MNISTClassifier 70lfsay7 a5fd9e77-af9b-4162-86f2-5ff107b94a02 -- POST / 200 344.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,960 mnist_classifier_MNISTClassifier 70lfsay7 5e0b8a2b-73fd-488f-89b8-be00ef39bfba -- POST / 200 341.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,960 mnist_classifier_MNISTClassifier 70lfsay7 dc06e503-89e2-4204-aeda-efa228e8c31b -- POST / 200 341.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,961 mnist_classifier_MNISTClassifier 70lfsay7 5e485679-1d37-4527-8b09-38e8814416e1 -- POST / 200 340.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,963 mnist_classifier_MNISTClassifier 70lfsay7 2a264683-45c3-44fa-a991-35cd2ceedfa0 -- POST / 200 341.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,963 mnist_classifier_MNISTClassifier 70lfsay7 6e73dea5-15ec-4cc2-a83a-aa3c39e60a57 -- POST / 200 340.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,964 mnist_classifier_MNISTClassifier 70lfsay7 c36deae1-db0b-48b5-aa54-7452bc156dbc -- POST / 200 337.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,964 mnist_classifier_MNISTClassifier 70lfsay7 0c233915-c041-4b23-ab6b-6b502189bcfa -- POST / 200 318.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,965 mnist_classifier_MNISTClassifier 70lfsay7 7294679d-b393-4e56-8c5c-326804c9e0e6 -- POST / 200 316.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,966 mnist_classifier_MNISTClassifier 70lfsay7 e04cfb5f-56cc-4be5-bad1-3ce70ca64a8d -- POST / 200 316.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,966 mnist_classifier_MNISTClassifier 70lfsay7 6ac5de1b-6ccb-4ccc-ba7b-8ed715660009 -- POST / 200 315.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,967 mnist_classifier_MNISTClassifier 70lfsay7 e29cafb2-bbc5-44f1-b24a-208405cfff9e -- POST / 200 314.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,967 mnist_classifier_MNISTClassifier 70lfsay7 2f97100a-af0c-432f-8d67-e9638223a8c3 -- POST / 200 313.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,968 mnist_classifier_MNISTClassifier 70lfsay7 4d72e43b-9a79-491d-8c90-fd3531d1603d -- POST / 200 313.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,968 mnist_classifier_MNISTClassifier 70lfsay7 ab9809e7-54e8-480f-a83c-ccec840c8a04 -- POST / 200 314.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,970 mnist_classifier_MNISTClassifier 70lfsay7 be797f48-4b9b-423d-8e1e-6720b8ebe1a8 -- POST / 200 311.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,970 mnist_classifier_MNISTClassifier 70lfsay7 e4e648a9-0eda-46f0-8731-3484be8d4e70 -- POST / 200 311.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,971 mnist_classifier_MNISTClassifier 70lfsay7 bd153f99-97d4-42b7-a1ec-4e543edd612e -- POST / 200 310.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,971 mnist_classifier_MNISTClassifier 70lfsay7 0833a7e3-473d-4266-a8b6-c92760e11dca -- POST / 200 310.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,973 mnist_classifier_MNISTClassifier 70lfsay7 ac4a70ea-cfc9-4396-a133-548b43eb2c7e -- POST / 200 311.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,976 mnist_classifier_MNISTClassifier 70lfsay7 c4de75d6-b11f-4bbd-81c3-3b7359a7080d -- POST / 200 314.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,981 mnist_classifier_MNISTClassifier 70lfsay7 2d39e1b3-e811-418f-966f-a166a8b46ce7 -- POST / 200 318.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,981 mnist_classifier_MNISTClassifier 70lfsay7 58413eda-c862-4f19-bd8b-9e09143a7731 -- POST / 200 318.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,982 mnist_classifier_MNISTClassifier 70lfsay7 e92675d7-8404-4849-9229-abd0a98f682d -- POST / 200 255.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,982 mnist_classifier_MNISTClassifier 70lfsay7 fa78cbe0-ecfd-4580-a0b3-8f3dabccdd3a -- POST / 200 313.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,987 mnist_classifier_MNISTClassifier 70lfsay7 5727202c-6186-46f0-bfb9-f8fe9625efc5 -- POST / 200 317.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,987 mnist_classifier_MNISTClassifier 70lfsay7 bdf25bcf-781c-41ea-a2f6-f3068ef27226 -- POST / 200 314.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,990 mnist_classifier_MNISTClassifier 70lfsay7 6b031cb2-8d4e-4a20-b983-843cd5dd5066 -- POST / 200 316.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,991 mnist_classifier_MNISTClassifier 70lfsay7 760a0b2f-1b38-4874-892e-2e31c27645fb -- POST / 200 314.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,991 mnist_classifier_MNISTClassifier 70lfsay7 47cff68d-9a3e-4740-b1d6-acb727668195 -- POST / 200 314.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,993 mnist_classifier_MNISTClassifier 70lfsay7 2a337377-3c3b-41b7-ace5-0dee07e674d4 -- POST / 200 315.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,994 mnist_classifier_MNISTClassifier 70lfsay7 e6535060-bf01-4795-8768-c311fea6cc93 -- POST / 200 315.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,994 mnist_classifier_MNISTClassifier 70lfsay7 3017f804-ff81-4d93-8efb-d55c57933b82 -- POST / 200 314.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,995 mnist_classifier_MNISTClassifier 70lfsay7 a636e93f-2480-4603-bbff-256aa146a238 -- POST / 200 314.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,995 mnist_classifier_MNISTClassifier 70lfsay7 1ce52286-3bde-4c6a-946f-1f77dec6c9ef -- POST / 200 309.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,996 mnist_classifier_MNISTClassifier 70lfsay7 b12e5a65-7abc-4c16-82c2-b8788e0a0a04 -- POST / 200 309.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,996 mnist_classifier_MNISTClassifier 70lfsay7 5c069811-9c17-4204-8cec-a064cebd0ef2 -- POST / 200 305.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,996 mnist_classifier_MNISTClassifier 70lfsay7 013bedbd-41b2-44af-83ce-2fef7af5f2df -- POST / 200 304.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,996 mnist_classifier_MNISTClassifier 70lfsay7 5ab0b27d-ef3d-482e-af0a-b0d042c5e084 -- POST / 200 304.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,997 mnist_classifier_MNISTClassifier 70lfsay7 88a0bd85-ea81-4e6a-a923-95b3442d9e7c -- POST / 200 303.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,997 mnist_classifier_MNISTClassifier 70lfsay7 5ff2b805-ed8f-4c39-9fb0-3f48e82b30bf -- POST / 200 302.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,997 mnist_classifier_MNISTClassifier 70lfsay7 ef7099a5-ce19-4a61-8d7f-e9f993e7334a -- POST / 200 302.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,997 mnist_classifier_MNISTClassifier 70lfsay7 e9899eef-1d03-42ec-b97d-ba49cb3dbe4a -- POST / 200 301.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,997 mnist_classifier_MNISTClassifier 70lfsay7 4f70e553-d623-4f06-9079-fc4be1f89034 -- POST / 200 287.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,998 mnist_classifier_MNISTClassifier 70lfsay7 47eb7a60-85be-451a-8557-e51e699388ae -- POST / 200 286.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,998 mnist_classifier_MNISTClassifier 70lfsay7 d651afcd-3cf1-4480-a73d-cf141051957e -- POST / 200 285.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,998 mnist_classifier_MNISTClassifier 70lfsay7 e076c29e-a8b6-45fa-b66e-824274380ddd -- POST / 200 285.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,998 mnist_classifier_MNISTClassifier 70lfsay7 31a2ad7a-3fbb-488a-bf4e-be61aebb54c2 -- POST / 200 272.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,999 mnist_classifier_MNISTClassifier 70lfsay7 87a61b55-11b3-44c6-ae8f-ddb8de7895f3 -- POST / 200 272.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,999 mnist_classifier_MNISTClassifier 70lfsay7 5cd3cf23-3878-4ff6-8200-1bf7eeb91f61 -- POST / 200 269.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,999 mnist_classifier_MNISTClassifier 70lfsay7 2985848c-8dae-444d-b54e-547aaeb40453 -- POST / 200 269.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:28,999 mnist_classifier_MNISTClassifier 70lfsay7 d16a0adb-e21e-4a50-914b-e88b891c53e2 -- POST / 200 269.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,000 mnist_classifier_MNISTClassifier 70lfsay7 64e2b5e2-0a40-49d9-b1a6-4772e83bed8c -- POST / 200 269.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,000 mnist_classifier_MNISTClassifier 70lfsay7 59170c7f-0aec-43a0-bbee-4fc4e7a1b7bd -- POST / 200 266.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,000 mnist_classifier_MNISTClassifier 70lfsay7 75dd2f50-1161-4f13-a4e2-2c16810b619e -- POST / 200 263.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,000 mnist_classifier_MNISTClassifier 70lfsay7 016501d4-eac7-4807-b2a0-21df3a0e464a -- POST / 200 261.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,000 mnist_classifier_MNISTClassifier 70lfsay7 1b0aafd5-49bd-47f7-99d3-335be9e9f0fc -- POST / 200 261.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,001 mnist_classifier_MNISTClassifier 70lfsay7 a1a9c454-a5e4-47ee-b5ff-371f9d257a8c -- POST / 200 261.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,001 mnist_classifier_MNISTClassifier 70lfsay7 1d8960fb-1e7d-4fd7-a801-9f18ef58c6c0 -- POST / 200 259.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,001 mnist_classifier_MNISTClassifier 70lfsay7 6beb266f-68ba-45f3-a52c-533e570ad3e2 -- POST / 200 259.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,001 mnist_classifier_MNISTClassifier 70lfsay7 982fe84e-6010-4d9d-aaa0-e79fe06b70cc -- POST / 200 169.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,001 mnist_classifier_MNISTClassifier 70lfsay7 cd163211-590b-4397-8176-a4c687009150 -- POST / 200 137.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,002 mnist_classifier_MNISTClassifier 70lfsay7 1486f073-0624-40a9-adcf-b138bc22ddb7 -- POST / 200 134.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,003 mnist_classifier_MNISTClassifier 70lfsay7 079817ed-6bc4-4a9d-83e0-7ccdc3b72029 -- POST / 200 135.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,004 mnist_classifier_MNISTClassifier 70lfsay7 cb98dfa4-b9a3-4301-8170-cf899c0ca150 -- POST / 200 136.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,005 mnist_classifier_MNISTClassifier 70lfsay7 ef8f4deb-34fb-41c7-8bba-d1271bb894cf -- POST / 200 136.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,005 mnist_classifier_MNISTClassifier 70lfsay7 427c4c8b-24f6-4d0d-bfa0-542e143bbdec -- POST / 200 136.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,006 mnist_classifier_MNISTClassifier 70lfsay7 a8e9bdf9-842d-40f7-becb-38eb506d59b3 -- POST / 200 136.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,008 mnist_classifier_MNISTClassifier 70lfsay7 368307cc-0efe-4212-b495-46202883634c -- POST / 200 136.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,008 mnist_classifier_MNISTClassifier 70lfsay7 e1a8b3e7-cfd2-4862-adf8-a9ecf44c3910 -- POST / 200 136.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,008 mnist_classifier_MNISTClassifier 70lfsay7 f0735099-72b3-4d01-8388-9ffa083768dd -- POST / 200 136.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,055 mnist_classifier_MNISTClassifier 70lfsay7 aaa63baa-3461-4898-adc3-9cbbdd983873 -- POST / 200 179.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,081 mnist_classifier_MNISTClassifier 70lfsay7 f18c5707-3514-496e-b08a-8cb390824500 -- POST / 200 202.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,083 mnist_classifier_MNISTClassifier 70lfsay7 88780b39-0a85-4b12-96bc-bd2bb4b4fd79 -- POST / 200 203.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,084 mnist_classifier_MNISTClassifier 70lfsay7 b3ee9aec-f61a-4ffb-9804-02753ee3dd3c -- POST / 200 204.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,085 mnist_classifier_MNISTClassifier 70lfsay7 d306b4bc-63e5-45d0-973e-f93f423e6bc2 -- POST / 200 204.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,085 mnist_classifier_MNISTClassifier 70lfsay7 82620848-1c31-4bb5-8d95-5844a01d240b -- POST / 200 205.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,085 mnist_classifier_MNISTClassifier 70lfsay7 659efc1b-7405-4ccd-9872-4f11a4552245 -- POST / 200 204.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,085 mnist_classifier_MNISTClassifier 70lfsay7 4182eeb9-2be4-4b9d-bc86-fd9f1ccc11e8 -- POST / 200 204.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,085 mnist_classifier_MNISTClassifier 70lfsay7 5f0a239a-02f8-47b2-8c44-e07aa3ee12e2 -- POST / 200 202.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,086 mnist_classifier_MNISTClassifier 70lfsay7 5ea13aed-3c13-4179-8fa1-3b34e0957b2e -- POST / 200 202.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,086 mnist_classifier_MNISTClassifier 70lfsay7 0a470659-63a2-4ddb-87fe-c541fb9ba330 -- POST / 200 202.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,086 mnist_classifier_MNISTClassifier 70lfsay7 483b034d-0319-4b42-a511-b24391221853 -- POST / 200 201.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,090 mnist_classifier_MNISTClassifier 70lfsay7 cb88cddb-ad31-4b5b-8dad-1f324a1807bd -- POST / 200 206.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,091 mnist_classifier_MNISTClassifier 70lfsay7 69614f34-2e96-4de0-b5df-047f9366de69 -- POST / 200 204.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,189 mnist_classifier_MNISTClassifier 70lfsay7 2717788a-2eaa-4a93-8c8d-34ea8faaaa4a -- POST / 200 226.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,191 mnist_classifier_MNISTClassifier 70lfsay7 69686c16-c4eb-4d60-b63c-a58887515c76 -- POST / 200 221.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,192 mnist_classifier_MNISTClassifier 70lfsay7 77546fae-8432-4f8f-8784-78cdc2ccc258 -- POST / 200 236.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,193 mnist_classifier_MNISTClassifier 70lfsay7 773f99ae-6074-43da-aaa6-6c2191e02312 -- POST / 200 236.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,195 mnist_classifier_MNISTClassifier 70lfsay7 5320ae4a-0d7b-4f39-9065-d4e763ceda74 -- POST / 200 238.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,196 mnist_classifier_MNISTClassifier 70lfsay7 7eb7b216-aa7e-4e74-b80d-17d2692604b9 -- POST / 200 233.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,196 mnist_classifier_MNISTClassifier 70lfsay7 ad2638eb-bdb7-41f5-bc2d-753c80f2825b -- POST / 200 211.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,197 mnist_classifier_MNISTClassifier 70lfsay7 f0f7f804-a7e8-48c2-bbf5-f51fb8295fc1 -- POST / 200 185.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,197 mnist_classifier_MNISTClassifier 70lfsay7 17c3dca1-bccb-4c49-a862-c9ae0872dc2e -- POST / 200 186.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,197 mnist_classifier_MNISTClassifier 70lfsay7 f727d612-6ddc-4d4f-8912-a9d19fc69cbc -- POST / 200 187.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,199 mnist_classifier_MNISTClassifier 70lfsay7 da399630-115f-47d2-9b0d-91b1e643e3ad -- POST / 200 168.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,201 mnist_classifier_MNISTClassifier 70lfsay7 8481e703-7013-4e45-81ed-b0e143523ea4 -- POST / 200 188.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,206 mnist_classifier_MNISTClassifier 70lfsay7 ffe602c1-7f46-4133-8f0d-c6307a83cede -- POST / 200 195.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,210 mnist_classifier_MNISTClassifier 70lfsay7 422a659c-f646-4fa5-9a1f-dbb3c5251ae0 -- POST / 200 198.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,211 mnist_classifier_MNISTClassifier 70lfsay7 fc5b7758-286d-46dc-a827-97ad367c2a7b -- POST / 200 179.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,211 mnist_classifier_MNISTClassifier 70lfsay7 af2f7fa6-c65a-4c71-908d-ac145e652dc8 -- POST / 200 191.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,212 mnist_classifier_MNISTClassifier 70lfsay7 d81b3b83-fc72-4fdd-96f6-623cf18dec84 -- POST / 200 184.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,291 mnist_classifier_MNISTClassifier 70lfsay7 1c6c8d41-5e99-441d-8825-3aea6bf266de -- POST / 200 262.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,291 mnist_classifier_MNISTClassifier 70lfsay7 ed04fdfb-7e64-494f-bfa7-ab0fc3e87fb2 -- POST / 200 262.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,292 mnist_classifier_MNISTClassifier 70lfsay7 2517d131-6699-4952-a8ec-5f91c14bbd84 -- POST / 200 259.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,293 mnist_classifier_MNISTClassifier 70lfsay7 a48c7d21-1bb7-4f35-9b73-fddcc0423142 -- POST / 200 258.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,293 mnist_classifier_MNISTClassifier 70lfsay7 69b0ac77-90d0-4d22-9532-2feafc58375e -- POST / 200 258.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,294 mnist_classifier_MNISTClassifier 70lfsay7 2ce85639-0f4f-4368-bccc-51194e8f1f93 -- POST / 200 256.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,295 mnist_classifier_MNISTClassifier 70lfsay7 9f37bd5d-1705-4514-b34f-f82a3495d926 -- POST / 200 255.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,295 mnist_classifier_MNISTClassifier 70lfsay7 23ccaaeb-dec5-4b41-9013-036a6f35c94b -- POST / 200 255.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,295 mnist_classifier_MNISTClassifier 70lfsay7 49127c7c-19f5-46bd-ad57-f2db081a0977 -- POST / 200 256.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,296 mnist_classifier_MNISTClassifier 70lfsay7 baa7c16c-c804-45f9-8cbe-601e2df57a60 -- POST / 200 256.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,297 mnist_classifier_MNISTClassifier 70lfsay7 5cc2e324-7af2-4967-acc8-bb9a31ea140c -- POST / 200 257.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,298 mnist_classifier_MNISTClassifier 70lfsay7 163937c6-f5df-4a99-b72e-747469ab0f67 -- POST / 200 257.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,299 mnist_classifier_MNISTClassifier 70lfsay7 fcd422d5-8c6c-471b-95c5-223e7976a150 -- POST / 200 258.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,299 mnist_classifier_MNISTClassifier 70lfsay7 1520e6f3-7f86-479f-8138-7de26c40afbc -- POST / 200 258.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,300 mnist_classifier_MNISTClassifier 70lfsay7 a745ea70-285c-4154-8e4b-8f06e5d5f78d -- POST / 200 257.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,301 mnist_classifier_MNISTClassifier 70lfsay7 47c19105-3336-4489-adf6-a1dd80a30d75 -- POST / 200 258.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,302 mnist_classifier_MNISTClassifier 70lfsay7 c74eb65f-4c06-4c66-ad22-05fec236fcd9 -- POST / 200 258.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,303 mnist_classifier_MNISTClassifier 70lfsay7 a4c6e1e9-5c03-4296-aad3-e85e39924c0e -- POST / 200 252.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,304 mnist_classifier_MNISTClassifier 70lfsay7 1f57c5f6-a7ef-4d6b-a469-1a155fc00926 -- POST / 200 211.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,304 mnist_classifier_MNISTClassifier 70lfsay7 85d80c66-5906-41e5-9c2e-7988fdffafd3 -- POST / 200 211.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,304 mnist_classifier_MNISTClassifier 70lfsay7 175ef662-3bb3-4f45-9038-cf712c3f3108 -- POST / 200 212.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,305 mnist_classifier_MNISTClassifier 70lfsay7 a51a1959-7f05-4ce2-9d5d-b2ac8c5d103f -- POST / 200 212.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,305 mnist_classifier_MNISTClassifier 70lfsay7 45291a24-3a6b-42ea-9650-16fc9c3105b2 -- POST / 200 212.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,305 mnist_classifier_MNISTClassifier 70lfsay7 9d805d99-9373-4347-890a-e938b6d26cff -- POST / 200 211.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,306 mnist_classifier_MNISTClassifier 70lfsay7 f6a839de-38bc-43c0-84c0-097e419db060 -- POST / 200 203.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,306 mnist_classifier_MNISTClassifier 70lfsay7 8c17f7d3-78e7-4311-b4cf-34f078a907ec -- POST / 200 203.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,306 mnist_classifier_MNISTClassifier 70lfsay7 4f6825af-6067-49b9-8e70-c09f8ca7d98e -- POST / 200 201.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,306 mnist_classifier_MNISTClassifier 70lfsay7 8b26210c-5532-4d50-91f1-387bc4582917 -- POST / 200 201.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,307 mnist_classifier_MNISTClassifier 70lfsay7 bc5e84fe-4a6d-4e27-a09f-d31f22a2d6e0 -- POST / 200 201.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,307 mnist_classifier_MNISTClassifier 70lfsay7 6c39ab8c-4601-41d0-a4c5-c51220f50a15 -- POST / 200 201.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,308 mnist_classifier_MNISTClassifier 70lfsay7 5f9f4381-e9f2-4aaf-91c0-bbbbd4c2a8f1 -- POST / 200 200.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,309 mnist_classifier_MNISTClassifier 70lfsay7 8881d6e4-f51f-4274-b4b6-6f1aad6cb470 -- POST / 200 199.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,309 mnist_classifier_MNISTClassifier 70lfsay7 0c859b53-6a80-474f-888f-7a648201dc20 -- POST / 200 201.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,310 mnist_classifier_MNISTClassifier 70lfsay7 f88b6011-b6ec-40f6-9dd7-67c0f355588c -- POST / 200 198.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,310 mnist_classifier_MNISTClassifier 70lfsay7 3085e7fa-4a83-4982-9d16-638068fe2c96 -- POST / 200 202.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,311 mnist_classifier_MNISTClassifier 70lfsay7 c70b8110-7e6c-4bcc-b3db-3e3058ed6c3a -- POST / 200 199.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,311 mnist_classifier_MNISTClassifier 70lfsay7 0fc2f6df-663d-4a83-9957-0f50d56d973a -- POST / 200 198.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,312 mnist_classifier_MNISTClassifier 70lfsay7 e0dbc139-3d69-43b6-bb09-bf258f3039d5 -- POST / 200 198.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,312 mnist_classifier_MNISTClassifier 70lfsay7 1ff610b0-a006-447b-a199-dacafca29f80 -- POST / 200 197.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,313 mnist_classifier_MNISTClassifier 70lfsay7 1c6f5b88-0678-4396-8db3-eab61329f5dc -- POST / 200 194.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,313 mnist_classifier_MNISTClassifier 70lfsay7 f6142c43-0e80-4181-937c-08db919107b0 -- POST / 200 194.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,313 mnist_classifier_MNISTClassifier 70lfsay7 7445380a-e5be-4e96-a440-be01d4ee8074 -- POST / 200 192.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,313 mnist_classifier_MNISTClassifier 70lfsay7 dc0a5d91-1d85-4535-b710-9ec05040e59d -- POST / 200 191.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,314 mnist_classifier_MNISTClassifier 70lfsay7 e45a10ae-0d8e-4ece-95d9-fdbadee2105a -- POST / 200 192.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,314 mnist_classifier_MNISTClassifier 70lfsay7 4a566ab3-74cc-4d0a-b6ed-2b6d10b92a05 -- POST / 200 192.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,315 mnist_classifier_MNISTClassifier 70lfsay7 a4519995-c733-4c3e-9d5b-abfaf9e19d4b -- POST / 200 192.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,315 mnist_classifier_MNISTClassifier 70lfsay7 968cb3fb-c64d-405f-84cc-067b011b9def -- POST / 200 192.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,316 mnist_classifier_MNISTClassifier 70lfsay7 554d6204-9a58-4763-b9b3-6f5a33f7efae -- POST / 200 192.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,316 mnist_classifier_MNISTClassifier 70lfsay7 0764efc5-083c-44bc-9359-48111bad844d -- POST / 200 192.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,317 mnist_classifier_MNISTClassifier 70lfsay7 6ec065b1-cb76-48ff-8c28-0ea9b1acad5e -- POST / 200 193.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,317 mnist_classifier_MNISTClassifier 70lfsay7 bafd064f-1cc3-4407-90e1-357de2683d1a -- POST / 200 192.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,318 mnist_classifier_MNISTClassifier 70lfsay7 0daef2a7-0e9e-4ce1-b5f7-59c48f957d75 -- POST / 200 192.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5032) INFO 2026-10-09 01:15:29,318 mnist_classifier_MNISTClassifier 70lfsay7 b4c670a2-a1b1-473b-9461-73d45b27689b -- POST / 200 187.9ms
Processed 1000 requests in 5.14 seconds
Throughput: 194.65 requests/second

Ray Serve automatically buffers and load balances requests across the replicas.

Fault tolerance

In production, process and machine failures are inevitable. Ray Serve is designed so that each major component in the Serve stack (the controller, replicas, and proxies) can fail and recover while your application continues to handle traffic.

Serve can also recover from larger infrastructure failures, such as entire nodes or pods failing. Serve can even recover from head node failures, or the entire head pod if deploying on KubeRay.

For more information about Ray Serve’s fault tolerance, see the Ray Serve fault-tolerance guide.

Monitor the deployment

Monitoring is critical when running large-scale deployments. The Ray dashboard displays Serve metrics like request throughput, latency, and error rates. It also shows cluster resource usage, replica status, and overall deployment health in real time. The dashboard also lets you inspect logs from individual replicas across the cluster.

For debugging, Ray offers distributed debugging tools that let you attach a debugger to running replicas across the cluster. For more information, see the Ray Serve monitoring documentation.

Conclusion

In this tutorial, you:

• Deployed a PyTorch model using Ray Serve with production best practices.

• Enabled dynamic request batching to optimize performance.

• Configured autoscaling and fractional GPU allocation to efficiently scale across a cluster.

• Tested the service with concurrent asynchronous requests.

Further reading

Ray Serve has more production features that are out of scope for this tutorial but are worth checking out:

• Specialized large language model (LLM) serving APIs that handle complexities like managing key-value (KV) caches and continuous batching.

• Model multiplexing to dynamically load and serve many different models on the same deployment. This is useful for serving per-user fine-tuned models, for example.

• Composed deployments to orchestrate multiple deployments into a single app.

For more information, see the Ray Serve documentation and Ray Serve examples.