Class ModelRunnerHandle

• Defined in File ModelRunnerHandle.h

Class Documentation

class ModelRunnerHandle

Public Functions

ModelRunnerHandle(const std::string &packagePath, const std::string &modelName)

ModelRunnerHandle(ModelRunnerHandle&&) = default

ModelRunnerHandle &operator=(ModelRunnerHandle&&) = default

ModelRunnerHandle(const ModelRunnerHandle&) = delete

ModelRunnerHandle &operator=(const ModelRunnerHandle&) = delete

~ModelRunnerHandle()

c10::IValue run(const std::vector<c10::IValue> &args, const std::unordered_map<std::string, c10::IValue> &kwargs)

std::vector<c10::IValue> runWithFlatInputsAndOutputs(std::vector<c10::IValue> flatInputs)

A low level API which expects user to always pass in flattened inputs.

The ownership of the entire input list must be transferred to the executor via std::move or in-place construction.