cpp_backend

The C++ Inference Backend

The C++ backend is responsible for performing the inference. The directory also has support for the CFFI integration to allow to invoke C++ functions through python.

Path: cpp_backend

lib/include

tflite_utils.h contains helper functions that are potentially useful in implementing the final deployment apps.

interface.h contains the distributed_inference_interface() function that's going to get exported to the CFFI flow in Python. The distributed_inference_interface() should call a wrapper function that executes the actual inference.

backend.h is the header file containing the declaration of the distributed_inference_wrapper.

lib/src

backend.cpp gets generated by generate.py script.