TFLite Interpreter

Posted 2022-11-02 Dufre.WC

文章目录

• Architechture
• Model Structure
• • Subgraph
  • • Operator
• Class Structure
• • TfLiteNode/TfLiteRegistration
• Interpreter Implement
• • mmap
  • • TfLiteNode
    • TfLiteRegistration
    • TfLiteContext
  • Workflow
  • • InterpreterBuild::operator()
    • Subgraph::Invoke()
• Example
• • ParseNodes
  • ParseTensors
  • • SetTensorParameterReadOnly()
    • SetTensorParameterReadWrite()
  • Subgraph::Invoke()

Architechture

• PC
  • model training
  • convert model to xxx.tflite
• Device
  • xxx.tflite interpreter
  • inference
    • Neon Kernels
    • Hardware Acceleration interface(GPU/APU…)

Model Structure

Subgraph

Operator

Class Structure

TfLiteNode/TfLiteRegistration

Interpreter Implement

mmap

TfLiteNode

TfLiteRegistration

TfLiteContext

Workflow

InterpreterBuild::operator()

Subgraph::Invoke()

Example

This is CNN Model

1. Conv2D
2. MaxPool2D
3. Conv2D
4. MaxPool2D
5. Reshape
6. FullyConnected
7. Softmax
   

ParseNodes

ParseTensors

SetTensorParameterReadOnly()

SetTensorParameterReadWrite()

Subgraph::Invoke()