BaseEngine

BaseEngine is the base class for all engines. It's an alternative to the LLM API service which supports local deployment.

You can also easily inherit this base class to customize your own engine class. Just override the __init__ and inference method.