Pipeline

txtai provides a generic pipeline processing framework with the only interface requirement being a __call__ method. Pipelines are flexible and process various types of data. Pipelines can wrap machine learning models as well as other processes.

Pipelines are run with Python or configuration. Pipelines can be instantiated in configuration using the lower case name of the pipeline. Configuration-driven pipelines are run with workflows or the API.

List of pipelines

The following is a list of the default pipelines available in txtai.

• Audio
  • TextToSpeech
  • Transcription
• Data Processing
  • Segmentation
  • Tabular
  • Text extraction
• Image
  • Caption
  • Image Hash
  • Objects
• Text
  • Entity
  • Extractive QA
  • Generator
  • Labeling
  • Sequences
  • Similarity
  • Summary
  • Translation
• Training
  • HF ONNX
  • ML ONNX
  • Trainer