Description

Transform data type from Triple to Vector.

Parameters

Name Description Type Required？ Default Value
handleInvalid Strategy to handle unseen token String “ERROR”
tripleColumnCol Name of the triple column col String ✓
tripleValueCol Name of the triple value column String ✓
reservedCols Names of the columns to be retained in the output table String[] null
vectorCol Name of a vector column String ✓
vectorSize Size of the vector Long -1
tripleRowCol Name of the triple row column String

Script Example

Code

  1. import numpy as np
  2. import pandas as pd
  5. data = np.array([[1,'1',1.0],[1,'2',2.0]])
  6. df = pd.DataFrame({"row":data[:,0], "col":data[:,1], "val":data[:,2]})
  7. data = dataframeToOperator(df, schemaStr="row double, col string, val double",op_type="batch")
  10. op = TripleToVectorBatchOp()\
  11.     .setTripleRowCol("row").setTripleColCol("col").setTripleValCol("val")\
  12.     .setReservedCols(["row"]).setVectorCol("vec").setVectorSize(5)\
  13.     .linkFrom(data)
  14. op.print()

Results

  1. |row|vec|
  2. |-|-----|
  3. |1|$5$1.0 2.0|