Description

Append an id column to BatchOperator. the id can be DENSE or UNIQUE

Parameters

Name Description Type Required？ Default Value
appendType append type. DENSE or UNIQUE String “DENSE”
idCol Id column name String “append_id”

Script Example

Code

  1. import numpy as np
  2. import pandas as pd
  3. from pyalink.alink import *
  6. def exampleData():
  7.     return np.array([
  8.         [1.0, "A", 0, 0, 0],
  9.         [2.0, "B", 1, 1, 0],
  10.         [3.0, "C", 2, 2, 1],
  11.         [4.0, "D", 3, 3, 1]
  12.     ])
  15. def sourceFrame():
  16.     data = exampleData()
  17.     return pd.DataFrame({
  18.         "f0": data[:, 0],
  19.         "f1": data[:, 1],
  20.         "f2": data[:, 2],
  21.         "f3": data[:, 3],
  22.         "label": data[:, 4]
  23.     })
  26. def batchSource():
  27.     return dataframeToOperator(
  28.         sourceFrame(),
  29.         schemaStr='''
  30.     f0 double, 
  31.     f1 string, 
  32.     f2 int, 
  33.     f3 int, 
  34.     label int
  35.     ''',
  36.         op_type='batch'
  37.     )
  40. (
  41.     AppendIdBatchOp()
  42.     .setIdCol("append_id")
  43.     .linkFrom(batchSource())
  44.     .print()
  45. )

Result

  1.     f0 f1  f2  f3  label  append_id
  2. 0  1.0  A   0   0      0          0
  3. 1  2.0  B   1   1      0          1
  4. 2  3.0  C   2   2      1          2
  5. 3  4.0  D   3   3      1          3