Description

Stochastic Outlier Selection algorithm.

Parameters

Name Description Type Required？ Default Value
perplexity Perplexity Double 4.0
vectorCol Name of a vector column String ✓
predictionCol Column name of prediction. String ✓

Script Example

Code

  1. data = np.array([
  2.   ["0.0,0.0"],
  3.   ["0.0,1.0"],
  4.   ["1.0,0.0"],
  5.   ["1.0,1.0"],
  6.   ["5.0,5.0"],
  7. ])
  9. df_data = pd.DataFrame({
  10.     "features": data[:, 0],
  11. })
  13. data = dataframeToOperator(df_data, schemaStr='features string', op_type='batch')
  14. sos = SosBatchOp().setVectorCol("features").setPredictionCol("outlier_score").setPerplexity(3.0)
  16. output = sos.linkFrom(data)
  17. output.print()

Results

features outlier_score
1.0,1.0 0.12396819612216292
0.0,0.0 0.27815186043725715
0.0,1.0 0.24136320497783578
1.0,0.0 0.24136320497783578
5.0,5.0 0.9998106220648153