com.baidubce.services.bmr.model
Class StreamingStepConfig

java.lang.Object
  extended by com.baidubce.services.bmr.model.StepConfig
      extended by com.baidubce.services.bmr.model.StreamingStepConfig

public class StreamingStepConfig
extends StepConfig

Represent configuration for a streaming step. A streaming step can be configured with name, actionOnFailure, mapper, reducer, input, output and arguments. The essential options are mapper, input, output and actionOnFailure, and the optional ones are name, reducer and arguments.


Constructor Summary
StreamingStepConfig()
           
 
Method Summary
 StreamingStepConfig withActionOnFailure(String actionOnFailure)
          Configure the action on failure for the streaming step.
 StreamingStepConfig withAdditionalFile(String remote, String local)
          Configure the additional file for the step.
 StreamingStepConfig withArguments(String arguments)
          Configure the arguments for the step.
 StreamingStepConfig withInput(String input)
          Configure the input for the step.
 StreamingStepConfig withMapper(String mapper)
          Configure the mapper program for the step.
 StreamingStepConfig withName(String name)
          Configure the name for the step.
 StreamingStepConfig withOutput(String output)
          Configure the output for the step.
 StreamingStepConfig withReducer(String reducer)
          Configure the reducer program for the step.
 
Methods inherited from class com.baidubce.services.bmr.model.StepConfig
addAdditionalFile, addProperty, getActionOnFailure, getAdditionalFiles, getName, getProperties, getType, setActionOnFailure, setAdditionalFiles, setName, setProperties, setType
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

StreamingStepConfig

public StreamingStepConfig()
Method Detail

withInput

public StreamingStepConfig withInput(String input)
Configure the input for the step.

Parameters:
input - The input path for the step.
Returns:
StreamingStepConfig

withMapper

public StreamingStepConfig withMapper(String mapper)
Configure the mapper program for the step.

Parameters:
mapper - The mapper program for the step.
Returns:
StreamingStepConfig

withOutput

public StreamingStepConfig withOutput(String output)
Configure the output for the step.

Parameters:
output - The output path for the step.
Returns:
StreamingStepConfig

withArguments

public StreamingStepConfig withArguments(String arguments)
Configure the arguments for the step.

Parameters:
arguments - The arguments for the step.
Returns:
StreamingStepConfig

withReducer

public StreamingStepConfig withReducer(String reducer)
Configure the reducer program for the step.

Parameters:
reducer - The reducer program for the step.
Returns:
StreamingStepConfig

withName

public StreamingStepConfig withName(String name)
Configure the name for the step.

Parameters:
name - The name for the step.
Returns:
StreamingStepConfig

withActionOnFailure

public StreamingStepConfig withActionOnFailure(String actionOnFailure)
Configure the action on failure for the streaming step. This property is set to enum value: "Continue": continue to execute other steps. "TerminateCluster": terminate the cluster when this step fails. "CancelAndWait": cancel the other pending steps and set the cluster's status to WAITING.

Parameters:
actionOnFailure - The action on step's failure.
Returns:
StreamingStepConfig

withAdditionalFile

public StreamingStepConfig withAdditionalFile(String remote,
                                              String local)
Configure the additional file for the step.

Parameters:
remote - The remote file of the additional file.
local - The local file of the additional file.
Returns:
StreamingStepConfig


Copyright © 2018. All rights reserved.