public class HadoopInputs extends Object
It provides methods to create Flink InputFormat wrappers for Hadoop
InputFormat
and InputFormat
.
Key value pairs produced by the Hadoop InputFormats are converted into Tuple2
where
the first field is the key and the second field is the value.
Constructor and Description |
---|
HadoopInputs() |
Modifier and Type | Method and Description |
---|---|
static <K,V> HadoopInputFormat<K,V> |
createHadoopInput(org.apache.hadoop.mapred.InputFormat<K,V> mapredInputFormat,
Class<K> key,
Class<V> value,
org.apache.hadoop.mapred.JobConf job,
TypeInformation<scala.Tuple2<K,V>> tpe)
Creates a Flink
InputFormat that wraps the given Hadoop
InputFormat . |
static <K,V> HadoopInputFormat<K,V> |
createHadoopInput(org.apache.hadoop.mapreduce.InputFormat<K,V> mapreduceInputFormat,
Class<K> key,
Class<V> value,
org.apache.hadoop.mapreduce.Job job,
TypeInformation<scala.Tuple2<K,V>> tpe)
Creates a Flink
InputFormat that wraps the given Hadoop
InputFormat . |
static <K,V> HadoopInputFormat<K,V> |
readHadoopFile(org.apache.hadoop.mapred.FileInputFormat<K,V> mapredInputFormat,
Class<K> key,
Class<V> value,
String inputPath,
org.apache.hadoop.mapred.JobConf job,
TypeInformation<scala.Tuple2<K,V>> tpe)
Creates a Flink
InputFormat that wraps the given Hadoop
FileInputFormat . |
static <K,V> HadoopInputFormat<K,V> |
readHadoopFile(org.apache.hadoop.mapreduce.lib.input.FileInputFormat<K,V> mapreduceInputFormat,
Class<K> key,
Class<V> value,
String inputPath,
org.apache.hadoop.mapreduce.Job job,
TypeInformation<scala.Tuple2<K,V>> tpe)
Creates a Flink
InputFormat that wraps the given Hadoop
FileInputFormat . |
static <K,V> HadoopInputFormat<K,V> |
readHadoopFile(org.apache.hadoop.mapred.FileInputFormat<K,V> mapredInputFormat,
Class<K> key,
Class<V> value,
String inputPath,
TypeInformation<scala.Tuple2<K,V>> tpe)
Creates a Flink
InputFormat that wraps the given Hadoop
FileInputFormat . |
static <K,V> HadoopInputFormat<K,V> |
readHadoopFile(org.apache.hadoop.mapreduce.lib.input.FileInputFormat<K,V> mapreduceInputFormat,
Class<K> key,
Class<V> value,
String inputPath,
TypeInformation<scala.Tuple2<K,V>> tpe)
Creates a Flink
InputFormat that wraps the given Hadoop
FileInputFormat . |
static <K,V> HadoopInputFormat<K,V> |
readSequenceFile(Class<K> key,
Class<V> value,
String inputPath,
TypeInformation<scala.Tuple2<K,V>> tpe)
Creates a Flink
InputFormat that reads a Hadoop sequence
file with the given key and value classes. |
public static <K,V> HadoopInputFormat<K,V> readHadoopFile(org.apache.hadoop.mapred.FileInputFormat<K,V> mapredInputFormat, Class<K> key, Class<V> value, String inputPath, org.apache.hadoop.mapred.JobConf job, TypeInformation<scala.Tuple2<K,V>> tpe)
InputFormat
that wraps the given Hadoop
FileInputFormat
.public static <K,V> HadoopInputFormat<K,V> readHadoopFile(org.apache.hadoop.mapred.FileInputFormat<K,V> mapredInputFormat, Class<K> key, Class<V> value, String inputPath, TypeInformation<scala.Tuple2<K,V>> tpe)
InputFormat
that wraps the given Hadoop
FileInputFormat
.public static <K,V> HadoopInputFormat<K,V> readSequenceFile(Class<K> key, Class<V> value, String inputPath, TypeInformation<scala.Tuple2<K,V>> tpe)
InputFormat
that reads a Hadoop sequence
file with the given key and value classes.public static <K,V> HadoopInputFormat<K,V> createHadoopInput(org.apache.hadoop.mapred.InputFormat<K,V> mapredInputFormat, Class<K> key, Class<V> value, org.apache.hadoop.mapred.JobConf job, TypeInformation<scala.Tuple2<K,V>> tpe)
InputFormat
that wraps the given Hadoop
InputFormat
.public static <K,V> HadoopInputFormat<K,V> readHadoopFile(org.apache.hadoop.mapreduce.lib.input.FileInputFormat<K,V> mapreduceInputFormat, Class<K> key, Class<V> value, String inputPath, org.apache.hadoop.mapreduce.Job job, TypeInformation<scala.Tuple2<K,V>> tpe)
InputFormat
that wraps the given Hadoop
FileInputFormat
.public static <K,V> HadoopInputFormat<K,V> readHadoopFile(org.apache.hadoop.mapreduce.lib.input.FileInputFormat<K,V> mapreduceInputFormat, Class<K> key, Class<V> value, String inputPath, TypeInformation<scala.Tuple2<K,V>> tpe)
InputFormat
that wraps the given Hadoop
FileInputFormat
.public static <K,V> HadoopInputFormat<K,V> createHadoopInput(org.apache.hadoop.mapreduce.InputFormat<K,V> mapreduceInputFormat, Class<K> key, Class<V> value, org.apache.hadoop.mapreduce.Job job, TypeInformation<scala.Tuple2<K,V>> tpe)
InputFormat
that wraps the given Hadoop
InputFormat
.Copyright © 2014–2017 The Apache Software Foundation. All rights reserved.