Constructor and Description |
---|
PartitionPathUtils() |
Modifier and Type | Method and Description |
---|---|
static LinkedHashMap<String,String> |
extractPartitionSpecFromPath(Path currPath)
Make partition spec from path.
|
static String |
generatePartitionPath(LinkedHashMap<String,String> partitionSpec)
Make partition path from partition spec.
|
static FileStatus[] |
listStatusWithoutHidden(FileSystem fs,
Path dir)
List file status without hidden files.
|
static List<Tuple2<LinkedHashMap<String,String>,Path>> |
searchPartSpecAndPaths(FileSystem fs,
Path path,
int partitionNumber)
Search all partitions in this path.
|
static String |
unescapePathName(String path) |
public static String generatePartitionPath(LinkedHashMap<String,String> partitionSpec)
partitionSpec
- The partition spec.public static LinkedHashMap<String,String> extractPartitionSpecFromPath(Path currPath)
currPath
- partition file path.public static FileStatus[] listStatusWithoutHidden(FileSystem fs, Path dir) throws IOException
IOException
public static List<Tuple2<LinkedHashMap<String,String>,Path>> searchPartSpecAndPaths(FileSystem fs, Path path, int partitionNumber)
path
- search path.partitionNumber
- partition number, it will affect path structure.Copyright © 2014–2020 The Apache Software Foundation. All rights reserved.