Example 11 with WriteMarkers
use of org.apache.hudi.table.marker.WriteMarkers in project hudi by apache.
the class FlinkCreateHandle method createMarkerFile.
@Override
protected void createMarkerFile(String partitionPath, String dataFileName) {
WriteMarkers writeMarkers = WriteMarkersFactory.get(config.getMarkersType(), hoodieTable, instantTime);
writeMarkers.createIfNotExists(partitionPath, dataFileName, getIOType());
}
Also used :
WriteMarkers(org.apache.hudi.table.marker.WriteMarkers)
Aggregations
WriteMarkers (org.apache.hudi.table.marker.WriteMarkers)11
HoodieInstant (org.apache.hudi.common.table.timeline.HoodieInstant)5
ArrayList (java.util.ArrayList)4
List (java.util.List)3
Path (org.apache.hadoop.fs.Path)3
FileSlice (org.apache.hudi.common.model.FileSlice)3
HoodieWriteConfig (org.apache.hudi.config.HoodieWriteConfig)3
HoodieTable (org.apache.hudi.table.HoodieTable)3
HashMap (java.util.HashMap)2
SparkRDDWriteClient (org.apache.hudi.client.SparkRDDWriteClient)2
HoodieTimeline (org.apache.hudi.common.table.timeline.HoodieTimeline)2
TimelineLayoutVersion (org.apache.hudi.common.table.timeline.versioning.TimelineLayoutVersion)2
IOException (java.io.IOException)1
Serializable (java.io.Serializable)1
Map (java.util.Map)1
Set (java.util.Set)1
TimeoutException (java.util.concurrent.TimeoutException)1
Function (java.util.function.Function)1
Collectors (java.util.stream.Collectors)1
Stream (java.util.stream.Stream)1
