基于apache flink的流处理(flink版本)

Apache Flink 社区非常高兴地宣布了 Apache Flink 1.14.4 发布了，这是 Apache Flink 1.14 的第三个 bugfix 版本.

这个版本修复了 51 个 bug 和漏洞，并对 Flink 1.14 进行了小的改进。下面是所有 bug 修复和改进的列表(不包括对构建基础结构和构建稳定性的改进)。有关所有更改的完整列表，请参阅: JIRA

我们强烈建议所有用户升级到 Flink 1.14.4。

  org.apache.flink
  flink-java
  1.14.4


  org.apache.flink
  flink-streaming-java_2.11
  1.14.4


  org.apache.flink
  flink-clients_2.11
  1.14.4

您可以在更新下载页面上找到二进制文件 Downloads page.

library/flink (official images)

apache/flink (ASF repository)

apache-flink==1.14.4

[Flink-21788] - Throw PartitionNotFoundException if the partition file has been lost for blocking shuffle

[Flink-24954] - Reset read buffer request timeout on buffer recycling for sort-shuffle

[Flink-25653] - Move buffer recycle in SortMergeSubpartitionReader out of lock to avoid deadlock

[Flink-25654] - Remove the redundant lock in SortMergeResultPartition

[Flink-25879] - Track used search terms in Matomo

[Flink-25880] - Implement Matomo in Flink documentation

[Flink-21752] - NullPointerException on restore in PojoSerializer

[Flink-23946] - Application mode fails fatally when being shut down

[Flink-24334] - Configuration kubernetes.flink.log.dir not working

[Flink-24407] - Pulsar connector chinese document link to Pulsar document location incorrectly.

[Flink-24607] - SourceCoordinator may miss to close SplitEnumerator when failover frequently

[Flink-25171] - When the DDL statement was executed, the column names of the Derived Columns were not validated

[Flink-25199] - StreamEdges are not unique in self-union, which blocks propagation of watermarks

[Flink-25362] - Incorrect dependencies in Table Confluent/Avro docs

[Flink-25407] - Network stack deadlock when cancellation happens during initialisation

[Flink-25466] - TTL configuration could parse in StateTtlConfig#DISABLED

[Flink-25486] - Perjob can not recover from checkpoint when zookeeper leader changes

[Flink-25494] - Duplicate element serializer during DefaultOperatorStateBackendSnapshotStrategy#syncPrepareResources

[Flink-25678] - TaskExecutorStateChangelogStoragesManager.shutdown is not thread-safe

[Flink-25683] - wrong result if table transfrom to DataStream then window process in batch mode

[Flink-25728] - Potential memory leaks in StreamMultipleInputProcessor

[Flink-25732] - Dispatcher#requestMultipleJobDetails returns non-serialiable collection

[Flink-25827] - Potential memory leaks in SourceOperator

[Flink-25856] - Fix use of UserDefinedType in from_elements

[Flink-25883] - The value of DEFAULT_BUNDLE_PROCESSOR_CACHE_SHUTDOWN_THRESHOLD_S is too large

[Flink-25893] - ResourceManagerServiceImpl's lifecycle can lead to exceptions

[Flink-25952] - Savepoint on S3 are not relocatable even if entropy injection is not enabled

[Flink-26039] - Incorrect value getter in map unnest table function

[Flink-26159] - Pulsar Connector: should add description MAX_FETCH_RECORD in doc to explain slow consumption

[Flink-26160] - Pulsar Connector: stopCursor description should be changed. Connector only stop when auto discovery is disabled.

[Flink-26187] - Chinese docs override english aliases

[Flink-26304] - GlobalCommitter can receive failed committables

[Flink-20188] - Add documentation for new File Source

[Flink-21407] - Clarify which sources and APIs support which formats

[Flink-20830] - Add a type of HEADLESS_CLUSTER_IP for rest service type

[Flink-24880] - Error messages "OverflowError: timeout value is too large" shown when executing PyFlink jobs

[Flink-25160] - Make doc clear: tolerable-failed-checkpoints counts consecutive failures

[Flink-25611] - Remove CoordinatorExecutorThreadFactory thread creation guards

[Flink-25650] - document unaligned checkpoints performance limitations (larger records/flat map/timers/...)

[Flink-25767] - Translation of page 'Working with State' is incomplete

[Flink-25818] - Add explanation how Kafka Source deals with idleness when parallelism is higher then the number of partitions

[Flink-25576] - Update com.h2database:h2 to 2.0.206

[Flink-25785] - Update com.h2database:h2 to 2.0.210