Skip to content

MySQL CDC sync fails due to zero date in the source #81630

Description

@SteZe85

Connector Name

source-mysql

Connector Version

3.53.0

What step the error happened?

During the sync

Relevant information

Our MySQL CDC connector (source-mysql, Percona Server 5.7.41-44-log) repeatedly crashes during binlog streaming when it encounters a MySQL zero-date value (0000-00-00 00:00:00)

I found this related PR: #78084

Relevant log output

"internalMessage" : "org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped.",
"externalMessage" : "MySQL Connector Error: The sync encountered an unexpected error in the change event producer and has stopped. Please check the logs for details and troubleshoot accordingly.\nhttps://docs.oracle.com/javase/9/docs/api/java/lang/RuntimeException.html",

Caused by: org.apache.kafka.connect.errors.ConnectException: Error while processing event at offset {ts_sec=1783634723, file=mysql-bin.000678, pos=820639837, row=1, server_id=10, event=2}
Caused by: org.apache.kafka.connect.errors.DataException: Invalid value: null used for required field: "date_added", schema type: STRING
	at org.apache.kafka.connect.data.ConnectSchema.validateValue(ConnectSchema.java:224)
	at org.apache.kafka.connect.data.Struct.validate(Struct.java:233)
	at org.apache.kafka.connect.data.Struct.put(Struct.java:216)
	at io.debezium.data.Envelope.update(Envelope.java:308)
	at io.debezium.relational.RelationalChangeRecordEmitter.emitUpdateRecord(RelationalChangeRecordEmitter.java:123)
	at io.debezium.pipeline.EventDispatcher.dispatchDataChangeEvent(EventDispatcher.java:281)

Contribute

  • Yes, I want to contribute

Internal Tracking: https://github.com/airbytehq/oncall/issues/12600

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions