当试图运行Kafka源连接器时，CORRUPT_MESSAGE

Question

我试图使用以下配置运行Kafka源连接器：

{
    "name": "source-mariadb-VIEW_GIORGOS", 
    "config": { "connector.class":"io.confluent.connect.jdbc.JdbcSourceConnector", 
                "tasks.max":"10", 
                "connection.url":"jdbc:mariadb://localhost:3306/kafka?user=myuser&password=mypass", 
                "table.whitelist":"VIEW_GIORGOS", 
                "mode":"timestamp", 
                "timestamp.column.name":"ROWVERSION", 
                "validate.non.null":"false", 
                "topic.prefix":"GIORGOS-", 
                "table.types":"TABLE,VIEW", 
                "poll.interval.ms":"1000",
                "consumer.group.id":"mytopicgroup1" 
    }
}

但是Kafka Connect报告了以下错误：

WARN [Producer clientId=producer-8] Got error produce response with correlation id 1504 on topic-partition GIORGOS-VW_GIORGOS, retrying (2147483149 attempts left). 
Error: CORRUPT_MESSAGE (org.apache.kafka.clients.producer.internals.Sender:526)

Answer 1

我发现这个错误与保留政策有关。

compact策略需要键和值。由于视图没有密钥，因此消息已损坏。改变对delete的政策为我解决了这个问题。