FAQ

When I try to compile I get an error about a missing SNAPSHOT dependency.

The error looks something like this:

[ERROR] Failed to execute goal on project kafka-connect-jdbc: Could not resolve dependencies for project
io.confluent:kafka-connect-jdbc:jar:3.1.0-SNAPSHOT: Could not find artifact 
org.apache.kafka:connect-api:jar:0.10.1.0-SNAPSHOT in confluent (http://packages.confluent.io/maven/) -> [Help 1]

During development of the JDBC connector we sometimes use a SNAPSHOT version of Kafka in order to build and test against new features. If you want to build a development version, you may need to build and install these dependencies to your local Maven repository in order to build the connector:

• Kafka - clone https://github.com/confluentinc/kafka.git and build with ./gradlew installAll
• Common - clone https://github.com/confluentinc/common and build with mvn install

Out of Memory Errors

The connector sets the JDBC fetch size to be equal to batch.max.rows. This provides a hint to the JDBC driver as to the number of rows to fetch. However, in practice, drivers may require this option to be set in conjunction with other settings to properly stream results and avoid OOM. Here are some dialects and configuration required gathered from Issue 34:

• MySQL: Attach to your JDBC connection string the parameter: ?useCursorFetch=true
• PostgreSQL: Should work out of the box
• MS SQL: Attach to connection string the parameter: ;selectMethod=cursor