Go Dcp Client

This repository contains go implementation of a Couchbase Database Change Protocol (DCP) client.

Contents

• Why?
• Usage
• Configuration
• Examples

Why?

• Our main goal is to build a dcp client for faster and stateful systems. We're already using this repository in below implementations:
  • Elastic Connector
  • Kafka Connector

Example

package main

import (
	"log"

	"github.com/Trendyol/go-dcp-client"

	"github.com/Trendyol/go-dcp-client/models"
)

func listener(ctx *models.ListenerContext) {
	switch event := ctx.Event.(type) {
	case models.DcpMutation:
		log.Printf("mutated(vb=%v) | id: %v, value: %v | isCreated: %v", event.VbID, string(event.Key), string(event.Value), event.IsCreated())
	case models.DcpDeletion:
		log.Printf("deleted(vb=%v) | id: %v", event.VbID, string(event.Key))
	case models.DcpExpiration:
		log.Printf("expired(vb=%v) | id: %v", event.VbID, string(event.Key))
	}

	ctx.Ack()
}

func main() {
	dcp, err := godcpclient.NewDcp("config.yml", listener)
	if err != nil {
		panic(err)
	}

	defer dcp.Close()

	dcp.Start()
}

Usage

$ go get github.com/Trendyol/go-dcp-client

Configuration

Variable	Type	Is Required
hosts	array	yes
username	string	yes
password	string	yes
bucketName	string	yes
scopeName	string	no
collectionNames	array	no
metadataBucket	string	no
dcp.bufferSizeKb	integer	no
dcp.listener.bufferSize	integer	no
dcp.group.name	string	yes
dcp.group.membership.type	string	yes
dcp.group.membership.memberNumber	integer	no
dcp.group.membership.totalMembers	integer	no
api.port	integer	no
metric.averageWindowSec	float	no
metric.enabled	boolean (true/false)	no
metric.path	string	no
leaderElection.enabled	boolean (true/false)	no
leaderElection.type	string	no
leaderElection.config	string/string key value map	no
leaderElection.rpc.port	integer	no
logger.level	string	no
checkpoint.type	string	no
checkpoint.interval	integer	no
checkpoint.timeout	integer	no
healthCheck.interval	integer	no
healthCheck.timeout	integer	no

Examples

• example with static membership
• static membership config
• kubernetesStatefulSet membership config
• kubernetesHa membership config
• couchbase membership config - thanks to @onursak