buildkit pod timeout

[varun-vijayagopal]

We use buildx and buildkit to build images on our kubernetes cluster. At times the buildkit pod ( driver ) takes more than 2 mins to come up and this causes buildx build to fail with below

#0 building with "docker-listing-916" instance using kubernetes driver

#1 [internal] booting buildkit
#1 waiting for 1 pods to be ready
#1 waiting for 1 pods to be ready 110.0s done
#1 ERROR: expected 1 replicas to be ready, got 0

Is there a way to increase timeout or wait time for this ?

[raxod502-plaid]

According to the source code, this is hardcoded and cannot be customized. I suggest that this be fixed because it is not appropriate for this to be non-configurable.

buildx/driver/kubernetes/driver.go

Lines 98 to 120 in 1f28985

	func (d *Driver) wait(ctx context.Context) error {
	// TODO: use watch API
	var (
	err error
	depl *appsv1.Deployment
	)
	for try := 0; try < 100; try++ {
	depl, err = d.deploymentClient.Get(ctx, d.deployment.Name, metav1.GetOptions{})
	if err == nil {
	if depl.Status.ReadyReplicas >= int32(d.minReplicas) {
	return nil
	}
	err = errors.Errorf("expected %d replicas to be ready, got %d",
	d.minReplicas, depl.Status.ReadyReplicas)
	}
	select {
	case <-ctx.Done():
	return ctx.Err()
	case <-time.After(time.Duration(100+try*20) * time.Millisecond):
	}
	}
	return err
	}