build: add containerized building

[tisonkun]

This PR fixes apache/pulsar#20272

• doc
• doc-required
• doc-not-needed
• doc-complete

cc @visortelle @asafm welcome to test in your env:

docker-compose up

... should simply work and you can browse at http://localhost:3000/

[tisonkun]

Still, we need .build-versions.json to specify build versions. I'm preparing a patch to use environment variable so that we can easily integrate it in the containerized building process.

[visortelle]

Confirm, it works.

[visortelle]

Maybe it has sense to implement full build process with Docker?

Let's say, I have such a problem in Python script that runs yarn install:

https://github.com/apache/pulsar-site/actions/runs/4979344185/jobs/8911494860

I'm not sure how I can debug it locally.

The current Docker setup doesn't have any mention of Python, poetry package manager, etc.

[tisonkun]

@visortelle I think of it just now. Let me try it out.

[tisonkun]

@visortelle For the specific issue, maybe try out yarn install to see if any errors?

There are too much legacy scripts logic that need some time to migrate..

[visortelle]

@tisonkun I tried locally. No changes in yarn.lock.
Will set up GitHub Actions for this branch in my fork.

[visortelle]

@tisonkun by the way, I used another command to run child process, and now I at least see the concrete error message cannot find module 'replace-in-files'.

import subprocess

...

def run_command(command):
    process = subprocess.Popen(command, stdout=subprocess.PIPE, stderr=subprocess.PIPE, shell=True)
    stdout, stderr = process.communicate()

    if stdout:
        print("STDOUT:")
        print(stdout.decode('utf-8'))
    if stderr:
        print("STDERR:")
        print(stderr.decode('utf-8'))

...

run_command('yarn install')

https://github.com/tealtools/pulsar-site-pip-249/actions/runs/4980539690/jobs/8913580517

Maybe the run command's logging should be also improved.

[tisonkun]

Let's discuss in your fork. It's unrelated to this PR or the upstream code.

Basically, you need to run yarn install before any other command. It looks like your run node scripts/replace.js before yarn install - the script is another tech debt.

[tisonkun]

I'll merge this patch first. Further improvement can be done later. I'll try to directly push some fix on the PIP-249 branch.

[asafm]

Works great!
Thanks!