Skip to content

Conversation

@wesm
Copy link
Member

@wesm wesm commented Jun 15, 2018

This patch provides a script for downloading all the third party dependencies to a particular location, and new environment variables that can be used to direct the build system to use local files for ExternalProject builds instead of accessing the internet.

@codecov-io
Copy link

codecov-io commented Jun 15, 2018

Codecov Report

Merging #2141 into master will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master    #2141   +/-   ##
=======================================
  Coverage   86.39%   86.39%           
=======================================
  Files         230      230           
  Lines       40701    40701           
=======================================
  Hits        35162    35162           
  Misses       5539     5539

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 884474c...4583759. Read the comment docs.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A nice improvement for this script would be to only download files that were not yet downloaded. Either by checking for their existence or by using wget -c

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there a way we can avoid duplicating version numbers and download URLs between this and the CMake files?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't care for the idea of maintaining the version numbers in two places either. I'm not sure how to get data from a file in to CMake. I have done a bit of Google searching and I can't really find anything conclusive. CMake does have rudimentary string / regular expression parsing, that's probably the only way. I will take a crack at it and put a file like thirdparty/versions.txt

Add additional needed dependencies for offline build
@wesm
Copy link
Member Author

wesm commented Jun 22, 2018

OK, I think I've addressed all the comments so far. I will improve the documentation / README and then this should be good to go

@wesm wesm changed the title WIP ARROW-902: [C++] Script for downloading all thirdparty build dependencies and configuration for offline builds ARROW-902: [C++] Script for downloading all thirdparty build dependencies and configuration for offline builds Jun 22, 2018
@wesm
Copy link
Member Author

wesm commented Jun 22, 2018

This should be ready to go once I get the build passing

@wesm
Copy link
Member Author

wesm commented Jun 23, 2018

+1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants