-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
update to python 3.10 and scispacy 0.5.1
- Loading branch information
Showing
4 changed files
with
63 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,2 @@ | ||
**/*.whl | ||
.DS_Store |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,42 @@ | ||
FROM python:3.10-slim-buster | ||
|
||
# Temporary for local testing | ||
# | ||
# Do comment this out when pushing. it will crash the deployment | ||
# | ||
#ARG aws_access_key_id | ||
#ENV AWS_ACCESS_KEY_ID $aws_access_key_id | ||
#ARG aws_secret_access_key | ||
#ENV AWS_SECRET_ACCESS_KEY $aws_secret_access_key | ||
ENV PRODIGY_LOGGING=verbose | ||
|
||
RUN pip install --upgrade pip | ||
|
||
# install base packages | ||
RUN apt-get clean \ | ||
&& apt-get update --fix-missing \ | ||
&& apt-get install -y \ | ||
git \ | ||
curl \ | ||
gcc \ | ||
g++ \ | ||
build-essential \ | ||
wget \ | ||
awscli \ | ||
libpq-dev | ||
|
||
WORKDIR /work | ||
|
||
# copy over shell files and make them executable | ||
COPY . . | ||
RUN chmod +x * | ||
|
||
# install python dependencies | ||
RUN pip install -r requirements.in | ||
|
||
# add the code as the final step so that when we modify the code | ||
# we don't bust the cached layers holding the dependencies and | ||
# system packages. | ||
|
||
RUN chmod +rwx * | ||
CMD [ "/bin/bash" ] |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,16 @@ | ||
# MyNLP Docker | ||
|
||
Dockercontainer based on: | ||
- Python 3.10.6 | ||
- [scispacy](https://github.com/allenai/scispacy) 0.5.1 | ||
- [prodigy](https://prodi.gy/). **Note:** Wheels are required in `/prodigy-1.11.8` in the root of this repository | ||
|
||
## Build container locally | ||
|
||
``` | ||
docker build -t mynlp-p310:latest . | ||
``` | ||
|
||
## Build container for AWS | ||
|
||
TODO |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,3 @@ | ||
scispacy | ||
--find-links ./prodigy-1.11.8 prodigy | ||
https://s3-us-west-2.amazonaws.com/ai2-s2-scispacy/releases/v0.5.0/en_core_sci_md-0.5.0.tar.gz |