christianlight/tutor
6
0
Fork 0
mirror of https://github.com/ChristianLight/tutor.git synced 2024-11-16 01:57:16 +00:00
Code Issues Releases Activity
9db0e59ae7
tutor/openedx/Dockerfile

113 lines
5.6 KiB
Docker
Raw Normal View History

:sunrise:
2017-07-03 10:39:19 +00:00
FROM ubuntu:16.04
Multiple improvements, including Ginkgo compatibility Docker stack now includes a studio, smtp server, rabbitmq container and an LMS worker. There are still a couple things to do, though. (see TODOs)
2017-07-24 09:32:50 +00:00
############ common to lms & cms
:sunrise:
2017-07-03 10:39:19 +00:00
# Install system requirements
Working stack: still some bugs to fix
2017-12-26 00:16:35 +00:00
RUN apt update && \
apt upgrade -y && \
# Global requirements
apt install -y language-pack-en git python-virtualenv build-essential software-properties-common curl git-core libxml2-dev libxslt1-dev python-pip libmysqlclient-dev python-apt python-dev libxmlsec1-dev libfreetype6-dev swig gcc g++ && \
No longer refer to 'edxapp' 'edxapp' is an old reference to the vagrant image and it does not make much sense.
2018-04-12 13:45:59 +00:00
# openedx requirements
hawthorn.1 release From a deployment perspective, this release comes with an upgrade of the cs_comments_service (forums) and a change to the logging configuration.
2018-04-21 10:41:04 +00:00
apt install -y gettext gfortran graphviz graphviz-dev libffi-dev libfreetype6-dev libgeos-dev libjpeg8-dev liblapack-dev libpng12-dev libsqlite3-dev libxml2-dev libxmlsec1-dev libxslt1-dev nodejs npm ntp pkg-config && \
Working stack: still some bugs to fix
2017-12-26 00:16:35 +00:00
# Our requirements
apt install -y mysql-client
:sunrise:
2017-07-03 10:39:19 +00:00
# Install symlink so that we have access to 'node' binary without virtualenv.
# This replaces the "nodeenv" install.
RUN apt install -y nodejs-legacy
Package static assets inside the openedx image This allows us to deploy much faster: all we have to do is to copy the assets from the container to the shared volume. We also changed the way themes are managed: similarly to static assets, they are now packaged inside the docker image.
2018-12-07 18:30:30 +00:00
# Dockerize will be useful to wait for mysql DB availability
ENV DOCKERIZE_VERSION v0.6.1
RUN curl -L -o /tmp/dockerize.tar.gz https://github.com/jwilder/dockerize/releases/download/$DOCKERIZE_VERSION/dockerize-linux-amd64-$DOCKERIZE_VERSION.tar.gz \
&& tar -C /usr/local/bin -xzvf /tmp/dockerize.tar.gz \
&& rm /tmp/dockerize.tar.gz
Enable customized themes This makes assets collection faster because we no longer compile assets from the themes bundled with edx-platform. Close #88
2018-11-28 18:57:17 +00:00
# Static assets will reside in /openedx/data, themes in /openedx/themes and
# edx-platform will be checked-out in /openedx/
RUN mkdir /openedx /openedx/data /openedx/themes /openedx/edx-platform
:sunrise:
2017-07-03 10:39:19 +00:00
WORKDIR /openedx/edx-platform
Working stack: still some bugs to fix
2017-12-26 00:16:35 +00:00
## Checkout edx-platform code
Working devstack This allows the user to run their own devstack inside the containers. Yay! Also, we handle file permissions cleanly: in docker-entrypoint.sh we chmod the data and edx-platform files to the same UID of the user on the host machine. No more permission headaches!
2018-04-09 17:16:58 +00:00
ARG EDX_PLATFORM_REPOSITORY=https://github.com/edx/edx-platform.git
Upgrade to hawthorn.2
2018-10-02 06:36:29 +00:00
ARG EDX_PLATFORM_VERSION=open-release/hawthorn.2
Working devstack This allows the user to run their own devstack inside the containers. Yay! Also, we handle file permissions cleanly: in docker-entrypoint.sh we chmod the data and edx-platform files to the same UID of the user on the host machine. No more permission headaches!
2018-04-09 17:16:58 +00:00
RUN git clone $EDX_PLATFORM_REPOSITORY --branch $EDX_PLATFORM_VERSION --depth 1 .
:sunrise:
2017-07-03 10:39:19 +00:00
Package static assets inside the openedx image This allows us to deploy much faster: all we have to do is to copy the assets from the container to the shared volume. We also changed the way themes are managed: similarly to static assets, they are now packaged inside the docker image.
2018-12-07 18:30:30 +00:00
# Download extra locales to /openedx/locale
RUN cd /tmp \
&& curl -L -o openedx-i18n.tar.gz https://github.com/regisb/openedx-i18n/archive/hawthorn.tar.gz \
&& tar xzf /tmp/openedx-i18n.tar.gz \
&& mv openedx-i18n-hawthorn/edx-platform/locale/ /openedx/ \
&& rm -rf openedx-i18n*
# Copy convenient scripts
COPY ./bin/docker-entrypoint.sh /usr/local/bin/
Working devstack This allows the user to run their own devstack inside the containers. Yay! Also, we handle file permissions cleanly: in docker-entrypoint.sh we chmod the data and edx-platform files to the same UID of the user on the host machine. No more permission headaches!
2018-04-09 17:16:58 +00:00
# Install python requirements (clone source repos in a separate dir, otherwise
# will be overwritten when we mount edx-platform)
Prevent package uninstall in openedx image The `update_assets` paver task of the lms/cms attempt to manually uninstall some old packages. We should not concern ourselves by this, since all requirements are installed from scratch in every docker image. Close #73.
2018-10-01 17:18:01 +00:00
ENV NO_PYTHON_UNINSTALL 1
Working devstack This allows the user to run their own devstack inside the containers. Yay! Also, we handle file permissions cleanly: in docker-entrypoint.sh we chmod the data and edx-platform files to the same UID of the user on the host machine. No more permission headaches!
2018-04-09 17:16:58 +00:00
RUN pip install --src ../venv/src -r requirements/edx/base.txt
Install dev requirements in open edx image Development environment crashes on missing debug_toolbar if we don't install development requirements.
2018-08-27 20:40:44 +00:00
RUN pip install --src ../venv/src -r requirements/edx/development.txt
:sunrise:
2017-07-03 10:39:19 +00:00
Local filesystem storage for ORA2 uploads By default, open response assessment files are sent to S3. Here, we store uploaded files with the "filesystem" backend instead. To do so, we must install a forked version of ora2 that fixes a couple issues. Note that the "django" backend is not very usable, as file extensions are lost on upload. Close #97
2018-11-20 10:24:52 +00:00
# Install patched version of ora2
Fix ora2 uninstall prior to re-install
2018-11-25 21:24:25 +00:00
RUN pip uninstall -y ora2 && \
pip install --src ../venv/src git+https://github.com/regisb/edx-ora2.git@open-release/hawthorn.2#egg=ora2==2.1.17
Local filesystem storage for ORA2 uploads By default, open response assessment files are sent to S3. Here, we store uploaded files with the "filesystem" backend instead. To do so, we must install a forked version of ora2 that fixes a couple issues. Note that the "django" backend is not very usable, as file extensions are lost on upload. Close #97
2018-11-20 10:24:52 +00:00
Remove redundancy in dependency install Full dependency install is replaced by just nodejs dependency install, which should considerably accelerate the build step. This closes #2. Kudos to @sampaccoud for suggesting this!
2018-02-07 07:22:04 +00:00
# Install nodejs requirements
Faster "npm install" This should shave a few minutes per build.
2018-12-08 19:02:45 +00:00
RUN npm set progress=false \
&& npm install
hawthorn.1 release From a deployment perspective, this release comes with an upgrade of the cs_comments_service (forums) and a change to the logging configuration.
2018-04-21 10:41:04 +00:00
ENV PATH ./node_modules/.bin:${PATH}
:sunrise:
2017-07-03 10:39:19 +00:00
Package static assets inside the openedx image This allows us to deploy much faster: all we have to do is to copy the assets from the container to the shared volume. We also changed the way themes are managed: similarly to static assets, they are now packaged inside the docker image.
2018-12-07 18:30:30 +00:00
# Install private requirements: this is useful for installing custom xblocks.
# In particular, to install xblocks from a private repository, clone the
# respositories to ./requirements on the host and add `-e ./myxblock/` to
# ./requirements/private.txt.
COPY ./requirements/ /openedx/requirements
RUN touch /openedx/requirements/private.txt \
&& pip install --src ../venv/src -r /openedx/requirements/private.txt
Fix assets generation in development webpack requires the NODE_ENV environment variable which is incorrectly set "paver update_assets" in development mode. To avoid this issue, we split update_assets into its subparts.
2018-11-20 10:24:34 +00:00
Download, don't build Images are no longer built locally, Instead, they are downloaded from docker hub. This completely changes config file organisation. In particular, we no longer copy configuration files to the original docker image.
2018-05-16 17:02:44 +00:00
# Link configuration files to common /openedx/config folder, which should later
# be mounted as a volume. Note that this image will not be functional until
# config files have been mounted inside the container
Package static assets inside the openedx image This allows us to deploy much faster: all we have to do is to copy the assets from the container to the shared volume. We also changed the way themes are managed: similarly to static assets, they are now packaged inside the docker image.
2018-12-07 18:30:30 +00:00
RUN mkdir -p /openedx/config/universal/lms /openedx/config/universal/cms \
&& ln -s /openedx/config/universal/lms/ /openedx/edx-platform/lms/envs/universal \
&& ln -s /openedx/config/universal/cms/ /openedx/edx-platform/cms/envs/universal \
&& ln -s /openedx/config/lms.env.json /openedx/ \
&& ln -s /openedx/config/cms.env.json /openedx/ \
&& ln -s /openedx/config/lms.auth.json /openedx/ \
&& ln -s /openedx/config/cms.auth.json /openedx/
COPY settings/lms/*.py /openedx/config/universal/lms/
COPY settings/cms/*.py /openedx/config/universal/cms/
# Collect production assets. By default, only assets from the default theme
# will be processed. This makes the docker image lighter and faster to build.
# To compile assets from other themes, build the image with the THEMES
# argument: THEMES=dark-theme,edx.org
# Custom themes added to /openedx/themes can also be compiled.
# Here, we don't run "paver update_assets" which is slow, compiles all themes
# and requires a complex settings file. Instead, we decompose the commands
# and run each one individually to collect the production static assets to
# /openedx/data/staticfiles.
# 1. xmodule_assets: run xmodule.static_content.main, which lists all xblocks and generates webpack manifest in common/static/xmodule
# 2. pavelib.assets.process_npm_assets: copy libraries installed via npm to common/static/common/*/vendor
# 3. webpack: generate webpack-stats.json
# 4. compile_sass: compile each sass file individually with libsass.
# 5. pavelib.assets.collect_assets: run ./manage.py lms/cms collectstatic. This is the only command that requires a settings file.
RUN xmodule_assets common/static/xmodule \
&& python -c "import pavelib.assets; pavelib.assets.process_npm_assets()" \
&& STATIC_ROOT_LMS=/openedx/data/staticfiles STATIC_ROOT_CMS=/openedx/data/staticfiles/studio NODE_ENV=production ./node_modules/.bin/webpack --config=webpack.prod.config.js
ARG THEMES=open-edx
COPY ./themes/ /openedx/themes/
RUN paver compile_sass --theme-dirs=/openedx/edx-platform/themes,/openedx/themes --themes=$THEMES \
&& python -c "import pavelib.assets; pavelib.assets.collect_assets(['lms', 'cms'], 'universal.assets')"
:sunrise:
2017-07-03 10:39:19 +00:00
Working stack: still some bugs to fix
2017-12-26 00:16:35 +00:00
# service variant is "lms" or "cms"
Working devstack This allows the user to run their own devstack inside the containers. Yay! Also, we handle file permissions cleanly: in docker-entrypoint.sh we chmod the data and edx-platform files to the same UID of the user on the host machine. No more permission headaches!
2018-04-09 17:16:58 +00:00
ENV SERVICE_VARIANT lms
Download, don't build Images are no longer built locally, Instead, they are downloaded from docker hub. This completely changes config file organisation. In particular, we no longer copy configuration files to the original docker image.
2018-05-16 17:02:44 +00:00
ENV SETTINGS universal.production
Working stack: still some bugs to fix
2017-12-26 00:16:35 +00:00
Package static assets inside the openedx image This allows us to deploy much faster: all we have to do is to copy the assets from the container to the shared volume. We also changed the way themes are managed: similarly to static assets, they are now packaged inside the docker image.
2018-12-07 18:30:30 +00:00
# Entrypoint will fix permissions of all files and run commands as openedx
Working devstack This allows the user to run their own devstack inside the containers. Yay! Also, we handle file permissions cleanly: in docker-entrypoint.sh we chmod the data and edx-platform files to the same UID of the user on the host machine. No more permission headaches!
2018-04-09 17:16:58 +00:00
ENTRYPOINT ["docker-entrypoint.sh"]
:sunrise:
2017-07-03 10:39:19 +00:00
# Run server
EXPOSE 8000
Multiple improvements, including Ginkgo compatibility Docker stack now includes a studio, smtp server, rabbitmq container and an LMS worker. There are still a couple things to do, though. (see TODOs)
2017-07-24 09:32:50 +00:00
CMD gunicorn --name ${SERVICE_VARIANT} --bind=0.0.0.0:8000 --max-requests=1000 ${SERVICE_VARIANT}.wsgi:application
Copy Permalink