Diffusion mirror of https://gitlab.wikimedia.org/toolforge-repos/grid-jobs.git
Diffusion tool-grid-jobs (master)
README.md
README.md
sge-jobs
List tools running on Toolforge Son of Grid Engine exec nodes.
Install
Clone repo and create basic files:
bastion$ become sge-jobs tools.sge-jobs@bastion:~$ mkdir -p ~/www/python tools.sge-jobs@bastion:~$ git clone https://phabricator.wikimedia.org/source/tool-grid-jobs.git ~/www/python/src
Create virtualenv inside kubernetes:
tools.sge-jobs@bastion:~$ webservice --backend=kubernetes python shell tools.sge-jobs@interactive:~$ python3 -m venv ~/www/python/venv tools.sge-jobs@interactive:~$ source ~/www/python/venv/bin/activate (venv)tools.sge-jobs@interactive:~$ pip install -U pip (venv)tools.sge-jobs@interactive:~$ pip install -r ~/www/python/src/requirements.txt
Back to bastion, start the webservice:
tools.sge-jobs@bastion:~$ webservice --backend=kubernetes python start
Creating the list is pretty expensive and we don't need it to be a real time display, so a nice thing to do is setup a cron job to collect new data once an hour:
21 * * * * jstart -N update-cache curl 'https://tools.wmflabs.org/sge-jobs/?purge'
License
[GNU GPLv3+](//www.gnu.org/copyleft/gpl.html "GNU GPLv3+")
Forked from precise-tools
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits