Jupyterlab on 静静的安全笔记

Jupyterlab 配置 Latex 环境

Sat, 29 Feb 2020 14:34:55 +0000

1docker exec -it jupytercgmsabefcn bash
2apt install texlive-full
3pip install jupyterlab_latex
4jupyter serverextension enable --sys-prefix jupyterlab_latex
5jupyter labextension install @jupyterlab/latex

在jupyter_notebook_config.py文件里添加一句话实现PdfLaTex模式编译：

1c.LatexConfig.latex_command = 'pdflatex'

自定义LaTex的编译模式，默认是XeLaTex模式。效果如图，不过只能编译简单的一些包，还有字体缺失的问题存在。

完整 jupyter 镜像已上传至阿里云，拉取命令如下：

1docker pull registry.cn-shanghai.aliyuncs.com/bugatii100peagle/jupytercgmsabefcnlatex:v1.1

full 包是默认安装中文 cjk 包的，如下：

 1After this operation, 3,546 MB of additional disk space will be used.
 2
 3 The following additional packages will be installed:
 4 aglfn asymptote asymptote-doc biber blt chktex cm-super cm-super-minimal context context-modules dvidvi dvipng feynmf
 5 fonts-adf-accanthis fonts-adf-berenis fonts-adf-gillius fonts-adf-universalis fonts-arphic-bkai00mp fonts-arphic-bsmi00lp
 6 fonts-arphic-gbsn00lp fonts-arphic-gkai00mp fonts-baekmuk fonts-cabin fonts-comfortaa fonts-croscore
 7 fonts-crosextra-caladea fonts-crosextra-carlito fonts-ebgaramond fonts-ebgaramond-extra fonts-font-awesome
 8 fonts-freefont-otf fonts-freefont-ttf fonts-gfs-artemisia fonts-gfs-baskerville fonts-gfs-bodoni-classic
 9 fonts-gfs-complutum fonts-gfs-didot fonts-gfs-didot-classic fonts-gfs-gazis fonts-gfs-neohellenic fonts-gfs-olga
 10 fonts-gfs-porson fonts-gfs-solomos fonts-gfs-theokritos fonts-go fonts-hosny-amiri fonts-ipaexfont-gothic
 11 fonts-ipaexfont-mincho fonts-ipafont-gothic fonts-ipafont-mincho fonts-junicode fonts-lato fonts-linuxlibertine
 12 fonts-lobster fonts-lobstertwo fonts-noto-hinted fonts-noto-mono fonts-oflb-asana-math fonts-open-sans fonts-roboto-hinted
 13 fonts-sil-gentium fonts-sil-gentium-basic fonts-sil-gentiumplus fonts-sil-gentiumplus-compact fonts-sil-padauk fonts-stix
 14 fonts-texgyre fonts-unfonts-core fonts-unfonts-extra fragmaster freeglut3 ghostscript gsfonts imagemagick imagemagick-6.q16
 15 info javascript-common lacheck latex-cjk-all latex-cjk-chinese latex-cjk-chinese-arphic-bkai00mp
 16 latex-cjk-chinese-arphic-bsmi00lp latex-cjk-chinese-arphic-gbsn00lp latex-cjk-chinese-arphic-gkai00mp latex-cjk-common
 17 latex-cjk-japanese latex-cjk-japanese-wadalab latex-cjk-korean latex-cjk-thai latexdiff latexmk lcdf-typetools
 18 libalgorithm-c3-perl libauthen-sasl-perl libautovivification-perl libb-hooks-endofscope-perl libb-hooks-op-check-perl
 19 libbtparse1 libbusiness-isbn-data-perl libbusiness-isbn-perl libbusiness-ismn-perl libbusiness-issn-perl
 20 libclass-accessor-perl libclass-c3-perl libclass-c3-xs-perl libclass-data-inheritable-perl libclass-factory-util-perl
 21 libclass-inspector-perl libclass-method-modifiers-perl libclass-singleton-perl libdata-compare-perl libdata-dump-perl
 22 libdata-optlist-perl libdata-uniqid-perl libdate-simple-perl libdatetime-calendar-julian-perl
 23 libdatetime-format-builder-perl libdatetime-format-strptime-perl libdatetime-locale-perl libdatetime-perl
 24 libdatetime-timezone-perl libdevel-callchecker-perl libdevel-caller-perl libdevel-globaldestruction-perl
 25 libdevel-lexalias-perl libdevel-stacktrace-perl libdist-checkconflicts-perl libdjvulibre-text libdjvulibre21
 26 libdouble-conversion1 libdynaloader-functions-perl libegl-mesa0 libegl1 libemail-date-format-perl libemf1
 27 libencode-eucjpms-perl libencode-hanextra-perl libencode-jis2k-perl libencode-locale-perl libeval-closure-perl libevdev2
 28 libexception-class-perl libexporter-tiny-perl libfile-find-rule-perl libfile-homedir-perl libfile-listing-perl
 29 libfile-sharedir-perl libfile-slurper-perl libfile-which-perl libfont-afm-perl libfontenc1 libgbm1 libgirara-gtk3-3
 30 libglapi-mesa libglu1-mesa libglx-mesa0 libgs9 libgs9-common libgudev-1.0-0 libhtml-form-perl libhtml-format-perl
 31 libhtml-parser-perl libhtml-tagset-perl libhtml-tree-perl libhttp-cookies-perl libhttp-daemon-perl libhttp-date-perl
 32 libhttp-message-perl libhttp-negotiate-perl libilmbase12 libinput-bin libinput10 libio-html-perl libio-socket-ssl-perl
 33 libipc-run3-perl libipc-shareable-perl libjs-jquery libjson-c3 liblingua-translit-perl liblist-allutils-perl
 34 liblist-moreutils-perl liblist-someutils-perl liblist-utilsby-perl libllvm9 liblog-dispatch-perl liblog-log4perl-perl
 35 liblwp-mediatypes-perl liblwp-protocol-https-perl libmagic-mgc libmagic1 libmagickcore-6.q16-3-extra libmail-sendmail-perl
 36 libmailtools-perl libmime-charset-perl libmime-lite-perl libmime-types-perl libmodule-implementation-perl
 37 libmodule-runtime-perl libmro-compat-perl libmtdev1 libnamespace-autoclean-perl libnamespace-clean-perl libnet-http-perl
 38 libnet-libidn-perl libnet-smtp-ssl-perl libnet-ssleay-perl libnetpbm10 libnotify4 libnumber-compare-perl libopenexr22
 39 libosmesa6 libosp5 libostyle1c2 libpackage-deprecationmanager-perl libpackage-stash-perl libpackage-stash-xs-perl
 40 libpadwalker-perl libparams-classify-perl libparams-util-perl libparams-validate-perl libparams-validationcompiler-perl
 41 libperlio-utf8-strict-perl libplot2c2 libpoppler-qt5-1 libpstoedit0c2a libqt5core5a libqt5dbus5 libqt5gui5 libqt5network5
 42 libqt5svg5 libqt5widgets5 libqt5xml5 libreadonly-perl libref-util-perl libref-util-xs-perl libregexp-common-perl
 43 librole-tiny-perl libruby2.5 libscalar-list-utils-perl libsigsegv2 libsombok3 libsort-key-perl libspecio-perl
 44 libsub-exporter-perl libsub-exporter-progressive-perl libsub-identify-perl libsub-install-perl libsub-name-perl
 45 libsub-quote-perl libsys-hostname-long-perl libtcl8.6 libtext-bibtex-perl libtext-csv-perl libtext-csv-xs-perl
 46 libtext-glob-perl libtext-roman-perl libtext-unidecode-perl libtie-cycle-perl libtimedate-perl libtk8.6 libtry-tiny-perl
 47 libunicode-collate-perl libunicode-linebreak-perl liburi-perl libutempter0 libvariable-magic-perl libwacom-bin
 48 libwacom-common libwacom2 libwayland-server0 libwebpdemux2 libwmf0.2-7 libwww-perl libwww-robotrules-perl libxcb-icccm4
 49 libxcb-image0 libxcb-keysyms1 libxcb-randr0 libxcb-render-util0 libxcb-util1 libxcb-xinerama0 libxcb-xkb1
 50 libxkbcommon-x11-0 libxml-libxml-perl libxml-libxml-simple-perl libxml-libxslt-perl libxml-namespacesupport-perl
 51 libxml-parser-perl libxml-sax-base-perl libxml-sax-expat-perl libxml-sax-perl libxml-writer-perl libxmuu1 libxtst6
 52 libxxf86dga1 libyaml-tiny-perl libzip4 netbase netpbm notification-daemon openjade perl-openssl-defaults pfb2t1c2pfb prerex
 53 ps2eps pstoedit psutils purifyeps python3-olefile python3-pil python3-pil.imagetk python3-tk qt5-gtk-platformtheme
 54 qttranslations5-l10n rake ruby ruby-did-you-mean ruby-minitest ruby-net-telnet ruby-power-assert ruby-test-unit ruby2.5
 55 rubygems-integration sgml-base tex-gyre texinfo texlive-bibtex-extra texlive-extra-utils texlive-font-utils
 56 texlive-fonts-extra-doc texlive-fonts-extra-links texlive-fonts-recommended-doc texlive-formats-extra texlive-games
 57 texlive-humanities texlive-humanities-doc texlive-lang-arabic texlive-lang-chinese texlive-lang-cjk texlive-lang-cyrillic
 58 texlive-lang-czechslovak texlive-lang-english texlive-lang-european texlive-lang-french texlive-lang-german
 59 texlive-lang-greek texlive-lang-italian texlive-lang-japanese texlive-lang-korean texlive-lang-other texlive-lang-polish
 60 texlive-lang-portuguese texlive-lang-spanish texlive-latex-base-doc texlive-latex-extra-doc texlive-latex-recommended-doc
 61 texlive-luatex texlive-metapost texlive-metapost-doc texlive-music texlive-pictures-doc texlive-pstricks
 62 texlive-pstricks-doc texlive-publishers texlive-publishers-doc texlive-science texlive-science-doc tk8.6-blt2.5 vprerex
 63 x11-utils xbitmaps xterm zathura zathura-pdf-poppler zip
 64Suggested packages:
 65 gv blt-demo perl-tk fontforge context-nonfree context-doc-nonfree ghostscript-x imagemagick-doc autotrace cups-bsd | lpr
 66 | lprng curl enscript gimp gnuplot graphviz groff-base hp2xx html2ps libwmf-bin mplayer povray radiance sane-utils transfig
 67 ufraw-batch texinfo-doc-nonfree apache2 | lighttpd | httpd auctex hbf-cns40-b5 hbf-jfs56 hbf-kanji48 libdigest-hmac-perl
 68 libgssapi-perl libgd-barcode-perl libscalar-properties-perl libdbd-csv-perl liblog-dispatch-filerotate-perl librrds-perl
 69 libxml-dom-perl libcrypt-ssleay-perl file libjxr-tools libpod2-base-perl default-mta | mail-transport-agent
 70 libmojolicious-perl libscalar-number-perl qt5-image-formats-plugins qtwayland5 libtest-fatal-perl tcl8.6 tk8.6
 71 libwmf0.2-7-gtk libauthen-ntlm-perl doc-base sgml-data xfig | ivtools-bin | tgif | transfig python-pil-doc python3-pil-dbg
 72 python3-pil.imagetk-dbg tix python3-tk-dbg ri ruby-dev bundler sgml-base-doc xindy mesa-utils xfonts-cyrillic www-browser
 73 zathura-ps zathura-djvu zathura-cb
 74Recommended packages:
 75 fonts-freefont fonts-droid-fallback
 76The following NEW packages will be installed:
 77 aglfn asymptote asymptote-doc biber blt chktex cm-super cm-super-minimal context context-modules dvidvi dvipng feynmf
 78 fonts-adf-accanthis fonts-adf-berenis fonts-adf-gillius fonts-adf-universalis fonts-arphic-bkai00mp fonts-arphic-bsmi00lp
 79 fonts-arphic-gbsn00lp fonts-arphic-gkai00mp fonts-baekmuk fonts-cabin fonts-comfortaa fonts-croscore
 80 fonts-crosextra-caladea fonts-crosextra-carlito fonts-ebgaramond fonts-ebgaramond-extra fonts-font-awesome
 81 fonts-freefont-otf fonts-freefont-ttf fonts-gfs-artemisia fonts-gfs-baskerville fonts-gfs-bodoni-classic
 82 fonts-gfs-complutum fonts-gfs-didot fonts-gfs-didot-classic fonts-gfs-gazis fonts-gfs-neohellenic fonts-gfs-olga
 83 fonts-gfs-porson fonts-gfs-solomos fonts-gfs-theokritos fonts-go fonts-hosny-amiri fonts-ipaexfont-gothic
 84 fonts-ipaexfont-mincho fonts-ipafont-gothic fonts-ipafont-mincho fonts-junicode fonts-lato fonts-linuxlibertine
 85 fonts-lobster fonts-lobstertwo fonts-noto-hinted fonts-noto-mono fonts-oflb-asana-math fonts-open-sans fonts-roboto-hinted
 86 fonts-sil-gentium fonts-sil-gentium-basic fonts-sil-gentiumplus fonts-sil-gentiumplus-compact fonts-sil-padauk fonts-stix
 87 fonts-texgyre fonts-unfonts-core fonts-unfonts-extra fragmaster freeglut3 ghostscript gsfonts imagemagick imagemagick-6.q16
 88 info javascript-common lacheck latex-cjk-all latex-cjk-chinese latex-cjk-chinese-arphic-bkai00mp
 89 latex-cjk-chinese-arphic-bsmi00lp latex-cjk-chinese-arphic-gbsn00lp latex-cjk-chinese-arphic-gkai00mp latex-cjk-common
 90 latex-cjk-japanese latex-cjk-japanese-wadalab latex-cjk-korean latex-cjk-thai latexdiff latexmk lcdf-typetools
 91 libalgorithm-c3-perl libauthen-sasl-perl libautovivification-perl libb-hooks-endofscope-perl libb-hooks-op-check-perl
 92 libbtparse1 libbusiness-isbn-data-perl libbusiness-isbn-perl libbusiness-ismn-perl libbusiness-issn-perl
 93 libclass-accessor-perl libclass-c3-perl libclass-c3-xs-perl libclass-data-inheritable-perl libclass-factory-util-perl
 94 libclass-inspector-perl libclass-method-modifiers-perl libclass-singleton-perl libdata-compare-perl libdata-dump-perl
 95 libdata-optlist-perl libdata-uniqid-perl libdate-simple-perl libdatetime-calendar-julian-perl
 96 libdatetime-format-builder-perl libdatetime-format-strptime-perl libdatetime-locale-perl libdatetime-perl
 97 libdatetime-timezone-perl libdevel-callchecker-perl libdevel-caller-perl libdevel-globaldestruction-perl
 98 libdevel-lexalias-perl libdevel-stacktrace-perl libdist-checkconflicts-perl libdjvulibre-text libdjvulibre21
 99 libdouble-conversion1 libdynaloader-functions-perl libegl-mesa0 libegl1 libemail-date-format-perl libemf1
100 libencode-eucjpms-perl libencode-hanextra-perl libencode-jis2k-perl libencode-locale-perl libeval-closure-perl libevdev2
101 libexception-class-perl libexporter-tiny-perl libfile-find-rule-perl libfile-homedir-perl libfile-listing-perl
102 libfile-sharedir-perl libfile-slurper-perl libfile-which-perl libfont-afm-perl libfontenc1 libgbm1 libgirara-gtk3-3
103 libglu1-mesa libgudev-1.0-0 libhtml-form-perl libhtml-format-perl libhtml-parser-perl libhtml-tagset-perl libhtml-tree-perl
104 libhttp-cookies-perl libhttp-daemon-perl libhttp-date-perl libhttp-message-perl libhttp-negotiate-perl libilmbase12
105 libinput-bin libinput10 libio-html-perl libio-socket-ssl-perl libipc-run3-perl libipc-shareable-perl libjs-jquery
106 libjson-c3 liblingua-translit-perl liblist-allutils-perl liblist-moreutils-perl liblist-someutils-perl liblist-utilsby-perl
107 libllvm9 liblog-dispatch-perl liblog-log4perl-perl liblwp-mediatypes-perl liblwp-protocol-https-perl libmagic-mgc libmagic1
108 libmagickcore-6.q16-3-extra libmail-sendmail-perl libmailtools-perl libmime-charset-perl libmime-lite-perl
109 libmime-types-perl libmodule-implementation-perl libmodule-runtime-perl libmro-compat-perl libmtdev1
110 libnamespace-autoclean-perl libnamespace-clean-perl libnet-http-perl libnet-libidn-perl libnet-smtp-ssl-perl
111 libnet-ssleay-perl libnetpbm10 libnotify4 libnumber-compare-perl libopenexr22 libosmesa6 libosp5 libostyle1c2
112 libpackage-deprecationmanager-perl libpackage-stash-perl libpackage-stash-xs-perl libpadwalker-perl libparams-classify-perl
113 libparams-util-perl libparams-validate-perl libparams-validationcompiler-perl libperlio-utf8-strict-perl libplot2c2
114 libpoppler-qt5-1 libpstoedit0c2a libqt5core5a libqt5dbus5 libqt5gui5 libqt5network5 libqt5svg5 libqt5widgets5 libqt5xml5
115 libreadonly-perl libref-util-perl libref-util-xs-perl libregexp-common-perl librole-tiny-perl libruby2.5
116 libscalar-list-utils-perl libsigsegv2 libsombok3 libsort-key-perl libspecio-perl libsub-exporter-perl
117 libsub-exporter-progressive-perl libsub-identify-perl libsub-install-perl libsub-name-perl libsub-quote-perl
118 libsys-hostname-long-perl libtcl8.6 libtext-bibtex-perl libtext-csv-perl libtext-csv-xs-perl libtext-glob-perl
119 libtext-roman-perl libtext-unidecode-perl libtie-cycle-perl libtimedate-perl libtk8.6 libtry-tiny-perl
120 libunicode-collate-perl libunicode-linebreak-perl liburi-perl libutempter0 libvariable-magic-perl libwacom-bin
121 libwacom-common libwacom2 libwayland-server0 libwebpdemux2 libwmf0.2-7 libwww-perl libwww-robotrules-perl libxcb-icccm4
122 libxcb-image0 libxcb-keysyms1 libxcb-randr0 libxcb-render-util0 libxcb-util1 libxcb-xinerama0 libxcb-xkb1
123 libxkbcommon-x11-0 libxml-libxml-perl libxml-libxml-simple-perl libxml-libxslt-perl libxml-namespacesupport-perl
124 libxml-parser-perl libxml-sax-base-perl libxml-sax-expat-perl libxml-sax-perl libxml-writer-perl libxmuu1 libxtst6
125 libxxf86dga1 libyaml-tiny-perl libzip4 netbase netpbm notification-daemon openjade perl-openssl-defaults pfb2t1c2pfb prerex
126 ps2eps pstoedit psutils purifyeps python3-olefile python3-pil python3-pil.imagetk python3-tk qt5-gtk-platformtheme
127 qttranslations5-l10n rake ruby ruby-did-you-mean ruby-minitest ruby-net-telnet ruby-power-assert ruby-test-unit ruby2.5
128 rubygems-integration sgml-base tex-gyre texinfo texlive-bibtex-extra texlive-extra-utils texlive-font-utils
129 texlive-fonts-extra-doc texlive-fonts-extra-links texlive-fonts-recommended-doc texlive-formats-extra texlive-full
130 texlive-games texlive-humanities texlive-humanities-doc texlive-lang-arabic texlive-lang-chinese texlive-lang-cjk
131 texlive-lang-cyrillic texlive-lang-czechslovak texlive-lang-english texlive-lang-european texlive-lang-french
132 texlive-lang-german texlive-lang-greek texlive-lang-italian texlive-lang-japanese texlive-lang-korean texlive-lang-other
133 texlive-lang-polish texlive-lang-portuguese texlive-lang-spanish texlive-latex-base-doc texlive-latex-extra-doc
134 texlive-latex-recommended-doc texlive-luatex texlive-metapost texlive-metapost-doc texlive-music texlive-pictures-doc
135 texlive-pstricks texlive-pstricks-doc texlive-publishers texlive-publishers-doc texlive-science texlive-science-doc
136 tk8.6-blt2.5 vprerex x11-utils xbitmaps xterm zathura zathura-pdf-poppler zip

气象人的JupyterLab

Mon, 17 Feb 2020 15:37:26 +0000

上两篇文章

Jupyterlab安装配置教程

Jupyter多用户配置

中讲了Jupyter的主要部署方法，老实说，对新手很不友好，我也不想再经历一次这样的过程，尤其是Basemap的安装。所以，咱直接打包个镜像吧。不得不说Docker真是个拯救了无数程序猿秀发的好工具。

使用截图

简单来说，这就是一个部署在服务器上的Anaconda，用的的Jupyterlab的界面，您可以随时随地在任意电脑上打开一个浏览器（IE除外），输入服务器的网址，用户密码就能打开，还能下载数据，计算，绘图，整合了常用的Grads，Fortran的内核，安装了Basemap，Metpy，Siphon，Atmos，ecmwf_api，NCL_to_Python等Python常用气象工具包。

Quick Start

如果你想快速部署，而没有时间看完教程的话，看这里就好。或者看Gitee上本项目的主页。

首先安装Docker，方法见Docker常用命令总结

1docker pull registry.cn-shanghai.aliyuncs.com/bugatii100peagle/jupytercgmsabefcn:v1
2cd ~
3mkdir jupyterlab
4mkdir jupyterlab/workspace
5docker run --name jupytercgmsabefcn -d -p 8000:8888 -v `pwd`:/workspace -w /workspace -e GRANT_SUDO=yes --user root registry.cn-shanghai.aliyuncs.com/bugatii100peagle/jupytercgmsabefcn:v1 jupyter-lab --no-browser --port=8888 --ip=0.0.0.0 --allow-root

预计安装时间4小时（博主使用家用WiFi，视网络环境时间可能有延长），其中安装Docker用 1~2 小时，拖取jupytercgmsabefcn镜像用2小时。run起来之后，浏览器打开http://IP:8080，密码是空密码，直接回车即可。

Tips

不要在jupyterlab直接挂在阿里云OSS，OSS擅长存储不擅长访问。
jupyterlab/workspace是用于暂存的工作空间，在此文件夹下读写数据和作图都比较快速。
jupyterlab下另建一个新文件夹用于挂载阿里云OSS或FTP，workspace下文件编写完成再归档至此OSS文件夹。既能保证数据不丢失，又能保证读写速度。

C 和 Grads 的插件

我的镜像是很久以前我就装好了的，拖取的是官方的 jupyter-science 已经预装好了python3 julia R 我后来又装了C Grads，至于怎么装的我忘了，不过机智的我打包了镜像。直接拖下来用就行。

【 2020-02-20 14:26:59】我想起来了，好像是在Jupyter-Docker-stacks上找的jupyter-datascience-notebook，我好像还把Scipy删掉了。

1docker pull registry.cn-shanghai.aliyuncs.com/bugatii100peagle/jupytercgrads
2docker run --name jupyter -d -p 8000:8888 --restart=always -v `pwd`/jupyterlab/workspace:/workspace -w /workspace -e GRANT_SUDO=yes --user root 127.0.0.1:5000/jupytercgrads jupyter-lab --no-browser --port=8888 --ip=0.0.0.0 --allow-root

安装运行参考我之前写的jupyterLab安装配置教程，运行界面如下

气象绘图工具包 Metpy Siphon atmos

参考Meetpy Installation Guide和在Jupyter中安装Python包，docker exec -it jupyter bash进入镜像后，输入如下代码

1python -m pip install metpy
2python -m pip install siphon

atoms要手动安装，下载代码后再install

1wget https://files.pythonhosted.org/packages/65/1b/9e08dbd6979877cb1d24b5b3ee607c91ece212b010b49715ca7443999e24/atmos-0.2.5.tar.gz
2tar -xvf atmos-0.2.5.tar.gz
3cd atmos-0.2.5
4nano setup.py

修改片段

1from setuptools import setup
2from pip..req import parse_requirements
3#修改片段，不然会发生报错 ModuleNotFoundError: No module named 'pip.req'
4from setuptools import setup
5from pip._internal.req import parse_requirements

保存退出再执行

1python setup.py install

参考install quantopian时出现No module named pip.req的解决办法

地图支持包Basemap

1conda update -n base conda
2conda update -n base conda # 对，更新两次，直到不会再提示更新

更新这步都很费时间，保守估计两小时。为什么说是估计呢，因为后面我没熬住，睡着了。然后参考解决conda的“Solving environment: failed”问题和anaconda安装basemap运行如下代码。

1conda config --set channel_priority flexible
2conda install basemap

弹出如下信息即表示，已经找到basemap安装包，conda install basemap反而安装挺快，快到让我怀疑昨晚熬夜的两小时还失败了是不是幻觉。

1The following NEW packages will be INSTALLED:
2
3 basemap conda-forge/linux-64::basemap-1.2.1-py37hd1be537_2
4 geos conda-forge/linux-64::geos-3.8.0-he1b5a44_0
5 proj4 conda-forge/linux-64::proj4-5.2.0-he1b5a44_1006
6 pyproj conda-forge/linux-64::pyproj-1.9.6-py37h516909a_1002
7 pyshp conda-forge/noarch::pyshp-2.1.0-py_0

测试运行，会遇到basemap KeyError ‘PROJ_LIB’解决办法，解决办法就是代码中指定目录运行。终端输入

1whereis proj
2# 输出：proj: /usr/share/proj /opt/conda/bin/proj

浏览器打开jupyter,新建.ipynb文件，输入

 1%matplotlib inline
 2import os
 3os.environ['PROJ_LIB'] = "/usr/share/proj"
 4import numpy as np
 5import matplotlib.pyplot as plt
 6from mpl_toolkits.basemap import Basemap
 7
 8plt.figure(figsize=(8, 8))
 9m = Basemap(projection='ortho', resolution=None, lat_0=50, lon_0=-100)
10m.bluemarble(scale=0.5);

参考数据科学 IPython 笔记本 8.16 地理数据和 Basemap无报错，并出现一个地球，即表示安装成功。

basemap还挺大，装了2G左右吧。

Basemap 的继承者 Cartopy

Basemap 自2020年开始停止维护，所以，新的项目还是用新工具吧。

1wget https://files.pythonhosted.org/packages/e5/92/fe8838fa8158931906dfc4f16c5c1436b3dd2daf83592645b179581403ad/Cartopy-0.17.0.tar.gz
2tar zxvf Cartopy-0.17.0.tar.gz
3cd Cartopy-0.17.0
4python setup.py install

网不好的也可以尝试从百度网盘下载

1链接：https://pan.baidu.com/s/1EOofzd9VcFgYTbpRhDf5pg
2提取码：c60e

测试，浏览器打开jupyter输入以下代码,能出土没报错即可。

 1import cartopy.crs as ccrs
 2import matplotlib.pyplot as plt
 3
 4ax = plt.axes(projection=ccrs.PlateCarree())
 5ax.coastlines()
 6
 7# Save the plot by calling plt.savefig() BEFORE plt.show()
 8# plt.savefig('coastlines.pdf')
 9# plt.savefig('coastlines.png')
10plt.show()

Ncar的NCL_to_Python

参考Important letter regarding the future of NCL和PyNIO和PyNGL。但是PyNIO和PyNGL与basemap冲突，climate-dev mailing list archives，也提到对代码做了修改，反正这两货不能在一起，那就打包两个，幸好之前docker了镜像。

从刚安装号atmos的那个镜像开始，运行并进入镜像。

1conda config --set channel_priority flexible
2conda install xarray netcdf4 scipy pyngl pynio ncl

测试，浏览器打开jupyterlab，上传下面这个包，解压，打开,运行其中的文件，没报错，出图即可。

1链接：https://pan.baidu.com/s/1lpBJTJHp466zbru9cKtoTg
2提取码：8q3y

欧洲中心数据下载ecmwf-api

参考利用Python调用ECMWF欧洲中心API批量下载数据，python调用ECMWF欧洲中心api下载数据

1python -m pip install ecmwf-api-client

测试，打开ipython，输入下方代码，没报错即可。

1from ecmwfapi import ECMWFDataServer

Fortran支持jupyter-fortran-kernel

下载插件包上传之服务器解压安装。

1链接：https://pan.baidu.com/s/1EAkEEVtmuOyB_VtzEAMqrQ
2提取码：d4l6
3复制这段内容后打开百度网盘手机App，操作更方便哦

1apt install gfortran
2unzip jupyter-fortran-kernel-master.zip
3cd jupyter-fortran-kernel-master
4python setup.py install
5jupyter-kernelspec install fortran_spec/

打开浏览器，就可以看到Fortran的选项

点击打开，输入

1program aa
2implicit none
3print*,'Hello World'
4end

镜像包信息

jupytercgrads_metpy_siphon_atmos_basemap_ecmwf_fortran_cartopy

jupytercgrads_metpy_siphon_atmos_ncl_ecmwf_fortran

失败的方法安装地图支持包BaseMap

首先安装依赖包

1python -m pip install geos
2python -m pip install pip
3python -m pip install Pillow

参考basemap安装教程，linux python 安装basemap

1pip install pyproj

测试，bash输入以下命令没报错即可。

1python -c 'import pyproj'

basemap的包真的好难下，我这里存了个百度网盘，需要的自行下载。

1链接：https://pan.baidu.com/s/1hMhdVfVb1n709bxnSJCECg
2提取码：a1cw

参考python番外（2）——Basemap安装上传服务器到Docker环境，这里可以用workspace目录，反正装完删掉就可以。

1tar zxvf basemap-1.1.0.tar.gz
2cd basemap-1.0.7/geos-3.3.3/
3export GEOS_DIR=/usr/local
4./configure --prefix=$GEOS_DIR
5make

能解压个二十分钟左右吧，慢慢等着，然后make报错。

 1return (ISNAN(x) && ISNAN(y) && ISNAN(z));
 2 ^~~~~
 3../../../include/geos/geom/Coordinate.inl:39:10: note: suggested alternative: ‘SN AN’
 4return (ISNAN(x) && ISNAN(y) && ISNAN(z));
 5 ^~~~~
 6 SNAN
 7../../../include/geos/geom/Coordinate.inl: In member function ‘bool geos::geom::C oordinate::equals3D(const geos::geom::Coordinate&) const’:
 8../../../include/geos/geom/Coordinate.inl:83:21: error: ‘ISNAN’ was not declared in this scope
 9 ((z == other.z)||(ISNAN(z) && ISNAN(other.z)));
10 ^~~~~
11../../../include/geos/geom/Coordinate.inl:83:21: note: suggested alternative: ‘SN AN’
12 ((z == other.z)||(ISNAN(z) && ISNAN(other.z)));
13 ^~~~~
14 SNAN
15make[4]: *** [Makefile:373: IndexedPointInAreaLocator.lo] Error 1
16make[4]: Leaving directory '/workspace/basemap-1.1.0/geos-3.3.3/src/algorithm/loc ate'
17make[3]: *** [Makefile:392: all-recursive] Error 1
18make[3]: Leaving directory '/workspace/basemap-1.1.0/geos-3.3.3/src/algorithm/loc ate'
19make[2]: *** [Makefile:444: all-recursive] Error 1
20make[2]: Leaving directory '/workspace/basemap-1.1.0/geos-3.3.3/src/algorithm'
21make[1]: *** [Makefile:476: all-recursive] Error 1
22make[1]: Leaving directory '/workspace/basemap-1.1.0/geos-3.3.3/src'
23make: *** [Makefile:368: all-recursive] Error

解决办法参考GEOS安装出错

1cd include/geos/
2nano platform.h

修改24行

1/* Has isnan */
2/* #undef HAVE_ISNAN */

改为

1/* Has isnan */
2#define HAVE_ISNAN 1

然后不要configure 直接 make 然后 make install

make 也要个40多分钟吧

【 2020-02-18 0:23:56】一个小时，反正也就只有等着。

【 2020-02-18 1:08:34】又一个小时，我好想睡觉，但是不看他装完我睡不着。

【 2020-02-18 1:28:23】我好像想起来我折腾这玩意这么慢了，这是在OSS下，为了方便管理代码，我挂载了OSS盘做储存，OSS擅长存而不擅长高频访问，而编译make就是个高频的活动。

【 2020-02-18 1:39:44】脱离OSS目录重新configure nano platform.h make

【2020-02-18 1:44:01 】make 完毕，make install 不到30秒完毕。2/100*60=1.2，也就是说我花了两小时等一个1分20秒就能出的东西，还傻等了两小时。

但是我回到basemap文件夹下python setup.py install 时报错

1In file included from src/_geoslib.c:248:0:
2/usr/local/include/geos_c.h:149:22: note: expected ‘GEOSMessageHandler {aka void (*)(const char *)}’ but argument is of type ‘void (*)(char *, char *)’
3 extern void GEOS_DLL initGEOS(GEOSMessageHandler notice_function,
4···
5src/_geoslib.c:5619:13: error: ‘PyThreadState {aka struct _ts}’ has no member named ‘exc_traceback’; did you mean ‘curexc_traceback’?
6 tstate->exc_traceback = local_tb;
7 ^~~~~~~~~~~~~
8 curexc_traceback
9error: Command "gcc -pthread -B /opt/conda/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/usr/local/include -I['/opt/conda/lib/python3.7/site-packages/numpy/core/include'] -I/opt/conda/lib/python3.7/site-packages/numpy/core/include -I/opt/conda/include/python3.7m -c src/_geoslib.c -o build/temp.linux-x86_64-3.7/src/_geoslib.o -MMD -MF build/temp.linux-x86_64-3.7/src/_geoslib.o.d" failed with exit status 1

参考 Python踩坑之路， Python 3.7 Build failure: error: ‘PyThreadState’ {aka ‘struct _ts’} has no member named ‘exc_type’; did you mean ‘curexc_type’? #11

1pip install PyOpenGL PyOpenGL_accelerate
2apt-get install python3-dev
3apt-get install libevent-dev

当然都没有解决。

JupyterLab多用户配置

Sun, 16 Feb 2020 23:59:58 +0000

上一篇初步安装了JupyterLab，但是这个不能多用户真的让人难过。

拉取镜像运行

在阿里云镜像市场上找到一个配置好Ananoconda和JupyterLab的镜像，使用如下代码直接拉取

1docker pull registry.cn-shanghai.aliyuncs.com/stormstone/juplab

带端口号运行，其中8000是本机主要用户端口，7777是第二个用户的端口，要多少用户就用多少端口。Docker的/home下新建用户并设置密码，密码多少无所谓，Docker的work目录也挂过来，你可以用OSS在本机挂载。

1docker run -p 8000:8888 -p 7777:7777 -d --name jupyterlabofstormstone -v `pwd`/新建一个宿主机Jupyter目录/home:/home -v `pwd`/新建一个宿主机Jupyter目录/work:/work --restart=always registry.cn-shanghai.aliyuncs.com/stormstone/juplab:v2

进入镜像，新建用户

1docker exec -it jupyterlabofstormstone bash
2adduser share # share 是我新建的用户
3passwd share

切换用户，生成配置文件，其实这个文件在哪里大概不重要，后面带绝对路径运行即可，不过咱还是规范点。

1su share
2jupyter notebook --generate-config

修改/home/share/.jupyter/jupyter_notebook_config.py加入如下字段，密码是空密码

1c.NotebookApp.ip='*'
2c.NotebookApp.password = 'sha1:840438352003:10c0d77ee275c741e22e6929cb7822e61ab5c256'
3c.NotebookApp.open_browser = False
4c.NotebookApp.port =7777
5c.NotebookApp.notebook_dir = '/work/share' 
6c.PAMAuthenticator.encoding = 'utf8'
7c.NotebookApp.default_url = '/lab'
8c.NotebookApp.allow_remote_access = True

修改root配置

切换回root,重复上述动作。

1su root
2jupyter notebook --generate-config

生成密码

1ipython

输入

1from notebook.auth import passwd
2passwd()

在跳出的框内输入密码，两次，得到一个Token值。复制一下一会要用。

修改/root/.jupyter/jupyter_notebook_config.py加入如下字段

1c.NotebookApp.ip='*'
2c.NotebookApp.password = 你自己生成Token
3c.NotebookApp.open_browser = False
4c.NotebookApp.port =8888
5c.NotebookApp.notebook_dir = '/work' 
6c.PAMAuthenticator.encoding = 'utf8'

保存，退出镜像

重启镜像

1docker stop jupyterlabofstormstone
2docker restart jupyterlabofstormstone
3docker exec jupyterlabofstormstone nohup jupyter notebook --config /home/share/.jupyter/jupyter_notebook_config.py --allow-root # 给新用户的端口也跑起来，会输出一些信息，不用管，ctrl-c也没有影响

现在可以在http://IP:8000和http://IP:7777两个端口打开了，为两个端口绑定域名，设置操作权限等。

参考

JupyterHub 配置和管理

实验室工作站jupyterhub安装笔记

JupyterLab on JupyterHub

jupyter notebook 权限控制，实现多个用户工作空间不同，同时使用

如何用一台服务器给多个 Jupyter 用户提供服务

jupyterLab安装配置教程

Thu, 13 Feb 2020 16:43:59 +0000

服务器信息：

1Distributor ID: Ubuntu
2Description: Ubuntu 18.04 LTS
3Release: 18.04
4Codename: bionic

准备工作

更新服务器软件列表

首先，更新下列表，装一下依赖

1sudo apt-get update
2sudo apt-get upgrade
3sudo apt-get -y install git gcc g++ make openssl libssl-dev libbz2-dev libreadline-dev libsqlite3-dev python-dev libmysqlclient-dev

安装Docker

参考Docker常用命令总结

安装JupyterLab

下面是我自己用registry搭建的仓库，已经有一个安装好C内核与Grads的jupyterLab，你可以用官网的jupyterlab。搭建私有仓库的方法参考：搭建私有docker仓库并使用OSS作为存储

 1docker pull registry
 2docker run -d -p 443:5000 --restart=always --name registry \
 3 -v `pwd`/config:/config \
 4 -e "REGISTRY_AUTH=htpasswd" \
 5 -e "REGISTRY_AUTH_HTPASSWD_REALM=Registry Realm" \
 6 -e REGISTRY_AUTH_HTPASSWD_PATH=/config/htpasswd \
 7 -e REGISTRY_HTTP_TLS_CERTIFICATE=/config/chained.pem \
 8 -e REGISTRY_HTTP_TLS_KEY=/config/domain.key \
 9 -e REGISTRY_STORAGE=oss \
10 -e REGISTRY_STORAGE_OSS_ACCESSKEYID=********** \
11 -e REGISTRY_STORAGE_OSS_ACCESSKEYSECRET=***************** \
12 -e REGISTRY_STORAGE_OSS_REGION=oss-cn-qingdao \
13 -e REGISTRY_STORAGE_OSS_BUCKET=******* \
14 registry:2

拉取jupyter镜像，这里我使用的jupytercgrads是我自己自建仓库的带C内核和Grads内核的，以后搞个Docker镜像仓库Harbor之搭建及配置，然后我把镜像传上来吧。

1docker pull 127.0.0.1:5000/jupytercgrads
2mkdir jupyterlabjupyterlab
3docker run --name jupyter -d -p 8000:8888 --restart=always -v `pwd`/jupyterlab/workspace:/workspace -w /workspace -e GRANT_SUDO=yes --user root 127.0.0.1:5000/jupytercgrads jupyter-lab --no-browser --port=8888 --ip=0.0.0.0 --allow-root

【 2020-02-17 12:58:00 更新】我把镜像上传到阿里云仓库了，可以通过一下代码拉取。

1docker pull registry.cn-shanghai.aliyuncs.com/bugatii100peagle/jupytercgrads

配置登录密码

进入Docker镜像中，启动Ipython交互端

1docker exec -it jupyter bash
2ipython

输入

1from notebook.auth import passwd
2passwd()

会要求你输入密码，不会显示，输两遍就行

1Enter password:
2Verify password:
3Out[3]: 'sha1:记下这串数字'

新建配置文件

1jupyter lab --generate-config

或者在已有的配置文件/home/jovyan/.jupyter/jupyter_notebook_config.py中添加

1c.NotebookApp.ip = '*'
2c.NotebookApp.password = 'sha1:刚刚那串串数字'
3c.NotebookApp.allow_remote_access = True

保存，退出镜像，重启镜像

1docker restart jupyter

打开浏览器，输入http://IP:8000就能看到下图输密码，而不是输Token，这样只要用密码登录就行了。

多用户配置

配置jupyterlab的参考

如何用一台服务器给多个 Jupyter 用户提供服务

JupyterLab远程访问配置方法（CentOS7）

云服务器搭建神器JupyterLab（多图）

docker stop jupyter Docker で JupyterLab を起動し、token 入力なしでアクセスする

jupyter notebook 安装 C/C++ kernel

jupyter-kernel

Jupyterlab 的安装与配置

What is the password for using “sudo apt-get install” command? #949

jupyterlab /jupyterlab-latex

利器|JupyterLab 数据分析必备IDE完全指南

ykatsu111 /jupyter-grads-kernel

brendan-rius /jupyter-c-kernel

Jupyterhub安装

其实安装JupyterLab已经够个人使用了，如果要多用户管理可以试试JupyterHub。但是我除了用Docker安装成功外，另外用pip和conda都安装失败了。参考实验室工作站jupyterhub安装笔记

Docker安装JupyterHub

Using Docker，docker 安装jupyterhub支持R语言中看起来也不难，没有烦人的配置。

下载好后让它跑起来，然后进入镜像。

1docker run -p 8000:8000 -d --name jupyterhub --restart=always jupyterhub/jupyterhub
2docker exec -it jupyterhub bash

带路径文件的启动，首先在宿主机上新建文件夹/root/jupyterhub/jupyterhub/和/root/jupyterhub/home/，然后用如下命令启动。

1docker run -p 8000:8000 -d --name jupyterhub -v /root/jupyterhub/jupyterhub/:/srv/jupyterhub -v /root/jupyterhub/home/:/home --restart=always jupyterhub/jupyterhub_build jupyterhub

在镜像中新建用户，默认不能用 root登录。

1useradd admin
2passwd admin

会要求你输入密码，你看不见，输入两次一样的就行。

更新pip,更新jupyterhub

1pip install --upgrade pip
2pip install --upgrade jupyterhub
3pip install notebook --upgrade

然后就可以从浏览器通过http://IP:8000访问了，输入刚刚新建的用户名和密码。

失败的方法参考

下载Anaconda

手动从清华anaconda源下载anaconda-5.3.0的安装包，加执行权限然后bash执行。

1wget https://mirrors.tuna.tsinghua.edu.cn/anaconda/archive/Anaconda3-5.3.1-Linux-x86_64.sh
2chmod +x Anaconda3-5.3.1-Linux-x86_64.sh
3bash Anaconda3-5.3.1-Linux-x86_64.sh

说一下这个安装过程中的问题，别一路憨憨就过去了。首先是回车继续安装

然后会给你看一堆文件，问你接受条款么？不用管，直接yes完事。

接着问你启动命令要不要加到bashrc里，填yes，错过了的同学也可以参考Jupyterhub安装配置及心得手动加上。

最后问你要不要VSCode编辑器，咱在服务器上配置不用装，填no，在笔记本上装，可以yes。其实jupyter自带的Spyder编辑器也不错，VSCode编辑器使用起来也不错，看个人喜好。

装完记得重载一下配置

1source ~/.bashrc

conda安装Jupyterhub

添加清华源，然后升级一下，再安装。卡死请参考使用conda命令下载jupyter时一直在Solving environment卡死

1conda config --add channels https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/free/
2conda config --add channels https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud/conda-forge
3conda config --add channels https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud/msys2/
4conda config --set show_channel_urls yes
5conda upgrade --all # 先升级一下，不然会很慢
6conda install -c conda-forge jupyterhub
7conda install jupyterlab

用pip安装Jupyterhub

使用pip，速度杠杠滴。

1python3 -m pip install jupyterhub -i https://pypi.douban.com/simple/
2npm install -g configurable-http-proxy
3python3 -m pip install --upgrade notebook -i https://pypi.douban.com/simple/

但是我参考Jupyterhub安装配置及心得设置后的jupyterHub，页面打不开，显示Not Found,终端也报错。