%matplotlib inline
import pandas as pd
import socket
host = socket.getfqdn()
from core import load, zoom, calc, save,plots,monitor
#reload funcs after updating ./core/*.py
import importlib
importlib.reload(load)
importlib.reload(zoom)
importlib.reload(calc)
importlib.reload(save)
importlib.reload(plots)
importlib.reload(monitor)
<module 'core.monitor' from '/ccc/work/cont003/gen7420/odakatin/monitor-sedna/notebook/core/monitor.py'>
below are list of enviroment variable one can pass
local : if True run dask local cluster, if not true, put number of workers setted in the 'local' if no 'local ' given, local will be setted automatically to 'True'
#
Monitor.sh calls M_MLD_2D
and AWTD.sh, Fluxnet.sh, Siconc.sh, IceClim.sh, FWC_SSH.sh
AWTD.sh M_AWTMD
Fluxnet.sh M_Fluxnet
FWC_SSH.sh M_FWC_2D M_FWC_integrals M_FWC_SSH M_SSH_anomaly
M_Mean_temp_velo
M_Mooring M_Sectionx M_Sectiony
%%time
# 'savefig': Do we save output in html? or not. keep it true.
savefig=True
client,cluster,control,catalog_url,month,year,daskreport,outputpath = load.set_control(host)
!mkdir -p $outputpath
!mkdir -p $daskreport
client
local True using host= irene5809.c-irene.mg1.tgcc.ccc.cea.fr starting dask cluster on local= True This code is running on irene5809.c-irene.mg1.tgcc.ccc.cea.fr using SEDNA_DELTA_MONITOR file experiment, read from ../lib/SEDNA_DELTA_MONITOR.yaml on year= 2012 on month= 02 outputpath= ../results/SEDNA_DELTA_MONITOR/ daskreport= ../results/dask/6418604irene5809.c-irene.mg1.tgcc.ccc.cea.fr_SEDNA_DELTA_MONITOR_02M_Fluxnet/ CPU times: user 3.69 s, sys: 732 ms, total: 4.42 s Wall time: 1min 35s
Client-69c3f3da-13d3-11ed-8c05-080038b93b8b
Connection method: Cluster object | Cluster type: distributed.LocalCluster |
Dashboard: http://127.0.0.1:8787/status |
584f656c
Dashboard: http://127.0.0.1:8787/status | Workers: 64 |
Total threads: 256 | Total memory: 251.06 GiB |
Status: running | Using processes: True |
Scheduler-a0b54f86-accd-43c6-b616-8d127d07d403
Comm: tcp://127.0.0.1:41790 | Workers: 64 |
Dashboard: http://127.0.0.1:8787/status | Total threads: 256 |
Started: 1 minute ago | Total memory: 251.06 GiB |
Comm: tcp://127.0.0.1:38508 | Total threads: 4 |
Dashboard: http://127.0.0.1:39630/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:42417 | |
Local directory: /tmp/dask-worker-space/worker-q9tmv9sh |
Comm: tcp://127.0.0.1:40527 | Total threads: 4 |
Dashboard: http://127.0.0.1:33802/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:43108 | |
Local directory: /tmp/dask-worker-space/worker-isd5o9oy |
Comm: tcp://127.0.0.1:41061 | Total threads: 4 |
Dashboard: http://127.0.0.1:38061/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:36506 | |
Local directory: /tmp/dask-worker-space/worker-it71h4i7 |
Comm: tcp://127.0.0.1:43453 | Total threads: 4 |
Dashboard: http://127.0.0.1:38681/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:35404 | |
Local directory: /tmp/dask-worker-space/worker-2osu2f0j |
Comm: tcp://127.0.0.1:46038 | Total threads: 4 |
Dashboard: http://127.0.0.1:36937/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:44829 | |
Local directory: /tmp/dask-worker-space/worker-64w16l5r |
Comm: tcp://127.0.0.1:34884 | Total threads: 4 |
Dashboard: http://127.0.0.1:33707/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:36063 | |
Local directory: /tmp/dask-worker-space/worker-jde57nzc |
Comm: tcp://127.0.0.1:46761 | Total threads: 4 |
Dashboard: http://127.0.0.1:46471/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:39029 | |
Local directory: /tmp/dask-worker-space/worker-0k7nzj7n |
Comm: tcp://127.0.0.1:42668 | Total threads: 4 |
Dashboard: http://127.0.0.1:38036/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:41607 | |
Local directory: /tmp/dask-worker-space/worker-9iog2r2j |
Comm: tcp://127.0.0.1:44983 | Total threads: 4 |
Dashboard: http://127.0.0.1:41627/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:34682 | |
Local directory: /tmp/dask-worker-space/worker-edxwuqi1 |
Comm: tcp://127.0.0.1:42278 | Total threads: 4 |
Dashboard: http://127.0.0.1:38415/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:38354 | |
Local directory: /tmp/dask-worker-space/worker-bj4ijeef |
Comm: tcp://127.0.0.1:38860 | Total threads: 4 |
Dashboard: http://127.0.0.1:46442/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:45093 | |
Local directory: /tmp/dask-worker-space/worker-640690rg |
Comm: tcp://127.0.0.1:37685 | Total threads: 4 |
Dashboard: http://127.0.0.1:38332/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:35193 | |
Local directory: /tmp/dask-worker-space/worker-ajvomah5 |
Comm: tcp://127.0.0.1:35749 | Total threads: 4 |
Dashboard: http://127.0.0.1:43137/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:35897 | |
Local directory: /tmp/dask-worker-space/worker-vagi3cal |
Comm: tcp://127.0.0.1:38540 | Total threads: 4 |
Dashboard: http://127.0.0.1:38386/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:42185 | |
Local directory: /tmp/dask-worker-space/worker-j77uz_pp |
Comm: tcp://127.0.0.1:39313 | Total threads: 4 |
Dashboard: http://127.0.0.1:37950/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:45212 | |
Local directory: /tmp/dask-worker-space/worker-yjz359v8 |
Comm: tcp://127.0.0.1:45681 | Total threads: 4 |
Dashboard: http://127.0.0.1:44969/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:45448 | |
Local directory: /tmp/dask-worker-space/worker-n4d7ti8h |
Comm: tcp://127.0.0.1:45486 | Total threads: 4 |
Dashboard: http://127.0.0.1:39486/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:46590 | |
Local directory: /tmp/dask-worker-space/worker-4c9jj_sb |
Comm: tcp://127.0.0.1:33550 | Total threads: 4 |
Dashboard: http://127.0.0.1:45019/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:45502 | |
Local directory: /tmp/dask-worker-space/worker-16o62jn7 |
Comm: tcp://127.0.0.1:39274 | Total threads: 4 |
Dashboard: http://127.0.0.1:35333/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:37017 | |
Local directory: /tmp/dask-worker-space/worker-jqxr5ekt |
Comm: tcp://127.0.0.1:35390 | Total threads: 4 |
Dashboard: http://127.0.0.1:38552/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:34038 | |
Local directory: /tmp/dask-worker-space/worker-w5o8i_53 |
Comm: tcp://127.0.0.1:44173 | Total threads: 4 |
Dashboard: http://127.0.0.1:44882/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:38099 | |
Local directory: /tmp/dask-worker-space/worker-qjnx57ty |
Comm: tcp://127.0.0.1:42649 | Total threads: 4 |
Dashboard: http://127.0.0.1:39651/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:37911 | |
Local directory: /tmp/dask-worker-space/worker-o8ba5cyd |
Comm: tcp://127.0.0.1:41003 | Total threads: 4 |
Dashboard: http://127.0.0.1:46179/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:38658 | |
Local directory: /tmp/dask-worker-space/worker-74rn84xh |
Comm: tcp://127.0.0.1:41208 | Total threads: 4 |
Dashboard: http://127.0.0.1:34830/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:37376 | |
Local directory: /tmp/dask-worker-space/worker-3w_qcfs0 |
Comm: tcp://127.0.0.1:35145 | Total threads: 4 |
Dashboard: http://127.0.0.1:37541/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:36507 | |
Local directory: /tmp/dask-worker-space/worker-iuu9ugyp |
Comm: tcp://127.0.0.1:45503 | Total threads: 4 |
Dashboard: http://127.0.0.1:39944/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:35483 | |
Local directory: /tmp/dask-worker-space/worker-pt1lqild |
Comm: tcp://127.0.0.1:46782 | Total threads: 4 |
Dashboard: http://127.0.0.1:32817/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:38912 | |
Local directory: /tmp/dask-worker-space/worker-a7tniwfl |
Comm: tcp://127.0.0.1:34673 | Total threads: 4 |
Dashboard: http://127.0.0.1:45520/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:37421 | |
Local directory: /tmp/dask-worker-space/worker-yg5wult1 |
Comm: tcp://127.0.0.1:40501 | Total threads: 4 |
Dashboard: http://127.0.0.1:34328/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:34425 | |
Local directory: /tmp/dask-worker-space/worker-vumgbrtp |
Comm: tcp://127.0.0.1:33884 | Total threads: 4 |
Dashboard: http://127.0.0.1:35225/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:41888 | |
Local directory: /tmp/dask-worker-space/worker-j4w0mash |
Comm: tcp://127.0.0.1:37423 | Total threads: 4 |
Dashboard: http://127.0.0.1:42679/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:42326 | |
Local directory: /tmp/dask-worker-space/worker-ly7q5a8n |
Comm: tcp://127.0.0.1:44546 | Total threads: 4 |
Dashboard: http://127.0.0.1:35334/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:34221 | |
Local directory: /tmp/dask-worker-space/worker-mme_441g |
Comm: tcp://127.0.0.1:35548 | Total threads: 4 |
Dashboard: http://127.0.0.1:46565/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:46008 | |
Local directory: /tmp/dask-worker-space/worker-005skei8 |
Comm: tcp://127.0.0.1:37201 | Total threads: 4 |
Dashboard: http://127.0.0.1:45936/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:42744 | |
Local directory: /tmp/dask-worker-space/worker-mxp68qg7 |
Comm: tcp://127.0.0.1:34111 | Total threads: 4 |
Dashboard: http://127.0.0.1:44412/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:40578 | |
Local directory: /tmp/dask-worker-space/worker-l4z9pkip |
Comm: tcp://127.0.0.1:45070 | Total threads: 4 |
Dashboard: http://127.0.0.1:37210/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:37010 | |
Local directory: /tmp/dask-worker-space/worker-uk7iaikv |
Comm: tcp://127.0.0.1:45635 | Total threads: 4 |
Dashboard: http://127.0.0.1:39492/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:46832 | |
Local directory: /tmp/dask-worker-space/worker-66vnzyv4 |
Comm: tcp://127.0.0.1:45005 | Total threads: 4 |
Dashboard: http://127.0.0.1:39579/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:42005 | |
Local directory: /tmp/dask-worker-space/worker-95jbz7x7 |
Comm: tcp://127.0.0.1:40324 | Total threads: 4 |
Dashboard: http://127.0.0.1:40002/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:36992 | |
Local directory: /tmp/dask-worker-space/worker-2f7wwvj_ |
Comm: tcp://127.0.0.1:38300 | Total threads: 4 |
Dashboard: http://127.0.0.1:34330/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:44682 | |
Local directory: /tmp/dask-worker-space/worker-d9k3l67y |
Comm: tcp://127.0.0.1:43266 | Total threads: 4 |
Dashboard: http://127.0.0.1:36618/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:35073 | |
Local directory: /tmp/dask-worker-space/worker-tic2zljm |
Comm: tcp://127.0.0.1:40403 | Total threads: 4 |
Dashboard: http://127.0.0.1:37322/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:38669 | |
Local directory: /tmp/dask-worker-space/worker-6lfslwy3 |
Comm: tcp://127.0.0.1:38785 | Total threads: 4 |
Dashboard: http://127.0.0.1:45543/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:44045 | |
Local directory: /tmp/dask-worker-space/worker-w0py11w3 |
Comm: tcp://127.0.0.1:42225 | Total threads: 4 |
Dashboard: http://127.0.0.1:41929/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:37684 | |
Local directory: /tmp/dask-worker-space/worker-mr0z_duz |
Comm: tcp://127.0.0.1:41264 | Total threads: 4 |
Dashboard: http://127.0.0.1:39858/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:36433 | |
Local directory: /tmp/dask-worker-space/worker-y397725g |
Comm: tcp://127.0.0.1:40479 | Total threads: 4 |
Dashboard: http://127.0.0.1:40569/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:38631 | |
Local directory: /tmp/dask-worker-space/worker-0s6a20qj |
Comm: tcp://127.0.0.1:36854 | Total threads: 4 |
Dashboard: http://127.0.0.1:38682/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:42404 | |
Local directory: /tmp/dask-worker-space/worker-q0vjkg79 |
Comm: tcp://127.0.0.1:38286 | Total threads: 4 |
Dashboard: http://127.0.0.1:45920/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:33050 | |
Local directory: /tmp/dask-worker-space/worker-vh60w9c6 |
Comm: tcp://127.0.0.1:35643 | Total threads: 4 |
Dashboard: http://127.0.0.1:40355/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:33094 | |
Local directory: /tmp/dask-worker-space/worker-h2ew7mmc |
Comm: tcp://127.0.0.1:33026 | Total threads: 4 |
Dashboard: http://127.0.0.1:42938/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:35880 | |
Local directory: /tmp/dask-worker-space/worker-4rfg3q2r |
Comm: tcp://127.0.0.1:43611 | Total threads: 4 |
Dashboard: http://127.0.0.1:43087/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:45548 | |
Local directory: /tmp/dask-worker-space/worker-5i_n0gtc |
Comm: tcp://127.0.0.1:35316 | Total threads: 4 |
Dashboard: http://127.0.0.1:37021/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:41852 | |
Local directory: /tmp/dask-worker-space/worker-cr4yfn0g |
Comm: tcp://127.0.0.1:37743 | Total threads: 4 |
Dashboard: http://127.0.0.1:43665/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:41755 | |
Local directory: /tmp/dask-worker-space/worker-q8n6pw3h |
Comm: tcp://127.0.0.1:40362 | Total threads: 4 |
Dashboard: http://127.0.0.1:36474/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:42072 | |
Local directory: /tmp/dask-worker-space/worker-f6newwek |
Comm: tcp://127.0.0.1:33146 | Total threads: 4 |
Dashboard: http://127.0.0.1:44108/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:39892 | |
Local directory: /tmp/dask-worker-space/worker-o7bysmnv |
Comm: tcp://127.0.0.1:46713 | Total threads: 4 |
Dashboard: http://127.0.0.1:36026/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:46126 | |
Local directory: /tmp/dask-worker-space/worker-l3hy4fxr |
Comm: tcp://127.0.0.1:42144 | Total threads: 4 |
Dashboard: http://127.0.0.1:45510/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:41074 | |
Local directory: /tmp/dask-worker-space/worker-0lt99hjl |
Comm: tcp://127.0.0.1:36376 | Total threads: 4 |
Dashboard: http://127.0.0.1:36476/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:42356 | |
Local directory: /tmp/dask-worker-space/worker-oi1eaoos |
Comm: tcp://127.0.0.1:43091 | Total threads: 4 |
Dashboard: http://127.0.0.1:38102/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:44309 | |
Local directory: /tmp/dask-worker-space/worker-tb7fx3zc |
Comm: tcp://127.0.0.1:43183 | Total threads: 4 |
Dashboard: http://127.0.0.1:46359/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:40909 | |
Local directory: /tmp/dask-worker-space/worker-ytlh550w |
Comm: tcp://127.0.0.1:38775 | Total threads: 4 |
Dashboard: http://127.0.0.1:36487/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:36768 | |
Local directory: /tmp/dask-worker-space/worker-svyz4tcq |
Comm: tcp://127.0.0.1:46768 | Total threads: 4 |
Dashboard: http://127.0.0.1:37251/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:38945 | |
Local directory: /tmp/dask-worker-space/worker-3mfw3yga |
Comm: tcp://127.0.0.1:41872 | Total threads: 4 |
Dashboard: http://127.0.0.1:33902/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:42817 | |
Local directory: /tmp/dask-worker-space/worker-kcwxs0qr |
Comm: tcp://127.0.0.1:41949 | Total threads: 4 |
Dashboard: http://127.0.0.1:35023/status | Memory: 3.92 GiB |
Nanny: tcp://127.0.0.1:45219 | |
Local directory: /tmp/dask-worker-space/worker-4gku5cak |
df=load.controlfile(control)
#Take out 'later' tagged computations
#df=df[~df['Value'].str.contains('later')]
df
Value | Inputs | Equation | Zone | Plot | Colourmap | MinMax | Unit | Oldname | Unnamed: 10 | |
---|---|---|---|---|---|---|---|---|---|---|
Fluxnet | gridV.vomecrty,param.e3v_0,param.e1v,param.mas... | calc.Fluxnet(data) | FramS_All | Fluxnet_integrals | None | ((-10,10),(-10,50) ,(-150,50),(-25,5) ) | (Sv,TW, mSv,10^-2 Sv) | I-6 | ||
Fluxnet | gridV.vomecrty,param.e3v_0,param.e1v,param.mas... | calc.Fluxnet(data) | Davis | Fluxnet_integrals | None | ((-5.0,5.0),(-25,27) ,(-200,50),(-9,5) ) | (Sv,TW, mSv,10^-2 Sv) | I-6 | ||
Fluxnet | gridV.vomecrty,param.e3v_0,param.e1v,param.mas... | calc.Fluxnet(data) | Bering | Fluxnet_integrals | None | ((-2,2),(-10,50) ,(-150,50),(-2,4) ) | (Sv,TW, mSv,10^-2 Sv) | I-6 |
Each computation consists of
%%time
import os
calcswitch=os.environ.get('calc', 'True')
lazy=os.environ.get('lazy','False' )
loaddata=((df.Inputs != '').any())
print('calcswitch=',calcswitch,'df.Inputs != nothing',loaddata, 'lazy=',lazy)
data = load.datas(catalog_url,df.Inputs,month,year,daskreport,lazy=lazy) if ((calcswitch=='True' )*loaddata) else 0
data
calcswitch= False df.Inputs != nothing True lazy= False CPU times: user 307 µs, sys: 53 µs, total: 360 µs Wall time: 363 µs
0
%%time
monitor.auto(df,data,savefig,daskreport,outputpath,file_exp='SEDNA'
)
#calc= False #save= False #plot= True Value='Fluxnet' Zone='FramS_All' Plot='Fluxnet_integrals' cmap='None' clabel='(Sv,TW, mSv,10^-2 Sv)' clim= ((-10, 10), (-10, 50), (-150, 50), (-25, 5)) outputpath='../results/SEDNA_DELTA_MONITOR/' nc_outputpath='../nc_results/SEDNA_DELTA_MONITOR/' filename='SEDNA_Fluxnet_integrals_FramS_All_Fluxnet' #3 no computing , loading starts data=save.load_data(plot=Plot,path=nc_outputpath,filename=filename) start saving data load 1Dnc file from ../nc_results/SEDNA_DELTA_MONITOR/../*/SEDNA_Fluxnet_integrals_FramS_All_Fluxnet*.nc load computed data completed
<xarray.Dataset> Dimensions: (t: 90) Coordinates: time_centered (t) object dask.array<chunksize=(31,), meta=np.ndarray> * t (t) object 2012-01-01 12:00:00 ... 2012-01-31 12:0... y int64 ... Data variables: Volume flux Net (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Volume flux Northward (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Heat flux Net (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Heat flux Northward (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Freshwater Net (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Freshwater Northward (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Ice export (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Volume flux South (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Heat flux South (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Freshwater South (t) float64 dask.array<chunksize=(31,), meta=np.ndarray>
#5 Plotting filename= plots.Fluxnet_integrals(data,path=outputpath,filename=filename,save=savefig,cmap=cmap,clim=clim,clabel=clabel)
WARNING:param.CurvePlot02240: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend. WARNING:param.CurvePlot02241: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend. WARNING:param.CurvePlot02242: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend. WARNING:param.CurvePlot02266: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend. WARNING:param.CurvePlot02267: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend. WARNING:param.CurvePlot02268: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend.
../results/SEDNA_DELTA_MONITOR/SEDNA_Fluxnet_integrals_FramS_All_Fluxnet_20120101-20120228.html starts plotting
WARNING:param.CurvePlot02290: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend. WARNING:param.CurvePlot02291: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend. WARNING:param.CurvePlot02292: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend. WARNING:param.CurvePlot02299: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend.
plotting ../results/SEDNA_DELTA_MONITOR/SEDNA_Fluxnet_integrals_FramS_All_Fluxnet_20120101-20120228.html ../results/SEDNA_DELTA_MONITOR/SEDNA_Fluxnet_integrals_FramS_All_Fluxnet_20120101-20120228.html created
Value='Fluxnet' Zone='Davis' Plot='Fluxnet_integrals' cmap='None' clabel='(Sv,TW, mSv,10^-2 Sv)' clim= ((-5.0, 5.0), (-25, 27), (-200, 50), (-9, 5)) outputpath='../results/SEDNA_DELTA_MONITOR/' nc_outputpath='../nc_results/SEDNA_DELTA_MONITOR/' filename='SEDNA_Fluxnet_integrals_Davis_Fluxnet' #3 no computing , loading starts data=save.load_data(plot=Plot,path=nc_outputpath,filename=filename) start saving data load 1Dnc file from ../nc_results/SEDNA_DELTA_MONITOR/../*/SEDNA_Fluxnet_integrals_Davis_Fluxnet*.nc load computed data completed
<xarray.Dataset> Dimensions: (t: 90) Coordinates: time_centered (t) object dask.array<chunksize=(31,), meta=np.ndarray> * t (t) object 2012-01-01 12:00:00 ... 2012-01-31 12:0... y int64 ... Data variables: Volume flux Net (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Volume flux Northward (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Heat flux Net (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Heat flux Northward (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Freshwater Net (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Freshwater Northward (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Ice export (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Volume flux South (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Heat flux South (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Freshwater South (t) float64 dask.array<chunksize=(31,), meta=np.ndarray>
#5 Plotting filename= plots.Fluxnet_integrals(data,path=outputpath,filename=filename,save=savefig,cmap=cmap,clim=clim,clabel=clabel)
WARNING:param.CurvePlot03176: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend. WARNING:param.CurvePlot03177: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend. WARNING:param.CurvePlot03178: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend. WARNING:param.CurvePlot03202: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend. WARNING:param.CurvePlot03203: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend. WARNING:param.CurvePlot03204: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend.
../results/SEDNA_DELTA_MONITOR/SEDNA_Fluxnet_integrals_Davis_Fluxnet_20120101-20120228.html starts plotting
WARNING:param.CurvePlot03226: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend. WARNING:param.CurvePlot03227: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend. WARNING:param.CurvePlot03228: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend. WARNING:param.CurvePlot03235: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend.
plotting ../results/SEDNA_DELTA_MONITOR/SEDNA_Fluxnet_integrals_Davis_Fluxnet_20120101-20120228.html ../results/SEDNA_DELTA_MONITOR/SEDNA_Fluxnet_integrals_Davis_Fluxnet_20120101-20120228.html created
Value='Fluxnet' Zone='Bering' Plot='Fluxnet_integrals' cmap='None' clabel='(Sv,TW, mSv,10^-2 Sv)' clim= ((-2, 2), (-10, 50), (-150, 50), (-2, 4)) outputpath='../results/SEDNA_DELTA_MONITOR/' nc_outputpath='../nc_results/SEDNA_DELTA_MONITOR/' filename='SEDNA_Fluxnet_integrals_Bering_Fluxnet' #3 no computing , loading starts data=save.load_data(plot=Plot,path=nc_outputpath,filename=filename) start saving data load 1Dnc file from ../nc_results/SEDNA_DELTA_MONITOR/../*/SEDNA_Fluxnet_integrals_Bering_Fluxnet*.nc load computed data completed
<xarray.Dataset> Dimensions: (t: 90) Coordinates: time_centered (t) object dask.array<chunksize=(31,), meta=np.ndarray> * t (t) object 2012-01-01 12:00:00 ... 2012-01-31 12:0... y int64 ... Data variables: Volume flux Net (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Volume flux Northward (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Heat flux Net (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Heat flux Northward (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Freshwater Net (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Freshwater Northward (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Ice export (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Volume flux South (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Heat flux South (t) float64 dask.array<chunksize=(31,), meta=np.ndarray> Freshwater South (t) float64 dask.array<chunksize=(31,), meta=np.ndarray>
#5 Plotting filename= plots.Fluxnet_integrals(data,path=outputpath,filename=filename,save=savefig,cmap=cmap,clim=clim,clabel=clabel)
WARNING:param.CurvePlot04112: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend. WARNING:param.CurvePlot04113: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend. WARNING:param.CurvePlot04114: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend. WARNING:param.CurvePlot04138: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend. WARNING:param.CurvePlot04139: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend. WARNING:param.CurvePlot04140: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend.
../results/SEDNA_DELTA_MONITOR/SEDNA_Fluxnet_integrals_Bering_Fluxnet_20120101-20120228.html starts plotting
WARNING:param.CurvePlot04162: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend. WARNING:param.CurvePlot04163: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend. WARNING:param.CurvePlot04164: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend. WARNING:param.CurvePlot04171: Converting cftime.datetime from a non-standard calendar (noleap) to a standard calendar for plotting. This may lead to subtle errors in formatting dates, for accurate tick formatting switch to the matplotlib backend.
plotting ../results/SEDNA_DELTA_MONITOR/SEDNA_Fluxnet_integrals_Bering_Fluxnet_20120101-20120228.html ../results/SEDNA_DELTA_MONITOR/SEDNA_Fluxnet_integrals_Bering_Fluxnet_20120101-20120228.html created
CPU times: user 15.4 s, sys: 6.46 s, total: 21.8 s Wall time: 1min 8s