HPC Pack install guide

HPC Pack install guide : Science,Server & Web : Rupert S

https://www.microsoft.com/en-us/download/details.aspx?id=54507 Microsoft HPC Pack 2016 including linux

Windows server: Step 1

install Microsoft HPC Pack - Microsoft HPC Pack server/Workstation/Unmanaged server/node

Head Node
127.0.0.1,dn.n-helix.com,worldcommunitygrid.org,lhcathome.cern.ch,cern.ch,boinc.bakerlab.org,cloudflareworkers.com,cloudflare.com,cloud.sfr.fr,sfrcloud.sfr.fr,webrlb01.cern.ch,boincai01.cern.ch,8.8.4.4,1.1.1.1

You will need a server certificate such as a comodo or digicert or microsoft.. for the next page of hpc pack install

https://www.gogetssl.com/compare-domain-sslcertificates/

Docker though the install service

powershell Install-PackageProvider -Name NuGet -Force
powershell Install-Module -Name DockerMsftProvider -Repository PSGallery -Force
powershell Install-Package -Name docker -ProviderName DockerMsftProvider -Force

Windows 7/8/10: Step 1

install Microsoft HPC Pack node or workstation/server

Head Node
127.0.0.1,dn.n-helix.com,worldcommunitygrid.org,lhcathome.cern.ch,cern.ch,boinc.bakerlab.org,cloudflareworkers.com,cloudflare.com,cloud.sfr.fr,sfrcloud.sfr.fr,webrlb01.cern.ch,boincai01.cern.ch,8.8.4.4,1.1.1.1

You will need a server certificate such as a comodo or digicert or microsoft.. for the next page of hpc pack install

https://www.gogetssl.com/compare-domain-sslcertificates/

https://docker.com - docker CE for windows 7/8/10 install requiring download and install of docker community edition edge..

powershell Install-PackageProvider -Name NuGet -Force
powershell Install-Module -Name DockerMsftProvider -Repository PSGallery -Force
powershell Install-Package -Name docker -ProviderName DockerMsftProvider -Force
and then install docker CE

https://docker.com

Step 2 for both : Enable Kubernets in docker and set available CPU's & Resources then >

admin : CMD

docker run --name railgun-memcached -d -p=127.0.0.1:11211:11211 -e https_proxy=http://127.0.0.1:3128 -e http_proxy=http://127.0.0.1:3128 -e ftp_proxy=http://127.0.0.1:3128 --restart=always memcached:latest

docker run -d --name=railgun -p 2408:2408 -e RG_ACT_TOKEN=ENTERapiTOKENHERE -e RG_ACT_HOST=127.0.0.1 -e RG_LOG_LEVEL=1 -e RG_WAN_PORT=2408 -e https_proxy=http://127.0.0.1:3128 -e http_proxy=http://127.0.0.1:3128 -e ftp_proxy=http://127.0.0.1:3128 --link railgun-memcached:memcached --restart=always rungeict/cloudflare-railgun

docker run -d --name=squid-memcached -p=127.0.0.1:3128:3128 -e RG_ACT_HOST=127.0.0.1 -e RG_LOG_LEVEL=1 -e https_proxy=http://127.0.0.1:3128 -e http_proxy=http://127.0.0.1:3128 -e ftp_proxy=http://127.0.0.1:3128 --link railgun-memcached:memcached --restart=always  minimum2scp/squid

docker run -d --name=nuster-memcache -p=127.0.0.1:8080:8080 -p=127.0.0.1:443:443 -p=127.0.0.1:80:80 -e RG_ACT_HOST=127.0.0.1 -e RG_LOG_LEVEL=1 -e https_proxy=http://127.0.0.1:3128 -e http_proxy=http://127.0.0.1:3128 -e ftp_proxy=http://127.0.0.1:3128 --restart=always nuster/nuster

docker run --name binddns-resolver -d --restart=always -e https_proxy=http://127.0.0.1:3128 -e http_proxy=http://127.0.0.1:3128 -e ftp_proxy=http://127.0.0.1:3128 -p 53:53/tcp -p 53:53/udp -p 5353:5353/tcp -p 5353:5353/udp -p 10000:10000/tcp --volume /srv/docker/bind:/data sameersbn/bind

# to configure and update binddns-resolver : https://localhost:10000

# alternative requires to be configured docker run --name=binddns-resolver -d -p 53:53/udp -p 53:53 -d -p 5353:5353/udp -p 5353:5353 -e https_proxy=http://127.0.0.1:3128 -e http_proxy=http://127.0.0.1:3128 -e ftp_proxy=http://127.0.0.1:3128 -d --restart=always --volume /srv/docker/bind:/data unixtastic/bind-dnssec-resolver

# Do not forget that the first DNS server is 127.0.0.1

docker run --name nax-waf -e BACKEND_IP=127.0.0.1 -e KIBANA_PASSWORD=Safe5 -d --link railgun-memcached:memcached --restart=always scollazo/naxsi-waf-with-ui

docker exec squid-memcached curl http://127.0.0.1/

****

Selenium runs once - you need to re run it on boot

https://store.docker.com/community/images/selenium/standalone-chrome
https://github.com/SeleniumHQ/docker-selenium

docker run -d -it --rm -p=0.0.0.0:9222:9222 -p=0.0.0.0:443:443  --link railgun-memcached:memcached --name=chrome-headless-selenium -v /tmp/chromedata/:/data selenium/standalone-chrome

port : 4444

****
*waf firewall*
https://hub.docker.com/r/scollazo/naxsi-waf-with-ui/
docker pull scollazo/naxsi-waf-with-ui

*zend php stack is licenced*
https://hub.docker.com/_/php-zendserver/
docker pull php-zendserver

*nginx php stack*
https://hub.docker.com/r/richarvey/nginx-php-fpm/
docker pull richarvey/nginx-php-fpm

*node js*

https://hub.docker.com/r/mhart/alpine-node/
docker pull mhart/alpine-node

*squid cache*
https://hub.docker.com/r/minimum2scp/squid/
docker pull minimum2scp/squid

*Nuster http Cache - needs configuration !*
https://github.com/jiangwenyuan/nuster
https://hub.docker.com/r/nuster/nuster/
docker pull nuster/nuster

*railgun*
https://www.cloudflare.com/docs/railgun/installation.html
https://www.cloudflare.com/docs/railgun/daemon_execution.html

https://hub.docker.com/r/rungeict/cloudflare-railgun/
docker pull rungeict/cloudflare-railgun

https://www.cloudflare.com/website-optimization/railgun/?r=1

*bind DNS*
https://hub.docker.com/r/sameersbn/bind/#introduction
docker pull sameersbn/bind

# to configure and update binddns-resolver : https://localhost:10000

****
dhcp servers

freeradius dhcp servers
https://hub.docker.com/r/freeradius/freeradius-server/
docker pull freeradius/freeradius-server
docker run -d --name my-radius -p 1812-1813:1812-1813/udp --restart=always freeradius/freeradius-server

RackHD dhcp server
https://rackhd.readthedocs.io/en/latest/
https://github.com/RackHD/
https://hub.docker.com/r/rackhd/isc-dhcp-server/
docker pull rackhd/isc-dhcp-server

docker run -d --name rackhd-dhcp -p 1812-1813:1812-1813/udp --restart=always rackhd/isc-dhcp-server

Alpine dhcp
https://hub.docker.com/r/joebiellik/dhcpd/
docker pull joebiellik/dhcpd
****

https://hackernoon.com/a-kubernetes-guide-for-docker-swarm-users-c14c8aa266cc

https://blog.alexellis.io/you-need-to-know-kubernetes-and-swarm/

Further reading for swarm node configuration

https://github.com/docker/labs/blob/master/swarm-mode/beginner-tutorial/README.md

Traefik : Swarm cloud single ip/site url; header wall that keeps all nodes hidden within to handle web traffic from the singular web portal to inside the node array list (funnels Data, Hence > traefik)
https://github.com/bee42/traefik-with-docker
https://github.com/bee42/docker-orchestration-swarming

https://hub.docker.com/r/bee42/docker-orchestration-swarming/
docker pull bee42/docker-orchestration-swarming

****
Open science grid including tensor flow & GPU
https://hub.docker.com/u/opensciencegrid/

swarm elasticsearch
https://hub.docker.com/r/agoryachev/docker-swarm-elasticsearch/

****
Media server
https://hub.docker.com/r/kurento/kurento-media-server/
docker pull kurento/kurento-media-server
docker run -d --name kms-mediaserver -p 8888:8888 kurento/kurento-media-server

Image neural enhancer
https://github.com/alexjc/neural-enhance
https://hub.docker.com/r/alexjc/neural-enhance/
docker pull alexjc/neural-enhance

caffe gpu
https://hub.docker.com/r/tleyden5iwx/caffe-gpu-master/
docker pull tleyden5iwx/caffe-gpu-master

****
Boinc HPC Computing

https://github.com/BOINC/boinc-client-docker

https://github.com/marius311/boinc-server-docker/blob/master/docs/cookbook.md

https://cosmicmar.com/2016/02/14/boinc-server-docker-1/

Our suggestion of boinc detection of docker (docker launch takes 15 seconds plus so boinc would have to wait for the process to initiate in the windows task manager before..

The initial detection system would launch for Container VM & also pull user data into the VM (the necessary ID from project add device & also set the VM and OS use for special case use and non generic project data,
Of special note is the use of Linux containers; This container potentially could batch multiple projects with finesse; In particular Science Linux and Alpine (for size and usability) (science kernel version is possible)

docker pull alpine - check this out!

*alpine is a tiny Linux with many apps very flexible 5mb*
https://hub.docker.com/_/alpine/
docker pull alpine


Finally special contained secure environments for HPC Boinc Networking science is realised with relative technical aplume & thusly easily usable by the average; Non average user.

boinc node network on alpine linux with rasberry-pi
https://github.com/firepear/homefarm

****
http://science.n-helix.com/2018/09/hpc.html - a bit about boinc in terms of Docker & Microsoft HPC Pack
http://science.n-helix.com/2017/04/boinc.html - HPC, Optimisation & Boinc - programming

HPC - Compute Network - Boinc & Science - Telecoms

HPC Compute Network - Advise install - Windows & Linux Server by Rupert S 

Spread the word : Operation Liberate the Node - High performance computation for beneficial means of complimentary use to the future & survival.

Ways and means of obtaining scientific worth and usage though the usage of High Performance Computing or HPC that can indeed solve many of the humanitarian objectives of our worlds.

Boinc VM's are a specific objective of worth to the charitable science community and field research..

http://science.n-helix.com/2017/04/boinc.html  - HPC, Optimisation & Boinc - programming

http://science.n-helix.com/2018/09/hpc-pack-install-guide.html

HPC Pack 2016 Update 1 fixes - install one after the other - after installing HPC Pack 2016 Update 1
https://www.microsoft.com/en-us/download/details.aspx?id=56964
https://www.microsoft.com/en-us/download/details.aspx?id=57174

https://www.microsoft.com/en-us/download/details.aspx?id=54507 Microsoft HPC Pack 2016 including linux

https://technet.microsoft.com/en-us/library/cc514029(v=ws.11).aspx all HPC Packs 2016,2012 to 2008 info and download

https://msdn.microsoft.com/en-us/library/ff976568.aspx Microsoft High Performance Computing for Developers - info and downloads

https://docs.microsoft.com/en-us/azure/virtual-machines/windows/hpcpack-cluster-active-directory - information and virtualisation

https://docs.microsoft.com/en-us/azure/virtual-machines/windows/hpcpack-cluster-options

Azura win+linux+iso
https://docs.microsoft.com/en-gb/azure/virtual-machines/linux/high-performance-computing

Instructions
https://docs.microsoft.com/en-us/powershell/high-performance-computing/overview?view=hpc16-ps
https://docs.microsoft.com/en-us/azure/cloud-services/cloud-services-setup-hybrid-hpcpack-cluster

Netport Clarity HPC
https://docs.microsoft.com/en-us/powershell/high-performance-computing/appendix-1-hpc-cluster-networking?view=hpc16-ps

https://docs.microsoft.com/en-us/powershell/high-performance-computing/microsoft-hpc-pack-node-deployment?view=hpc16-ps

Appendix A: KMS Client Setup Keys
https://docs.microsoft.com/en-us/previous-versions/windows/it-pro/windows-server-2012-R2-and-2012/jj612867(v=ws.11)

Operational achievement & field testing of HPC configuration.

You will need a server certificate such as a comodo or digicert or microsoft > https://www.gogetssl.com/compare-domain-sslcertificates/

Simple Final 4 - Test configuration - Operation : Help https://worldcommunitygrid.org , Boinc , Cloudflare , HPC & SFR SA .. Achieve dreams of computation that will exceed expectations of science today.

Install Microsoft HPC Pack 2016 or higher , performance HPC pro users ! including linux , for host settings of HPC Pack

For CCP_CONNECTIONSTRING & CCP_SCHEDULER ; Set in the install setup when installed.

The node address you enter for HPC pack for the nodes, load the certificate into the next page of install & root certificate!

CCP_CONNECTIONSTRING=127.0.0.1,dn.n-helix.com,worldcommunitygrid.org,lhcathome.cern.ch,cern.ch,boinc.bakerlab.org,cloudflareworkers.com,cloudflare.com,cloud.sfr.fr,sfrcloud.sfr.fr,webrlb01.cern.ch,boincai01.cern.ch

CCP_SCHEDULER=127.0.0.1,dn.n-helix.com,worldcommunitygrid.org,lhcathome.cern.ch,cern.ch,boinc.bakerlab.org,cloudflareworkers.com,cloudflare.com,8.8.4.4,cloud.sfr.fr,sfrcloud.sfr.fr,webrlb01.cern.ch,boincai01.cern.ch

**** Some Alternative HPC Paths that compliment Microsoft HPC Pack

https://docs.docker.com/get-started/

Kubernets K8's Docker comes with a version for local clusters
https://kubernetes.io/docs/concepts/
https://kubernetes.io/docs/setup/pick-right-solution/
https://kubernetes.io/docs/setup/pick-right-solution/#local-machine-solutions

*docker containers of use* & BOINC Host/Client VM Cloud Configuration.

docker pull kubernets/spinnaker-clouddriver
docker pull cloudnativelabs/kube-router
docker pull alpine
docker pull whatwedo/cloudflare-railgun
docker pull rungeict/cloudflare-railgun

docker run --name railgun-memcached -d -p=127.0.0.1:11211:11211 --restart=always memcached:latest

docker run --name=binddns-resolver -d -p 53:53/udp -p 53:53 -d -p 5353:5353/udp -p 5353:5353 -d --restart=always unixtastic/bind-dnssec-resolver

docker run -d --name=railgun -p 2408:2408 -e RG_ACT_TOKEN=ENTERTOKENHERE -e RG_ACT_HOST=127.0.0.0 -e RG_LOG_LEVEL=1 -e RG_WAN_PORT=2408 --link railgun-memcached:memcached --restart=always rungeict/cloudflare-railgun

Do not forget that the first DNS server is 127.0.0.1

docker run -d --name=squid-memcached -p=127.0.0.1:3128:3128 -e RG_ACT_HOST=127.0.0.1 -e RG_LOG_LEVEL=1 -e http_proxy=http://127.0.0.1:3128 --link railgun-memcached:memcached --restart=always  minimum2scp/squid

docker run --name nax-waf -e BACKEND_IP=127.0.0.1 -e KIBANA_PASSWORD=Safe5 -d --link railgun-memcached:memcached --restart=always scollazo/naxsi-waf-with-ui

docker exec squid-memcached curl http://127.0.0.1/

https://store.docker.com/community/images/selenium/standalone-chrome
https://github.com/SeleniumHQ/docker-selenium


Selenium runs once - you need to re run it on boot

https://store.docker.com/community/images/selenium/standalone-chrome
https://github.com/SeleniumHQ/docker-selenium

port : 4444

https://store.docker.com/community/images/alpeware/chrome-headless-trunk
docker run -d -it --rm -p=0.0.0.0:9222:9222 -p=0.0.0.0:443:443 --name=chrome-headless -v /tmp/chromedata/:/data alpeware/chrome-headless-trunk

port : 9222

***

https://github.com/BOINC/boinc-client-docker
https://github.com/marius311/boinc-server-docker/blob/master/docs/cookbook.md
https://cosmicmar.com/2016/02/14/boinc-server-docker-1/

Our suggestion of boinc detection of docker (docker launch takes 15 seconds plus so boinc would have to wait for the process to initiate in the windows task manager before..

The initial detection system would launch for Container VM & also pull user data into the VM (the necessary ID from project add device & also set the VM and OS use for special case use and non generic project data,
Of special note is the use of Linux containers; This container potentially could batch multiple projects with finesse; In particular Science Linux and Alpine (for size and usability) (science kernel version is possible)

docker pull alpine - check this out!

Finally special contained secure environments for HPC Boinc Networking science is realised with relative technical aplume & thusly easily usable by the average; Non average user.

RS

In other notes : 

https://www.openfabrics.org/

http://www.opencompute.org/

https://openhpc.community/downloads/

https://azure.microsoft.com/en-us/resources/templates/slurm/

https://wikis.nyu.edu/display/NYUHPC/Slurm+Tutorial
https://wiki.hpc.uconn.edu/index.php/SLURM_Guide

Linux, Windows excetera HTCondor
https://research.cs.wisc.edu/htcondor/

Platform LSF will do much you can utilise, It runs on Windows. It is commercial, and can be purchased with support. https://www.ibm.com/it-infrastructure

****

*waf firewall*

https://hub.docker.com/r/scollazo/naxsi-waf-with-ui/
docker pull scollazo/naxsi-waf-with-ui

*zend php stack is licenced*

https://hub.docker.com/_/php-zendserver/
docker pull php-zendserver

*nginx php stack*

https://hub.docker.com/r/richarvey/nginx-php-fpm/
docker pull richarvey/nginx-php-fpm

*node js*

https://hub.docker.com/r/mhart/alpine-node/
docker pull mhart/alpine-node

*squid cache*

https://hub.docker.com/r/minimum2scp/squid/
docker pull minimum2scp/squid

***

*alpine is a tiny linux with many apps very flexible 5mb*

https://hub.docker.com/_/alpine/
docker pull alpine

If you are wondering what putty is in windows hpc pack,

Appearing to be SSH Shell client (console)

https://www.putty.org/

https://research.computing.yale.edu/support/hpc/user-guide/connect-windows-putty
http://inside.mines.edu/HPC-SSH-Putty

(C)Rupert S

Univers/e/al Algebra - Paper

Univers/e/al Algebra - Paper

Creational diversification of universe creation though algebra expression.

Imagination and will power in the data space.

Universe,Integer,Float,Rand,Chaos - Computation.


Firstly Algebra fits all theories nicely in a mesh... will algebra hold onto all our data ?
To explain definitely but singularly!

Quantum physics is an export to algebra's precision...
or the input into algebra's certainty.

Expanding upon algebra with Expansion floats... Or returning to certainty from the clarity of quantum improbability..

Add to the theory of data and command execution and we may incert all code after the rules as long as we do not mind the result and the outcome.

Probable and usable theory creates rule sets for a universe even if not our own.

Thus we can provide a space for programing logic and algebra in universe creation, To provide the key pre expression note...

To consider the rules one may well define the layout of the source, "The Creative Machine".


Multiverse theory though mathematical, programmatical and chaos fractal origin.

(c)Rupert S

Combining these three allows complexity within subjective conception or to the observer a view of complexity in simplicity.

http://science.n-helix.com/2018/06/compression-libraries-index-prime.html
http://science.n-helix.com/2018/01/integer-floats-with-remainder-theory.html
http://science.n-helix.com/2018/07/universeal-algebra-paper.html

Precision Psychology

Precision Psychology & Psycho-metrics

Data on precision from 1970 to 2000's study indicates that research requires funding - for publishing

However the conclusions test the dynamic of human consciousness & interestingly show that data within the learning brain will need multiple executions to further precision of the learner,
However that the dynamic of the individual varies from one person to another,

Thusally to advantage education the results indicate that the S.A.T testing of america does contain a certain validity,
Fundamentally the mind neural net contains a lower fidelity precision to retaining & re training data than humanity really feels entitled to!

Better training & Better use of graphs and tables; Better use of time allocated to training & learning; Improving the result may take many years,

Case studies such as degrees in doctoring & tailoring have been selectively modified for the average mean & ill suite perfect ideals & with lower precision to old data 4bit & 5 bit..

Experiments that have improved modern man/humanity are frankly advertisement or Visual testing & exploitation aka elections & voting, food & goods for example.

(c)Rupert S

https://science.n-helix.com/

https://www.zdnet.com/article/is-your-brain-analog-or-digital/

https://arxiv.org/ftp/arxiv/papers/1805/1805.01631.pdf

Uses for micro laser & light emitting sources

Uses for micro laser & light emitting sources - (c)RS

"@ThisWeekinHPC  this is a pretty legendary research with quite a number of applications...
I have a few but no comment on what :L http://bit.ly/nanobeads"

"Scientists Create Continuously Emitting Microlasers With Nanoparticle-Coated Beads"
"Laser properties of 5-micron spheres"

"Angel Fernandez-Bravo, a postdoctoral researcher at Berkeley Lab’s Molecular Foundry, who was the lead author of study, mixed the beads with sodium yttrium fluoride nano-particles “doped,” or embedded, with thulium, an element belonging to a group of metals known as lanthanides. The Molecular Foundry"

****

Since the nano micro beads re emit ...

Controlling the signal allows for the following applications and more: (c)RS


Low power Fiber Ethernet...

Solar Batteries (the nano beads allow infrared to be emitted into solar cells over hours at optimum frequency)

Light bulbs that convert incandescent infrared heat sources into light...

Light emission conversion of high potential energy sources into pure light..

The creation of ultra low power usage light chips...

To provide power to satellites during the shadow times... (solar conversion)

To cool space ships by the emission of light on reflectors and or as controlled light sources during reentry & friction events... (space craft heat shielding)

Various functional usages such as lighting rooms from fire places, candles and other low emission sources such as body heat...

Emission of satellite download data into light sensors (they have to be shielded and latency will be low)

Network buffers and boosters...

Cohesive Light Computer Processors

Disordered Light Computer Processors

Low power Electro cell CPU/GPU/processors with conversion and light chip dynamic (tm)

(c)Rupert S

Nano foundry promotion & security

https://nano-foundry-lbl.org.hpc.n-helix.com/

https://science.n-helix.com/

Compression Libraries - Index Prime

JPG / Math / Chaos Solve - Compression Libraries - Index Prime - Index fractal : (c) RS

Scientists have reformulated compression & JPG algorithms to create imprecise Math Libraries that improve the amount of data a logic X/Y Table can contain + N to the power of D

To be clear the principle works but does not lead a perfect accuracy...

However the use of advanced compression,

Algorithms like LZ and Br GZIP with further improve matters in the GPL Versions that we the consumer are allowed to make.. (Due to the fact that compression is at the very least STACKER or LZ & ZIP & JPG etcetera)

In short i personally lay claim to the foundations of compressed RAM/Arrays & Math units..

Including Decompression run-time and approximate similarity Compression with True Value Lossless compression (for details) & math solve fractal,

JPG / Math / Chaos Solve - Compression Libraries - Index Prime - Index fractal

Here signed (c) Rupert S

in reference to inspire

Matrix of density - Black holes RS

Black holes : Matrix of density

Such an ultra dense material as a black hole contains the density to compress the wave length,
In principle depending on the properties of the waves within the medium to infinity..
However due to the nature of differing waves the combining principle of the combined wave forms may diverge from the principles found within this universe,

The differences found in heavy bosons and wu particles for example mean that particles perceptibly differing in principle and action compared to matter density; energy; Gravity and fluctuations in quantum and other forces create divergence in principle over time.

Existence thusly is not always the same in principle or function & or action or potential.

(c)Rupert S

http://science.n-helix.com/2014/02/revolution-in-processor-clocks.html