User Tools

Site Tools


platform:sungrid

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
platform:sungrid [2017/09/02 18:03]
support
— (current)
Line 1: Line 1:
-====== Using the SUN Grid Compute Utility ====== 
-**Note:​** ​ In early 2010 Oracle announced it was discontinuing the Sun Cloud project. Since Sunday, March 7, 2010, the network.com web site has been inaccessible 
-===== GAMS on the SUN Grid ===== 
-Currently installed is GAMS distribution 22.5 for Solaris 10. Please check the information about the currently supported solvers on that platform. The installation includes these solvers without size restrictions: ​ 
-    * GAMS/BDMLP (LP/​MIP) ​ 
-    * GAMS/​COINBONMIN (MINLP) ​ 
-    * GAMS/​COINCBC (LP/​MIP) ​ 
-    * GAMS/​COINGLPK (LP/​MIP) ​ 
-    * GAMS/​COINIPOPT (CNS/​NLP) ​ 
-    * GAMS/MILES (MCP) 
  
-The setup supports (any or all of which): 
-  * Sequential and Parallel Job Submission 
-  * GAMS Grid Computing Facility 
-  * Parallel Solver Threads ​ 
- 
- 
- 
- 
- 
-===== Simple GAMS Job Submission ===== 
-Note: We use the model [[https://​www.gams.com/​latest/​gamslib_ml/​libhtml/​gamslib_trnsport.html|trnsport]] from the GAMS model library as an example. ​ 
-  * Create a working directory 
-  * Copy all required model files (e.g. ''​trnsport.gms''​) into the working directory directory 
-  * Create a script ''​rungams.sh''​ there. This file contains the full command line(s) to be executed, e.g.: <​code>​gams/​gams trnsport.gms lo=3 </​code>​ The entries ''​gams/​gams''​ and ''​lo=3''​ are mandatory. If your script has several lines, please make sure to save it in [[http://​en.wikipedia.org/​wiki/​Newline|Unix Format]] (''​LF''​ and **not** ''​CR+LF''​) 
-  * Zip all files ({{platform:​trnsport.zip|trnsport.zip}}) 
-  * Logon to the [[http://​en.wikipedia.org/​wiki/​Sun_Cloud|Sun Grid]]: "//​Since Sunday, March 7, 2010, the network.com web site has been inaccessible.//"​ 
-    {{platform:​connect.jpg|}} 
-  * Goto to the Job Catalog and checkout the GAMS Job 
-    {{platform:​checkout.jpg|}} 
-  * Generate new resource (type Data) named ''​trnsport'' ​ and upload your compressed files (''​trnsport.zip''​) 
-   ​{{platform:​resource.jpg|}} 
-  * Edit the catalog job GAMS and add trnsport.zip as an user supplied resource. Don't forget to save the the modified job 
-    {{platform:​edit.jpg|}}  ​ 
-  * Submit the job 
-    {{platform:​job_running.jpg|}} 
-  * Wait until it has finished ​ and download the {{platform:​gams_22.5_111731.zip|results}} 
-    {{platform:​download.jpg|}}  ​ 
- 
- 
-===== Parallel Job Submission ===== 
-The example above submits the jobs sequentially to the GRID engine. If you want parallel submission of multiple jobs, you will need a modified setup: 
-  - Create a subdirectory called ''​models''​ in your working directory 
-  - Copy all model and data files into the directory ''​models''​ 
-  - Copy the script ''​rungams.sh''​ (below) and your license file ''​gamslice.txt''​ (if any) into your working directory. 
-  - Zip everything, e.g: ''​zip -9r batch *''​ 
-  - Logon to the Sun Grid 
-  - Generate new resource (type Data), e.g. ''​Batch'' ​ and upload your compressed files (''​batch.zip''​). 
-  - Edit the job GAMS and add batch.zip as an user supplied resource. Don't forget to save the the modified job. 
-  - Finally submit the job, wait until it has finished ​ and download the output. 
-Here are the {{platform:​batch.zip|input}} and the {{platform:​gams_22.5_111724.zip|output}}-files of an example (batch). 
-<​code>​ 
-#​!/​bin/​ksh  ​ 
-if [ -f $HOME/​.profile ]; then 
-       . $HOME/​.profile 
-fi 
-LD_LIBRARY_PATH=$HOME/​gams:/​usr/​sfw/​lib/​amd64:​$LD_LIBRARY_PATH;​ export LD_LIBRARY_PATH 
-PATH=$PATH:​$HOME/​gams;​ export PATH 
-for p in models/​*.gms 
-  do 
-    # get the file name without path and  extension 
- fn=${p##​*/​};​fn=${fn%.gms}.sh; ​ export fn 
-        echo "echo Filename: $fn                           "​ > $fn 
-        echo "​env|grep -i hostname ​                        "​ >>$fn 
-        echo "​gams/​gams ${p} lo=3                          " >>$fn 
-        chmod 750 $fn 
-        qsub -cwd -V  $fn 
-done  
-</​code>​ 
-**Notes:​** ​ 
-  * If you want to provide your own GAMS license file (''​gamslice.txt''​),​ copy it into the working directory and not into the models directory. Also in ''​rungams.sh'' ​ change the GAMS call to: ''​echo "​gams/​gams ${p} lo=3 license = gamslice.txt " >>​$fn''​ 
-  * Please note that we use simple distributed parallel processing: All jobs are being distributed independently,​ repetitive tasks to separate Sun Grid Compute Utility nodes for processing and do not require tasks to execute concurrently. Please check [[http://​www.sun.com/​service/​sungrid/​SunGridDevelopersGuide.pdf|the Sun Grid Developer'​s Guide]] for more information. 
- 
-===== Using the GAMS Grid Computing Facility ​ on the SUN Grid Compute Utility ===== 
-In addition to parallel job submission the [[http://​www.gams.com/​docs/​gridcomputing.htm|GAMS Grid Computing Facility]] also supports parallel model solution, i.e. the generation and submission of models for solutions that can be solved independently. Just follow the instructions in Appendix J of the GAMS User's Guide for more information,​ how to setup your model. 
-As an example you may use the {{platform:​trnsgrid.zip|input}} and {{platform:​gams-current_111260.zip|output}} files for the [[http://​www.gams.com/​modlib/​libhtml/​trnsgrid.htm|trnsgrid]]-model of the GAMS model library. 
- 
- 
-===== Using Parallel Solver Threads (SMP) ===== 
-Each CPU of the Sun Grid has 2 Cores with 2 * 4GB of RAM. Two parallel CPLEX solver threads are supported (with the proper license and  a cplex option file). Please check the GAMS/CPLEX solver manual for more information. 
- 
-===== Getting the number of different CPUs for running a job ===== 
-  * Unzip the output file from a run into a temporary directory 
-  * Search for ''​HOSTNAME''​ in *.sh.o*, e.g, e.g.( if ''​grep''​ is installed) for the ''​batch''​ example you will something similar to:  
-<​code>​ 
-grep -i hostname *.sh.o* 
-bdmlp_indus89.sh.o25721:​HOSTNAME=r133c23z1.network.com 
-cbc_indus89.sh.o25722:​HOSTNAME=r129c24z0.network.com 
-chenery.sh.o25723:​HOSTNAME=r130c05z0.network.com 
-fuel.sh.o25724:​HOSTNAME=r130c25z1.network.com 
-gemmcp.sh.o25725:​HOSTNAME=r133c25z1.network.com 
-glpk_indus89.sh.o25726:​HOSTNAME=r133c23z0.network.com 
-openpit.sh.o25727:​HOSTNAME=r129c26z0.network.com 
-waterx.sh.o25728:​HOSTNAME=r133c36z1.network.com 
-</​code>​ 
--> This job  was running on 8 different CPUs.  
- 
- 
-=====  Individual Installation of the Software ===== 
-For more information about an individual installation of GAMS on the SUN Grid Compute Utility please visit the [[installation:​sungrid| installation notes]]. 
- 
-===== More Resources ​ ===== 
-  * [[http://​sungrid.dev.java.net|Sun Grid Developer Community Web]] 
-  * [[http://​www.gams.com/​docs/​gridcomputing.htm|The GAMS Grid Computing Facility]] 
-  * Wikipedia entries on: 
-    * [[http://​en.wikipedia.org/​wiki/​Grid_computing|Grid Computing]] 
-    * [[http://​en.wikipedia.org/​wiki/​Sun_grid|the Sun Grid]] 
IMPRESSUM / LEGAL NOTICEPRIVACY POLICY platform/sungrid.1504368207.txt.gz ยท Last modified: 2017/09/02 18:03 by support