Press [ esc ] or close+

EOSCpilot Science Demonstrator: PROMINENCE - HPCAAS for fusion

SCIENTIFIC OBJECTIVES OF THE DEMONSTRATOR

PROMINENCE provides smaller fusion sites access to HPC class nodes through a cloud interface. These sites are unique, e.g. in the development of novel algorithms which will lead to increased efficiency and impact. The demonstrator supports the fusion community to make use of distributed cloud resource, and ensure that sites running small HPC clusters can utilise them efficiently. Beyond fusion, the availability of HPCaaS will be of interest to other disciplines and will be complementary to larger machines available in PRACE. Making hardware available through EOSC infrastructure with the capability of bursting between different providers is a desirable feature for communities wanting to make limited use of HPC for modelling, analysis or development and scalability testing of novel codes.

MAIN ACHIEVEMENTS

  • Successfully used Indigo Infrastructure Manager (IM) to create small compute clusters on EGI FedCloud Resources
  • Demonstrated the running small scale MPI applications on those clusters to assess the impact of high latency interconnects
  • Demonstrated the ability to bust between fed cloud sites and commercial sites
  • Performance comparison of EGI FedCloud sites with commercial sites» Discovered currently IM does not integrate with SLA Manager
  • Demonstrated successful transfer of data from EGI FedCloud sites to S3 long term storage provided by STFC, and users ability to then access results
  • Trained a subset of users on the use of the interface and assisted them in deriving science result

IMPACT

PROMINENCE will provide smaller fusion sites access to HPC class nodes through a cloud interface. These sites provide unique expertise, e.g. in the development of novel algorithms which will lead to increased efficiency and impact. We will demonstrate that the fusion community can make use of distributed cloud resource, and ensure that sites running small HPC clusters can utilise them efficiently. This type of decentralised computing is vital for future ITER analysis where no single site will have sufficient resource to run all necessary HTC and HPC workflow.

Beyond fusion, the availability of HPCaaS will be of interest to other disciplines and will be complementary to larger machines available in PRACE. Making hardware available through EOSC infrastructure with the capability of bursting between different providers is a desirable feature for communities wanting to make limited use of HPC for modelling, analysis or development and scalability testing of novel codes.

RECOMMENDATIONS FOR THE IMPLEMENTATION

Currently, the need to have a virtual organization to make of EGI FedCloud resources, together with the limited amount of resources, meaning we cannot promote this as widely as we would like. Better integration of EGI and Indigo services should be considered a high priority. On our side, we are finalizing a simplification of the user interface to hide the complexity which will make cloud submission look more like batch submission.

Learn more of this Science Demonstrator on the EOSCpilot website.


The EOSC Portal is operated by the EOSC Enhance (Grant Agreement no. 871160), EOSC-hub (Grant Agreement no. 777536), and OpenAIRE-Advance (Grant Agreement no. 777541) projects funded by the European Union’s Horizon 2020 research and innovation programme. For a complete list of contributors, visit the About EOSC Portal