Toiminta-arkkitehtuurin suunnittelun tavoitteena on optimoida ja suunnitella asiakkaiden tarpeisiin ja odotuksiin
liittyvää palvelutarjontaa sekä palveluiden tuottamiseen tarvittavia toiminnan rakenteita. Rinnakkainen termi on liiketoiminta-arkkitehtuuri.
2.1. Keskeiset toimijat
Toimijat ovat ryhmitelty roolien mukaisesti.
2.2 Keskeisten toimijoiden välinen vuorovaikutus
2.3. Toiminnalliset palvelut
| 1. | ||||
|---|---|---|---|---|
| 2. | ||||
| 3. | ||||
Koulutus Tähän jäätiin | Koulutus sisältää arkkitehtuurin mukaisten palveluihin liittyvän koulutuksen (laskenta, ohjelmistot, ohjelmointi menetelmät, tiedealata, datan hallinta Koulutus voi olla lähi- tai verkkokoulutusta Advancements in data infrastructure, such as object storage and cloud services, may require major changes in data manipulations of users' computing process. Dissemination of best practices, for instance. Also "big data", GDPR etc. Sisältää etäkoulutukset MOOCs to allow users to study at their own location and on their own schedule. Organisations could also organise their own high-performance computing training (and/or education) - IT services (and/or study courses). | CSC, korkeakoulut ja tutkimuslaitokset | Erityisesti kouluttajille käyttäjille | |
| Online training - not only on-site (at CSC) | x | x | 2 | |
| Foresight for (AI/GPU) computing techniques and technologies | National service for transfering advancements in (AI/GPU) hardware technology into users' computing tasks on clusters. Fast advancement is typical especially in current GPU technology used in AI-based research. Dissemination through an expert blog, for instance. | x | x | 3 |
| Long-term student identity (CSC ID) | Students get their semi-permanent CSC account based on student status and HAKA identity. (study courses, research assistant roles, etc. - same account during the whole study duration) | x | x | 4 |
| Research process support | Increasing research process knowledge of computing support experts, through job rotation between CSC and users' organisations, for instance. | x | x | 5 |
Acquisition of computing and storage capacity, including licenses, for commercial use | Many (commercial) software have licenses where commercial use of software needs to be considered separately from academic use. | x | x | 6 |
| Long-term management of investments | Having a predictable long-term acquisition schedule and commitment for funding resources allows more frequent and smaller investment rounds, which enables closer following of technlogy advancements and lowers risks for poorly-timed acquisitions in such a case when a technology leap is just around the corner. | x | x | 7 |
| Service for externally-controlled resources (in CSC clusters) | Research institute/University-owned compute resources attached to CSC clusters where research institute/university controls priorities of the compute job queue. | xx | x | 8 |
| 4. | ||||
| Laskenta kapasiteetti | Computing time from servers, cloud included | CSC, korkeakoulut, research institutes, commercial (cloud) providers | Researchers, companies, students | |
| Project lifetime data storage msiirretään ryhmään 5 | POSIX & object storage for projects for data production & analysis. From scratch to fast disk to object storage. | CSC, universities, research institutes, commercial (cloud) providers | Researchers, companies, students | |
| Konesali ja ylläpito | DC space, electricity, administration of physical and virtual servers. Especially for more specific needs related to e.g. data security. | CSC, universities, Valtori, research institutes | Organisaatiot, sekä tutkijoille ja opiskelijoille | |
| Ohjelmisto ja tietokantapalvelut | Scientific sw and databases, sisältää hankinnat, konsortioiden hallinta ja asennukset | CSC, universities, research institutes | Organisaatiot, Researchers, companies, students | |
| Verkkopalvelut | Palvelu tarjoaa tietoliikenne yhteydet järjerstelmiin ja ulkoisiin resursseihin Sisältää lisäpalvelut kuten esim. verkonvalvonta, tietorurva, eduroam | CSC, universities, Valtori, research institutes | Orgnaisaatiot Researchers, companies, students | |
Resurssien monitorointi | Monitoring for compute & storage, load status Information for users regarding system load and storage remaining capacity | CSC, universities, research institutes | Organisaatiot Researchers, companies, students | |
| Related support/consulting and documentation kuuluu ryhmiin 3 tai 2 | Advice on resources, documentation for users and sysadmins | CSC, universities, research institutes | Researchers, company users, students | |
| Käyttöliittymät ia rajapinnat | Palvelussa tarjotaan erilaiset käyttöliitymät ja rajapinnat laskenta ja tallennus palveluihin. Palvelu sisältää työvoiden hallinnan. SSH, No Machine, Open OnDemand etc,, remote desktops, web interfaces | CSC, universities, research institutes | Researchers, company users , students | Interoperability, similar interfaces in Tier-2, Tier-1 and Tier-0 important |
| Ohjelmointi ja käyttöympäristö | Asiakkaalle tarjotaan ohjelmointi ja käyttöympäristölaskenta ja tallennus palveluihin. Compilers, numerical libraries, parallel computing libraries, performance analysis tools, debuggers, eräajojärjestelmä | CSC, universities, research institutes | Researchers, company users , students | Researchers, companies, students |
| Pilvi- ja konttiympäristöt | Kontitetut sovellukset ja ympäristöt konttisovellusten luomiseen ja ajamiseen | CSC, universities, research institutes | Researchers, company users , students | |
| 5. | ||||
| Data opening service | Place to store large data files for a long period and open those. Include also non-publicly open data (e.g. sensitive data). | CSC, Zenodo, Eudat | x | A bit out of scope but needed service nevertheless |
| Remote desktop | VDI/Remote desktop to visualize data. Also possibility to handle large datasets elsewhere that on e.g. local laptop and copying the data back and forth. | CSC | Especially users with large amount of data. | |
| Creating (international) standards | Help with stating the standards per discipline what to open and under what policies. | Multiple stakeholders, can CSC help here? | x | Hard and long term target, but very essential. |
| Data service catalogue | Comprehensive data service catalogue. What options are out there to store the data and what to choose. Considerations are opening, sensitivity, interoperability, etc. | CSC, Universities, research institutes | x | |
| Fast sensitive data storage | Fast storage space for sensitive data. Nowadays data moved back and forth between local units and CSC (ePouta CPU utilization low because data moving takes long amount of time). | CSC | x | |
| Global dataset access | Effective access to globally commonly used databases (e.g. on UK). Data should be already available at CSC. | CSC | x | |
| Better data workflow training | With large datasets researchers in transition in moving from local (laptop) to HPC resources. Training for entire way of working needed. | CSC, Universities | x | |
| RSE support for data | Small research groups do not necessarily have resources to manage their data (cleaning, cleansing). Help there is needed. Research Support Engineers (RSE) as a service would help. | CSC, Universities, Research institutes | x | |
| Automatic data transfer | Easy to use way to move data automatically between fast (Lustre) and slow (Allas) storages in the background. Way to link the data to compute task (e.g. binder) and no need to manually move the data by the user (no user rclone, rsync). Focus on usability when designing the service. | CSC | x | |
| Easy access management | Self management portal to handle access rights. Should also include capacity management. Identity management (Haka, Google, facebook). | CSC | x | |
| Palvelun nimi | Palvelun kuvaus | Palvelun käyttäjät | palvelun tuottaja | Huomiot |
|---|---|---|---|---|
| ||||
| xxxxx xxxxxx xxxxx xxxx xxx xxx xxx xxx xxx xxx | ||||
| 2. Tukipalvelut: käyttäjä- ja resurssien hallinta sekä AAI | ||||
| vvrvrvr. rvrvrvr. rvr vrv r. rvrvrvr. rvrvrvrvr rvrvrvrvrvr | rvrvrvrrvrvr rvrvrv rvrvrv | rrvr | ||
| 3. Asiantuntijapalvelualue: koulutus, menetelmät, tiedealat sekä loppukäyttäjätuki | ||||
| Koulutus | Koulutus sisältää arkkitehtuurin mukaisten palveluihin liittyvän koulutuksen (laskenta, ohjelmistot, ohjelmointi menetelmät, tiedealata, datan hallinta Koulutus voi olla lähi- tai verkkokoulutusta Advancements in data infrastructure, such as object storage and cloud services, may require major changes in data manipulations of users' computing process. Dissemination of best practices, for instance. Also "big data", GDPR etc. Sisältää etäkoulutukset MOOCs to allow users to study at their own location and on their own schedule. Organisations could also organise their own high-performance computing training (and/or education) - IT services (and/or study courses). | CSC, korkeakoulut ja tutkimuslaitokset | Erityisesti kouluttajille käyttäjille | |
| Online training - not only on-site (at CSC) | x | x | 2 | |
| Foresight for (AI/GPU) computing techniques and technologies | National service for transfering advancements in (AI/GPU) hardware technology into users' computing tasks on clusters. Fast advancement is typical especially in current GPU technology used in AI-based research. Dissemination through an expert blog, for instance. | x | x | 3 |
| Long-term student identity (CSC ID) | Students get their semi-permanent CSC account based on student status and HAKA identity. (study courses, research assistant roles, etc. - same account during the whole study duration) | x | x | 4 |
| Research process support | Increasing research process knowledge of computing support experts, through job rotation between CSC and users' organisations, for instance. | x | x | 5 |
Acquisition of computing and storage capacity, including licenses, for commercial use | Many (commercial) software have licenses where commercial use of software needs to be considered separately from academic use. | x | x | 6 |
| Long-term management of investments | Having a predictable long-term acquisition schedule and commitment for funding resources allows more frequent and smaller investment rounds, which enables closer following of technlogy advancements and lowers risks for poorly-timed acquisitions in such a case when a technology leap is just around the corner. | x | x | 7 |
| Service for externally-controlled resources (in CSC clusters) | Research institute/University-owned compute resources attached to CSC clusters where research institute/university controls priorities of the compute job queue. | xx | x | 8 |
| 4. Laskenta ja hosting palvelualue | ||||
| Laskenta kapasiteetti | Computing time from servers, cloud included | CSC, korkeakoulut, research institutes, commercial (cloud) providers | Researchers, companies, students | |
| Project lifetime data storage msiirretään ryhmään 5 | POSIX & object storage for projects for data production & analysis. From scratch to fast disk to object storage. | CSC, universities, research institutes, commercial (cloud) providers | Researchers, companies, students | |
| Konesali ja ylläpito | DC space, electricity, administration of physical and virtual servers. Especially for more specific needs related to e.g. data security. | CSC, universities, Valtori, research institutes | Organisaatiot, sekä tutkijoille ja opiskelijoille | |
| Ohjelmisto ja tietokantapalvelut | Scientific sw and databases, sisältää hankinnat, konsortioiden hallinta ja asennukset | CSC, universities, research institutes | Organisaatiot, Researchers, companies, students | |
| Verkkopalvelut | Palvelu tarjoaa tietoliikenne yhteydet järjerstelmiin ja ulkoisiin resursseihin Sisältää lisäpalvelut kuten esim. verkonvalvonta, tietorurva, eduroam | CSC, universities, Valtori, research institutes | Orgnaisaatiot Researchers, companies, students | |
Resurssien monitorointi | Monitoring for compute & storage, load status Information for users regarding system load and storage remaining capacity | CSC, universities, research institutes | Organisaatiot Researchers, companies, students | |
| Related support/consulting and documentation kuuluu ryhmiin 3 tai 2 | Advice on resources, documentation for users and sysadmins | CSC, universities, research institutes | Researchers, company users, students | |
| Käyttöliittymät ia rajapinnat | Palvelussa tarjotaan erilaiset käyttöliitymät ja rajapinnat laskenta ja tallennus palveluihin. Palvelu sisältää työvoiden hallinnan. SSH, No Machine, Open OnDemand etc,, remote desktops, web interfaces | CSC, universities, research institutes | Researchers, company users , students | Interoperability, similar interfaces in Tier-2, Tier-1 and Tier-0 important |
| Ohjelmointi ja käyttöympäristö | Asiakkaalle tarjotaan ohjelmointi ja käyttöympäristölaskenta ja tallennus palveluihin. Compilers, numerical libraries, parallel computing libraries, performance analysis tools, debuggers, eräajojärjestelmä | CSC, universities, research institutes | Researchers, company users , students | Researchers, companies, students |
| Pilvi- ja konttiympäristöt | Kontitetut sovellukset ja ympäristöt konttisovellusten luomiseen ja ajamiseen | CSC, universities, research institutes | Researchers, company users , students | |
| 5. Tallennus ja datan hallinnan palvelualue | ||||
| Data opening service | Place to store large data files for a long period and open those. Include also non-publicly open data (e.g. sensitive data). | CSC, Zenodo, Eudat | x | A bit out of scope but needed service nevertheless |
| Remote desktop | VDI/Remote desktop to visualize data. Also possibility to handle large datasets elsewhere that on e.g. local laptop and copying the data back and forth. | CSC | Especially users with large amount of data. | |
| Creating (international) standards | Help with stating the standards per discipline what to open and under what policies. | Multiple stakeholders, can CSC help here? | x | Hard and long term target, but very essential. |
| Data service catalogue | Comprehensive data service catalogue. What options are out there to store the data and what to choose. Considerations are opening, sensitivity, interoperability, etc. | CSC, Universities, research institutes | x | |
| Fast sensitive data storage | Fast storage space for sensitive data. Nowadays data moved back and forth between local units and CSC (ePouta CPU utilization low because data moving takes long amount of time). | CSC | x | |
| Global dataset access | Effective access to globally commonly used databases (e.g. on UK). Data should be already available at CSC. | CSC | x | |
| Better data workflow training | With large datasets researchers in transition in moving from local (laptop) to HPC resources. Training for entire way of working needed. | CSC, Universities | x | |
| RSE support for data | Small research groups do not necessarily have resources to manage their data (cleaning, cleansing). Help there is needed. Research Support Engineers (RSE) as a service would help. | CSC, Universities, Research institutes | x | |
| Automatic data transfer | Easy to use way to move data automatically between fast (Lustre) and slow (Allas) storages in the background. Way to link the data to compute task (e.g. binder) and no need to manually move the data by the user (no user rclone, rsync). Focus on usability when designing the service. | CSC | x | |
| Easy access management | Self management portal to handle access rights. Should also include capacity management. Identity management (Haka, Google, facebook). | CSC | x | |
2.3.1 Palvelualueet
Diagrammi on tehty 27.5.2020 järjestettyä työpajaa varten.Diagrammissa on palveluiden tunnistamista varten nimetty alustavasti viisi palvelualuetta. Kuhunkin palvelualueeseen on merkitty siihen liittyvät keskeiset toteutettavat kyvykkyydet - helpottamaan palveluiden tunnistamista.
