Common general documents for the ESSnet
The meeting was virtual and organized in three mornings from 13 to 15 January 2021. See also the meeting agenda.
The tracks leaders give an overview of the content of Track 1 (development of test services) and track 2 (service reuse).
The architecture recommandations have the following structure:
The Cookbook is divided in two parts: the first on ARC and Relais, the second on schoolbook examples.
The schoolbook examples are managed and described in a dedicated repository.
During the track, we will work on the schoolbook scenario 1. The two services to be created are CAWI and Error Location.
Discussions will be about service reuse. Istat and Insee will present their work on their reuse cases. There could also be a presentation on the PXWeb reuse case.
The discussion will also be about the WP1 deliverables.
Repository where to find the code: https://github.com/I3S-ESSnet/ExampleServices
Presentation of the services to implement: https://miro.com/app/board/o9J_lbXK-AY=/
CAWI service:
Error localisation service:
At the starting point, the code list (list of countries) is hard coded in the two services. Example of the hard coded questionnaire: EU Weather.
The goal is to create a CodeList service and make changes to CAWI and Error Localization so they use the REST CodeList service.
Marco and Trygve worked on the Error Localisation service in Java, Romain and Benoît on the CodeList Service in Python, and Patrick and Jon on the CAWI in .NetCore.
More specifications are needed if we want to communicate about the results. It is also necessary to be able to run the services on one computer and to create Docker images to make a demonstration more easily.
The following reuse cases are reviewed:
Franck also gave an update on the developments concerning VTL tools:
Eurostat has launched the open sourcing of the VTL editor that they are developing under the EUPL license.
Good progress has been made on the Trevas VTL engine. A video on Trevas can be found here: http://krmes.info/videos/Trevas-demo.mkv. Trevas is now working with Apache Spark, and work is ongoing to deploy it on a Kubernetes cluster.
Thanks to the “deployathon” sessions, it has been possible to gain experience on deploying services on a public cloud like GCP. To do it properly, you have to be completely in an “Infrastructure as code” logic, and for this you need different competences from those needed for pre-cloud resources.
Good results have been obtained, only some documentation is missing. It is necessary to improve the reuse report deliverables for the three services, and to update the documentation about ARC, Relais and perhaps PXweb. For this the user manuals will be used. Every deliverable will be published on the Sygma and CROS portals. For each service, the as-is and will-be architecture will be documented. It would be interesting to link the WP1 deliverables with the WP2 work. Over the next few weeks, Istat will organize dedicated meetings for each reuse case in order to finalize all deliverables.
Currently, there is a very tight resource situation in Sweden. Some work remain to be done on the “why?”. On the “what?” and “how?” chapters, it is necessary to merge specific aspects with WP3. The last deliverable is not very detailed in the grant, so what has to be done is not very clear. It is decided to go got a “low profile” document compiling elements from the different presentations done during the course of the project.
The technical part has been done, a first version of the platform is available. The documentation (blueprint) has to be completed. There are two parts in this documentation: guidance on high level principles, and documentation on exploitation (in this part, the technologies change very quickly and it is difficult to have an up-to-date document: there could be a lot of appendices).
The communication package is almost done. Some materials are work in progress: the video for ARC from France, PXweb testimony from Norway, and testimony for Tau-argus from Portugal.
The PXweb video is pending with the dissemination department, they have agreed to do it but it is necessary to find the time frame. The ARC video is planned to be done for the end of January.
The flyers have to be updated because they were intended for a physical meeting, not for virtual meetings.
The changes made in the budget and the state of the deliverables have been presented.
Actions for all WP leaders:
Actions for WP1 leader:
Actions for WP2 leader:
Actions for WP3 leader:
Actions for WP4 leader:
Jakob will make the wrapping with his interactive presentation. We have to determine in which session we are and then decide which points we want to communicate. The topic could be “Track H. Frameworks, software and tools” (see NTTS program : https://www.conference-service.com/NTTS2021/documents/NTTS%202021%20topics_final.pdf)
It is proposed to make a short video on the success stories (for example integration of ARC and Relais) and a second video more GUI oriented (“this is how it looks like”, a demo like video, like the one Nicolas Laval recorded for VTL tools).
What messages do we want to give about sharing services:
Franck, Mauro and Jakob will collaborate in preparing the presentation, Pedro will be the reviewer.
Reproducing the method for deploying IS2 and ARC, the services developed during the workshop have been successfully deployed. Some difficulties were encountered, they will be documented.
Miro dashboard : https://miro.com/app/board/o9J_lb4VPS0=/
Physical or digital ?
Considering the pandemic situation, it is decided to make a virtual workshop:
Possible roadmap for organizing the workshop: