The TAMS4CPS Consortium holds a series of workshops and adjacent webinars covering the TAMS4CPS M&S themes to highlight the research agenda and the state of the art from which research collaborations may arise.
Workshops held in the US consist of activities to:
- share EU and US perspectives on the state of the art, strengths and opportunities, and vision;
- identify and prioritize trends and drivers, markets, technologies and enablers in the field;
- elicit “test cases” (instances of CPSs and CPS design challenges) that can be used to benchmark modelling and simulation products (methods, tools, etc.) against the state of the art and against each other;
- identify research collaboration priorities and implementation plans.
Each US workshop which focus on a different theme in the area of modelling and simulation for CPS is followed by an EU workshop, to validate its outputs in the context of EU priorities and determine target areas for collaboration.
What is a test case?
Test cases act like exemplars that will serve as demonstrators for stretching the capabilities of CPS modelling tools and techniques. The role of test cases is to provide M&S developers with a means to evaluate their product against the state of the art and other products. The format of a test case may vary depending on the M&S research area: some may require an accompanying data set, whereas others may just be a description of the use case. The minimal requirement for a test case is a detailed enough description to provide an unambiguous specification of a cyber-physical system. Ideally a test case should contain specifications for three different competency levels to provide a form of benchmark for an M&S product. These competency levels are:
- Basic (now): this would provide “entry level” requirements for an M&S product; such a test case should be achievable by the current state of the art
- Moderate (3-5 years in the future): this would stretch the M&S product in an incremental way, expanding the state of the art in some significant, but tractable direction
- Advanced (7-10 years in the future): this would be a futuristic vision of what an M&S product should be able to achieve
Promoting a test case can potentially bring the attention of researchers, tool developers or funding bodies onto key modeling and simulation challenges to address in a particular domain.