Members and Collaborators

• Genevieve Bartlett
• Jelena Mirkovic
• Jim Blythe, USC/ISI

Overview

Current testbed experiments are often ad-hoc, manual, complex and hard to repeat and reuse. This is due mostly to our current inability to capture, standardize and encode experiment behavior. In this research we look for ways to structure and automate testbed experimentation, to enable repeatability and reusability of experiments.

DEW

Distributed Experiment Workflow, or DEW, is a new experiment representation. DEW enables the researcher to abstract the definition of an experiment from its realization. It encodes the desired behavior of an experiment at a high-level as a scenario (e.g. “generate attack from A to B, wait 10 seconds, turn on defense at C”), and provides sufficient details as to how each action in a scenario can be realized on the testbed, via bindings (e.g. use script attack.py with specific parameters for the attack action). DEW further encodes only those features of testbed topology, which matter for the experiment, via constraints (e.g. “use Ubuntu OS on C”).

When an experiment is to be realized on the testbed, the constraints section of DEW is used to generate a resource request for the testbed. Once the experiment is allocated—physical nodes are reserved and loaded with the operating system—the scenario and bindings are used, along with allocation details, to produce scripts, which run on the nodes.

When the researcher runs the experiment on the testbed they parameterize and run these scripts, possibly interspersed with manual actions, which produces a run history. Together, the DEW representation, node allocations and the run history represent a complete record of an experiment, which can be shared and reused by others.

LegoTG

LegoTG is a framework for composable traffic generation with custom blueprints. Our framework facilitates easy reconfiguration, sharing and customization of traffic generation in testbed experiments, and easy adoption of new code by users.

We decompose traffic generation into orthogonal tiers: traffic feature selection, feature models, and traffic realization. We then divide realization into separate functionalities, so that each functionality can be achieved by a stand-alone customizable component which we call a “TGblock”. This modularization facilitates high code reuse, as researchers can combine TGblocks from different traffic generators, modify, replace and add TGblocks to fit their needs.
.

Software and Datasets

• DEW
• LegoTG

Publications

• Toward Findable, Accessible, Interoperable, and Reusable Cybersecurity Artifacts, David Balenson, Terry Benzel, Eric Eide, David Emmerich, David Johnson, Jelena Mirkovic and Laura Tinnel, In Proceedings of Cyber Security Experimentation and Test (CSET), 2022PDFBIB
• User Experiences with Network Testbeds, Jelena Mirkovic and Portia Pusey, In Proceedings of Cyber Security Experimentation and Test (CSET), 2021PDFBIB
• DEW: Distributed Experiment Workflows , Jelena Mirkovic, Genevieve Bartlett and James Blythe, In Proceedings of CSET, 2018PDFBIB
• Expressing Different Traffic Models Using The LegoTG Framework, Genevieve Bartlett and Jelena Mirkovic, In Proceedings of Workshop on Computer and Networking Experimental Research using Testbeds (CNERT), 2015PDFBIB
• LegoTG: Composable Traffic Generation with a Custom Blueprint, J. Mirkovic and G. Bartlett, Information Sciences Institute technical report number ISI-TR-699, 2015PDFBIB
• A Semantic Framework for Data Analysis in Networked Systems, A. Viswanathan, A. Hussain, J. Wroclawski, S. Schwab and J. Mirkovic, In Proceedings of the Networked System Design and Implementation (NSDI), 2011PDFBIB