Computer Science

Virtual filter for non-duplicate sampling with network applications

Document Type

Article

Abstract

Sampling is key to handling mismatch between the line rate and the throughput of a network traffic measurement module. Flow-spread measurement requires non-duplicate sampling, which only samples the elements (carried in packet header or payload) in each flow when they appear for the first time and blocks them for subsequent appearances. The only prior work for non-duplicate sampling incurs considerable overhead, and has two practical limitations: It lacks a mechanism to set an appropriate sampling probability under dynamic traffic conditions, and it cannot efficiently handle multiple concurrent sampling tasks. This paper proposes a virtual filter design for non-duplicate sampling, which reduces the processing overhead by about half and reduces the memory overhead by an order of magnitude or more under some practical settings. It has a mechanism to automatically adapt its sampling probability to the traffic dynamics. It can be modified to handle sampling for multiple independent tasks with different probabilities. We also enhance the virtual filter for flow spread measurement and super spreader detection with a large measurement period.

Publication Title

IEEE/ACM Transactions on Networking

Publication Date

2022

Volume

30

Issue

6

First Page

2818

Last Page

2833

ISSN

1063-6692

DOI

10.1109/TNET.2022.3182694

Keywords

flow spread, non-duplicate sampling, traffic measurement

APA Citation

Ma, C., Wang, H., Odegbile, O. O., Chen, S., & Melissourgos, D. (2022). Virtual filter for non-duplicate sampling with network applications. IEEE/ACM Transactions on Networking, 30(6), 2818-2833.

Link to Full Text

Share

COinS