Keyboard shortcuts

Press or to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

TCP Source Benchmarks

Performance benchmarks for TCP-based data source scenarios using daemon mode.

Purpose

Test TCP network reception and parsing performance with reliable transport.

Test Scenarios

ScenarioDescriptionValidated Features
parse_to_blackholeTCP → Parse → DiscardTCP reception + pure parsing throughput
parse_to_fileTCP → Parse → FileComplete TCP-to-file parsing pipeline
trans_to_blackholeTCP → Parse+Transform → DiscardParsing + OML transformation throughput
trans_to_fileTCP → Parse+Transform → FileComplete transformation pipeline

Quick Start

cd benchmark

# Parse to blackhole (default: 20M lines, 6 workers)
./case_tcp/parse_to_blackhole/run.sh

# Medium dataset (200K lines)
./case_tcp/parse_to_blackhole/run.sh -m

# Custom configuration
./case_tcp/parse_to_file/run.sh -w 8 sysmon 500000

Data Flow

wpgen → TCP (port 19001) → wparse daemon → sink (blackhole/file)

Configuration

  • Default Port: 19001
  • Default Workers: 6
  • Protocol: TCP (reliable transport)

TCP 源基准测试 (中文)

基于 TCP 数据源的性能基准测试,使用 daemon 模式。

用途

测试 TCP 网络接收和解析性能,使用可靠传输。

测试场景

场景说明验证特性
parse_to_blackholeTCP → 解析 → 丢弃TCP 接收 + 纯解析吞吐量
parse_to_fileTCP → 解析 → 文件完整 TCP 到文件解析管道
trans_to_blackholeTCP → 解析+转换 → 丢弃解析 + OML 转换吞吐量
trans_to_fileTCP → 解析+转换 → 文件完整转换管道

快速开始

cd benchmark

# 解析到黑洞(默认:2000 万行,6 个 worker)
./case_tcp/parse_to_blackhole/run.sh

# 中等规模数据集(20 万行)
./case_tcp/parse_to_blackhole/run.sh -m

# 自定义配置
./case_tcp/parse_to_file/run.sh -w 8 sysmon 500000

数据流向

wpgen → TCP (端口 19001) → wparse daemon → sink (黑洞/文件)

配置说明

  • 默认端口: 19001
  • 默认 Worker: 6
  • 协议: TCP(可靠传输)