NBomber 6.0.1

Blog post about NBomber v6.0.1

Changes

• Implement custom Metrics API #732
• Improve Console UI for printing metrics #807
• Thresholds C#/F# check func should be printed in HTML Report #777
• Add new system metrics #772
• Optimize performance calculation of Mean and StdDev #771
• HTML Report - move .NET process metrics into Scenario tab #766
• Add failures stats for CSV report #761
• Reduce allocation for JSON serialization #760
• Add GetScenarioTimerTime() #738
• Coordinator report memory performance improvements on long bombing runs #733
• Add option to pass custom latency #727
• Add links into XML comments to refer to documentation pages #724
• Auto Cluster - NBomber session and agent folder(s) flat structure #719
• Add ScenarioStatsActor metrics compression #714

Fixes

• Fix bug with Thresholds for missed metrics #798
• Correct NuGet Packages to Debug NBomber Tests? (Visual Studio (Repeated System.IO.IOException , Console.dll) #729
• Revisit allocations #723
• Add property based testing for ScenarioStatsActor & MetricsStatsActor #711
• Improve F# Error handling by using common IFault #757
• Unhandled exception: MetricsStatsActor failed #695

NBomber.Studio

• Fixed bug with incorrect handling for session switch.
• Added auto-update

New examples

• Runtime Thresholds

Roadmap

• Roadmap

NBomber v5.8.2

Changes

• Update vulnerable packages for NBomber.Contracts
• Update vulnerable packages for NBomber.Sinks.InfluxDB

NBomber v5.8.1

Fixes

• Fix bug with NullReference raised in latest version of ConsoleTables package #755

NBomber v5.8.0 - Scenario Weight, Runtime Thresholds

Changes

• Add Thresholds support #746
• Add Scenario Weight to introduce dynamic workload distribution #663
• Implement Random.Zipf extension method #726
• Implement Random.Choice extension method #725
• NBomberRunner LoadConfig should be able to load JSON content #750
• HTML Report - Latency indicators should display selected step's data #753
• Add Get/Find/Exist extensions for Stats types that work without allocations #742
• Add offline license validation #736
• Make it possible to remove Net real-time stats table from Console #705

Fixes

• HTML generation fails when scenario duration is less than 5 sec #741

NBomber.Http

• WithJsonBody method adds the wrong headers

New examples

• Runtime Thresholds
• Scenario Weight
• Zipfian Distribution
• Multinomial Distribution

Roadmap

• Roadmap

NBomber v5.7.0 - Timescale, WebBrowser

Docs updates

• Output Reports
• WebBrowser support
• TimescaleDB Sink
• SessionID CLI Args

Changes

• Add CLI argument to override SessionId #696
• Add ScenarioCancellationToken to IScenarioContext #696
• Add ReportFinalizer handler to allow manipulation of final data for report generation #690
• HTML Report - Display ClusterInfo, NBomberConfig #637
• Show Standard Deviation in HTML Report #676

Fixes

• Grafana - Incorrect query for Request Count #694
• AutoCluster - Grafana dashboard isn't displaying Status Codes #697
• Improve license validation #686

NBomber.Timescale

• Add RealtimeStatsSink for TimescaleDB #665

NBomber.WebBrowser

• Add support of WebBrowser Testing #649

New examples

• TimescaleDB
• WebBrowser testing
• Grafana Loki

Roadmap for v5.8.0

• Roadmap

NBomber v5.6.0 - MQTT and new Thresholds

Docs updates

• Asserts and Thresholds
• Bytes API
• Scenario Stats API
• HTTP JSON support
• Tracing HTTP request
• MQTT plugin

Changes

• Add Bytes extensions API #677
• Add InstanceId and InstanceNumber for ScenarioInfo #671
• Add Percent property to express thresholds #579
• Add ScenarioInstanceData dictionary for IScenarioContext #651
• Improve logger for NBomber Cluster #666
• Fix incorrect data transfer stats for GlobalInfo when multiple steps involved #653
• Fix repeated test step names in HTML report #647
• Fix bug with HTML and DateTime parsing #673

NBomber.HTTP

• Extend HTTP plugin by parametric typed Send<TResponse>(request) #659
• Extend HTTP plugin by WithJsonBody(data) #625
• Add HTTP tracing for NBomber.Http #528

NBomber.MQTT

• Implement NBomber MQTT plugin #349 by @mangystx

New examples

• Ping MQTT by @mangystx
• HTTP JSON
• HTTP Tracing
• Assert and Thresholds

NBomber v5.5.0 - WebSockets

Changes:

• Add API for scenario distribution Zipfan, Multinomial, Uniform

• Add Single-file deployment support

• Fixed issue with log file > 1GB

• Add NBomber.WebSockets plugin

Docs updates:

• Dynamic workloads
• WebSockets
• NBomber.Data

New examples:

• Dynamic worloads

• Data examples

• WebSockets

NBomber v5.4.1 - Fixes for ReportingSink

Roadmap

Fixes:

• Fixed incorrect disposing of ReportingSink in cluster mode

NBomber v5.4.0 - Iterations support

Roadmap

Changes:

• Add Iterations support for Load Simulations
• Change behavior of InvocationNumber
• Add displaying units of measure for Console, Txt, Md
• Improved randomization for ScenarioActor invocation

Docs updates:

• Load Simulations
• Iterations For Constant
• Iterations For Inject
• Timeouts
• License
• Grafana

New examples:

• Total Iterations

NBomber v5.3.0 - Manual Cluster

Roadmap

Changes:

• Add Manual Cluster

Fixes:

• Fixed leader election bug (race condition) for AutoCluster when cluster contains more than 300 nodes
• Fixed validation for an empty ScenarioSettings
• Fixed validations for an empty LoadSimulations

Docs updates:

• Manual Cluster
• Local Dev Cluster
• Install NATS Message Broker
• CLI Arguments

New examples:

• Manual Cluster Example