Replaying AWS SNS

Background

AWS SNS (Simple Notification Service) uses HTTP-based APIs, which means you can use Speedscale's standard replay capabilities to capture and replay SNS traffic. Unlike protocol-specific brokers like Kafka or RabbitMQ, SNS traffic can be replayed directly using Speedscale's standard HTTP replay functionality.

For more information about AWS SNS, see the AWS SNS documentation.

Prerequisites

1. speedctl is installed
2. Create a snapshot containing the traffic you need.

Standard Replay Approach

Since AWS SNS uses HTTP-based APIs, you can use Speedscale's standard replay capabilities:

1. Capture Production Traffic: Use Speedscale to capture your application's interactions with AWS SNS
2. Create a Snapshot: Create a snapshot from the captured traffic
3. Run a Replay: Use Speedscale's standard replay functionality to replay the traffic

For detailed instructions on using Speedscale's standard replay capabilities, see the Getting Started Guide.

Alternative: Custom Load Driver Approach

If you need more control over message replay patterns or want to extract and replay messages independently, you can use a custom load driver approach similar to Kafka and RabbitMQ:

Extract the data

Grab your snapshot id and run this command to extract message payloads from SNS traffic:

speedctl extract data <snapshot-id> --path .http.request.body --path .ts

This will generate a CSV with message data, timestamps, and corresponding RRPair UUIDs.

Create your producer

Create a custom load producer using the AWS SDK for your preferred language. The steps are:

1. Read the CSV from the previous step
2. Create an AWS SNS client
3. Iterate over the CSV
4. For each row, extract the message body and optionally the timestamp
5. If timing mode is enabled, wait between messages to match the original recording timing
6. Publish the message to the SNS topic
7. Close the client when complete

An example script in Go is provided below:

package main

import (
	"encoding/csv"
	"flag"
	"fmt"
	"io"
	"os"
	"time"

	"github.com/aws/aws-sdk-go/aws"
	"github.com/aws/aws-sdk-go/aws/session"
	"github.com/aws/aws-sdk-go/service/sns"
)

var (
	respectTiming = flag.Bool("respect-timing", false, "Respect original message timing from recording")
	csvFile       = flag.String("csv", "your_file.csv", "Path to CSV file")
	topicARN      = flag.String("topic", "arn:aws:sns:us-east-1:123456789012:demo-topic", "SNS topic ARN")
	region        = flag.String("region", "us-east-1", "AWS region")
)

func main() {
	flag.Parse()
	if err := do(); err != nil {
		panic(err)
	}
}

func do() error {
	// Open CSV file
	file, err := os.Open(*csvFile)
	if err != nil {
		return fmt.Errorf("failed to open CSV file: %w", err)
	}
	defer file.Close()

	// Create CSV reader
	reader := csv.NewReader(file)

	// Skip header row
	if _, err := reader.Read(); err != nil {
		return fmt.Errorf("failed to read CSV header: %w", err)
	}

	// Create AWS session
	sess, err := session.NewSession(&aws.Config{
		Region: aws.String(*region),
	})
	if err != nil {
		return fmt.Errorf("failed to create AWS session: %w", err)
	}

	// Create SNS client
	svc := sns.New(sess)

	var lastTimestamp time.Time
	startTime := time.Now()

	// Iterate over CSV rows
	for {
		row, err := reader.Read()
		if err == io.EOF {
			break
		}
		if err != nil {
			return fmt.Errorf("failed to read CSV row: %w", err)
		}

		// Extract message body from first column
		messageBody := row[0]

		// Handle timing if enabled
		if *respectTiming && len(row) > 1 {
			// Parse timestamp from second column
			timestamp, err := time.Parse(time.RFC3339Nano, row[1])
			if err != nil {
				return fmt.Errorf("failed to parse timestamp %s: %w", row[1], err)
			}

			// Calculate delay relative to previous message
			if !lastTimestamp.IsZero() {
				delay := timestamp.Sub(lastTimestamp)
				if delay > 0 {
					time.Sleep(delay)
				}
			} else {
				// First message - record start time
				startTime = time.Now()
			}
			lastTimestamp = timestamp
		}

		// Publish message to SNS topic
		_, err = svc.Publish(&sns.PublishInput{
			TopicArn: aws.String(*topicARN),
			Message:  aws.String(messageBody),
		})
		if err != nil {
			return fmt.Errorf("failed to publish message to SNS: %w", err)
		}
	}

	if *respectTiming {
		elapsed := time.Since(startTime)
		fmt.Printf("Replay completed in %s with original timing\n", elapsed)
	} else {
		fmt.Println("Replay completed at maximum speed")
	}

	return nil
}

Usage Examples

Publish messages as fast as possible (default):

go run main.go --csv your_file.csv --topic arn:aws:sns:us-east-1:123456789012:demo-topic --region us-east-1

Respect original message timing from the recording:

go run main.go --csv your_file.csv --topic arn:aws:sns:us-east-1:123456789012:demo-topic --region us-east-1 --respect-timing

note

Make sure to update the topic ARN, AWS region, and ensure you have proper AWS credentials configured (via environment variables, IAM role, or AWS credentials file). SNS topics can be created via the AWS Console or CLI. Use the --respect-timing flag to preserve the original message timing patterns from your production traffic, or omit it to send messages as fast as possible for maximum throughput testing.

Note: SNS is a pub/sub service that delivers messages to multiple subscribers. When replaying, messages will be delivered to all subscribers configured for the topic.