Skip to main content

Release Notes

v1.3.405: 2023-09-19

  • SPD-6108 increase analyzer memory requests
  • SPD-6089 Don't duplicate report analysis
  • SPD-6020 change report status as soon as testing is done
  • SPD-6026 remove report's intermediary processing buffers
  • SPD-6102 increase tracker timeout
  • SPD-6101 better logs

v1.3.400: 2023-09-17

  • SPD-6088 simplified aggregate processing
  • SPD-6094 better dupliate logic for kraken
  • SPD-6093 permit malformed access tokens
  • SPD-6091 avoid hanging on streaming metric RPCs
  • SPD-6090 logging improvements
  • SPD-6088 don't overwrite replay events
  • SPD-5908 Use new field for ability to set log collection
  • fix:use more efficient reading mechanism and better library for gzip
  • SPD-6078 namespace not required for operator to inspector RPCs
  • SPD-6076 refactor grpc error code checks
  • SPD-6075 add report ID to event response in inspector
  • SPD-6056 Prevent deadlock during snapshot reanalyze
  • SPD-6057 Move default configs out of s3 pt 1
  • SPD-6064 Add restart policy to compose files
  • SPD-6063 Separate out lambdas for scanning
  • fix: remove deadcode from goproxy
  • SPD-6050 Fix bug with duplicate aggregates
  • SPD-6059 collect logs should only exclude misc
  • SPD-6050 Refactor aggregates so that cpu/mem are separated by container
  • SPD-6061 tell karpenter to never evict analyzer jobs
  • SPD-6059 flush logs only
  • SPD-6059 go mem limit and flush logs from memory
  • SPD-6054 use the protocol identifier to know we read any data or not
  • SPD-6055 remove restrictive assertion defaults
  • SPD-5834 process client SET statements

v1.3.375: 2023-09-13

  • SPD-6048 Separate out lambda image building
  • SPD-6045 fix setting replay events from operator
  • SPD-6046 error when reports or snapshots fail, even if it's not our fault so we can help the customer
  • SPD-6003 Make analyzer job launch synchronous to prevent broken states
  • SPD-6044 update CSV errors
  • SPD-6041 handle NoSuchKey error so that we get the right grpc code
  • SPD-6044 handle index or column for key
  • SPD-6038 Make auto allocated users non-admins
  • SPD-6036 Handle panic for assertion loading
  • SPD-3060 add retrieve operator config
  • SPD-6030 add RetrieveOperatorConfig
  • SPD-6029 use heartbeat or updated at time for latest snapshot update
  • SPD-5834 complete mysql handshake requiring auth
  • SPD-6003 Stop using deprecated internal RPCs
  • SPD-6029 logging changes
  • SPD-5834 start working on responder matching for mysql
  • SPD-6027 Use body hash filter if xml parsing fails
  • SPD-5975 Only collect logs from when collector started
  • SPD-5991 operator not mounting secrets
  • SPD-6013 Patch security vulns
  • SPD-6024 add --logs-only flag to speedctl pull

v1.3.354: 2023-09-07

  • SPD-6023 fix sync before write
  • SPD-6017 minor fixes to avoid on call annoyance

v1.3.352: 2023-09-07

  • SPD-6011 set report status as soon as analyzer is done
  • SPD-6010 analyzer should keep sending heartbeats while its alive
  • SPD-6001 analyzer streaming events
  • SPD-5984 Fix settings for default test configs
  • SPD-6005 Report goproxy status in istio env
  • SPD-5992 upload speedscale component workloads
  • SPD-5978 tolerate misidentified content types
  • SPD-6001 analyzer events streaming RPC
  • SPD-5972 ensure report ID is passed from events
  • SPD-5996 Actually log error in reconciler
  • SPD-5972 serialize report updates in tracker
  • Revert SPD-5988
  • SPD-5989 fix secret support
  • SPD-5988 speed up report analysis
  • SPD-5972 add visibility for time series creation
  • SPD-5977 separate ignored from match in line diff
  • SPD-5828 fix inspector secret concatenation

v1.3.335: 2023-08-31

  • SPD-5961 Don't keep appending to signature filters on reanalyze
  • SPD-5980 filter AppDynamics
  • SPD-5966 enable RECORD_ACTIVE in responder only mode
  • SPD-5969 track handshake details for each rrpair
  • SPD-5967 Let analyzer job tolerate arm nodes
  • SPD-5964 Update RDS CA bundle
  • SPD-5965 Add resource definitions to analyzer jobs
  • SPD-5962 fix inspector panic
  • SPD-5947 fix notifications collection
  • SPD-5947 fix success rate
  • SPD-5899 Make inbound port reporting more accurate
  • SPD-5938 update default test types
  • SPD-5932 ensure analyzer success rate not overwritten by patch
  • SPD-5935 show responder signature in raw file
  • SPD-5933 fix removed JSON tokens filter bug

v1.3.320: 2023-08-23

  • Remove cap net_admin from binary
  • SPD-5923 don't include redis for generator only replay on docker
  • SPD-5921 remove leftover test data
  • SPD-5905 make sure type assertions are the correct types
  • Fix broken arm builds for goproxy
  • SPD-5898 Use http2 passed tlsconfig for haproxy protocol so that NextProto is populated
  • SPD-5892 auto-mount secrets if present in transforms
  • SPD-5895 make pcap builds by default and allow diagnostics mode
  • SPD-5805 Operator needs to intelligently handle kube api rate limits
  • SPD-5888 handle super short replays better
  • SPD-5887 Add owner ref to deployed demos
  • SPD-5893 easier generator local development
  • SPD-5707 fix replay events
  • SPD-5834 refactor and generalize some of the mysql protocol processing
  • SPD-5771 Fix normal goproxy build
  • SPD-5786 prepend snapshot during merge
  • SPD-5771 Fix pcap build by escaping bash vars
  • SPD-5836 add initial mysql signature proto
  • SPD-5812 init replay on cloud runner
  • SPD-5875 misc speedctl changes
  • SPD-5873 add expiration to tokens
  • SPD-5867 Only ignore workloads explicitly marked as such
  • SPD-5870 count failures in TPS
  • SPD-5869 logging additions
  • SPD-5854 prevent generator from hanging
  • SPD-5834 refactor protocol readers for reuse
  • SPD-5863 Update vuln libs

v1.3.293: 2023-08-16

  • SPD-5862 inspector returns sidecar status
  • SPD-5847 add inspector timeout
  • SPD-5512 send failed RRPairs in low data mode
  • SPD-5834 add blueprint code for responder providers
  • SPD-5824 fix for postgres ssl
  • Fix typo in replay mutating hook yaml description
  • SPD-5851 generator traffic copies log changes
  • SPD-5845 Make webhooks argo pre-sync hooks to avoid cert inconsistency
  • SPD-5849 Downgrade axiom ingest error to warning

v1.3.284: 2023-08-14

  • SPD-5824 logging and formatting
  • SPD-5794 fix missing client id in reports
  • SPD-5772 postgres protocol rework for operation grouping
  • SPD-5783,SPD-5803,SPD-5442 diff viewer enhancements
  • SPD-5808 support mysql filters
  • SPD-5797 generate human readable filter rules
  • SPD-5732 Deploy demo on inspector startup
  • SPD-5783 use RRPair method to get payload bytes
  • SPD-5791 convert command for web-coppied-uuids
  • SPD-5772 postgres protobuf rework for logical message grouping
  • SPD-5777 fix incorrect byte advancement in mysql dissector
  • SPD-5773 filter elastic apm
  • SPD-5776 add --workload-type flag to speedctl replay
  • SPD-5731 default to proper certs directory
  • SPD-5750 fix CPU / memory metrics race
  • SPD-5769 improve postgres readability for valid utf8 strings
  • SPD-5443 add expvar connection tracking
  • SPD-5766 improvate protocol binary processing with better logging
  • SPD-5768 bidirectional streams with heartbeats
  • SPD-5732 Add speedctl cmd for demos
  • SPD-5770 move token export
  • SPD-5732 Add java demo to inspector
  • SPD05648 set telemetry interval to 1s in speedctl
  • SPD-5750 logs and local dial options
  • SPD-5767 attach discovered tokens to snapshot
  • SPD-5765 fix protocol identification for unencrypted postgres
  • SPD-5764 fix goproxy crash when getting mysql ssl request
  • SPD-5738 apply security patches in labmda image
  • SPD-5471 fix panic in api-gateway
  • SPD-5759 fix kafka protocol errors

v1.3.254: 2023-08-03

  • SPD-5749 never use H2 client for plaintext requests
  • SPD-5725 modify protocol identification to not rely on buffered data
  • SPD-5568 fix bearer token test data
  • SPD-5746 inspector heartbeats
  • SPD-5727 consistent port number for speedctl mock replay
  • SPD-5745 always pass logger to inspector stream
  • SPD-5734 Delete table associations on delete
  • SPD-5681 add inspector dispatch events
  • SPD-5726 Close connection pools on lambda shutdown and upgrade psql driver

v1.3.245: 2023-08-01

  • SPD-5269 user management panic
  • SPD-5701 prevent connection hanging when locking fails
  • SPD-5730 print generator settings as info
  • SPD-5713 operator rollout support / moving rollout logic from inspector to operator
  • SPD-5724 Handle new/deleted tenant usage
  • SPD-5713 operator cleaning
  • SPD-5715 add flexible message handling for remaining kafka messages
  • SPD-5650 pretty print create snapshot
  • SPD-5683 add recovery back to kafka
  • SPD-5705 avoid hardcoded path for certs from environment
  • SPD-5714 convert kafka bytes that are valid utf8 into strings
  • SPD-5653 Fix demo assertions and responder matches data
  • SPD-5705 discard connections with zero data read
  • SPD-5708 add kafka req/resp unmarshaling
  • SPD-5683 fix panics for flexible kafka messages

v1.3.230: 2023-07-28

  • SPD-5704 avoid ioctl() calls that have inconsistent behavior
  • SPD-5704 fix cases where goproxy ioctl returns 0 for hijacked tls connections
  • SPD-5684 set proxy dial timeout

v1.3.227: 2023-07-25

  • SPD-5670 fix out of order poll() events
  • SPD-5671 fixes and additions for argo rollouts
  • SPD-5685 better local operator instructions
  • SPD-5531 additional kafka messages
  • SPD-5531 add kafka fetch and apiversions dissection
  • SPD-5654 store postman collection
  • SPD-5666 speedctl install default to standard test config
  • SPD-5653 Add demo perf graph artifacts
  • SPD-5531 add support for metadata rrpairs
  • SPD-5531 add basic structure for kafka visibility
  • SPD-5659 fix create certs default director
  • SPD-5676 Send subset of usage data to Suger incrementally
  • SPD-5674 Support updating tenant entitlement id
  • SPD-5660 update docker install message

v1.3.213: 2023-07-20

  • SPD-5643 set start time according to perf timeslices
  • SPD-5658 avoid data race in analyzer
  • SPD-5658 better logs
  • SPD-5648 collect every 1s by default

v1.3.209: 2023-07-18

  • SPD-5637 add additional data readiness check
  • SPD-5637 fix infinite recursion and proxy delays
  • SPD-5619-2 fix create snapshot
  • SPD-5635 better errors when init replay fails
  • SPD-5619 add speedctl create snapshot
  • SPD-5636 handle perf.grpc conversion
  • SPD-5601 add tls hijack attempt for postgres
  • SPD-5588 separate process context
  • SPD-5630 keep report start time
  • SPD-5632 improve api gateway log
  • SPD-5588 support streaming metrics in collector
  • SPD-5626 Show date transform in analysis mode
  • SPD-5623 avoid duplicates in analyzer
  • SPD-4328 Operator or Responder should be able to recognise different host for requests
  • SPD-5628 speedctl minor fixes
  • SPD-5627 generator echo server for local dev
  • SPD-5588 send cpu mem rpc
  • SPD-5588 move analyzer to use apiclient
  • SPD-5616 Fix bug with postman import
  • SPD-5537 Add user email to errors in usr-mgmt
  • SPD-5218 speedctl init does not authenticate properly
  • remove buildkit caching
  • SPD-5276 Add client_id field to report_assertions DB table
  • SPD-5588 add merge support for patch report metadata RPC
  • SPD-5613 fix auth token detection
  • SPD-5614 remove warning on tech mismatch
  • SPD-5601 reorganize some things to fit into the dissector model
  • SPD-5588 fix app URL
  • SPD-3506 pull push json
  • SPD-5588 api client in analyzer
  • SPD-5612 add DataTokens to speedctl output
  • SPD-5605 internal gRPC server
  • SPD-5499 TCP probe needs a timeout
  • SPD-5586 speedctl passthrough mode problems
  • SPD-5496 generator streaming metrics
  • SPD-5496 ensure we capture report start / end time
  • SPD-5603 move LOCALDIAL env vars to lib/config
  • SPD-5604 non emulated goproxy compilation
  • SPD-5599 ensure same connection for locking
  • SPD-5602 add connect go protocol support
  • SPD-5197 Add speedctl uninstall command
  • SPD-5597 honor regex in JSON lookup
  • SPD-5599 add advisory locks to report modification operations
  • SPD-5588 refactoring
  • SPD-5347 jwt autodiscovery
  • SPD-5591 Dev env fixes
  • SPD-5590 set build output when building locally
  • SPD-5579 only set default config on compatible asserters

v1.3.161: 2023-07-06

  • SPD-5580 default to speedscale certs if tls in certs empty
  • SPD-5496 rm tests with api-gateway dependency, now duplicates
  • SPD-5496 only process summary aggregator when dirty
  • SPD-5496 timescale interface for testing
  • SPD-5492 Don't err out if we can't decompress captured bodies
  • SPD-5463 return invalid argument error on invalid S3 names
  • SPD-5572 absolute build cache path
  • SPD-5498 Allow chaining of variable load/store in transforms
  • SPD-5578 add check for unsupported protocols with no data
  • SPD-5572 additions to cache configuration
  • SPD-5496 use independent context for upload in stream
  • SPD-5572 use buildkit cache import/export directives
  • SPD-5496 streaming rpc for performance time series
  • SPD-5573 merge latency and throughput timeslices into new PerfTimeslices
  • SPD-5569 warn on snapshot creation with error status
  • SPD-5520 Include large payloads size in service list

v1.3.145: 2023-06-28

  • SPD-5570 fix for slice bounds error
  • SPD-5482 Some goproxy logs not json
  • SPD-5569 better cron logs
  • SPD-5520 Specifiy which object attributes to get in indexer
  • SPD-5003 How do I set test_prep_timeout
  • SPD-5496 replace s3 with s3 loader interface
  • SPD-5520 Make indexer populate large payload metric
  • SPD-5567 minor RRPair refactor
  • SPD-5565 fix signature address undefined
  • SPD-5562 fix subtle bug that introduces null bytes into readers
  • SPD-5558 add proxy protocol http clients
  • SPD-5514 fix host filter
  • SPD-5556 Add speedmgmt command to update tenant entitlement id
  • SPD-5381 Integrate gauger with Suger API
  • SPD-5427 support PROXY protocol wrapped connections
  • SPD-5460 back out debug message
  • SPD-5551 add speedctl filter explanations
  • SPD-5543 ensure proxy request header is not nil
  • SPD-5522 handle postgres backend SSL response
  • SPD-5460 add responder debug statement
  • SPD-5446 add outbound intermediate proxy support for goproxy
  • SPD-5535 Add azure monitoring hosts to default filter rule
  • SPD-5381 Migration to add column entitlement_id in tenants table

v1.3.122: 2023-06-21

  • SPD-5513 disable sos graph validation temporarily
  • SPD-5468 friendly cron name
  • SPD-5394 prevent hanging on latencyAgg stop
  • SPD-5508 Fix sql batch logic
  • SPD-5513 separate latency table upload from reporting

v1.3.117: 2023-06-19

  • SPD-5485 add advanced grpc filtering

v1.3.116: 2023-06-16

  • SPD-5509 rm panic caused by concurrent map changes
  • SPD-5500 protect from uppercase snapshot ids
  • SPD-5508 Fix leftover sql flushing for assertions
  • SPD-5250 handle other startup messages correctly
  • SPD-5502 Don't validate graphs on short reports

v1.3.111: 2023-06-16

  • SPD-5497 Don't try to extract local files in analysis mode
  • SPD-5501 fix random string double transformation
  • SPD-5315 rm from config
  • SPD-5494 Remove unnecessary sleep in snapshot analysis
  • SPD-4675 use the correct timestamp
  • SPD-4443 Fix json_delete render
  • SPD-5489 remove restrictive filter checks
  • SPD-5488 timeslice verification in sos
  • SPD-4443 Redo json_delete transform
  • SPD-4675 ensure empty buckets get processed
  • SPD-4443 Add json delete transform
  • SPD-5383 Update vuln packages

v1.3.94: 2023-06-12

  • SPD-5459 payloads already cut is not an error

v1.3.93: 2023-06-12

  • SPD-5456 fix auth recycling cpu usage
  • SPD-5360 increase provisioning timeout from 30 to 60s
  • SPD-5352 add a help message to speedmgmt output
  • SPD-5448 error only if report artifact missing is unexpected
  • SPD-4400 split test teardown from env teardown
  • SPD-5424 add speedctl create certs and let goproxy get certs from environment
  • SPD-5440 log top level errors
  • SPD-5440 revert if statement logic

v1.3.86: 2023-06-08

  • SPD-5382 generator support for cut payload retrieval
  • SPD-4192 allow schemeless custom URL
  • SPD-5382 handle large payload responses from responder
  • SPD-5370 add signoz new relic and sentry filters
  • SPD-5420 add analyzer status messages to snapshot creation
  • SPD-5420 capture mock responses in speedctl
  • SPD-5417 tls trust docs
  • SPD-5392 fix forwarder escalating metrics
  • SPD-5401 Send more than one heartbeat
  • SPD-5047 Remove pod security policy references
  • SPD-5312 explain speedctl capture args
  • SPD-5373 warning for low data mode with assertions
  • SPD-5385 sort inspectors
  • SPD-4716 Remove firehose reporter from authapi
  • SPD-5378 rename put transform
  • SPD-4716 Use credentials from API key refresh
  • SPD-5362 protect grpc decoder from buffer overrun
  • SPD-5365 vars on demand
  • SPD-5365 cleanup and refactoring ahead of changes to transforms
  • SPD-5355 Add warning for progressDeadlineSeconds

v1.3.66: 2023-05-30

  • SPD-5341 Support hostnetwork for operator
  • SPD-5359 cleanup
  • SPD-5354 add speedctl get snapshot latest option
  • SPD-5327 fix tenant allocation
  • SPD-5353 fix append() bug and improve operation humanize
  • SPD-5330 update go references to 1.20

v1.3.60: 2023-05-25

  • SPD-5349 fix panic in operator and add safety measures
  • SPD-5090 implement remaining mysql command dissections

v1.3.58: 2023-05-25

  • SPD-5317 Support grpc in passthrough mode
  • SPD-5345 optimize analyzer filtering
  • SPD-5090 EOF bugfix, improved ergonomics, COM_QUIT support

v1.3.55: 2023-05-24

  • SPD-5315 remove analysis mode from config
  • SPD-5327 readme
  • SPD-5327 re-enable user on registration if deleted
  • SPD-5090 adding metrics for mysql
  • SPD-5319 Use stable protojson for proto decoding
  • SPD-5319 Use stable json marshalling

v1.3.49: 2023-05-23

  • SPD-5335 deprecate unused ProtoBufs field
  • SPD-5336 tune analyzer SQL queries
  • SPD-5090 support valid utf8 strings
  • SPD-5090 prepared statements

v1.3.45: 2023-05-22

  • SPD-5318 Respect timeouts
  • SPD-5090 query resultset
  • SPD-5318 Make snapshot creation respect timeout
  • SPD-5311 add protocol override for postman import
  • SPD-5090 adding incomplete ping and query dissection
  • SPD-5322 add concurrency to snapshot creation
  • SPD-5321 minor transform refactor
  • SPD-5090 complete connection phase
  • SPD-5310 handle https proxy better
  • SPD-5306 add Google Cloud Trace to default filters
  • SPD-5303 add smart mode proxy to handle both socks and http inline proxies
  • SPD-5307 add bulk export to speedctl misc request response output

v1.3.33: 2023-05-16

  • SPD-5261 Record responder hits for grpc streams
  • SPD-5294 Ensure timestamp on replay events
  • SPD-5233 api gateway ingest
  • SPD-5090 fix binary parsing for mysql greeting
  • SPD-5295 Include port and extra hosts on replay
  • SPD-5297 Update tenant name in IDP
  • SPD-5292 postman import accept port
  • SPD-5090 fix issues with mysql data vis
  • SPD-5259 Don't nil out headers needed for protocol detection
  • SPD-5287 add speedctl check timeout
  • SPD-5234,SPD-5286 speedctl commands for user-data and cron

v1.3.22: 2023-05-15

  • SPD-5290 use a dead simple health server
  • SPD-5090 build changes and add detected tech/protocol
  • SPD-5285 Ensure docker internal host is setup for linux
  • SPD-5232 read the file once and no more
  • SPD-5232 load file from S3 user data dir

v1.3.17: 2023-05-12

  • SPD-5193 speedctl clone snapshot
  • SPD-5090 bootstrapping and parse at least the server greeeting
  • SPD-4875 Apply istio sidecar config to injected pods only
  • SPD-5277 speedmgmt user delete
  • SPD-5272 metric logs from warn to debug
  • SPD-5274 turn on discover patterns in standard
  • SPD-5232 user data rpcs
  • SPD-5238 use a consistent key in analysis mode
  • SPD-4874 Preserve inferred port for sidecar
  • SPD-5270 housekeeping
  • SPD-5051 use updated tcp state checks
  • SPD-5257 don't include fields

v1.3.5: 2023-05-09

  • SPD-5262 Allow binding of 443
  • SPD-5263 add redactor to generator and analyzer
  • SPD-5237 hypertables do not support concurrent index creation
  • SPD-5237 rrpairs index
  • SPD-5262 Add capability for priv port
  • SPD-5262 Change operator webhook port to 443
  • SPD-5244 Fix vulns
  • SPD-4425 Support grpc streams in the responder
  • SPD-5253 remove analyzer sequence ordering
  • SPD-5237 revert on conflict change
  • SPD-5248 activate dlp in generator transforms
  • SPD-5237 add debug func
  • SPD-5200 add DLP to transform system
  • SPD-5227 add transforms to forwarder
  • SPD-4425 Guts for grpc stream replay
  • SPD-4836 logs
  • SPD-5217 create snapshot using existing filter
  • SPD-5210 add a simple edit subcommand

v1.2.584: 2023-05-02

  • SPD-5212 Use signature hash instead of Sprintf to reduce memory usage
  • SPD-5196 update hint messages
  • SPD-4996 better errors for demo
  • SPD-5211 prevent protected uploads
  • SPD-5206 add host override
  • SPD-5208 handle trace logs
  • SPD-4425 Handle GRPC streams in generator
  • SPD-5207 some minor fixes

v1.2.576: 2023-05-01

  • SPD-5186 Support strict mode in istio