Release Notes
v1.3.405: 2023-09-19
- SPD-6108 increase analyzer memory requests
- SPD-6089 Don't duplicate report analysis
- SPD-6020 change report status as soon as testing is done
- SPD-6026 remove report's intermediary processing buffers
- SPD-6102 increase tracker timeout
- SPD-6101 better logs
v1.3.400: 2023-09-17
- SPD-6088 simplified aggregate processing
- SPD-6094 better dupliate logic for kraken
- SPD-6093 permit malformed access tokens
- SPD-6091 avoid hanging on streaming metric RPCs
- SPD-6090 logging improvements
- SPD-6088 don't overwrite replay events
- SPD-5908 Use new field for ability to set log collection
- fix:use more efficient reading mechanism and better library for gzip
- SPD-6078 namespace not required for operator to inspector RPCs
- SPD-6076 refactor grpc error code checks
- SPD-6075 add report ID to event response in inspector
- SPD-6056 Prevent deadlock during snapshot reanalyze
- SPD-6057 Move default configs out of s3 pt 1
- SPD-6064 Add restart policy to compose files
- SPD-6063 Separate out lambdas for scanning
- fix: remove deadcode from goproxy
- SPD-6050 Fix bug with duplicate aggregates
- SPD-6059 collect logs should only exclude misc
- SPD-6050 Refactor aggregates so that cpu/mem are separated by container
- SPD-6061 tell karpenter to never evict analyzer jobs
- SPD-6059 flush logs only
- SPD-6059 go mem limit and flush logs from memory
- SPD-6054 use the protocol identifier to know we read any data or not
- SPD-6055 remove restrictive assertion defaults
- SPD-5834 process client SET statements
v1.3.375: 2023-09-13
- SPD-6048 Separate out lambda image building
- SPD-6045 fix setting replay events from operator
- SPD-6046 error when reports or snapshots fail, even if it's not our fault so we can help the customer
- SPD-6003 Make analyzer job launch synchronous to prevent broken states
- SPD-6044 update CSV errors
- SPD-6041 handle NoSuchKey error so that we get the right grpc code
- SPD-6044 handle index or column for key
- SPD-6038 Make auto allocated users non-admins
- SPD-6036 Handle panic for assertion loading
- SPD-3060 add retrieve operator config
- SPD-6030 add RetrieveOperatorConfig
- SPD-6029 use heartbeat or updated at time for latest snapshot update
- SPD-5834 complete mysql handshake requiring auth
- SPD-6003 Stop using deprecated internal RPCs
- SPD-6029 logging changes
- SPD-5834 start working on responder matching for mysql
- SPD-6027 Use body hash filter if xml parsing fails
- SPD-5975 Only collect logs from when collector started
- SPD-5991 operator not mounting secrets
- SPD-6013 Patch security vulns
- SPD-6024 add --logs-only flag to speedctl pull
v1.3.354: 2023-09-07
- SPD-6023 fix sync before write
- SPD-6017 minor fixes to avoid on call annoyance
v1.3.352: 2023-09-07
- SPD-6011 set report status as soon as analyzer is done
- SPD-6010 analyzer should keep sending heartbeats while its alive
- SPD-6001 analyzer streaming events
- SPD-5984 Fix settings for default test configs
- SPD-6005 Report goproxy status in istio env
- SPD-5992 upload speedscale component workloads
- SPD-5978 tolerate misidentified content types
- SPD-6001 analyzer events streaming RPC
- SPD-5972 ensure report ID is passed from events
- SPD-5996 Actually log error in reconciler
- SPD-5972 serialize report updates in tracker
- Revert SPD-5988
- SPD-5989 fix secret support
- SPD-5988 speed up report analysis
- SPD-5972 add visibility for time series creation
- SPD-5977 separate ignored from match in line diff
- SPD-5828 fix inspector secret concatenation
v1.3.335: 2023-08-31
- SPD-5961 Don't keep appending to signature filters on reanalyze
- SPD-5980 filter AppDynamics
- SPD-5966 enable RECORD_ACTIVE in responder only mode
- SPD-5969 track handshake details for each rrpair
- SPD-5967 Let analyzer job tolerate arm nodes
- SPD-5964 Update RDS CA bundle
- SPD-5965 Add resource definitions to analyzer jobs
- SPD-5962 fix inspector panic
- SPD-5947 fix notifications collection
- SPD-5947 fix success rate
- SPD-5899 Make inbound port reporting more accurate
- SPD-5938 update default test types
- SPD-5932 ensure analyzer success rate not overwritten by patch
- SPD-5935 show responder signature in raw file
- SPD-5933 fix removed JSON tokens filter bug
v1.3.320: 2023-08-23
- Remove cap net_admin from binary
- SPD-5923 don't include redis for generator only replay on docker
- SPD-5921 remove leftover test data
- SPD-5905 make sure type assertions are the correct types
- Fix broken arm builds for goproxy
- SPD-5898 Use http2 passed tlsconfig for haproxy protocol so that NextProto is populated
- SPD-5892 auto-mount secrets if present in transforms
- SPD-5895 make pcap builds by default and allow diagnostics mode
- SPD-5805 Operator needs to intelligently handle kube api rate limits
- SPD-5888 handle super short replays better
- SPD-5887 Add owner ref to deployed demos
- SPD-5893 easier generator local development
- SPD-5707 fix replay events
- SPD-5834 refactor and generalize some of the mysql protocol processing
- SPD-5771 Fix normal goproxy build
- SPD-5786 prepend snapshot during merge
- SPD-5771 Fix pcap build by escaping bash vars
- SPD-5836 add initial mysql signature proto
- SPD-5812 init replay on cloud runner
- SPD-5875 misc speedctl changes
- SPD-5873 add expiration to tokens
- SPD-5867 Only ignore workloads explicitly marked as such
- SPD-5870 count failures in TPS
- SPD-5869 logging additions
- SPD-5854 prevent generator from hanging
- SPD-5834 refactor protocol readers for reuse
- SPD-5863 Update vuln libs
v1.3.293: 2023-08-16
- SPD-5862 inspector returns sidecar status
- SPD-5847 add inspector timeout
- SPD-5512 send failed RRPairs in low data mode
- SPD-5834 add blueprint code for responder providers
- SPD-5824 fix for postgres ssl
- Fix typo in replay mutating hook yaml description
- SPD-5851 generator traffic copies log changes
- SPD-5845 Make webhooks argo pre-sync hooks to avoid cert inconsistency
- SPD-5849 Downgrade axiom ingest error to warning
v1.3.284: 2023-08-14
- SPD-5824 logging and formatting
- SPD-5794 fix missing client id in reports
- SPD-5772 postgres protocol rework for operation grouping
- SPD-5783,SPD-5803,SPD-5442 diff viewer enhancements
- SPD-5808 support mysql filters
- SPD-5797 generate human readable filter rules
- SPD-5732 Deploy demo on inspector startup
- SPD-5783 use RRPair method to get payload bytes
- SPD-5791 convert command for web-coppied-uuids
- SPD-5772 postgres protobuf rework for logical message grouping
- SPD-5777 fix incorrect byte advancement in mysql dissector
- SPD-5773 filter elastic apm
- SPD-5776 add --workload-type flag to speedctl replay
- SPD-5731 default to proper certs directory
- SPD-5750 fix CPU / memory metrics race
- SPD-5769 improve postgres readability for valid utf8 strings
- SPD-5443 add expvar connection tracking
- SPD-5766 improvate protocol binary processing with better logging
- SPD-5768 bidirectional streams with heartbeats
- SPD-5732 Add speedctl cmd for demos
- SPD-5770 move token export
- SPD-5732 Add java demo to inspector
- SPD05648 set telemetry interval to 1s in speedctl
- SPD-5750 logs and local dial options
- SPD-5767 attach discovered tokens to snapshot
- SPD-5765 fix protocol identification for unencrypted postgres
- SPD-5764 fix goproxy crash when getting mysql ssl request
- SPD-5738 apply security patches in labmda image
- SPD-5471 fix panic in api-gateway
- SPD-5759 fix kafka protocol errors
v1.3.254: 2023-08-03
- SPD-5749 never use H2 client for plaintext requests
- SPD-5725 modify protocol identification to not rely on buffered data
- SPD-5568 fix bearer token test data
- SPD-5746 inspector heartbeats
- SPD-5727 consistent port number for speedctl mock replay
- SPD-5745 always pass logger to inspector stream
- SPD-5734 Delete table associations on delete
- SPD-5681 add inspector dispatch events
- SPD-5726 Close connection pools on lambda shutdown and upgrade psql driver
v1.3.245: 2023-08-01
- SPD-5269 user management panic
- SPD-5701 prevent connection hanging when locking fails
- SPD-5730 print generator settings as info
- SPD-5713 operator rollout support / moving rollout logic from inspector to operator
- SPD-5724 Handle new/deleted tenant usage
- SPD-5713 operator cleaning
- SPD-5715 add flexible message handling for remaining kafka messages
- SPD-5650 pretty print create snapshot
- SPD-5683 add recovery back to kafka
- SPD-5705 avoid hardcoded path for certs from environment
- SPD-5714 convert kafka bytes that are valid utf8 into strings
- SPD-5653 Fix demo assertions and responder matches data
- SPD-5705 discard connections with zero data read
- SPD-5708 add kafka req/resp unmarshaling
- SPD-5683 fix panics for flexible kafka messages
v1.3.230: 2023-07-28
- SPD-5704 avoid ioctl() calls that have inconsistent behavior
- SPD-5704 fix cases where goproxy ioctl returns 0 for hijacked tls connections
- SPD-5684 set proxy dial timeout
v1.3.227: 2023-07-25
- SPD-5670 fix out of order poll() events
- SPD-5671 fixes and additions for argo rollouts
- SPD-5685 better local operator instructions
- SPD-5531 additional kafka messages
- SPD-5531 add kafka fetch and apiversions dissection
- SPD-5654 store postman collection
- SPD-5666 speedctl install default to standard test config
- SPD-5653 Add demo perf graph artifacts
- SPD-5531 add support for metadata rrpairs
- SPD-5531 add basic structure for kafka visibility
- SPD-5659 fix create certs default director
- SPD-5676 Send subset of usage data to Suger incrementally
- SPD-5674 Support updating tenant entitlement id
- SPD-5660 update docker install message
v1.3.213: 2023-07-20
- SPD-5643 set start time according to perf timeslices
- SPD-5658 avoid data race in analyzer
- SPD-5658 better logs
- SPD-5648 collect every 1s by default
v1.3.209: 2023-07-18
- SPD-5637 add additional data readiness check
- SPD-5637 fix infinite recursion and proxy delays
- SPD-5619-2 fix create snapshot
- SPD-5635 better errors when init replay fails
- SPD-5619 add speedctl create snapshot
- SPD-5636 handle perf.grpc conversion
- SPD-5601 add tls hijack attempt for postgres
- SPD-5588 separate process context
- SPD-5630 keep report start time
- SPD-5632 improve api gateway log
- SPD-5588 support streaming metrics in collector
- SPD-5626 Show date transform in analysis mode
- SPD-5623 avoid duplicates in analyzer
- SPD-4328 Operator or Responder should be able to recognise different host for requests
- SPD-5628 speedctl minor fixes
- SPD-5627 generator echo server for local dev
- SPD-5588 send cpu mem rpc
- SPD-5588 move analyzer to use apiclient
- SPD-5616 Fix bug with postman import
- SPD-5537 Add user email to errors in usr-mgmt
- SPD-5218 speedctl init does not authenticate properly
- remove buildkit caching
- SPD-5276 Add client_id field to report_assertions DB table
- SPD-5588 add merge support for patch report metadata RPC
- SPD-5613 fix auth token detection
- SPD-5614 remove warning on tech mismatch
- SPD-5601 reorganize some things to fit into the dissector model
- SPD-5588 fix app URL
- SPD-3506 pull push json
- SPD-5588 api client in analyzer
- SPD-5612 add DataTokens to speedctl output
- SPD-5605 internal gRPC server
- SPD-5499 TCP probe needs a timeout
- SPD-5586 speedctl passthrough mode problems
- SPD-5496 generator streaming metrics
- SPD-5496 ensure we capture report start / end time
- SPD-5603 move LOCALDIAL env vars to lib/config
- SPD-5604 non emulated goproxy compilation
- SPD-5599 ensure same connection for locking
- SPD-5602 add connect go protocol support
- SPD-5197 Add speedctl uninstall command
- SPD-5597 honor regex in JSON lookup
- SPD-5599 add advisory locks to report modification operations
- SPD-5588 refactoring
- SPD-5347 jwt autodiscovery
- SPD-5591 Dev env fixes
- SPD-5590 set build output when building locally
- SPD-5579 only set default config on compatible asserters
v1.3.161: 2023-07-06
- SPD-5580 default to speedscale certs if tls in certs empty
- SPD-5496 rm tests with api-gateway dependency, now duplicates
- SPD-5496 only process summary aggregator when dirty
- SPD-5496 timescale interface for testing
- SPD-5492 Don't err out if we can't decompress captured bodies
- SPD-5463 return invalid argument error on invalid S3 names
- SPD-5572 absolute build cache path
- SPD-5498 Allow chaining of variable load/store in transforms
- SPD-5578 add check for unsupported protocols with no data
- SPD-5572 additions to cache configuration
- SPD-5496 use independent context for upload in stream
- SPD-5572 use buildkit cache import/export directives
- SPD-5496 streaming rpc for performance time series
- SPD-5573 merge latency and throughput timeslices into new PerfTimeslices
- SPD-5569 warn on snapshot creation with error status
- SPD-5520 Include large payloads size in service list
v1.3.145: 2023-06-28
- SPD-5570 fix for slice bounds error
- SPD-5482 Some goproxy logs not json
- SPD-5569 better cron logs
- SPD-5520 Specifiy which object attributes to get in indexer
- SPD-5003 How do I set test_prep_timeout
- SPD-5496 replace s3 with s3 loader interface
- SPD-5520 Make indexer populate large payload metric
- SPD-5567 minor RRPair refactor
- SPD-5565 fix signature address undefined
- SPD-5562 fix subtle bug that introduces null bytes into readers
- SPD-5558 add proxy protocol http clients
- SPD-5514 fix host filter
- SPD-5556 Add speedmgmt command to update tenant entitlement id
- SPD-5381 Integrate gauger with Suger API
- SPD-5427 support PROXY protocol wrapped connections
- SPD-5460 back out debug message
- SPD-5551 add speedctl filter explanations
- SPD-5543 ensure proxy request header is not nil
- SPD-5522 handle postgres backend SSL response
- SPD-5460 add responder debug statement
- SPD-5446 add outbound intermediate proxy support for goproxy
- SPD-5535 Add azure monitoring hosts to default filter rule
- SPD-5381 Migration to add column entitlement_id in tenants table
v1.3.122: 2023-06-21
- SPD-5513 disable sos graph validation temporarily
- SPD-5468 friendly cron name
- SPD-5394 prevent hanging on latencyAgg stop
- SPD-5508 Fix sql batch logic
- SPD-5513 separate latency table upload from reporting
v1.3.117: 2023-06-19
- SPD-5485 add advanced grpc filtering
v1.3.116: 2023-06-16
- SPD-5509 rm panic caused by concurrent map changes
- SPD-5500 protect from uppercase snapshot ids
- SPD-5508 Fix leftover sql flushing for assertions
- SPD-5250 handle other startup messages correctly
- SPD-5502 Don't validate graphs on short reports
v1.3.111: 2023-06-16
- SPD-5497 Don't try to extract local files in analysis mode
- SPD-5501 fix random string double transformation
- SPD-5315 rm from config
- SPD-5494 Remove unnecessary sleep in snapshot analysis
- SPD-4675 use the correct timestamp
- SPD-4443 Fix json_delete render
- SPD-5489 remove restrictive filter checks
- SPD-5488 timeslice verification in sos
- SPD-4443 Redo json_delete transform
- SPD-4675 ensure empty buckets get processed
- SPD-4443 Add json delete transform
- SPD-5383 Update vuln packages
v1.3.94: 2023-06-12
- SPD-5459 payloads already cut is not an error
v1.3.93: 2023-06-12
- SPD-5456 fix auth recycling cpu usage
- SPD-5360 increase provisioning timeout from 30 to 60s
- SPD-5352 add a help message to speedmgmt output
- SPD-5448 error only if report artifact missing is unexpected
- SPD-4400 split test teardown from env teardown
- SPD-5424 add speedctl create certs and let goproxy get certs from environment
- SPD-5440 log top level errors
- SPD-5440 revert if statement logic
v1.3.86: 2023-06-08
- SPD-5382 generator support for cut payload retrieval
- SPD-4192 allow schemeless custom URL
- SPD-5382 handle large payload responses from responder
- SPD-5370 add signoz new relic and sentry filters
- SPD-5420 add analyzer status messages to snapshot creation
- SPD-5420 capture mock responses in speedctl
- SPD-5417 tls trust docs
- SPD-5392 fix forwarder escalating metrics
- SPD-5401 Send more than one heartbeat
- SPD-5047 Remove pod security policy references
- SPD-5312 explain speedctl capture args
- SPD-5373 warning for low data mode with assertions
- SPD-5385 sort inspectors
- SPD-4716 Remove firehose reporter from authapi
- SPD-5378 rename put transform
- SPD-4716 Use credentials from API key refresh
- SPD-5362 protect grpc decoder from buffer overrun
- SPD-5365 vars on demand
- SPD-5365 cleanup and refactoring ahead of changes to transforms
- SPD-5355 Add warning for progressDeadlineSeconds
v1.3.66: 2023-05-30
- SPD-5341 Support hostnetwork for operator
- SPD-5359 cleanup
- SPD-5354 add speedctl get snapshot latest option
- SPD-5327 fix tenant allocation
- SPD-5353 fix append() bug and improve operation humanize
- SPD-5330 update go references to 1.20
v1.3.60: 2023-05-25
- SPD-5349 fix panic in operator and add safety measures
- SPD-5090 implement remaining mysql command dissections
v1.3.58: 2023-05-25
- SPD-5317 Support grpc in passthrough mode
- SPD-5345 optimize analyzer filtering
- SPD-5090 EOF bugfix, improved ergonomics, COM_QUIT support
v1.3.55: 2023-05-24
- SPD-5315 remove analysis mode from config
- SPD-5327 readme
- SPD-5327 re-enable user on registration if deleted
- SPD-5090 adding metrics for mysql
- SPD-5319 Use stable protojson for proto decoding
- SPD-5319 Use stable json marshalling
v1.3.49: 2023-05-23
- SPD-5335 deprecate unused ProtoBufs field
- SPD-5336 tune analyzer SQL queries
- SPD-5090 support valid utf8 strings
- SPD-5090 prepared statements
v1.3.45: 2023-05-22
- SPD-5318 Respect timeouts
- SPD-5090 query resultset
- SPD-5318 Make snapshot creation respect timeout
- SPD-5311 add protocol override for postman import
- SPD-5090 adding incomplete ping and query dissection
- SPD-5322 add concurrency to snapshot creation
- SPD-5321 minor transform refactor
- SPD-5090 complete connection phase
- SPD-5310 handle https proxy better
- SPD-5306 add Google Cloud Trace to default filters
- SPD-5303 add smart mode proxy to handle both socks and http inline proxies
- SPD-5307 add bulk export to speedctl misc request response output
v1.3.33: 2023-05-16
- SPD-5261 Record responder hits for grpc streams
- SPD-5294 Ensure timestamp on replay events
- SPD-5233 api gateway ingest
- SPD-5090 fix binary parsing for mysql greeting
- SPD-5295 Include port and extra hosts on replay
- SPD-5297 Update tenant name in IDP
- SPD-5292 postman import accept port
- SPD-5090 fix issues with mysql data vis
- SPD-5259 Don't nil out headers needed for protocol detection
- SPD-5287 add speedctl check timeout
- SPD-5234,SPD-5286 speedctl commands for user-data and cron
v1.3.22: 2023-05-15
- SPD-5290 use a dead simple health server
- SPD-5090 build changes and add detected tech/protocol
- SPD-5285 Ensure docker internal host is setup for linux
- SPD-5232 read the file once and no more
- SPD-5232 load file from S3 user data dir
v1.3.17: 2023-05-12
- SPD-5193 speedctl clone snapshot
- SPD-5090 bootstrapping and parse at least the server greeeting
- SPD-4875 Apply istio sidecar config to injected pods only
- SPD-5277 speedmgmt user delete
- SPD-5272 metric logs from warn to debug
- SPD-5274 turn on discover patterns in standard
- SPD-5232 user data rpcs
- SPD-5238 use a consistent key in analysis mode
- SPD-4874 Preserve inferred port for sidecar
- SPD-5270 housekeeping
- SPD-5051 use updated tcp state checks
- SPD-5257 don't include fields
v1.3.5: 2023-05-09
- SPD-5262 Allow binding of 443
- SPD-5263 add redactor to generator and analyzer
- SPD-5237 hypertables do not support concurrent index creation
- SPD-5237 rrpairs index
- SPD-5262 Add capability for priv port
- SPD-5262 Change operator webhook port to 443
- SPD-5244 Fix vulns
- SPD-4425 Support grpc streams in the responder
- SPD-5253 remove analyzer sequence ordering
- SPD-5237 revert on conflict change
- SPD-5248 activate dlp in generator transforms
- SPD-5237 add debug func
- SPD-5200 add DLP to transform system
- SPD-5227 add transforms to forwarder
- SPD-4425 Guts for grpc stream replay
- SPD-4836 logs
- SPD-5217 create snapshot using existing filter
- SPD-5210 add a simple edit subcommand
v1.2.584: 2023-05-02
- SPD-5212 Use signature hash instead of Sprintf to reduce memory usage
- SPD-5196 update hint messages
- SPD-4996 better errors for demo
- SPD-5211 prevent protected uploads
- SPD-5206 add host override
- SPD-5208 handle trace logs
- SPD-4425 Handle GRPC streams in generator
- SPD-5207 some minor fixes
v1.2.576: 2023-05-01
- SPD-5186 Support strict mode in istio