Skip to content
Dynamic Telemetry is a PROPOSAL : please provide feedback! :-)

Dynamic Telemetry is not an implementation, it's a request for collaboration, that will lead to an shared understanding, and hopefully one or more implementations.

Your feedback and suggestions on this document are highly encouraged!

Please:

  1. Join us, by providing comments or feedback, in our Discussions page

  2. Submit a PR with changes to this file ( docs/Slides.Overview.Presentation.md)

Direct Sharing URL

http://microsoft.github.io/DynamicTelemetry/docs/Slides.Overview.Presentation/

Dynamic Telemetry


  1. Stitched Together in a way that

Previous 2 or 3 years

  1. Aligning our API surfaces, core tech
  2. Supporting changes made in .NET, OpenTelemetry, and the kernels of Windows and Linux
  3. Industry / OSS Support
  4. Applications ranging from perf/security/cost reductions/AI

TLDR; What is Dynamic Telemetry

  1. Single Architecture
  2. That Connects bespoke telemetry / diagnostic tools
  3. Solving and Connecting
  4. 'Golden Path' scenarios
  5. Performance and Diagnostics
  6. Security and Privacy
  7. Dashboard and Alert Durability
  8. Cost Reductions
  9. Creating Opportunities for AI

Our Challenge

(each permutation, is often a whole new architecture requiring extensive refactoring)


Our Opportunity

  • Organize API's; Language, OS under OpenTelemetry
  • Tackle the connections under 'Dynamic Telemetry'; using Scenarios as golden paths

Actions

  • Seek 1P/3P (OSS) Community Agreement on Scenario Workflow; 'Golden Paths'
  • Focus on architectural North Star (Probe, Action, Processors, DurableID's)
  • Dynamic Telemetry vTeam creates aspirational samples
  • As time permits, we collectively turn my Dynamic Telemetry samples, into reality

Why DurableID's and structured payloads are helpful

  • Regular Expressions are fragile, confusing, and expensive
  • Durable ID provides a sort of 'GPS' to find the file and line
  • Structured Payloads allow easier reasoning over data

Risks


Scenarios

  • Performance and Diagnostics
  • Security and Privacy
  • Reliability
  • Durable Dashboards and Alerts
  • Cost Reduction
  • Opportunities for AI

Architecture


Diagnostics (aka Touch Reduction)

  • DurableID's and Structured Payloads can be used to Trigger
  • Memory Dumps, CPU samples, more verbose Logging

Security and Privacy

  • in SFI/Azure we've had problems with embedded PATs, certs
  • in GDPR/Client we've had problems with IP addresses, MAC/BSSID/SSID's

Cost Reduction

  • Logging is expensive
  • Not all Logs are great or always needed
  • Through positive identification
  • we can toggle
  • we can drop/modify

Opens up new Opportunities for AI

  • With Strings being CHEAP - more options
  • Reduce Volume
  • Reduce Costs
  • Reduce Privacy / Security Exposure