Dynamic Telemetry is a PROPOSAL : please provide feedback! :-)
Dynamic Telemetry is not an implementation, it's a request for collaboration, that will lead to an shared understanding, and hopefully one or more implementations.
Your feedback and suggestions on this document are highly encouraged!
Please:
-
Join us, by providing comments or feedback, in our Discussions page
-
Submit a PR with changes to this file ( docs/Slides.Overview.Presentation.md)
Direct Sharing URL
Dynamic Telemetry
- Stitched Together in a way that
Previous 2 or 3 years
- Aligning our API surfaces, core tech
- Supporting changes made in .NET, OpenTelemetry, and the kernels of Windows and Linux
- Industry / OSS Support
- Applications ranging from perf/security/cost reductions/AI
TLDR; What is Dynamic Telemetry
- Single Architecture
- That Connects bespoke telemetry / diagnostic tools
- Solving and Connecting
- 'Golden Path' scenarios
- Performance and Diagnostics
- Security and Privacy
- Dashboard and Alert Durability
- Cost Reductions
- Creating Opportunities for AI
Our Challenge
(each permutation, is often a whole new architecture requiring extensive refactoring)
Our Opportunity
- Organize API's; Language, OS under OpenTelemetry
- Tackle the connections under 'Dynamic Telemetry'; using Scenarios as golden paths
Actions
- Seek 1P/3P (OSS) Community Agreement on Scenario Workflow; 'Golden Paths'
- Focus on architectural North Star (Probe, Action, Processors, DurableID's)
- Dynamic Telemetry vTeam creates aspirational samples
- As time permits, we collectively turn my Dynamic Telemetry samples, into reality
Why DurableID's and structured payloads are helpful
- Regular Expressions are fragile, confusing, and expensive
- Durable ID provides a sort of 'GPS' to find the file and line
- Structured Payloads allow easier reasoning over data
Risks
Scenarios
- Performance and Diagnostics
- Security and Privacy
- Reliability
- Durable Dashboards and Alerts
- Cost Reduction
- Opportunities for AI
Architecture
Diagnostics (aka Touch Reduction)
- DurableID's and Structured Payloads can be used to Trigger
- Memory Dumps, CPU samples, more verbose Logging
Security and Privacy
- in SFI/Azure we've had problems with embedded PATs, certs
- in GDPR/Client we've had problems with IP addresses, MAC/BSSID/SSID's
Cost Reduction
- Logging is expensive
- Not all Logs are great or always needed
- Through positive identification
- we can toggle
- we can drop/modify
Opens up new Opportunities for AI
- With Strings being CHEAP - more options
- Reduce Volume
- Reduce Costs
- Reduce Privacy / Security Exposure