#Observability
"Ticking Time Bombs: 3 #Cloud Computing Stocks to Dump Before the Damage Is Done"
I don't agree with all of this, esp. re: @datadoghq. #Observability & #AIOps have never been hotter!
But the author makes good points. Fair to be cautious at least.
I posted a small 101 tutorial on how to set up grafana and produce some example timeseries graphs from your CPU temperature ๐ https://jonathanmh.com/p/visualising-data-with-grafana-loki-from-scratch/
๐ง Happy International #podcast Day ๐ง
no better time to flag ๐๐ฉ๐๐ง๐๐๐ฌ๐๐ซ๐ฏ๐๐๐ข๐ฅ๐ข๐ญ๐ฒ ๐๐๐ฅ๐ค๐ฌ๐๏ธ, where I talk #DevOps #opensource #observability #cloudnative and more with OSS maintainers and planet-scale practitioners.
It's already the 4th year running, so a lot of good episodes to catch up on ๐
I prepared a short clip to give you the gist:
https://www.linkedin.com/posts/horovits_podcast-devops-opensource-activity-7113915398487470080-mHFl?utm_source=share&utm_medium=member_desktop
#InternationalPodcastDay #podcasting #devrel
#SRE Story with Michael Hausenblas
https://www.srestories.dev/p/sre-story-with-michael-hausenblas
"Session Replay feature now available in @newrelic platform"
For my #DEM #RUM #DevOps #Observability #SRE #APM #AIOps #ITOps #Cloud peeps more into #innovation than #acquisition. ๐
I'll be looking more closely at this via @Sageable.
https://newrelic.com/blog/how-to-relic/session-replay-limited-preview-announcement
Cisco announces its intentions to acquire Splunk in $28 billion deal https://www.admin-magazine.com/News/Cisco-Plans-to-Acquire-Splunk #cybersecurity #observability #Cisco #Splunk #security #monitoring

In this blog I discuss the need to summarise the detail of modern #observability in order to use it effectively at scale. I cover:
๐ฎ Telemetry only makes sense when we have context
๐ค Sharing telemetry between engineering teams
๐ Leveraging observability to empower non-technical stakeholders
๐ The need to share service status in distributed systems
๐ Bridging the gap in perspective between leadership and engineering
https://squaredup.com/blog/observability-at-scale-needs-summary/
^------
boosting the "latlearn" toot upthread, so it is visible via its related topic tags:
#perf
#performance
#scale
#scaling
#scalability
#monitoring
#observability
#optimization
#data
#metrics
#measurement
#dashboards
#refactors
#benchmarks
#troubleshooting
#bottlenecks
#algorithms
#speed
#slowapps
#slowsites
#poorUX
#FOSS
#FOSSlibs
#APIs
#libs
#latencylibs
#latencyAPIs
#reporting
#latencyreporting
๐๏ธ Just dropped! This week on @geekingout_pod, I geek out with @jenniferplusplus. We talk about prioritizing #Observability when ๐ฉhits the fan, AI's good and bad side, and Jennifer's OSS project, Letterbook Social!
๐ง: https://geeking-out.simplecast.com/episodes/the-one-where-we-geek-out-on-ai-with-jennifer-moore
๐บ: https://youtu.be/HJs7PZTC_0I

"Ticking Time Bombs: 3 #Cloud Computing Stocks to Dump Before the Damage Is Done"
I don't agree with all of this, esp. re: @datadoghq. #Observability & #AIOps have never been hotter!
But the author makes good points. Fair to be cautious at least.
#PromCon 2023 is starting in Berlin TOMORROW ๐คฉ
If you can't attend, worry not! I'll cover the highlights on the OpenObservability Talks live stream next week.
I'll be joined by @nexucis principal engineer at Amadeus, a #Prometheus maintainer, and the creator of the #Perses project, an exciting addition to the @Prometheus ecosystem.
Join us Wednesday, 4 October, at 10:00 CET
๐ https://lnkd.in/dN8vMJSM
#opensource #observability #CloudNative #CNCF #devops #monitoring

@fossjobs Also found at https://boards.greenhouse.io/wikimedia/jobs/5379296?gh_src=506163cb1us .
Of interest for the #Prometheus and #Grafana #observability folks.
Also #Python #Puppet #Ansible #Terraform #Debian #spicerack.
"Session Replay feature now available in @newrelic platform"
For my #DEM #RUM #DevOps #Observability #SRE #APM #AIOps #ITOps #Cloud peeps more into #innovation than #acquisition. ๐
I'll be looking more closely at this via @Sageable.
https://newrelic.com/blog/how-to-relic/session-replay-limited-preview-announcement
Yay! #Couchbase (https://issues.couchbase.com/browse/JCBC-2046 ) and #Jersey (https://github.com/eclipse-ee4j/jersey/pull/5391 ) are natively supporting #MicrometerIO Observation! If you want us to help you instrument your project don't hesitate to ping us! https://github.com/micrometer-metrics/micrometer/blob/main/docs/modules/ROOT/pages/observation/projects.adoc #Java #Observability
Parca Office hours are starting in 5 minutes! Come learn about latest developments, ask any questions you might have about Parca and Parca Agent, or just hang out!
See you there!
#opensource #profiling #ebpf #observability #performance
https://docs.google.com/document/d/1h2Ni_Q14doE_kScJsLCQewKHRPZXsyWVQt7X0iRzAXo/edit
What's #OpenTelemetry? Is it GA? What's on the roadmap? how to get started?
I'm often asked these questions, so I've decided to hold a dedicated webinar to address them.
I'll hold the webinar on two timezones today/tomorrow:
๐
TODAY, September 26 at 3 PM EDT, or
๐
TOMORROW September 27 at 2 PM CET
RSVP here: https://lnkd.in/dtGufFY3
#cncf #opensource #observability #otel

Once, when I worked on observability systems, I helped a team with performance issues. While doing that, I discovered that they were inferring CPU utilization by measuring RAM utilization... rather than just using the available CPU metrics.
It's not that they didn't know about them, they just didn't believe them for reasons that I can no longer remember save for the emotion of being totally and completely bewildered.
#tech #observability
One good consequence of #Cisco buying #Splunk is that it brings clarity of mission to the product. Splunk under Cisco ownership can focus on system-level log management and event correlation, without trying too hard to shoehorn app-level #observability into its offering.
https://techcrunch.com/2023/09/21/cisco-to-acquire-splunk-in-28b-mega-deal/
I wrote a straightforward guide to auto-instrumenting #nodejs for tracing using #OpenTelemetry and #Jaeger!
This is going to be the first in a series of blogs where I build on this starting point. Next up I'm going to add the #OTEL Collector, and later look at custom instrumentation, head and tail based sampling, using tools other than Jaeger, and metrics.
#observability #monitoring #sre #javascript
https://squaredup.com/blog/auto-instrumenting-node-js-with-opentelemetry-jaeger/
About damn time. ๐ถ
Analysis to follow via @Sageable
#Splunk @Splunk #Cisco @Cisco #Observability #AIOps #Networking #Cybersecurity #SIEM #MandA #Acqusition
At first glance, there are some obvious ways the two companies could come together, but analysts and IT pros also identify potential snags as Cisco prepares to absorb Splunk for $28B.
#SIEM #observability #securityanalytics #AI #Splunk #splunksecurity #cisco #fullstackobservability #securityanalytics #securityautomation
Cisco beefs up cybersecurity play with $28 bln Splunk deal
https://www.reuters.com/markets/deals/cisco-acquire-splunk-28-billion-2023-09-21/
@chris_cooney talk at @DevOpsDaysLondon felt close to home as @puppet 8 and PE 2023.3 drop unchanged events from our reports to reduce the needless storage of data.

I'm excited to be at DevOpsDays London on a lovely sunny day! โ๏ธ Come chat to me and my colleagues at the Elastic booth to talk about anything #elasticsearch #observability, get your stamps and to take our quiz to win Lego and a cuddly Elky! ๐ซ



latlearn
a simple latency instrumentation and reporting lib for Golang
bunch of upgrades pushed up tonight
life? what life?
https://github.com/mkramlich/latlearn
#latency
#instrumentation
#monitoring
#observability
Nice analogy explaining observability with a metaphor about forest and the trees from @jessitron at the 3rd Open Space by @virtualddd #observability #complexity #thinkingInSystems
This week on Slight Reliability I chat to Eric Schabell from Chronosphere about how dashboards fit into modern #observability.
We discuss the Know > Triage > Understand process, the similarities between good documentation and good dashboards, leveraging dashboards to empower less experienced #SREs to be on call, and much more.
Grafana Beyla is an #opensource #eBPF auto-instrumentation tool for application observability.
It can report span information and RED metrics (Rate-Errors-Duration) for both Linux HTTP/S and gRPC services.
Learn more on #InfoQ: https://bit.ly/3EIzh4R
I've just finished reading the "Observability Engineering" book by O'Reilly.
It's a good book. I must admit I've learnt a lot about #observability, even if I already had a good understanding of the subject.
I've especially enjoyed the data storage chapters and some gems about the "cultural" aspects of observability.
My most important take though is the concept of the Error Budget (https://www.blameless.com/blog/error-budget), definitely I'm going to put that into good practice soon.
That said, while the book is great I feel that it's too long and I think that the authors could have taken a more pragmatic approach to writing some of the chapters. I think there are lots of "repetitions".
Easier said that done of course.
submitted "latlearn", my Golang latency instrumentation and reporting lib, to HN:
https://news.ycombinator.com/item?id=37549103
I expect it to BOMB like basically everything else I seem to do lately. I clearly have very different tastes and values than like 99.9999% of humanity online. lol
but I'm not bitter! no not all. heh
#golang
#programming
#HN
#HackerNews
#latency
#instrumentation
#API
#monitoring
#observability
#performance
#scalability
#scaling
#timespans
#durations
#metrics
#datadriven
#bottlenecks
LatencyLearner
aka: latlearn.go
latency performance instrumentation & reporting lib for Golang-based software
https://github.com/mkramlich/latlearn
#go
#golang
#programming
#performance
#scalability
#scaling
#algorithms
#latency
#monitoring
#instrumentation
#observability
#measuring
#metrics
#foss
#github
๐ ๐ฑ ๐ ๐ค ๐ก๏ธโ ๐๏ธ ๐ ๐ ๐ฏ ๐ฅ ๐ค
Love to learn together, and follow the Ops in Dev newsletter?
Subscribe at https://buttondown.email/opsindev.news
๐ค The Inner Dev learning AI/ML
Learn C++ with a little help from AI @sugaroverflow
AI/ML implementation security - #GitLab Global DevSecOps AI report
Civo machine learning with Kubeflow
MLflow in GitLab
OpenLLMetry for LLM #Observability
https://opsindev.news/archive/2023-09-16/#the-inner-dev-learning-aiml
โก Ops in Dev newsletter, September 2023: LLM #Observability, #eBPF for chaos engineering, auto-instrumentation with Odigos , IAST, #GitLab #DevSecOps AI report ๐ก eBPF Summit insights
https://opsindev.news/archive/2023-09-16/#hey-lovely-to-see-you-again
Thread ๐
What are *key* observability concepts you think software developers should know?
The three components of #observability are monitoring, traceability, and metrics. Major cloud providers offer observability tools of their own, but organizations need insight across hybrid and multi-cloud environments. Read on: https://www.releaseteam.com/blog/ #multicloud

DevOpsDays Tampa Bay happens in just over a week at Armature Works, and between the sessions, the Nora Jones keynote, and sharing ideas in the Open Spaces, youโll want to be there!
#Tampa #TampaBay #conference #conferences #DevOps #DevOpsDays #ChaosEngineering #CICD #observability
https://www.globalnerdy.com/2023/09/13/devopsdays-tampa-bay-2023-thursday-september-21/
It was great being back on stage at ContainerDays EU. This time I delivered a brand new talk about the data analytics paradigm in observability.
https://www.linkedin.com/posts/horovits_it-was-great-being-back-on-stage-at-containerdays-activity-7107642517336002562-ZGZx?utm_source=share&utm_medium=member_desktop
#devops #observability #data #analytics #cds #cds23

Just published: #Cisco Full-Stack #Observability draws on channel clout with Secure Application update. Featuring analysis from Andy Thurai of Constellation Research and Stephen Elliot of #IDC. #FSO #thousandeyes #AppDynamics #o11y https://www.techtarget.com/searchitoperations/news/366551878/Cisco-Full-Stack-Observability-draws-on-channel-clout
Eeeee!! @reesesbytes and I will be speaking at KubeCon's Observability Day co-located event this year. Can't wait!!
#o11yDay #kubecon2023 #observability #OTel #opentelemetry #o11y

#Observability is expensive๐ฐ, can get to 30% of your cloud budget!
But do you really need all this data?
@chris_cooney sharing eye-opening usage stats ContainerDays #cds23
A good prep for my talk on observability being a #data #analytics problem ๐

Outside of "how much" and "where is all of it," what should you talk to your users about re: their #o11y data needs?
Workflows?
Tooling gaps?
Metrics to improve?
Platform feature requests?
Current toil that feels unnecessary?
What other data should you bring to the discussion?

Thanks everyone at #ContainerDays for the warm welcome and the interest in all things #eBPF, #Observability and #ChaosEngineering - slides to learn async in https://go.gitlab.com/nwHFeG
Debugging production with Inspektor Gadget, auto-instrumentation for traces, performance comparisons with eBPF, and more out-of-the-box chaos engineering kept the after talk chats running for another hour.
1/2
Serverless Days Belfast at Night was a blast! I had a lot of fun presenting with my friend and colleague Guil and talking about #observability in #AWS. I also learned a ton from the other fantastic speakers! Thanks a million to the organizers๐
PS: slides here https://fth.link/sls-night
Hear Daniel Gomez Blanco's insights on leading a massive #Observability initiative at Skyscanner!
Learn about the adoption of #OpenTelemetry across hundreds of services and the value of open standards.
Don't miss this #InfoQ presentation: https://bit.ly/3PwCVVQ

Me and @jessitron will be streaming shortly at https://twitch.tv/ssObservability
This stream is entitled "Swearing at #k8s with traces", as we attempt to instrument an app Jess has been building in k8s. Join us, it'll be fun, there will be swearing.
I want to track realtime heap size of my server process through some kind of web browser analytics dashboard. I write golang.
What should I use in the modern world? Some kind of prometheus thingie?
#OpenTelemetry #Collector - architecture and configuration guide
https://signoz.io/blog/opentelemetry-collector-complete-guide/
Working through implementing #OTel in some applications, but having an issue with #dotnet baggage not being present when going from non-instrumented service to instrumented service via http. Anyone come across this? Everything I have found assumes that all services are instrumented.
#Observability #OpenTelemetry
Gearing up to migrate off your current #observability solution? Learn how the #OpenTelemetry Collector can ease the process of piloting different vendors here -> https://chronosphere.io/learn/evaluating-an-observability-vendor-why-you-should-try-before-you-buy-with-the-opentelemetry-collector/
โจ#OTel Q&A TODAY!!โจ @hazelweakly joins us this week to share some gold nuggets on her personal experiences with #Observability at this week's OTel Q&A:
DATE: 2023.08.31
TIME: 13:00 EDT/10:00 PDT
CALENDAR DETAILS: https://shorturl.at/dghy2
every #observability talk I've been to at #GoogleNext has mentioned #OpenTelemetry and specifically the Collector.
Love to see it โค๏ธ
I'll be dropping my blog post on how the Collector can help you "try before you buy" when it comes to #observability vendors tomorrow
โจLearn how to contribute to OpenTelemetry!! โจAre you an #OpenTelemetry practitioner? Have you ever wanted to contribute back to OpenTelemetry, but didnโt know where to begin? Then check out my latest blog post! ๐
https://adri-v.medium.com/how-to-contribute-to-opentelemetry-5962e8b2447e
#openSource #cncf #OTel #observability #openSourceContribution
Observability for Architects: A Contrarian Approach to Proactive Application Modernization
https://info.vfunction.com/en/ebook-observability-for-architects-ao/
"Technical debt can be managed with the right tools that shine a light on it and offer an easier fix and prevention than what architects are used to." -- #vFunction
What is #observability driven development? (#ODD). Martin Thwaites from honeycomb.io explains in 45 seconds (as part of Slight Reliability Episode 64).
One of my talks focuses on #Observability in general and Distributed Tracing in particular, with an OpenTelemetry implementation. I want to replace Jaeger with the #Grafana stack and benefit from logs.
Hence, I looked at #Loki: https://blog.frankel.ch/logs-loki/
Going live soon with @jessitron giving another look at #ChaosMesh and the #OpenTelemetry demo app to see what other ways we can break it! because #ChaosEngineering without #Observability is just Chaos...
Super stoked to have had my latest blog post (OTel Python Logging Auto-Instrumentation with the OTel Operator ) featured on O11y News. Check it out!
This week on #SlightReliability I chat with Martin Thwaites from Honeycomb.io about #observability during #development (#ODD). Some of my takeaways:
๐ป How observability in development frees up developers to spend less time debugging and more time writing code.
๐ค That manual instrumentation is where the power is.
๐ฐ Keeping the cost of observability data down through a combination of head and tail based sampling. "Keeping every span of trace data is irresponsible".
A fun little side project from this weekend. A GitHub action that uses the OpenTelemetry Collector Builder under the hood to produce a custom Collector! https://words.boten.ca/building-the-collector/ #opentelemetry #collector #observability
Building an Observability practice that's dependent on large amounts of egress, the highest margin product in cloud, is not sustainable.
Exploring #OpenTelemetry Capabilities. Explore the benefits of the OpenTelemetry protocol and gain the flexibility to configure telemetry according to your needs
https://dzone.com/articles/exploring-opentelemetry-capabilities
I'm thrilled to be working on a pipeline monitoring dashboard using Streamlit for my organization! With so many moving parts to manage, having Streamlit as the backbone of the project is a real game-changer. #Streamlit #Dashboard #Observability #devops
Keep up #APIs healthy with #ApacheAPISIX and #Prometheus
in an upcoming blog post about the power of the OTel Collector I couldn't help but add a little sass with:
Nobody has ever said: โI love migrating observability vendors.โ
๐ ๐ฑ ๐ ๐ค ๐ก๏ธโ ๐๏ธ ๐ ๐ ๐ฏ ๐ฅ ๐ค
Love to learn together, and follow the Ops in Dev newsletter?
Subscribe at https://buttondown.email/opsindev.news
๐ค The Inner Dev learning AI/ML
Learning #Rust with a little help from #AI
Block OpenAI scraping (thx @gergelyorosz )
Avoid Shadow AI - embrace generative AI in the SOC by Elastic
AI #Observability at Meta
https://opsindev.news/archive/2023-08-12/#the-inner-dev-learning-aiml
"@Splunk unveils #Splunk #AI to ease #security and #observability through #GenerativeAI"
Seems like a grab bag of 'capabilities', not products.
And a weird flex to suggest users need AI just to write queries. ๐ค
I expected more from an #AIOps pioneer.
I really love #Honeycomb and #OpenTelemetry. Big fan of how it gives a much greater perspective of the entire system.
I will say though, that in Java with async methods across services can be a little... entertaining to get the telemetry right ๐ฌ
"@Dynatrace to Acquire @rookout to Deliver #Code Debugging in Production Environments"
Looks to be a cool pickup, #Dynatrace forging ahead on #CloudOps & deep #Observability for modern #enterprise.
Keen to dig into this one w/ @Sageable ! Stay tuned!
https://www.dynatrace.com/news/press-release/dynatrace-to-acquire-rookout/
Hello! I'm Chris, a Site Reliability Engineer (#SRE #devops) working at @wikimediafoundation, the non-profit that administers #Wikipedia and other projects. My posts here will focus on improving #latency and #reliability, user-centric #observability, working with #kubernetes and #Python, sometimes #PHP or #Puppet. I love silly #shell #oneliners and tinkering with systems. For fun I dabble in photography and gaming.
Hello everyone, I'm Anthony.
I'm a Linux engineer/SRE in my day job and interested in #automation #observability and #performance
Beyond those, I enjoy tinkering with #electronics #iot #homeassistant in my #homelab
Stepping away from the home, I love to be #outdoors and on my #mtb here in the wonderful #pnw
So how much am I missing out on by not having/trying out #tracing?
Context: Working on a system developed by less than ten people, made out of a few semi-monolithic services, most of which centers on ingesting and serving a hundred-odd usually-independent datasets.
Interesting solution ๐ Set up end-to-end tracing with Amazon CloudFront using OpenTelemetry https://aws.amazon.com/blogs/networking-and-content-delivery/set-up-end-to-end-tracing-with-amazon-cloudfront-using-opentelemetry/ #AWS #CDN #Observability
Going live in 20 minutes on https://twitch.tv/ssObservability with @marcduiker from Diagrid building some #observability into a #Dapr solution, this should be fun :D
๐ ๐ฑ ๐ ๐ค ๐ก๏ธโ ๐๏ธ ๐ ๐ ๐ฏ ๐ฅ ๐ค
Love to learn together, and follow the Ops in Dev newsletter?
Subscribe at https://buttondown.email/opsindev.news
โก New Ops in Dev newsletter
https://opsindev.news/archive/2023-07-11/
#AI weights, Learning #eBPF workshop, tracepusher for CI/CD #Observability, Cost efficiency with Kepler and krr, KubeShark, #Flux 2.0.0
Let's dive in ๐ค
Since I collab with both the infosec and SRE communities, Iโm curious which #observability tool will win for most valuable during an incident.
Whatโs your vote?
Amazon CloudWatch now supports Cross-Account Service Quotas ๐ To track and visualize resource utilization and limits across various AWS services from multiple AWS accounts within a region using a central monitoring account https://aws.amazon.com/about-aws/whats-new/2023/07/amazon-cloudwatch-cross-account-service-quotas/ #AWS #Observability
I had a blast yesterday with @Martindotnet and @plantpoweredjames chatting about #dotnet and #observability! Martin is so inspiring when it comes to #observability and #opentelemetry!
It is definitely an underlooked topic in the .NET community!
If you've missed the livestream, you can watch it there๐
https://www.twitch.tv/videos/1862282163?collection=ls5f65-lTBc4NA
Missed my @monitorama talk on #Observability Anti-Patterns last week? No problem! You can catch it on the Monitorama YouTube Day 1 livestream at timestamp 1:01:56. ๐
The real power of #opensource lies with OPEN STANDARDS AND SPECIFICATIONS.
At #KubeCon it took the center stage. I summarized the important #observability related specs/standards updates you should be aware of in this blog post, which discusses #opentelemetry #opencensus #prometheus, new query language standardization and more:
https://horovits.medium.com/the-rise-of-open-standards-in-observability-highlights-from-kubecon-13694e732c97