Blog Beyond SIEM rules and playbooks
Blog · SOC operations
Beyond static SIEM rules and SOAR playbooks
SIEM and SOAR brought order to security operations: central logging, correlation rules and repeatable response. A decade later, many teams find the same tools generating more work than they remove. This article looks at four structural problems and at what has to change.
A model built for a calmer world
The classic SOC stack rests on two ideas. A SIEM collects logs and runs detection rules over them; each rule that matches raises an alert. A SOAR platform then runs playbooks: predefined sequences of enrichment and response steps triggered by alert types. Analysts sit between the two, reading alerts and deciding what to do.
That model assumes a manageable number of data sources, rules that stay correct once written, and situations that repeat closely enough for a fixed script to handle them. None of those assumptions holds well today. Environments change weekly, cloud and SaaS sources multiply, and attackers deliberately behave like administrators.
Problem one: the alert flood
A rule-centric SIEM evaluates each rule on its own. One suspicious sequence on one server can trip a dozen rules, and every match becomes its own alert with its own severity. Routine operations such as backups, software deployment and administrative scripts look a lot like attacker tradecraft and trigger the same rules.
The result is familiar to every analyst: a queue where the same activity appears many times, where most alerts turn out to be legitimate, and where the few that matter are hard to find. Teams respond by raising thresholds or muting rules, which reduces noise and creates blind spots at the same time.
The deeper issue is the unit of work. An alert describes a single observation. An attack is a story across hosts, accounts and time. As long as the alert is the unit, analysts spend their time reassembling stories by hand.
Problem two: brittle playbooks
Playbooks are valuable because they make response repeatable. They are also code, and code that touches many external systems. An API version changes, a field is renamed in an enrichment source, a team reorganises who owns a firewall, and the playbook either fails loudly or, worse, keeps running and does the wrong thing quietly.
Each playbook also encodes one path through one situation. Real incidents branch: the same alert type can mean a misconfigured backup job on one host and an intrusion on another. Covering the branches means more playbooks, and maintaining hundreds of them becomes a job in itself. Many organisations end up with a small set of trusted playbooks and a long tail that nobody dares to run.
Problem three: rule drift and silent blindness
Detection rules are written against specific log fields and formats. When a source is upgraded, a parser changes, or a field is renamed or moved, a rule does not necessarily fail. It keeps running, matches nothing, and reports nothing. From the console it looks like a quiet week.
The same happens when a log source stops sending data, sends it late, or starts sending only part of it. Without a continuous check that each rule still sees the data it was built for, coverage erodes without anyone deciding to remove it. Detection engineering teams know this problem well; few have the time to audit every rule against every source every week.
Problem four: knowledge that walks out of the door
Experienced analysts carry a map of the environment in their heads: which service account always runs that odd script at night, which server legitimately talks to an unusual country, which alert from which rule is always noise. That knowledge is what makes triage fast. It is rarely written down in a form a system can use.
Turnover is high and talent is scarce. ISC2 estimates the global cybersecurity workforce gap at 4.8 million people, and 90% of respondents report skills shortages in their organisations [1]. Every departure resets part of the SOC’s learning curve, and every new hire spends months rebuilding it.
From static to learning operations
| Classic approach | What a learning SOC does instead |
|---|---|
| One alert per rule match | Alerts grouped into one case per attack story, around the entities involved |
| Severity set by the rule author | Priority from what the activity means for this entity, against its own normal behaviour |
| Fixed playbooks per alert type | Investigation that adapts to the evidence, with response prepared as an approvable proposal |
| Rules assumed to keep working | Continuous checks that each detection still sees the data it needs, with drift reported |
| Knowledge in analysts’ heads | Lessons from settled cases kept by the system and reused on the next case |
Keep the SIEM, change the operating model
None of this means discarding the SIEM or EDR. They remain the best places to collect telemetry and run detections. What changes is what happens next. Instead of feeding a queue that people work through alert by alert, the alert stream feeds a system that reads every alert, ties it to the entity it concerns, builds the story, verifies conclusions against the raw logs and keeps what it learns.
Response changes too. Rather than a script that runs whenever a condition matches, the system prepares a proposal with its evidence, its expected effect and a way to undo it, and a person approves it. Detection content improves the same way: proposed rule changes are tested against your own history and reviewed before anything goes live.
This is the direction ApexAI takes: it works on top of the SIEM and EDR you already run, starting with read-only access, and turns them into a learning operation instead of a growing pile of rules and playbooks. The Why ApexAI page explains the wider context.
Questions
Is SOAR obsolete?
The need SOAR addresses, repeatable and auditable response, is more important than ever. What is reaching its limits is the static playbook: a fixed script per alert type that breaks when tools or situations change.
What is detection rule drift?
Rule drift is when a detection rule stops matching what it was built to catch, usually because a log field, format or source changed. The rule keeps running but silently sees nothing.
Do we need to replace our SIEM to move beyond playbooks?
No. The SIEM and EDR remain the sources of telemetry and detections. A learning SOC layer works on top of them, reading their alerts and logs and proposing improvements back.
Sources
Third-party figures, as published by their sources.
See ApexAI on your own alerts.
A walkthrough with your team, in observe mode first: ApexAI scores and proposes, nothing acts on its own.