ALL CASE FILES
CASE-001SIEM Engineering / SOC Implementation

Enterprise SIEM Log Source Onboarding & Detection Validation

A practical enterprise SIEM engineering case study covering the complete telemetry lifecycle — from source integration and ingestion validation to parsing, normalization, detection validation and SOC operational readiness.

SIEM ENGINEERINGLOG SOURCE INTEGRATIONDETECTION ENGINEERINGSOC IMPLEMENTATION
SANITIZED ENTERPRISE CASE STUDY
01Executive Summary

The engineering problem

Enterprise SIEM implementations are not complete when a log source simply shows a "Connected" status.

A security data source can be technically connected while still failing operationally because of ingestion gaps, stale collectors, incorrect parsing, field-normalization issues, duplicate telemetry, or detection rules that cannot consume the incoming data correctly.

This case study presents my approach to validating enterprise log-source onboarding from initial integration through detection readiness.

“Is this security data actually usable by the SOC?”

02Core Engineering Principle

Connectivity is only the beginning

CONNECTED
≠
INGESTING
≠
PARSED
≠
DETECTION READY
  1. 01Generated
  2. 02Collected
  3. 03Ingested
  4. 04Parsed
  5. 05Normalized
  6. 06Detection-compatible
  7. 07Investigation-ready

A mature SIEM onboarding process validates every layer independently. Connectivity is only the beginning.

03Context

The challenge

The environment contained multiple enterprise security and infrastructure data sources feeding centralized monitoring platforms. The validation process needed to answer:

  • Is the source actively generating security telemetry?
  • Are events reaching the intended collector?
  • Is ingestion continuous and within the expected volume?
  • Are timestamps accurate?
  • Are important security fields being parsed correctly?
  • Are fields normalized consistently enough for investigation and correlation?
  • Are duplicate or stale collection paths present?
  • Can detection rules actually use the telemetry?
  • Can analysts reliably investigate incidents generated from the source?

A "Connected" status alone could not answer these questions.

04Responsibilities

My role

  • 01Log-source onboarding and integration
  • 02Syslog/API/agent-based collection validation
  • 03Ingestion and event-flow troubleshooting
  • 04EPS and telemetry-volume analysis
  • 05Parsing and field-normalization validation
  • 06Duplicate/stale collector analysis
  • 07Correlation and detection-rule validation
  • 08SOC operational-readiness checks
  • 09Troubleshooting with infrastructure and security teams
  • 10Documentation and handover
05Telemetry Architecture

Architecture

  1. Security / Infrastructure Sources
  2. Collection Layer
    Syslog / API / Agent
  3. Collector / Ingestion Layer
  4. SIEM Data Pipeline
  5. Parsing & Normalization
  6. Security Dataset / Event Store
  7. Detection & Correlation Rules
  8. Cases / Incidents
  9. SOC Investigation
06Methodology

6-phase validation methodology

01

Source Validation

The first step was verifying the actual telemetry source rather than relying only on SIEM connection status.

Validation included
  • Source availability
  • Expected log generation
  • Collection method
  • Collector assignment
  • Timestamp consistency
  • Expected telemetry categories
  • Event frequency and volume

Outcome: Establish whether an apparent ingestion problem originates at the source, collection layer, or SIEM.

02

Ingestion Validation

Once the source was confirmed, validate whether events were reaching the SIEM consistently.

Checks included
  • Last event received
  • Event continuity
  • Expected versus observed event volume
  • EPS behaviour
  • Collection gaps
  • Collector health
  • Duplicate collection paths
  • STATE A
    Source not reporting
  • STATE B
    Source connected but events not arriving
  • STATE C
    Events arriving through an incorrect or stale collection path
03

Parsing & Normalization

Receiving logs was only the beginning.

The next step was confirming whether telemetry was usable for investigation and detection.

Depending on the event type, validation included fields such as
  • Source IP
  • Destination IP
  • Source Host
  • Destination Host
  • Username
  • Device
  • Event ID
  • Event Category
  • Action / Result
  • Timestamp

Not every telemetry source naturally contains every field. Validation therefore focused on whether the fields expected for that particular event type were extracted and normalized correctly.

04

Duplicate & Stale Path Analysis

Some enterprise environments contain multiple collectors or historical integration paths for the same source.

This can create
  • Duplicate telemetry
  • Incorrect reporting status
  • Unnecessary ingestion
  • Misleading monitoring
  • Detection noise

Collector paths were reviewed to distinguish active ingestion from stale or duplicate configurations. The active collection path was retained for operational monitoring while stale paths were identified for remediation or exclusion from reporting logic.

05

Detection Validation

A log source was not considered operationally ready merely because events were visible.

The telemetry also had to support the intended detection logic.

Validation included
  • Required detection fields
  • Field availability
  • Correlation conditions
  • Rule triggering behaviour
  • False-positive behaviour
  • Entity extraction
  • Incident/case generation
  • Investigation usability

Where necessary, detection logic was reviewed or tuned so that it reflected the actual structure of the incoming telemetry.

06

SOC Readiness

The final validation asked whether an analyst could actually investigate an alert generated from the source.

The resulting event/case should provide sufficient context to answer
  • What happened?
  • Which user or device was involved?
  • What source initiated the activity?
  • What destination was affected?
  • What security action occurred?
  • What related activity exists?
  • What should the analyst investigate next?

This moves validation from technical connectivity to operational SOC readiness.

07Troubleshooting

Troubleshooting decision flow

  1. Q1Is the source generating logs?
    NO → Source-side investigation
    YES
  2. Q2Are events reaching the expected collector?
    NO → Collection-path investigation
    YES
  3. Q3Is ingestion continuous?
    NO → Ingestion / collector investigation
    YES
  4. Q4Are required fields parsed and normalized?
    NO → Parsing / normalization investigation
    YES
  5. Q5Can detection logic consume the telemetry?
    NO → Detection / field-mapping review
    YES
  6. Q6Is the resulting case investigation-ready?
    NO → Enrichment / investigation-context review
    YES
  7. OPERATIONALLY READY
08Result

Operational improvement

The validation approach provided a structured method for distinguishing:

  • Non-reporting sources
  • Connected sources with no recent telemetry
  • Stale collector paths
  • Duplicate collection paths
  • Parsing problems
  • Field-normalization gaps
  • Detection compatibility problems

This reduced ambiguity between infrastructure connectivity issues and SIEM/detection-engineering issues and provided clearer ownership for remediation.

09Capabilities

What this case demonstrates

01

SIEM Engineering

Understanding the complete telemetry lifecycle rather than treating log-source onboarding as a connectivity task.

02

Detection Engineering

Validating that incoming telemetry contains the fields and behaviour required by detection logic.

03

Troubleshooting

Separating source, collection, ingestion, parsing, normalization and detection problems systematically.

04

SOC Operations

Ensuring that resulting alerts and cases contain usable investigative context.

05

Cross-Team Coordination

Working across SOC, infrastructure, platform and security teams to resolve telemetry and detection issues.

10Tooling

Technology stack

SIEM

  • IBM QRadar / QRoC
  • Cortex XSIAM

Collection

  • Syslog
  • API-based integrations
  • Agent-based collection

Engineering

  • Log-source onboarding
  • EPS analysis
  • Parsing
  • Normalization
  • Field mapping
  • Correlation-rule validation
  • Detection tuning

Investigation

  • XQL
  • AQL
  • Security telemetry analysis
  • Incident / case validation

SECURITY & CONFIDENTIALITY

This case study is intentionally sanitized.

Customer names, infrastructure identifiers, IP addresses, internal architecture details, security configurations, detection logic, credentials and other sensitive information have been excluded or generalized.

The case represents the engineering methodology and responsibilities involved rather than disclosing customer-specific implementation details.

SUCCESSFUL SIEM ONBOARDING IS NOT:

“CAN I SEE LOGS?”

IT IS:

“CAN THE SOC RELIABLY DETECT, INVESTIGATE AND RESPOND USING THIS TELEMETRY?”

That distinction turns log integration into security engineering.

BUILDING A SECURITY ENGINEERING TEAM?

I’m open to opportunities across Security Engineering, Detection Engineering, SIEM/XDR/SOAR, Incident Response, Security Automation and advanced SOC operations.