Job Type: Contract
Work Mode: Hybrid (3 Days from office)
Key Responsibilities
Design implement and maintain data pipelines to ingest and process OpenShift telemetry metrics logs traces at scale
Stream OpenShift telemetry via Kafka producers topics schemas and build resilient consumer services for transformation and enrichment
Engineer data models and routing for multitenant observability ensure lineage quality and SLAs across the stream layer
Integrate processed telemetry into Splunk for visualization dashboards ing and analytics to achieve Observability Level 4 proactive insights
Implement schema management AvroProtobuf governance and versioning for telemetry events
Build automated validation replay and backfill mechanisms for data reliability and recovery
Instrument services with OpenTelemetry standardize tracing metrics and structured logging across platforms
Use LLMs to enhance observability capabilities eg query assistance anomaly summarization runbook generation
Collaborate with platform SRE and application teams to integrate telemetry s and SLOs
Ensure security compliance and best practices for data pipelines and observability platforms
Document data flows schemas dashboards and operational runbooks
Required Skills
Handson experience building streaming data pipelines with Kafka producersconsumers schema registry Kafka ConnectKSQLKStream
Proficiency with OpenShiftKubernetes telemetry OpenTelemetry Prometheus and CLI tooling
Experience integrating telemetry into Splunk HEC UF sourcetypes CIM building dashboards and ing
Strong data engineering skills in Python or similar for ETLELT enrichment and validation
Knowledge of event schemas AvroProtobufJSON contracts and backwardforward compatibility
Familiarity with observability standards and practices ability to drive toward Level 4 maturity proactive monitoring automated insights
Understanding of hybrid cloud and multicluster telemetry patterns
Security and compliance for data pipelines secret management RBAC encryption in transitat rest
Good problemsolving skills and ability to work in a collaborative team environment
Strong communication and documentation skills