Key skills

Elastic StackElasticsearchKibanaIngest PipelinesIndex Lifecycle Management (ILM)LogstashBeatsPython scriptingETL/Data PipelineJSONYAMLField mappingsSchema designGitGitOpsData maskingData redactionData hashingRole-Based Access Control (RBAC)Kibana search and retrievalPersonally Identifiable Information (PII) handlingData privacyComplianceCI/CD toolsJenkinsGitLab CITeamCityLinuxBash scriptingPythonBashETLIntegration TestingGitLabAgileCI/CD

About this role

Sriven Systems Inc. is seeking an Elastic Pipeline Engineer to design and develop Elastic ingest pipelines for automated log processing. The role involves implementing data redaction techniques, configuring Elasticsearch settings, and collaborating with various teams in an Agile environment.

Responsibilities:

Design, develop, and configure Elastic ingest pipelines for automated log processing
Implement field-level data redaction, masking, and hashing for sensitive information
Configure Elasticsearch index templates, field mappings, and Index Lifecycle Management (ILM) policies
Build and maintain secure evidence pipelines with tamper-evident metadata
Configure role-based access control (RBAC) and auditor-facing search and retrieval views in Kibana
Develop automation scripts using Python for data processing and integration
Perform integration testing, support UAT, and resolve pipeline-related issues
Create technical documentation, operational runbooks, and participate in knowledge transfer sessions
Collaborate with architects, engineering teams, and compliance stakeholders in an Agile environment

Requirements:

5+ years of experience with Elastic Stack (Elasticsearch, Kibana, Ingest Pipelines, ILM)
Strong experience with Logstash, Beats, and ingest processor
4+ years of Python scripting and automation
Experience building ETL/Data Pipeline
Strong knowledge of JSON, YAML, field mappings, and schema design
Experience with Git/GitOps workflow
Hands-on experience with data masking, redaction, and hashing
Experience configuring RBAC and Kibana search/retrieval view
Knowledge of PII handling, data privacy, and compliance
Experience with CI/CD tools (Jenkins, GitLab CI, TeamCity, or similar)
Linux and Bash scripting experience