Data Engineer

Minisoft Technologies LLC is seeking a Senior Data Engineer to join their team. The role involves building and maintaining data pipelines, developing backend services, and managing large datasets while ensuring high availability in production environments.

Responsibilities:

• Build, maintain, and optimize scalable data pipelines
• Develop backend services using C# and Python
• Manage and query large datasets in BigQuery and Snowflake
• Support high-availability production environments
• Work with Kafka (Confluent), RabbitMQ, Docker, and Kubernetes
• Monitor, troubleshoot, and improve data platform performance

Requirements:

• C#
• Python
• Google BigQuery
• Snowflake
• Kafka (Confluent)
• RabbitMQ
• Docker
• Linux/Unix
• Elastic/ELK
• Terraform
• Kubernetes