PowerSecure, Inc.Remote
Data Solutions Engineer - HYBRID/NC RESIDENTS ONLY
United States of America
Full Time
10 hours ago
No H1B
Key skills
Azure Data FactoryAzure DatabricksDelta LakeDelta Live TablesDatabricksPySparkSpark SQLSQLPythonData ModelingDimensional ModelingAzure DevOpsGitUnity CatalogMicrosoft PurviewData Ingestion PatternsChange Data Capture (CDC)Data Pipeline DesignData Quality ChecksSource ControlCI/CDRBACData GovernanceData SecurityMonitoringLoggingAlertingRunbook AutomationELTData EngineeringAnalyticsBIPower BISparkAzureCommunicationCollaboration
About this role
PowerSecure, Inc. is a leading provider of innovative energy solutions to electric utilities and their industrial, institutional, and commercial customers. They are seeking a Data Solutions Engineer to design, build, and operate data pipelines on their Azure data platform, collaborating with BI Developers and stakeholders to ensure high-quality data delivery.
Responsibilities:
- Design, implement, and support end‑to‑end ELT pipelines (ingest → transform → publish) in Databricks/ADF
- Implement data quality checks (DLT expectations, unit tests) with alerting and remediation runbooks
- Build curated, analytics‑ready Delta tables using dimensional modeling for consumption by BI Developers
- Implement CDC and deletion‑flag patterns; manage schema drift and partitioning/Z‑Ordering strategies
- Operationalize jobs with monitoring, logging, alerting; participate in an on‑call rotation as needed
- Partner with the Data Architect to align designs with standards for governance, security, and cost efficiency
- Document pipelines, data contracts, and SLAs; continuously improve performance and reliability
Requirements:
- 2+ years of hands‑on data engineering (or comparable software engineering with significant data work)
- 2+ years building pipelines on Azure and Databricks (or equivalent cloud + Spark)
- Strong SQL (analytical queries, window functions), PySpark/Spark SQL, and data modeling fundamentals
- Bachelor's degree in MIS, Computer Science, Engineering, or equivalent experience
- Proficiency with SQL and Python (PySpark), including performance tuning on large datasets
- Experience with Azure Databricks, Delta Lake, Delta Live Tables (DLT), Azure Data Factory (or Fabric Data Pipelines), ADLS Gen2, and Azure DevOps/Git for CI/CD
- Working knowledge of Unity Catalog and/or Microsoft Purview for governance, lineage, and security
- Familiarity with data ingestion patterns (files, APIs, JDBC), schema evolution, CDC, and deletion detection patterns
- Understanding of dimensional modeling to produce analytics‑ready datasets for Power BI
- Exposure to orchestration/monitoring, cost optimization, alerting, and runbook‑driven operations
- Data pipeline design (batch & streaming), DLT expectations for data quality, and robust error handling
- Source control, branching strategies, and CI/CD for data assets (notebooks, jobs, workflows)
- Practical understanding of privacy, security, and RBAC in cloud data platforms
- Excellent communication, documentation, and cross‑functional collaboration skills
- Analytical mindset; bias toward automation and measurable reliability
- Applicants must be legally authorized to work in the United States and should not require now, or in the future, sponsorship for employment visa sponsorship