Data Engineer - DataBricks - Long-term contract, Hybrid
Location: Montvale, NJ (3 days per week on-site)
Duration: 1-Year Consulting Contract (with potential for conversion/long-term extension)
<>Role Overview</>
We are seeking a skilled and adaptable Data Engineer to join our client's Data & Analytics team, in a critical and interesting role helping build a platform used globally by the company's offices and customers. In this position, you will play a vital role in helping the teams connect with and migrate to a centralized, highly scalable data platform. You will build and maintain ingestion, transformation, and load (ITL) pipelines, partnering closely with architecture, AI, and global stakeholders.
<>Key Responsibilities</>
Data Platform and Pipeline Development: Own the design, development, and implementation of robust data pipelines that ingest, transform, and load structured and unstructured data into the data platform.
Platform Migration Support: Drive the migration and onboarding of analytics workflows onto theenterprise platform while strictly honoring data and metadata residency and Data Loss Prevention (DLP) standards.
Core Tech Stack & AI Integration: Build scalable data solutions primarily using Databricks (Delta Lake, Unity Catalog, Lakeflow), with additional exposure to Microsoft Fabric and Snowflake. Leverage AI-assisted development workflows (e.g., Copilot, Claude) to accelerate delivery and operationalize AI agent/advanced analytics inputs.
Data Quality & Validation: Champion data quality by developing and implementing rigorous validation frameworks ensuring the reliability of transactional and audit data sources.
Stakeholder & Global Collaboration: Collaborate with directors, architecture teams, and international offices and stakeholders to align on requirements, manage expectations, and support deployment.
Growth & Mentorship: Balance hands-on technical execution (approx. 70%) with architectural design, cross-functional collaboration, and technical leadership to help shape the future of the data platform solutions.
<>Qualifications & Requirements</>
Experience: 3 to 10+ years of professional data engineering experience building scalable data solutions for advanced analytics and enterprise platforms. We are open to diverse experience levels for candidates eager to grow and take on leadership ownership.
Primary Technology Expertise: Hands-on mastery of Databricks (Delta Lake, Unity Catalog, Lakeflow). Additional familiarity with Microsoft Fabric (Lakehouse, OneLake, Data Factory) and Snowflake is a strong plus.
Programming Skills: Strong, independent programming skills in SQL (complex queries, performance tuning), Python (pandas, PySpark, reusable modules), and Apache Spark (Spark SQL, DataFrames, distributed processing).
Environment & Tools: Experience with data preparation, Azure AI Search or similar tooling, and integration into AI-driven workflows. Proficiency with Agile methodologies, Git, and CI/CD pipelines.
Soft Skills & Location: Excellent problem-solving, communication, and project management skills to interface effectively with local and global stakeholders. Must be able to work on-site in the Montvale, NJ office 3 days per week (Mondays and Fridays from home)
By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Benchmark IT, LLC and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here: bmarkits.com/privacy-policy
