Data Engineer
United States of America
Contract
3 weeks ago
H1B Sponsor Likely
Key skills
SQLETL/ELT pipelinesSnowflakeBigQueryDatabricksHiveSparkTrinoKafkaPulsarKinesisData modelingGraphQLORM frameworksMySQLData quality engineeringData migrationMulti-priority managementAIETLELTData EngineeringGitHubSalesforceCRM
About this role
Intelliswift, an LTTS Company, is seeking a skilled Data Engineer to support a large-scale data platform migration initiative. The role focuses on designing and building scalable data pipelines and ensuring high data quality and reliability across systems.
Responsibilities:
- Design and build bidirectional data pipelines between CRM systems, data warehouses, and internal operational data stores
- Develop real-time streaming pipelines using distributed event-streaming frameworks (e.g., Kafka, Kinesis, Pulsar)
- Define and manage data schemas and entity models, including access controls and data lifecycle rules
- Build and maintain data validation, reconciliation, and monitoring frameworks to ensure data accuracy during migration
- Develop and maintain data documentation (schema definitions, transformations, mappings, data dictionaries)
- Collaborate with engineering, business, and CRM stakeholders to define data contracts, SLAs, and migration strategies
- Investigate and resolve data quality issues, pipeline failures, and inconsistencies
- Leverage AI-assisted development tools to improve efficiency in SQL development, pipeline creation, and schema management
Requirements:
- Strong proficiency in SQL and data transformation logic
- Hands-on experience building ETL/ELT pipelines in distributed data environments
- Experience with data warehouses such as Snowflake, BigQuery, Databricks, Hive, Spark, or Trino
- Experience with real-time streaming systems (Kafka, Pulsar, Kinesis, or similar)
- Solid understanding of data modeling (entity modeling, dimensional modeling)
- Experience with GraphQL and backend data access layers
- Familiarity with ORM frameworks and relational databases (MySQL or similar)
- Strong experience with data quality engineering (validation, monitoring, reconciliation)
- Experience with data migration across heterogeneous systems
- Ability to work independently and manage multiple priorities
- Bachelor's degree in Computer Science, Data Engineering, or related field
- 5+ years of data engineering experience
- Experience working with CRM platforms (e.g., Salesforce)
- Exposure to AI-assisted development tools (GitHub Copilot, Cursor, etc.)
- Experience with event-driven architectures and subscription-based data systems