CloudApper AIRemote
Data Engineer (Contract) (Remote)
United States of America
Full-time
1 hour ago
Visa Sponsor
Key skills
PythonSQLNoSQL databasesETL processesAWS GlueAWS RedshiftAWS EMRAWS LambdaAWS S3AWS KinesisAWS AthenaAzure DatabricksAzure Data FactoryAzure SQL DatabaseAzure Blob StorageAzure Event HubsGCP BigQueryGCP DataflowGCP DataprocGCP Pub/SubGCP Cloud StorageHadoopSparkAirflowSnowflakeNoSQLAIMachine LearningETLData WarehousingAnalyticsLookerTableauBigQueryRedshiftDatabricksKafkaCassandraAWSAzureGCPTerraformKubernetesDockerCloudFormationLambdaS3DynamoDBGlueAthenaKinesisAzure SQLBlob StoragePub/SubCloud StorageMongoDBGrafanaCommunicationRemote WorkSales
About this role
CloudApper AI is a leading company in cloud technology, focusing on innovative AI-driven solutions. They are looking for a skilled Data Engineer to develop and optimize data pipelines and implement big data solutions while collaborating with cross-functional teams in a remote work environment.
Responsibilities:
- Design, build, and optimize data pipelines, architectures, and data sets
- Work with big data technologies to solve complex data processing challenges
- Implement ETL processes and data warehousing solutions
- Attend meetings, providing pre-sales support and technical insights
- Collaborate with cross-functional teams to integrate data solutions into broader projects
- Engage in cloud-based data solutions using AWS, Azure, or GCP
- Ensure data integrity, efficiency, and scalability in all solutions
Requirements:
- Strong proficiency in Python
- Experience with SQL and NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB)
- Expertise in ETL processes and tools
- Proficiency in one or more cloud platforms: AWS, Azure, or GCP, with specific technologies including: AWS: Glue, Redshift, EMR, Lambda, S3, Kinesis, Athena; Azure: Databricks, Data Factory, Azure SQL Database, Blob Storage, Event Hubs; GCP: BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage
- Familiarity with big data tools like Hadoop, Spark, or Airflow
- Experience with Snowflake for cloud data warehousing
- Strong problem-solving skills and attention to detail
- Excellent English communication skills for client-facing roles and technical discussions
- Previous consulting or startup environment experience
- Ability to independently handle customer interactions and lead projects
- Proficiency in English is essential for effective communication with clients
- Availability for scheduled client meetings and responsiveness on Slack during EST business hours
- Experience with Looker, PowerBI, Tableau, or Grafana for data visualization
- Experience with machine learning and analytics
- Familiarity with containerization technologies like Docker, Kubernetes, and Infrastructure as Code (IaC) tools like Terraform or AWS CloudFormation
- Knowledge of API development and integration
- Experience with streaming technologies such as Kafka or Flink
- Understanding of data privacy and compliance regulations (e.g., GDPR, HIPAA)