Data Engineer

Mindlance is seeking a Data Engineer to develop and implement robust database solutions. The role involves designing and maintaining databases, optimizing performance, and ensuring data integrity while supporting data-driven decision-making.

Responsibilities:

• Developing and implementing database schemas, including tables, indexes, views, stored procedures, and triggers to meet business requirements and ensure data integrity
• Creating data models that represent the structure of the data, relationships between entities, and how data will be stored and accessed
• Planning and executing database migrations ensuring data integrity and minimal downtime
• Identifying and resolving performance bottlenecks, optimizing queries, indexes, and database configurations to improve query execution speed and overall system efficiency
• Continuously monitoring database performance, identifying and resolving issues, troubleshooting errors, and ensuring system stability and availability
• Implementing and managing backup and recovery strategies, including regular backups, disaster recovery plans, and data restoration procedures to ensure data availability and prevent data loss
• Implementing and enforcing security measures, including user authentication, authorization, access controls, and data encryption to protect sensitive data from unauthorized access and breaches
• Implementing procedures and checks to ensure data accuracy, consistency, and validity, including validation rules, data cleansing, and data quality monitoring
• Writing efficient and optimized SQL queries, stored procedures, functions, and triggers to perform data manipulation, retrieval, and analysis
• Creating and maintaining scripts for database administration tasks, including database creation, schema changes, data loading, and automated backups
• Implementing and managing high availability solutions, including database mirroring, log shipping, and Always On Availability Groups, to ensure continuous database availability
• Designing and implementing data warehouses, data marts, and business intelligence solutions to support data analysis and reporting
• Understanding and implementing cloud-based database solutions, including AWS RDS, to leverage cloud infrastructure and scalability
• Implementing data replication and distribution strategies to ensure data consistency across multiple databases or locations

Requirements:

• Core Database skillsets using SQL Server and Postgres
• Database Design and Implementation: Developing and implementing database schemas, including tables, indexes, views, stored procedures, and triggers to meet business requirements and ensure data integrity
• Data Modeling: Creating data models that represent the structure of the data, relationships between entities, and how data will be stored and accessed
• Table partitions and archiving
• Database Migration: Planning and executing database migrations ensuring data integrity and minimal downtime
• Database Administration and Maintenance: Performance Tuning: Identifying and resolving performance bottlenecks, optimizing queries, indexes, and database configurations to improve query execution speed and overall system efficiency
• Monitoring and Troubleshooting: Continuously monitoring database performance, identifying and resolving issues, troubleshooting errors, and ensuring system stability and availability
• Database Development and Support: SQL Development: Writing efficient and optimized SQL queries, stored procedures, functions, and triggers to perform data manipulation, retrieval, and analysis
• Advanced Database Technologies: High Availability and Disaster Recovery: Implementing and managing high availability solutions, including database mirroring, log shipping, and Always On Availability Groups, to ensure continuous database availability
• Backup and Recovery: Implementing and managing backup and recovery strategies, including regular backups, disaster recovery plans, and data restoration procedures to ensure data availability and prevent data loss
• Security Management: Implementing and enforcing security measures, including user authentication, authorization, access controls, and data encryption to protect sensitive data from unauthorized access and breaches
• Data Integrity and Quality: Implementing procedures and checks to ensure data accuracy, consistency, and validity, including validation rules, data cleansing, and data quality monitoring
• Database Scripting: Creating and maintaining scripts for database administration tasks, including database creation, schema changes, data loading, and automated backups
• Data Warehousing and Business Intelligence: Designing and implementing data warehouses, data marts, and business intelligence solutions to support data analysis and reporting
• Cloud Database Solutions: Understanding and implementing cloud-based database solutions, including AWS RDS, to leverage cloud infrastructure and scalability
• Data Replication and Distribution: Implementing data replication and distribution strategies to ensure data consistency across multiple databases or locations