Data Integration Specialist (Hybrid)

Symmetrio is actively recruiting for a Data Integration Specialist for our customer, a large government organization in Philadelphia, PA. As a Data Integration Specialist, you will play a crucial role in the seamless migration, integration, and management of large-scale data across Amazon S3 and Redshift environments. This role demands not only technical expertise but also an in-depth understanding of data architecture, data security, and integration strategies to ensure robust data infrastructure.

This is a full-time, hybrid position requiring on-site presence in Philadelphia 2 days per week.

Responsibilities

• Design, develop, and deploy ETL/ELT data pipelines to facilitate the transfer of complex datasets into Amazon S3, using tools such as Azure Data Factory, optimized for performance, resilience, and scalability
• Implement automated workflows to streamline the continuous data migration process, ensuring that data ingestion and processing run smoothly with minimal manual intervention
• Set up and manage Amazon S3 buckets for optimized data storage solutions, and configure data schemas and tables within Amazon Redshift to accommodate evolving business needs
• Migrate cleaned and preprocessed data efficiently into Amazon S3 and Redshift, ensuring data consistency and integrity throughout the process
• Proactively monitor data pipelines for performance, identifying potential bottlenecks or failures, and implementing solutions to maintain optimal data flow
• Regularly assess and refine data integration processes to enhance system efficiency and scalability, leveraging best practices in cloud and data engineering
• Maintain meticulous documentation for all data integration processes and ensure all activities comply with data governance standards, security protocols, and company policies

Requirements

• Minimum of 3 years of experience working as a Data Integration Specialist
• Proficiency with cloud platforms, particularly AWS (S3, Redshift, Lambda) and Azure Data Factory
• Strong skills in SQL and experience with ETL tools
• Demonstrated expertise in data security and integrity measures, including encryption and secure data transfer
• Excellent problem-solving and analytical abilities for troubleshooting data integration challenges
• Effective communication and documentation skills, with the ability to clearly document technical processes
• Preferred experience with AWS Glue, Python, C#, and SparkSQL

Benefits

• Health Care Plan (Medical, Dental & Vision)
• Retirement Plan (401k, IRA)
• Paid Time Off (Vacation, Sick & Public Holidays)