Staff Data Engineer - Remote (US Based)
UpRecruit
Austin, texas
Job Details
Full-time
Full Job Description
Job Details:
- Title: Sr. Data Engineer
- Salary: $220K - $240K
- Requirements: airflow, dbt, Snowflake, AWS, Python, SQL
- Location: 100% Remote
Our client, a rapidly growing MarTech company, is seeking a Staff Data Engineer to join their team. This role entails spearheading the evolution and upkeep of the Enterprise Data Platform - this includes overseeing a cutting-edge Serverless Data Lake, a Cloud Data Warehouse hosted on AWS, and critical data and application pipelines.
If you are looking to broaden your responsibilities, take on various leadership challenges, and propel your career growth, this is the opportunity you've been waiting for!
Responsibilities:
- Develop advanced data pipelines leveraging dbt, Airflow, and Snowflake, prioritizing performance optimization and data integrity using Great Expectations
- Lead architectural design sessions for our modern data stack, ensuring seamless integration with Snowflake, Airflow, dbt, Great Expectations, and AWS data services
- Collaborate with data science and product management teams to design, prototype, and launch new data products swiftly
- Tackle intricate challenges with innovative, streamlined solutions, prioritizing reliability, scalability, quality, and cost-effectiveness
- Establish processes for data transformation, metadata management, and workload optimization
- Partner with the team to conduct root cause analyses and audit internal and external data and processes to address specific business inquiries
Requirements
- Master’s (or B.S. with industry experience) in math, statistics, computer science, or related field
- 6+ years in Dimensional Data Warehousing/Data Modeling and ‘Big Data’
- 6+ years in pivotal Software/Data Engineering roles, with expertise in Snowflake, Airflow, dbt, and AWS
- Proficient in Python and SQL for complex data operations and transformations
- Experienced in data quality assurance frameworks, particularly Great Expectations
- Collaborates with data analytics to align business needs
- Familiar with AWS infrastructure
- Strong problem-solving skills for agile environments
- Excellent communication and teamwork
- Curious and passionate about data and problem-solving
- Challenges data validity and assumptions