Senior Data Engineer

XperiencOps Inc. is seeking a highly skilled and experienced Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a crucial role in designing, developing, and maintaining our data architecture and pipelines. You will collaborate closely with cross-functional teams to drive data initiatives and enable data-driven decision-making across the organization.

Responsibilities:

• Design and build scalable and efficient data pipelines and ETL processes to collect, process, and transform large volumes of data from various sources.
• Develop and maintain data warehouses, data lakes, and databases to ensure optimal storage, organization, and accessibility of structured and unstructured data.
• Collaborate with data scientists and other stakeholders to identify data requirements and implement solutions to support their needs.
• Ensure data quality and integrity through data validation, cleansing, and normalization techniques.
• Optimize data processes and performance to ensure efficient data processing and retrieval.
• Implement data governance and security measures to protect sensitive data.
• Stay updated with emerging technologies and industry best practices in data engineering and contribute to the adoption of new tools and frameworks.
• Provide technical guidance and mentorship to junior data engineers.

Requirements

- Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.

- Proven work experience as a Data Engineer, with a focus on building scalable and robust data pipelines and architecture.

- Strong programming skills in languages such as Python, SQL, or Java.

- Experience with big data processing frameworks and tools such as Apache Spark, Hadoop, or AWS Glue.

- Proficiency in working with relational and NoSQL databases, as well as SQL and data modeling.

- Familiarity with cloud platforms and services such as AWS or Azure.

- Strong understanding of data governance, data security, and data quality principles.

- Excellent problem-solving and analytical skills.

- Strong communication and collaboration abilities.

- Experience with streaming data technologies such as Apache Kafka or Apache Flink is a plus.

- Experience with machine learning and data science concepts is a plus.

Benefits

Office locations available for this role are:

- San Francisco, CA

- Dublin, CA