Senior Backend Engineer
UpRecruit
San Francisco, california
Job Details
Full-time
Full Job Description
- Analyze and enhance existing data processes in a specialized data management platform, ensuring efficiency and optimization.
- Collaborate closely with the engineering team to seamlessly integrate data solutions into our ecosystem.
- Lead the translation of basic product requirements into robust, scalable backend systems.
- Engage with diverse stakeholders, necessitating effective communication and teamwork.
- Provide technical guidance on coding, data management, and system architecture best practices.
Requirements
- Bachelor's or Master's degree in Computer Science, Software Engineering, or related fields.
- Senior-level experience in backend engineering, with a focus on data-centric projects.
- Proficiency in coding languages (e.g., Python, JavaScript) and scripting.
- Strong skills in NoSQL databases (e.g., MongoDB) and translating SQL to Aggregation.
- Hands-on expertise in ClickHouse, Delta Lake (Python/Spark SQL), Delta Live Tables, Unity Catalog.
- Experience with high-velocity, high-volume stream processing: Confluent Kafka, Spark Streaming.
- Familiarity with real-time data processing using Spark structured streaming and Kafka.
- In-depth involvement across the Data Engineering lifecycle, adept at independent work and solution architecture.
- Ability to distinguish between BI analytics and data engineering workflows.