Senior Data Engineer-Spark/Databricks

Job Responsibilities:

• Design, code, test, document, and maintain high-quality and scalable Big Data solutions in public and on-prem cloud.
• Research, evaluate, and deploy new tools, frameworks and patterns to build sustainable Big Data platform.
• Identify gaps and opportunities for improvement of existing solutions
• Define and develop APIs for integration with various data sources in the enterprise
• Analyze and define customer requirements.
• Assist in defining product technical architecture.
• Make accurate development effort estimates to assist management in project and resource planning.
• Create prototypes, proof-of-concepts & design and code reviews
• Collaborate with management, quality assurance, architecture, and other development teams
• Write technical documentation and participate in production support.
• Keep skills up to date through ongoing self-directed...