Data Engineer in California

Company Overview: Welcome to the forefront of data-driven innovation! Our company is at the cutting edge of leveraging real-time data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge real-time data solutions that enable timely insights and actions. Join us and lead our efforts in shaping the future of real-time data engineering.

Position Overview: As the Lead Real-Time Data Engineer, you'll lead our initiatives in designing, building, and optimizing real-time data infrastructure. You'll spearhead the development of scalable, reliable, and efficient systems for ingesting, processing, and analyzing real-time data streams. If you're a seasoned engineer with expertise in real-time data technologies and a proven track record of leadership in delivering successful projects, we invite you to lead our team in this exciting...

Company Overview: Welcome to the forefront of big data innovation! At our company, we're leading the charge in harnessing the power of big data to drive insights and innovation. Our mission is to develop scalable and robust big data solutions that empower organizations to extract value from their data at scale. Join us and be part of a dynamic team committed to shaping the future of big data engineering.

Position Overview: As a Big Data Engineer, you'll play a pivotal role in designing, building, and maintaining our big data infrastructure and platforms. Working closely with cross-functional teams of data scientists, analysts, and software engineers, you'll ensure the reliability, scalability, and efficiency of our big data pipelines and systems. If you're passionate about big data engineering and eager to drive innovation through scalable data solutions, we want you on our team.

Requirements

Key...

Company Overview: Welcome to the forefront of data-driven decision-making! At our company, we're committed to harnessing the power of data to drive insights and innovation. Our mission is to develop scalable and efficient data warehouse solutions that empower organizations to make informed decisions based on high-quality data. Join us and be part of a dynamic team dedicated to shaping the future of data warehouse engineering.

Position Overview: As a Data Warehouse Engineer, you'll play a crucial role in designing, building, and maintaining our data warehouse infrastructure and systems. Working closely with cross-functional teams of data analysts, business intelligence developers, and software engineers, you'll ensure the reliability, performance, and scalability of our data warehouse solutions. If you're passionate about data engineering and eager to drive innovation through scalable data warehouse solutions, we want you on our...

Unleash the Power of Data

We believe in the transformative power of data. As a Big Data Engineer, you'll play a pivotal role in our mission to harness vast amounts of information, turning it into actionable insights that can change the world. Our data isn't just big; it's colossal, and we need your skills to help us navigate, analyze, and innovate in an ocean of bytes.

What You'll Be Doing:

• Building and managing robust, scalable big data infrastructures that support groundbreaking AI and machine learning projects.
• Working with petabytes of data, your role will involve processing, cleaning, and structuring it to unlock its true potential.
• Collaborating with data scientists and AI engineers to design and deploy models that make sense of complex patterns and predictions.
• Innovating and implementing cutting-edge technologies and methodologies in data storage, data processing, and data...

• Providing analytical, operational, and strategic support to client
• Analyze the client's business needs and provide recommendations
• Map the business requirements to the application
• Design of application database: structure, content, and processes of data population; Validate the solution with the end-users;
• Design the reports and extraction: SQL statement, layout formatting, and report publication;
• Apply correspondent methodology and tools, the elaboration and implementation of consistent work plans, project and program documents, and achievement of results;
• Ensure proper reporting on implementation and achievement of outputs, as well as contribute to reporting on progress towards outcomes and impact.

Requirements

Requirements

• 10+ years experience as Data Engineer
• Proven experience as a data engineer, with a strong focus on ETL processes and data pipeline...

Dew Software is seeking a talented Data Engineer to join our team. We are a leading technology company that specializes in digital transformation and provides innovative solutions to our clients. As a Data Engineer at Dew Software, you will play a crucial role in designing, building, and maintaining scalable data pipelines and data infrastructure. You will work closely with cross-functional teams, including data scientists, software engineers, and business stakeholders, to gather requirements and deliver cutting-edge data solutions. Join our team and contribute to the development of robust and efficient data systems that empower our clients to make data-driven decisions and achieve their business objectives.

Requirements

• Bachelor's degree in computer science, engineering, or a related field
• Proven experience as a Data Engineer
• Strong understanding of data engineering principles and best practices
• Proficiency in SQL and...

About Eidon

We are a team of AI & Crypto researchers and engineers (coming from Google DeepMind, pioneering AI/Crypto companies) with the long-term mission of co-creating the full decentralized AI stack in a trustless and permissionless way, with fair rewards for participation and contribution, that advances and benefits all of humanity. Our first focus is on decentralizing AI Data publishers with data consumers in a decentralized network and marketplace. Our platform empowers data providers to retain ownership of their data and monetize it throughout its entire lifecycle while enabling data consumers to access ethically sourced and bespoke datasets not easily available anywhere else.

Our team is small, operating in a flat structure, highly motivated, and focused on engineering and product excellence. Eidon is a place for those who like to take ownership, have strong curiosity & do-it energy, appreciate challenging themselves, and are ready to...

1. Be responsible for security incident and event response and aid in threat and vulnerability research, including triage, remediation and documentation.

2. Be responsible for the assessment, verification, review, and audit of security/privacy controls and overall security posture across the organization.

3. Perform forensic testing, review test results, and collaborate with business stakeholders to establish sustainable resolution plans for vulnerabilities, gaps, and control deficiencies.

4. Develop situational awareness, stay informed on current technology and vulnerabilities, and utilize current information security disciplines and industry standards to ensure the confidentiality, integrity, and availability of information assets

5. Improve the overall strategy, operations, and risk management of Data Security

6. Design, develop, document and deploy enterprise security solutions to safeguard data and...

About SmartNews

SmartNews is a global leader in redefining information and news discovery, committed to providing users with accurate, timely information and supporting quality journalism. We combine the power of our unique machine-learning technology with the expertise of our first-rate editorial team to bring news that matters to millions of users from our over 3,000 global publishing partners.

Founded in 2012 in Tokyo, Japan, SmartNews has offices in Tokyo, San Francisco, Palo Alto, New York, and Singapore.

The Team

The Data Platform Team is responsible for building systems that will power the next 5 years of SmartNews data analytics. They develop and maintain common data platforms, ETL pipelines and data analytics infrastructure that can operate with low latency and high reliability while maintaining 99.99% uptime or above.

The Role

As a Data Platform Engineer, you will play a pivotal role...

The Shipyard is a leading, independent agency that builds performance-driven brands audiences can’t help but love.

By applying modern mindsets to established models, we fuel brand and marketing decisions that are more courageous and more validated.

Our ability to align bold creativity with individual consumer motivations lets us do more than hope for brand love – we methodically engineer it throughout the consumer journey. That’s how we activate the synergistic power of brand building and performance marketing.

Engineering Brand Love through the courageous ambitions of our people and our clients.

The agency has significant momentum and is on a roll with new business. Our team continues to expand across four cities...

The Shipyard is a leading, independent agency that builds performance-driven brands audiences can’t help but love.

By applying modern mindsets to established models, we fuel brand and marketing decisions that are more courageous and more validated.

Our ability to align bold creativity with individual consumer motivations lets us do more than hope for brand love – we methodically engineer it throughout the consumer journey. That’s how we activate the synergistic power of brand building and performance marketing.

Engineering Brand Love through the courageous ambitions of our people and our clients.

The agency has significant momentum and is on a roll with new business. Our team continues to expand across four cities...

Job Details: 

• Title: Sr. Data Engineer
• Salary: $180-$230K 
• Requirements: 8+ years of software dev exp (Large Data Sets or Big Data)
• Location: 100% onsite (San Francisco Bay Area) 

Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a vital role in reconstructing and refining data processes, collaborating closely with the engineering team to guarantee smooth integration of data solutions.

Responsibilities

• Comprehend and optimize existing data processes within Databricks.
• Collaborate with the engineering team to seamlessly integrate data solutions.
• Translate basic product requirements into robust back-end systems.
• Demonstrate proactive implementation of solutions to meet project deadlines.
• Work on systems involving various...

The Cloud Data Engineer is part of a Data team that is responsible for supporting, modernizing, and transforming our data and reporting capabilities across our products by implementing a new modernized data architecture. The position will be responsible for day-to-day data collection, transportation, maintenance/curation, and access to the GOVX corporate data assets. The Cloud Data Engineer will work cross-functionally across the enterprise to centralize data and standardize it for use by business reporting, machine learning, data science, and other stakeholders. This position plays a critical role in increasing awareness about available data and democratizing access to it across GOVX and our data partners.

This position will be under the supervision of the Platform Technical Lead.

RESPONSIBILITIES

• Supporting and modernizing existing data integrations.
• Crafting and maintaining efficient data pipeline...

Prominence is looking for a Data Engineer to assist with dimensional data modeling development for healthcare data architecture project.

Who We Are

Prominence is a healthcare technology strategy and implementation firm, focused on helping the nation’s leading healthcare organizations to do more with their data. Founded by former Epic managers, we understand the technology landscape in healthcare and provide IT staffing, advisory services, and analytics solutions to create robust data ecosystems that support clinical workflows, automate operational processes, and expedite research. Whether it’s guiding a technology implementation, establishing governance principles, or developing leading edge analytics, we help our customers make sense out of the mountain of data at their fingertips in order to deliver higher quality care at a lower cost.

Ranked as a best place to work over 27 times (and counting!), Prominence’s culture provides consultants with a...

The Company

Halo Industries has invented a technology to replace a decades-old semiconductor material slicing process that wastes billions of dollars annually. 

Halo’s laser-based technology eliminates this waste, delivering improvements in both material cost and performance, while enabling manufacturing advancements in a diverse set of high-growth applications markets, including the automotive, grid infrastructure, telecommunications and power electronics sectors.  

Halo originally spun out of Stanford University in 2014, acquiring a significant A round of VC funding in 2020 following the successful demonstration of the company’s precision material slicing equipment.

Halo is now planning its volume manufacturing operations and building a passionate team to meet its next milestone of deploying the company’s first fully integrated production line.

Halo Industries is well-funded, engaged with...

The Senior Research Engineer (Sr RE) is part of the Scientific Affairs team at ATEC. The Sr RE has a degree in engineering or relevant sciences and is responsible for design, development, and organizing data analytics research activities related to ATEC products. In this capacity the Sr RE works closely with the Clinical Research, R&D, Regulatory Affairs, and Marketing teams at ATEC.

Essential Duties and Responsibilities

• The Sr RE participates in defining the various research activities in order to demonstrate the value of ATEC products.
• Develop data analytics, machine learning, and deep learning algorithms for variety of data types including but not limited to medical images, clinical data, waveforms, and other biological data sources.
• Manages various aspects of research studies, from design, writing protocols, data collection and analysis, study reports and documentations, validation and verification, and...

Duties:

• Analyze and organize raw data.
• Build data systems and pipelines.
• Evaluate business needs and objectives.
• Interpret trends and patterns.
• Conduct complex data analysis and report on results.
• Prepare data for prescriptive and predictive modelling.
• Build algorithms and prototypes.
• Combine raw information from different sources.
• Explore ways to enhance data quality and reliability.
• Identify opportunities for data acquisition.
• Develop analytical tools and programs.
• Collaborate with data scientists and architects on several projects.

Requirements

Requirement: This position requires a bachelor's or higher degree in Computer Science,

Computer Information Systems or a closely related field of study.

Salary Range: $80k to $120k 

Location: California

Job Details: 

• Title: Sr. Data Engineer
• Salary: $160K - $180K
• Requirements: airflow, dbt, Snowflake, AWS, Python, SQL
• Location: 100% Remote

Our client, a personal finance startup, is seeking a Sr. Data Engineer to join their team. This role entails spearheading the evolution and upkeep of the Enterprise Data Platform - this includes overseeing a cutting-edge Serverless Data Lake, a Cloud Data Warehouse hosted on AWS, and critical data and application pipelines.

If you are looking to broaden your responsibilities, take on various leadership challenges, and propel your career growth, this is the opportunity you've been waiting for!

Responsibilities:

• Develop advanced data pipelines leveraging dbt, Airflow, and Snowflake, prioritizing performance optimization and data integrity using Great Expectations
• Lead architectural design sessions for our modern data stack, ensuring seamless...

The Shipyard is a leading, independent agency that builds performance-driven brands audiences can’t help but love.

By applying modern mindsets to established models, we fuel brand and marketing decisions that are more courageous and more validated.

Our ability to align bold creativity with individual consumer motivations lets us do more than hope for brand love – we methodically engineer it throughout the consumer journey. That’s how we activate the synergistic power of brand building and performance marketing.

Engineering Brand Love through the courageous ambitions of our people and our clients.

The agency has significant momentum and is on a roll with new business. Our team continues to expand across four cities...

The Shipyard is a leading, independent agency that builds performance-driven brands audiences can’t help but love.

By applying modern mindsets to established models, we fuel brand and marketing decisions that are more courageous and more validated.

Our ability to align bold creativity with individual consumer motivations lets us do more than hope for brand love – we methodically engineer it throughout the consumer journey. That’s how we activate the synergistic power of brand building and performance marketing.

Engineering Brand Love through the courageous ambitions of our people and our clients.

The agency has significant momentum and is on a roll with new business. Our team continues to expand across four cities...

About Pathway

Deeptech start-up, founded in March 2020.

• Our primary developer offering is an ultra-performant Data Processing Framework (unified streaming + batch) with a Python API, distributed Rust engine, and capabilities for data source integration & transformation at scale (Kafka, S3, databases/CDC,...).
• The single-machine version is provided on a free-to-use license (`pip install pathway`).
• Major data use cases are around event-stream data (including real-world data such as IoT), and graph data that changes over time.
• Our enterprise offering is currently used by leaders of the logistics industry, such as DB Schenker or La Poste, and tested across multiple industries. Pathway has been featured in Gartner's market guide for Event Stream Processing.
• Learn more at http://pathway.com/ and https://github.com/pathwaycom/.

Pathway is VC-funded, with amazing BAs from the AI space and industry. We have operations...

About the Job 

As a Data Engineer at Anthro Energy, you will play a pivotal role in leveraging data to drive innovation in lithium-ion electrolyte technology. You will be responsible for structuring scalable data streams and collaborating with engineers/scientists to handle their data efficiently. This position offers a unique opportunity to contribute to the advancement of sustainable energy solutions in a dynamic startup environment. 

What you will do 

• Design, implement, and manage a cloud-based database system to store and process large datasets related to battery research and development. 
• Work with external consultants and contractors to build and improve internal data systems. 
• Collaborate with the R&D team to understand and ingest data seamlessly into a centralized repository. 
• Utilize data visualization techniques to support findings and drive...

Rebel Space Technologies is seeking a talented and experienced Senior Software Engineer to join our team.

Senior Software Engineer (Data Platform)

At Rebel Space, our mission is to protect critical space infrastructure through enhanced observability and space system cybersecurity. We believe that as space infrastructure expands, it will be increasingly difficult to secure and monitor these systems against critical failures or evolving cyber threats. To address this, we are building software that empowers developers and operators to rigorously evaluate and secure their systems from conception through to operations. We supercharge the way space infrastructure is tested, monitored, and secured, ensuring systems are safeguarded in an increasingly complex space environment. Join us in building the space security infrastructure of the future.

As a Senior Software Engineer, you will be a key member of our engineering team. You will be responsible for...

About The Role

In this key position as a Data Engineer at Illuminate Literacy, you will harness the power of cloud-native technologies to architect and manage data pipelines and facilitate the flow of data that empowers our mission to transform learning. Leveraging your expertise in AWS data services, Python, SQL, and data engineering best practices, you will design, build, and optimize data workflows and infrastructures to process large volumes of data efficiently. Your role is critical in upholding data governance and ensuring adherence to our rigorous data management standards. Working in collaboration with cross-functional teams, you will provide the data engineering support necessary to inform decision-making and shape the strategies that advance our educational goals.

This position goes beyond mere data management; it involves crafting scalable and resilient data solutions that drive insights and innovation within the educational technology...

Are you interested in working with the World’s leading AI-powered Quality Engineering Company? Ready to advance your career, team up with global thought leaders across industries and make a difference every day? Join us at Qualitest!

We are looking for Senior GIS Data Engineer to join our growing team in Mountain View, CA, United States.

Job Description

We are seeking a highly skilled and experienced Senior GIS Data Engineer with specialized skills in Esri ArcGIS & FME (Feature Manipulation Engine) to join our team. The ideal candidate will have a proven track record in GIS data integration and transformation. The Senior GIS Data Engineer will play a key role in optimizing geospatial workflows, ensuring data accuracy, and driving innovation in GIS processes.

Responsibilities:

Architect and develop advanced FME workbenches, ensuring seamless map data transformation, comprehensive analysis, and robust reporting...

XperiencOps Inc. is seeking a highly skilled and experienced Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a crucial role in designing, developing, and maintaining our data architecture and pipelines. You will collaborate closely with cross-functional teams to drive data initiatives and enable data-driven decision-making across the organization.

Responsibilities:

• Design and build scalable and efficient data pipelines and ETL processes to collect, process, and transform large volumes of data from various sources.
• Develop and maintain data warehouses, data lakes, and databases to ensure optimal storage, organization, and accessibility of structured and unstructured data.
• Collaborate with data scientists and other stakeholders to identify data requirements and implement solutions to support their needs.
• Ensure data quality and integrity through data validation, cleansing, and...

Founded in 2016 in Silicon Valley, Pony.ai has quickly become a global leader in autonomous mobility and is a pioneer in extending autonomous mobility technologies and services at a rapidly expanding footprint of sites around the world. Operating Robotaxi, Robotruck and Personally Owned Vehicles (POV) business units, Pony.ai is an industry leader in the commercialization of autonomous driving and is committed to developing the safest autonomous driving capabilities on a global scale. Pony.ai’s leading position has been recognized, with CNBC ranking Pony.ai #10 on its CNBC Disruptor list of the 50 most innovative and disruptive tech companies of 2022. In June 2023, Pony.ai was recognized on the XPRIZE and Bessemer Venture Partners inaugural “XB100” 2023 list of the world’s top 100 private deep tech companies, ranking #12 globally. As of August 2023, Pony.ai has accumulated nearly 15 million miles of autonomous driving globally.

Responsibility

As a member of the...