Data Engineer for Data Platform

About SmartNews

SmartNews is a global leader in redefining information and news discovery, committed to providing users with accurate, timely information and supporting quality journalism. We combine the power of our unique machine-learning technology with the expertise of our first-rate editorial team to bring news that matters to millions of users from our over 3,000 global publishing partners.

Founded in 2012 in Tokyo, Japan, SmartNews has offices in Tokyo, San Francisco, Palo Alto, New York, and Singapore.

The Team

The Data Platform Team is responsible for building systems that will power the next 5 years of SmartNews data analytics. They develop and maintain common data platforms, ETL pipelines and data analytics infrastructure that can operate with low latency and high reliability while maintaining 99.99% uptime or above.

The Role

As a Data Platform Engineer, you will play a pivotal role...

Currently, Avint LLC is seeking a motivated, career and team-oriented platform data engineer in support of the U.S. Department of Homeland Security (DHS) Cybersecurity and Infrastructure Security Agency (CISA) Continuous Diagnostic & Mitigation (CDM) Data Services Program. The CDM Data Services Program is a critical component of CISA’s national effort to ensure the defense and resilience of cyberspace. The platform data engineer is responsible for taking contractual obligations, requirements, and customer desires and directs data business rules and data transformations between the customer and the team of developers. Ownership of the data model will be needed to test and observe data quality issues. Dashboard creation will be utilized to communicate findings. The successful candidate will bring a consultative approach to business processes and will proactively collaborate with different stakeholders to define the data workflow of the...

Rebel Space Technologies is seeking a talented and experienced Senior Software Engineer to join our team.

Senior Software Engineer (Data Platform)

At Rebel Space, our mission is to protect critical space infrastructure through enhanced observability and space system cybersecurity. We believe that as space infrastructure expands, it will be increasingly difficult to secure and monitor these systems against critical failures or evolving cyber threats. To address this, we are building software that empowers developers and operators to rigorously evaluate and secure their systems from conception through to operations. We supercharge the way space infrastructure is tested, monitored, and secured, ensuring systems are safeguarded in an increasingly complex space environment. Join us in building the space security infrastructure of the future.

As a Senior Software Engineer, you will be a key member of our engineering team. You will be responsible for...

Blackbird.AI helps organizations discover emergent threats and stay one step ahead of real-world harm through our AI-powered Narrative and Risk Intelligence Platform. Our commitment is to prioritize safety and security, providing the tools to identify potential risks and ensure a safer environment proactively. No matter the job or where it’s located, we’re all connected by a shared vision: To lead and enhance the landscape of risk intelligence. 

As a Senior/Principal Software Engineer reporting to the Director of Engineering, Data Platform, you will not only optimize data pipelines for our advanced real-time streaming cloud-hosted analytics platform but also lead the development of new features and capabilities. Your role will be pivotal in shaping the future of our platform, offering the chance to solve some of the most challenging data problems in the industry.

As a Software Engineer, you’ll have the chance to:

• Design and implement real time...

Team Introduction

The Data Management Suite team is building products that cover the whole lifecycle of data pipeline, including data ingestion and Integration, data development, data catalog, data security and data governance. These Products support various businesses so data engineers and data scientists could great boost their productivity.

As a software engineer in the data management suite team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the opportunity to gain hands-on experience on core systems in the data platform ecosystem. Your work will have a direct and huge impact on the company's core products as well as hundreds of millions of users. Responsibilities -

What You'll Do

• Work on the data development platform that covers intelligent IDE, workflow management that allows users to author and monitor workflows

• Design and develop...

Location: Usa/Usa/California/Sf Bay Area, Seattle

Sponsor Visa? Yes

Requirements

• Bachelor's degree in Computer Science or equivalent practical experience

• 4 years of experience in software development, and with data structures/algorithms

• 2 years of experience with design and architecture, and testing and launching software products Preferred qualifications:

• 5 years of experience building and developing large-scale infrastructure, distributed systems or networks, and/or experience with compute technologies, storage, and/or hardware architecture

• 3 years of experience working in a complex, matrixed organization involving cross-functional, and/or cross-business projects • Experiences in data platform related products development or big data technologies (such as Hadoop, Clickhouse, Flink etc.)

Team Introduction
The Data Platform team works on building data infrastructures and data products to support business engineering teams.

As a data engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the opportunity to gain hands-on experience on all kinds of systems in the data platform ecosystem. Your work will have a direct and huge impact on the company's core products as well as hundreds of millions of users.

Responsibility
• Design and build data transformations efficiently and reliably for different purposes (e.g. reporting, growth analysis, and multi-dimensional analysis)
• Design and implement reliable, scalable, robust and extensible big data systems that support core products and business
• Establish solid design and best engineering practice for engineers as well as non-technical...

Team Introduction:

Our mission in experimentation and evaluation team is to build the next-gen A/B testing platform, that empowers the company to make data-driven decision for the products. The supported scenarios include recommendation, push, ads, search, mobile app, UI interaction and service upgrades etc. Our platform's capabilities cover the entire experiment life cycle, from experiment design, experiment creation, metrics calculation, statistical analysis to final evaluation and launch. In the process of rapid iteration, we provide reliable services for businesses to make bold hypotheses and cautious verification.

As a software engineer in experimentation and evaluation team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. Your work will have a direct and huge impact on the company's core products as well as hundreds of millions of users.

What you'll do:

•...