Data Engineer - Remote in Florida

We are seeking an experienced AI/LLM Data Engineer to build and maintain the data pipeline for our Generative AI platform. The ideal candidate will be well-versed in the latest Large Language Model (LLM) technologies and have a strong background in data engineering, with a focus on Retrieval-Augmented Generation (RAG) and knowledge-base techniques.  This role sits in the AI COE within DX Tech & Digital. As a AI/LLM Data Engineer (you will report into the Director, AI Solutions & Development who oversees the AI COE. 

You will work on highly visible strategic projects, collaborating with cross-functional teams 

to define requirements and deliver high-quality AI solutions. 

The ideal candidate will have a passion for Generative AI and LLMs, with a proven track record of delivering innovative AI applications.

Responsibilities 
• Design, implement, and maintain an end-to-end multi-stage data...

About the Job:

Data Engineers at AdTheorent collaborate with data science and analytics teams to design, build, and scale very large datasets and data pipelines that enable analytics, modeling, experimentation, and reporting. The Data Engineer position is ideal for a data-focused engineer with a strong Python, Spark, and SQL experience who is looking to work with massive amounts of data in a cutting-edge, cloud-based environment. You will be responsible for building data solutions using tools from Apache and AWS, including Redshift, Spark, S3, Lambda, Clickhouse, and Airflow.

This is a remote, permanent, full-time position.

Responsibilities:

• Using a variety of open-source technologies (Python, Spark, Airflow), build data pipelines to extract, cleanse, and integrate data, from a variety of sources and formats
• Design, develop, and implement dimensional data marts to support analytics and reporting...

About the Job:

Data Engineers at AdTheorent collaborate with data science and analytics teams to design, build, and scale very large datasets and data pipelines that enable analytics, modeling, experimentation, and reporting. The Data Engineer position is ideal for a data-focused engineer with a strong Python, Spark, and SQL experience who is looking to work with massive amounts of data in a cutting-edge, cloud-based environment. You will be responsible for building data solutions using tools from Apache and AWS, including Redshift, Spark, S3, Lambda, Clickhouse, and Airflow.

This is a remote, permanent, full-time position.

Responsibilities:

• Using a variety of open-source technologies (Python, Spark, Airflow), build data pipelines to extract, cleanse, and integrate data, from a variety of sources and formats
• Design, develop, and implement dimensional data marts to support analytics and reporting...

Data Engineer will be responsible for ETL and documentation in building AssistRx  data warehouse and analytics capabilities.  Additionally, maintain existing systems/processes and develop new features, along with reviewing, presenting and implementing performance improvements.

Requirements

·       Build ETL (extract, transform, and loading) jobs using Fivetran and dbt for our internal projects and for customers that use various platforms like Azure, Salesforce, and AWS technologies

·       Monitoring active ETL jobs in production.

·       Build out data lineage artifacts to ensure all current and future systems are properly documented

·       Assist with the build out design/mapping documentation to ensure development is clear and testable for QA and UAT purposes

·      ...