Title: Lead Data Engineer 

Location: O'Fallon, MO 63368 (Hybrid)

Duration: 12 Months -- Need locals to MO

Exp: 14+ Years

Top 3 required technical skills:

• 1.  Data Engineering / Streaming Platforms (Kafka, real-time pipelines using scala/python, NIFI)
  2.  Big Data Platforms (Spark, Hadoop/Ozone, Hive or impala, AWS, Databricks)
  3.  Production Support & Platform Reliability (using Splunk for monitoring, troubleshooting, performance tuning)              

What will a typical workday look like for this contractor? What are their expected hours? A typical day includes:

• Designing and implementing new products or enhancements using scala/java/python on Cloudera manager platform.
• Supporting and troubleshooting production pipelines
• Collaborating with engineering, data science, and operations teams
• Participating in stand‑ups, planning, and design discussions
• Expected hours are standard business hours (40 hours/week), aligned with CST.                              

Position Overview

This role is part of the AI&DPE Data Engineering platform team, responsible for building and evolving large scale backend data systems, real time and batch pipelines, and AI enabled services that power analytics, decisioning, and automation across the organization.

This is a backend engineering role, focused on Scala/Python/Java, distributed data platforms (Cloudera/Spark), and cloud based architectures, with a strong emphasis on AI agent creation and intelligent automation. Visualization tools (e.g., Qlik) are consumers of the platform, not the core focus of this role.

You will work with massive transactional datasets, modern big data and cloud platforms, and AI driven workflows to transform how Mastercard processes, enriches, and operationalizes data at global scale.

Website: www.mavensoft.com