Senior Data Engineer

We are seeking a Senior Data Engineer to architect and develop the core data infrastructure that will underpin our AI-driven transformation. In this pivotal role, you will move beyond traditional ETL processes to design and deploy high-security Data Lakehouse environments, establishing a single, authoritative source of truth for our AI systems. You will lead the technical implementation of Workstream 1: Data & Platform Foundations, a critical initiative for our flagship projects. Your responsibilities will include integrating complex enterprise systems such as SAP S/4HANA and Ariba, as well as processing unstructured data like technical drawings and regulatory documents. Key Responsibilities: - Design and deploy defense-grade Data Lakehouse architectures to serve as the Single Source of Truth for AI-driven Supply Chain Intelligence. - Lead technical execution of Workstream 1: Data & Platform Foundations, mapping rigid enterprise systems like SAP S/4HANA, Ariba, and PLM. - Build connectors for external market intelligence feeds to enrich internal procurement data. - Design and implement a standardized procurement data model and taxonomy across multiple entities. - Engineer pipelines to ingest, process, and transform unstructured technical data into vector-ready formats for RAG applications. - Manage and optimize Vector Databases (e.g., Weaviate) for AI drafting assistants and generative tools. - Implement Role-Based Access Control (RBAC), audit logging, and data redaction policies to ensure compliance with export controls and on-premise security requirements. - Deploy automated data quality frameworks to validate Bill of Materials (BOM) completeness and cost data. Qualifications And Experience: - 5+ years of experience in Data Engineering, with at least 2 years focused on building pipelines for Machine Learning or Generative AI applications. - Expert proficiency in Python, SQL, and modern data engineering frameworks including Apache Spark, Kafka, and Airflow. - Strong experience extracting data from complex ERP environments, specifically SAP S/4HANA and SAP Ariba, with familiarity in SAP BTP as a plus. - Deep understanding of Data Lakehouse architectures (Databricks/Delta Lake), Relational Databases (PostgreSQL), and Vector Databases (Weaviate/Milvus). - Experience in Supply Chain, Manufacturing, or Defense sectors.