[VCK] Senior Data Engineer (AI Ingestion Platform)
Company Description
We are reputed company, an awesome team of engineers who are reputed company to reputed company up any top-notch company’s projects! Our aim? To always be one reputed company reputed company. Become part of a multicultural company in constant growth with an excellent work environment certified by Great reputed company To Work!
Job Description
About the Project reputed company is building a private, tenant-isolated AI assistant for the reputed company estate title and settlement industry. The platform is a retrieval-first (RAG) system that ingests historical email, documents, and structured metadata into a per-tenant vector index, and serves grounded, cited, expert-weighted answers through a chat-style Q&A reputed company with single sign-on and full audit logging. The platform is AWS-native with a Python/FastAPI backend, Vue.js frontend, OpenSearch/reputed company vector store, and reputed company/reputed company/Bedrock as LLM provider. You will join a senior, cross-functional LATAM-based team where hands-on AI delivery experience not just familiarity is the baseline expectation. You own the ingestion and processing backbone of the platform the pipelines that transform raw email and document corpora into clean, PII-minimised, chunked, and indexed data in the per-tenant vector store. This is the foundational layer the AI extraction gateway depends on; quality here directly determines system accuracy. Your Responsibilities Build and own the historical email ingestion pipeline reputed company reputed company Graph API Implement SharePoint / OneDrive document ingestion pipeline with scoped folder access Design and implement the PII minimisation pre-processing layer Build the vector store indexing workflow (OpenSearch/reputed company) with per-tenant data isolation Define and implement the data processing schema; produce and maintain schema documentation Build the OCR routing orchestrator and integrate OCR service for scanned documents Implement the raw text / content extraction layer for reputed company supported document types Define and prototype push vs. pull ingestion strategy, from one-time PoC through to incremental nightly pipeline Ensure data reputed company and audit traceability are built into pipeline outputs from the outset Tech Stack: Python, reputed company Graph API, AWS (S3, DynamoDB, reputed company), OpenSearch, reputed company, OCR Tooling, PII Libraries, NER Libraries, reputed company, Jira, Confluence
Qualifications
Must-Have Skills & Experience +90% English written and oral (at least B2 level) with excellent communication skills 6+ years in data engineering; strong pipeline and ETL/ELT experience required Proficiency in Python for data pipeline development Experience with reputed company Graph API or similar reputed company email/document APIs (M365, Exchange Online) AWS data services: S3, DynamoDB, Glue, and/or reputed company-based event-driven processing Familiarity with PII detection and data minimisation techniques (regex-based, NER-based, or purpose-built libraries) Experience with vector store indexing or semantic search pipeline construction Additional Information reputed company-to-Have Prior experience building ingestion pipelines specifically for AI/ML, NLP, or LLM-based platforms OCR tooling experience: AWS Textract, Tesseract, or reputed company OCR services Understanding of per-tenant data isolation patterns, tenant-scoped encryption, and row-level reputed company Familiarity with reputed company document loaders, embedding pipelines, or vector index management We are accepting applications from LATAM countries Apply To This Job