NTT Ltd - AI Foundational Model Engineer

AI Engineer is needed in Jersey City, United States.

Client: NTT Ltd

Location: Jersey City, NJ

Contract: Temporary

Job Description

We are currently seeking an AI Foundational Model Engineer to join our team in Jersey City, New Jersey. The role involves designing, building, deploying, and optimizing enterprise-grade AI systems powered by foundation models, LLMs, retrieval-augmented generation, and agentic workflows. This position converts AI concepts into secure, scalable, observable, and supportable production systems on the enterprise AI-ready platform (AIRP), which is currently AWS-hosted while following a cloud-agnostic architecture blueprint.

Requirements

Must-have Candidate Profile

• 7+ years in AI/ML engineering, platform engineering, software engineering, or applied machine learning.
• Hands-on experience with LLMs, transformers, embeddings, RAG, semantic search, and GenAI application patterns.
• Strong Python engineering skills with PyTorch, TensorFlow, Hugging Face, LangChain, LlamaIndex, Semantic Kernel, or equivalent frameworks.
• Experience deploying production AI services using APIs, containers, Kubernetes, CI/CD, cloud-native services, and monitoring platforms.
• Practical exposure to AWS AI/cloud services or comparable cloud-native AI deployment experience, with ability to ramp quickly on AWS-hosted AIRP patterns.
• Working knowledge of Terraform/IaC, DevOps pipelines, release management, model evaluation, inference optimization, and secure data handling.

Preferred Experience

• Banking, risk, compliance, financial crime, operations, or enterprise technology background.
• Experience with AWS Bedrock, SageMaker, OpenSearch, Kendra, Lambda, EKS/ECS, Azure OpenAI, Vertex AI, Databricks, vLLM, Triton, MLflow, Kubeflow, or model gateways.
• Exposure to cloud-agnostic application patterns, reusable IaC modules, model risk, AI governance, audit controls, AI cost governance, and private or open-source LLM deployments.

Key Responsibilities

• Design and implement LLM-powered applications such as knowledge assistants, document intelligence solutions, workflow agents, summarization tools, and decision-support systems.
• Build RAG pipelines using embeddings, chunking strategies, vector databases, semantic retrieval, reranking, response grounding, and citation patterns.
• Integrate AI capabilities with AWS-hosted platform components, including model APIs, model gateways, data services, container platforms, and enterprise authentication patterns.
• Collaborate with cloud engineering teams on Terraform modules, IaC templates, environment promotion, CI/CD pipelines, release controls, and rollback procedures.
• Adapt and optimize models using LoRA, PEFT, instruction tuning, distillation, transfer learning, quantization, and domain adaptation techniques where appropriate.
• Optimize inference workloads for latency, throughput, token efficiency, cost, reliability, and user experience.
• Implement model and application observability, including prompt logs, retrieval quality, hallucination indicators, drift signals, feedback loops, cost telemetry, and service health.
• Embed security, privacy, Responsible AI, and model risk controls into AI application design and delivery.
• Create production documentation, runbooks, release notes, test evidence, and audit-ready implementation records.

Compensation and Benefits

The starting pay range for this role will depend on the nature of the role offered and will be within $139,872 - $209,808, or $80-$100 for temporary positions. Actual compensation will depend on various factors, including relevant experience, technical skills, and qualifications. The position may also be eligible for incentive compensation based on performance.

This position is eligible for company benefits including medical, dental, and vision insurance, flexible spending accounts, life insurance, disability coverage, paid time off, 401k participation with company match, and additional voluntary or legally-required benefits.

About NTT DATA

NTT DATA is a $30 billion business and technology services leader, serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. As a Global Top Employer, we have experts in more than 50 countries and provide access to a robust ecosystem of innovation centers and partners. NTT DATA is a part of NTT Group, which invests over $3 billion annually in R&D.

Additional Information

NTT DATA endeavors to make our website accessible to all users. If you need assistance completing the application process or have inquiries regarding accessibility, please contact us via our website. We are an equal opportunity employer and qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status.