Abbott · posted · checked
Principal AI Platform Engineer
AzureJavaKubernetesPythonTypeScript$149k – $299kOn-site · United StatesStaff+
Who can apply
On-site · United States
Location: United States - Illinois - Abbott Park
Abbott is a global healthcare leader that helps people live more fully at all stages of life. Our portfolio of life-changing technologies spans the spectrum of healthcare, with leading businesses and products in diagnostics, medical devices, nutritionals and branded generic medicines. Our 122,000 colleagues serve people in more than 160 countries.
JOB DESCRIPTION:
The Opportunity
A hands-on technical leadership role accountable for the architecture, engineering, and reliability of Abbott's enterprise AI Platform: the control plane and paved road that let teams build, deploy, and operate enterprise GenAI and agentic systems safely and quickly. This role is the technical counterpart to the Product Manager, AI Platform and partners with AI Product Managers, AI/Agentic Engineering, Applied Data Science, security, and division engineering teams. The role is Director-mapped and begins as a player-coach, with responsibility to grow and lead a platform engineering team.
What You'll Do
Define and evolve the reference architecture for the AI control plane, paved-road services, SDKs, templates, and developer experience.
Design and build a model gateway that supports multi-provider routing, failover, quota and rate limiting, tenant isolation, key management, token accounting, and cost allocation (e.g., a LiteLLM-style gateway over Azure OpenAI, Amazon Bedrock, or Vertex AI).
Deliver a GenAI runtime for model serving, retrieval-augmented generation, context and memory stores, vector and hybrid search, sandboxed tool or code execution, secrets brokering, and MCP-style tool interoperability.
Own the technical design of model, agent, prompt, and tool registries, including versioning, lineage, approval and promotion gates, deprecation, and auditability.
Build platform observability and traceability for prompts, model calls, tool calls, and agent steps using distributed tracing (e.g., OpenTelemetry GenAI semantic conventions and Langfuse- or Arize-class tooling), with evaluation, quality, drift, latency, and cost signals.
Implement security, guardrails, and responsible-AI controls in the platform, including PII/PHI handling, prompt-injection defenses, identity-on-behalf-of, least-privilege tool access, and policy enforcement.