In this role, you will design and build next-generation applications powered by AI agents on the Microsoft Azure ecosystem. You'll own features end-to-end, from responsive front-end experiences to scalable back-end services and agent orchestration layers, building applications for, driven by, and consumed by AI agents - combining strong full stack fundamentals with cutting-edge agentic AI development.
RESPONSIBILITIES
- Design and build full stack, production-grade applications based on AI agents and multi-agent architectures.
- Develop modern, responsive web UIs supporting conversational experiences, real-time streaming agent responses, and dashboards for monitoring agents.
- Build robust back-end services and APIs (REST, gRPC, MCP) in Python (FastAPI), enabling agent-to-agent and agent-to-system communication.
- Develop agentic workflows using frameworks such as Semantic Kernel, AutoGen, LangChain/LangGraph, or Azure AI Agent Service.
- Integrate LLMs via Azure OpenAI Service, including prompt engineering, function/tool calling, and RAG pipelines.
- Design chunking and indexing strategies for RAG pipelines (semantic chunking, hybrid search, re-ranking) to optimize retrieval quality.
- Build and maintain evaluation pipelines for LLM/agent outputs (e.g., RAGAS, promptfoo, or custom eval frameworks) to measure accuracy, relevance, and reliability.
- Design cloud-native solutions using Azure Functions, AKS, Container Apps, Cosmos DB, and Azure AI Search, including data models across SQL and NoSQL stores.
- Implement secure, observable, cost-optimized systems using Azure Monitor, Key Vault, Entra ID, and CI/CD pipelines with infrastructure-as-code.
REQUIREMENTS
- 8+ years of full stack engineering experience, with at least 3 years on the Azure stack.
- Strong back-end skills in Python, with a solid grasp of distributed systems and microservices.
- Hands‑on experience building applications with LLMs and agent frameworks (Semantic Kernel, AutoGen, LangGraph, or similar).
- Experience with Azure OpenAI, Azure AI Foundry, and vector databases (Azure AI Search, Cosmos DB vector search).
- Proven experience with RAG architectures, embeddings, chunking/indexing strategies, prompt orchestration, and tool/function calling.
- Hands‑on experience with evaluation frameworks for LLM/agent outputs and defining quality metrics for AI systems.
- Experience designing end-to-end agentic solution architectures (multi‑agent orchestration, tool/agent boundaries, error‑handling and fallback strategies).
- Experience building real‑time features (WebSockets, SignalR, SSE) for streaming AI/agent responses.
- Solid understanding of authentication/authorization (OAuth2, Entra ID) and DevOps practices (CI/CD, IaC, Docker/Kubernetes).
SoftServe is an equal opportunity employer. Qualified applicants will receive consideration regardless of race, color, ancestry, ethnicity, national origin, religion, sex, sexual orientation, gender identity or expression, age, citizenship, disability, health condition, marital or family status, veteran status, or any other characteristic protected by applicable law.
#LI-DNI
About us
We are a digital engineering and technology consulting company where expertise grows alongsidepeople. For more than 30years, we have been elevating technology: helping organizations navigate complex businesschallenges by combining deepengineering knowledge with thoughtful, research-backed innovation. Our teams work across keyareas: digitalengineering, data and analytics, Сloud, and AI/ML. In each, we deliver practical, scalablesolutions rooted in realbusiness needs and measurable human impact.
You bring your perspective and ambition. We create an environment where your work meetsclarity, confidence, andpurpose.
We offer
Work from home, from the office, or in a hybrid format that supports focus andcollaboration.
Competitive, market-based pay, benchmarked by role andlocation — plus health coverage, paid time off, wellness support, and learningopportunities.
Approachable leaders who communicate openly, keep teams close to the strategy, andsupport long-term planning.
Advanced tech communities
Stay close to AI/ML, Cloud, Quantum Computing, IoT, andRobotics communities, with projects built on modern frameworks.
More opportunities available
Browse all open positions to find the best fit for your experience.
#J-18808-Ljbffr