Skip to main content
Job Title: Generative AI Engineer
Experience: 4-8 Years
Location: NYC, NY (Hybrid)
Job Summary: We are looking for a talented Generative AI Engineer to design, develop, and deploy AI-powered applications using Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), AI Agents, and modern AI frameworks. The candidate will work closely with architects, data scientists, and product teams to build scalable GenAI solutions that solve real business problems.
Key Responsibilities: Generative AI DevelopmentDevelop and deploy applications leveraging LLMs such as GPT-4, Claude, Gemini, Llama, and Mistral. Build conversational AI assistants, enterprise chatbots, and AI copilots. Design and implement prompt engineering and prompt optimization strategies. Fine-tune and evaluate foundation models where applicable. Develop AI workflows using Agentic AI frameworks.
RAG & Knowledge Systems:
  • Build and maintain Retrieval-Augmented Generation (RAG) solutions.
  • Develop document ingestion, chunking, embedding, and retrieval pipelines.
  • Integrate vector databases such as Pinecone, Weaviate, ChromaDB, Azure AI Search, or Qdrant.
  • Optimize search relevance, grounding, and response quality.
  • AI Framework DevelopmentDevelop applications using:
  • LangChainLlamaIndexSemantic KernelLangGraphCrewAIAutoGenCreate reusable AI components and accelerator frameworks.
API & Application Integration: Integrate GenAI services with enterprise applications. Develop RESTful APIs and microservices for AI workloads. Collaborate with frontend and backend teams to deliver end-to-end AI solutions. Implement AI model monitoring and feedback mechanisms. Cloud & DevOpsDeploy AI applications on Azure, AWS, or GCP.Build CI/CD pipelines for GenAI solutions. Use Docker and Kubernetes for containerization and orchestration. Monitor and optimize costs, latency, and performance. Security & Responsible AIImplement responsible AI practices, content filtering, and model guardrails. Ensure compliance with data privacy, security, and governance standards. Address hallucination, bias, and prompt injection risks.
Required Qualifications:
  • EducationBachelor's or Master's degree in Computer Science, Information Technology, Artificial Intelligence, or a related field.
  • Experience 3-8 years of software development experience.1+ years of hands-on experience with Generative AI or LLM-based solutions.
  • Experience building AI-powered applications in production environments.
  • Technical Skills
  • Programming Languages
  • Python (Mandatory)
  • Java (Preferred)
  • JavaScript/TypeScriptSQLGenerative AI & LLMsOpenAI GPT ModelsAzure OpenAI Service
  • Anthropic ClaudeGoogle GeminiLlama ModelsAI Frameworks
  • LangChainLlamaIndexSemantic KernelLangGraphCrewAIVector Databases
  • PineconeChromaDBWeaviateQdrantAzure AI SearchCloud Platforms
  • Microsoft AzureAWSGoogle Cloud Platform
  • DevOps ToolsDockerKubernetesGitHub Actions
  • Azure DevOpsTerraformPreferred Qualifications
  • Experience with Agentic AI and Multi-Agent Systems.
  • Knowledge of MLOps and LLMOps practices.
  • Experience with model evaluation frameworks such as RAGAS, TruLens, DeepEval, or Promptfoo.
  • Azure AI Engineer (AI-102), AWS AI Practitioner, or equivalent certifications.
  • Soft SkillsStrong analytical and problem-solving abilities.
  • Excellent communication and stakeholder management skills.
  • Ability to work in Agile/Scrum environments.
  • Strong collaboration and learning mindset.
Nice to Have: Experience building AI copilots for enterprise applications. Exposure to Azure AI Foundry, AWS Bedrock, or Vertex AI.Experience with OCR, Document Intelligence, and Knowledge Management systems. Understanding of AI governance and Responsible AI frameworks

Also on the board Same function, level within a rung

Level

Lead

Location

Manhattan, NY

Occupation

Software Developers

Industry

Custom Computer Programming Services

Posted

today

Apply for this role (opens in a new tab)