methods. LLM/GPT CI/CD pipelines and diagnostic monitoring for clients or set up for client self-monitoring. Ethical... and testing of data warehouse cubes, models, dimensions, measures, views and reports, being a results-motivated, curious, self...
strategies AI Integration - Consumed LLM APIs (Azure OpenAI/OpenAI, AWS Bedrock, Google Generative AI) from Java services... to overcome obstacles Work within automated testing and CICD processes Be an expert on the products we built Document solutions...
Design and build a data quality evaluation framework for AI training datasets, including scalable metrics, testing...., regression detection across dataset versions). Design and implement synthetic data generation pipelines (LLM-driven...
methods. LLM/GPT CI/CD pipelines and diagnostic monitoring for clients or set up for client self-monitoring. Ethical... and testing of data warehouse cubes, models, dimensions, measures, views and reports, being a results-motivated, curious, self...
AI-integrated workflows (RAG pipelines, structured LLM calls, automation orchestration) with strong guardrails and evaluation... testing, logging, tracing, and observability practices Improve development velocity by leveraging AI coding tools...
: Build LLM, RAG, NLP, and other ML-based features Integrate models via frameworks (TensorFlow, PyTorch, Hugging Face... flow Support testing and deployment of integrations Qualifications: Education Bachelor's or Master's degree...
for deep learning 3+ years in GenAI & Agents LLM evaluation methods; RAG pipelines; prompt/route registries; LangChain... Explainability/fairness testing; PHI/PII handling; model cards; AIRB/RAI artifacts and audit ready evidence 3+ years in Security...
for development, enablement and performance tuning of a wide variety of LLM model families, including massive scale large language... computing based architecture design, implementation, performance profiling, hardware-specific optimizations, testing...
approaches Apply modern software engineering practices (CI/CD, infrastructure as code, automated testing) to manage global... RoviSys organization Explore and apply emerging technologies, including frontier agentic AI and LLM-based automation...
for deep learning 3+ years in GenAI & Agents LLM evaluation methods; RAG pipelines; prompt/route registries; LangChain... Explainability/fairness testing; PHI/PII handling; model cards; AIRB/RAI artifacts and audit ready evidence 3+ years in Security...
, and testing as you ensure we build products customers trust and love. Salesforce is the global leader in Customer Relationship... Qualifications: Experience using and critically reviewing code and artifacts generated by large language model (LLM) coding...
around blockers. Key Accountabilities CI/CD & RELEASE AUTOMATION: Implements CI/CD pipelines including automated testing..., evaluation checks, contract testing and controlled environment promotion to ensure reliable, repeatable and production-ready...
under guidance from senior engineers. INTEGRATION SUPPORT: Assists with implementing and testing integrations across gateway... such as Terraform or CDK. Understanding of LLM gateway basics including routing, rate limiting and observability concepts. Familiarity...
application of engineering to the design, development, implementation, testing and maintenance of software in a systematic method... product roadmaps. These roles include, but are not limited to analysis, design, coding, engineering, testing, debugging...
and execute test plans; build and manage testing datasets for N-path, acceptance, and regression testing Research industry...), Geography, Computer Science, or STEM related field Recommended Qualifications Strong testing and QA experience...
Preferred Qualifications: LLM evaluation and regression testing: Experience building automated evaluation harnesses for LLM... of LLM and ML models You'll be rewarded and recognized for your performance in an environment that will challenge...
postmortems, and resilience testing. Keeps abreast of emerging cloud, DevOps, and AI trends and translates them into actionable... and operating model-serving pipelines, MLOps platforms, or LLM-based applications in cloud environments. Proficiency with GenAI...
Preferred Qualifications: LLM evaluation and regression testing: Experience building automated evaluation harnesses for LLM... of LLM and ML models You'll be rewarded and recognized for your performance in an environment that will challenge...
and campaign testing processes. Preferred Qualifications: Deep understanding of Large Language Model (LLM) techniques..., including Agents, Planning, Reasoning, and other related methods. Experience of all LLM models and their capabilities...
test plans incorporate security testing to validate security invariants (including negative cases). Collaborates... of a product works well with the components of the partner team, ensuring proper end-to-end testing, live-site coverage...