Deploy decision models with llama.cpp on Amazon SageMaker AI
AWS describes two paths for deploying decision models with llama.cpp on Amazon SageMaker AI: serving OpenAI-compatible chat completions via AWS DLC, or using a SemIf (formerly OpenJev) sub-image to directly return probabilities of declarative options without decoding answer tokens.