+#hjdZddlmZmZddlmZmZGddeZGddeZGdd eZ y ) zAWS providers for LMs.)ABCabstractmethod)AnyOptionalc eZdZdZ ddededeededdf dZdefd Ze d ed edefd Z d e ee fde ee ee fffdZy) AWSProvideraThis abstract class adds support for AWS model providers such as Bedrock and SageMaker. The subclasses such as Bedrock and Sagemaker implement the abstract method _call_model and work in conjunction with the AWSModel classes. Usage Example: bedrock = dspy.Bedrock(region_name="us-west-2") bedrock_mixtral = dspy.AWSMistral(bedrock, "mistral.mixtral-8x7b-instruct-v0:1", **kwargs) bedrock_haiku = dspy.AWSAnthropic(bedrock, "anthropic.claude-3-haiku-20240307-v1:0", **kwargs) bedrock_llama2 = dspy.AWSMeta(bedrock, "meta.llama2-13b-chat-v1", **kwargs) sagemaker = dspy.Sagemaker(region_name="us-west-2") sagemaker_model = dspy.AWSMistral(sagemaker, "", **kwargs) N region_name service_name profile_namebatch_n_enabledreturnc ddl}| |j|||_||_y|j |j|||_||_y#t$r}td|d}~wwxYw)a[_summary_. Args: region_name (str, optional): The AWS region where this LM is hosted. service_name (str): Used in context of invoking the boto3 API. profile_name (str, optional): boto3 credentials profile. batch_n_enabled (bool): If False, call the LM N times rather than batching. rNz$pip install boto3 to use AWS models.)r )r )boto3 ImportErrorclient predictorSessionr )selfr r r r rexcs V/var/www/html/sandstorm/venv/lib/python3.12/site-packages/dsp/modules/aws_providers.py__init__zAWSProvider.__init__s O   "\\,K\PDN / #]] ]ELL'MDN / ODE3 N OsA A2! A--A2c.|jjS)zReturn the provider name.) __class____name__)rs rget_provider_namezAWSProvider.get_provider_name2s~~&&&model_idbodycy)z'Call the model and return the response.Nrrrs r call_modelzAWSProvider.call_model6sr query_kwargscd|vr|ddkDrd|d<|ddkrd|d<d|vr|ddkDrd|d<|ddkrd|d<d}|js|jdd}||d<||fS) z=Ensure that input kwargs can be used by Bedrock or Sagemaker. temperaturegGz?g{Gz?top_pnnum_generations)r pop)rr#r(s rsanitize_kwargszAWSProvider.sanitize_kwargs:s L (M*T1.2 ]+M*T1.2 ]+ l "G$t+(, W%G$t+(, W% ##  a(A./L* +,r)NT)r __module__ __qualname____doc__strrboolrrrr"dictrtupleintr,r rrrrs  '+ $ ///sm /  /  /<'3'636c6c66DcNuS$sTWx.EX?Yrrc TeZdZdZ d dedeededdffd Zded edefd ZxZ S) Bedrockz+This class adds support for Bedrock models.Nr r r r c*t||d||y)z_summary_. Args: region_name (str): The AWS region where this LM is hosted. profile_name (str, optional): boto3 credentials profile. zbedrock-runtimeNsuperr)rr r r rs rrzBedrock.__init__Ss &7Wrrrc@|jj||ddS)Napplication/json)modelIdraccept contentType)r invoke_modelr!s rr"zBedrock.call_modelas*~~**%* +  r)NF) rr-r.r/r0rr1rr" __classcell__rs@rr6r6Ps\5 '+ % X Xsm X X  X 3 c c rr6cNeZdZdZ d dedeeddffd Zdededefd ZxZS) Sagemakerz-This class adds support for Sagemaker models.Nr r r c(t||d|y)z_summary_. Args: region_name (str, optional): The AWS region where this LM is hosted. profile_name (str, optional): boto3 credentials profile. zruntime.sagemakerNr8)rr r rs rrzSagemaker.__init__ms &9<Hrrrc@|jj||ddS)Nr;) EndpointNameBodyAccept ContentType)rinvoke_endpointr!s rr"zSagemaker.call_modelzs*~~--!%* .  r)N) rr-r.r/r0rrr"r@rAs@rrCrCjsN7 '+ I Ism I  I 3 c c rrCN) r/abcrrtypingrrrr6rCr rrrMs5# F#FR k 4  r