Changelog

​

Publish prompt

• A new method has been added to the SDK basalt.prompt.publish. This method allow users to programmatically publish a prompt.

​

Traces & logs

• Accept arrays as input, output and ideal_output
• Better support of input_tokens, output_tokens and cost

​

Python version

• Minimal python version is now 3.10

​

Development experience improvement

• Modification of the typings and documentation for a better developer experience when using the Python SDK
• Review methods to better support of async and add sync methods.

​

Experiments

• Added idealOutput params to traces and logs for ground truth evaluation in experiments

​

Datasets

• Support of dataset methods
• Caching of datasets

​

Add methods

• Added setEvaluatorConfig to traces
• AddedsetExperiment to traces

​

Experiments

• Added experiments.

​

Evaluations

• Added evaluations at the trace and log level.

​

Latency & Costs

• Added support for latency and costs through the monitoring system.

​

Patch for Basic Monitoring

• Patch the generation.end() that were not well flushed in certain cases.

​

Basic Monitoring

• Implemented basic monitoring after getting a prompt.

​

Patch for trace.end()

• Patch for trace.end() to allow for more flexible trace ending.

​

Monitoring

• Added support for monitoring.
• Added support for tracing.

​

List and Describe prompts

• Added support for listing and describing prompts.

​

First release of the SDK 🎉

• Added support for getting prompts.