Index A | B | C | D | E | F | G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W A accept (HttpHeaders attribute) accept_json() (HttpHeaders static method) add_azure_integration() (in module promptquality.integrations) add_openai_integration() (in module promptquality.integrations) add_targets() (GalileoPromptCallback method) adherence_basic (Scorers attribute) adherence_nli (ScorersConfiguration attribute) agent (NodeType attribute) aggregates (UserSubmittedMetrics attribute) aggregator_fn (CustomScorer attribute) ai21_j2_mid_v1 (Models attribute) ai21_j2_ultra_v1 (Models attribute) all_versions (BaseTemplateResponse attribute) anthropic_claude_3_haiku (Models attribute) anthropic_claude_3_sonnet (Models attribute) anthropic_claude_instant_v1 (Models attribute) anthropic_claude_v1 (Models attribute) anthropic_claude_v2 (Models attribute) anthropic_claude_v21 (Models attribute) api_client (Config property) api_key (Config attribute) (CreateIntegrationRequest attribute) api_key_login() (ApiClient static method) api_url (ApiClient attribute) (Config property) application_json (HttpHeaders attribute) auth_header (ApiClient property) average_bleu (PromptMetrics attribute) average_cost (PromptMetrics attribute) average_hallucination (PromptMetrics attribute) average_rouge (PromptMetrics attribute) aws_titan_text_express_v1 (Models attribute) aws_titan_text_lite_v1 (Models attribute) aws_titan_tg1_large (Models attribute) azure_chat_gpt (Models attribute) azure_chat_gpt_16k (Models attribute) azure_gpt_35_turbo (Models attribute) azure_gpt_35_turbo_16k (Models attribute) azure_gpt_35_turbo_instruct (Models attribute) azure_gpt_4 (Models attribute) B babbage_2 (Models attribute) base_url (ApiClient property) bifurcate_scorers() (in module promptquality.utils.scorer) bleu (Metrics attribute) (PromptRow attribute) C chain (NodeType attribute) chain_id (NodeRow attribute) chain_root_id (NodeRow attribute) chain_run() (in module promptquality.chain_run) chat (NodeType attribute) chat_gpt (Models attribute) chat_gpt_16k (Models attribute) check_scorer_name() (in module promptquality.utils.name) chunk_attribution_utilization_basic (Scorers attribute) chunk_attribution_utilization_gpt (Scorers attribute) (ScorersConfiguration attribute) chunk_attribution_utilization_nli (ScorersConfiguration attribute) chunk_attribution_utilization_plus (Scorers attribute) cohere_command_light_text_v14 (Models attribute) cohere_command_r_plus_v1 (Models attribute) cohere_command_r_v1 (Models attribute) cohere_command_text_v14 (Models attribute) completed (JobStatus attribute) completeness_basic (Scorers attribute) completeness_gpt (Scorers attribute) (ScorersConfiguration attribute) completeness_nli (ScorersConfiguration attribute) completeness_plus (Scorers attribute) config_file (Config property) console_url (Config attribute) content_type (HttpHeaders attribute) content_type_json() (HttpHeaders static method) context_adherence (Metrics attribute) (Scorers attribute) context_adherence_basic (Scorers attribute) context_adherence_explanation (Metrics attribute) context_adherence_plus (Scorers attribute) context_relevance (Metrics attribute) (Scorers attribute) (ScorersConfiguration attribute) correctness (Metrics attribute) (Scorers attribute) correctness_explanation (Metrics attribute) cost (PromptRow attribute) create_job() (ApiClient method) (in module promptquality.helpers) create_project() (ApiClient method) (in module promptquality.helpers) create_prompt_optimization_job() (in module promptquality.helpers) create_run() (ApiClient method) (in module promptquality.helpers) create_settings_combinations() (in module promptquality.run_sweep) create_template() (ApiClient method) (in module promptquality.helpers) create_template_version() (ApiClient method) (in module promptquality.helpers) creation_timestamp (NodeRow attribute) csv (DatasetFormat attribute) current_dataset_id (Config attribute) current_job_id (Config attribute) current_project_id (Config attribute) current_project_name (Config attribute) current_run_id (Config attribute) current_run_name (Config attribute) current_run_task_type (Config attribute) current_run_url (Config attribute) current_template (Config attribute) current_template_id (Config attribute) current_template_name (Config attribute) current_template_version (Config attribute) current_template_version_id (Config attribute) current_user (Config attribute) D DatasetFormat (class in promptquality.constants.dataset_format) davinci_2 (Models attribute) E endpoint (CreateIntegrationRequest attribute) error (JobStatus attribute) error_message (GetJobStatusResponse attribute) evaluation_criteria (PromptOptimizationConfiguration attribute) evaluation_model_alias (PromptOptimizationConfiguration attribute) examworks_v1 (Models attribute) F factuality (Scorers attribute) (ScorersConfiguration attribute) failed (JobStatus attribute) feather (DatasetFormat attribute) file_path (BaseDatasetRequest attribute) (UploadDatasetRequest attribute) files (BaseDatasetRequest property) finish() (GalileoPromptCallback method) finish_reason (NodeRow attribute) for_llm() (NodeRow class method) for_retriever() (NodeRow class method) format (BaseDatasetRequest attribute) frequency_penalty (Settings attribute) from_scorer() (UserSubmittedMetrics class method) from_scorers() (ScorersConfiguration class method) G GalileoPromptCallback (class in promptquality.callback) gemini_pro (Models attribute) generation_model_alias (PromptOptimizationConfiguration attribute) GENERIC (TagType attribute) get_config_location() (in module promptquality.utils.config) get_current_user() (ApiClient method) get_estimated_cost() (ApiClient method) (in module promptquality.helpers) get_job_status() (ApiClient method) (in module promptquality.helpers) get_metrics() (ApiClient method) (in module promptquality.get_metrics) get_project() (ApiClient method) (in module promptquality.helpers) get_project_by_name() (ApiClient method) get_project_from_name() (in module promptquality.helpers) get_root_id() (GalileoPromptCallback method) get_rows() (ApiClient method) (in module promptquality.get_rows) get_run_by_name() (ApiClient method) get_run_from_name() (in module promptquality.helpers) get_run_scorer_jobs() (ApiClient method) (in module promptquality.helpers) get_template() (ApiClient method) (in module promptquality.get_template) get_template_from_id() (in module promptquality.helpers) get_templates() (ApiClient method) (in module promptquality.helpers) gpt_35_turbo (Models attribute) gpt_35_turbo_16k (Models attribute) gpt_35_turbo_16k_0125 (Models attribute) gpt_35_turbo_instruct (Models attribute) gpt_4 (Models attribute) gpt_4_128k (Models attribute) gpt_4_turbo (Models attribute) gpt_4_turbo_0125 (Models attribute) groundedness (Scorers attribute) (ScorersConfiguration attribute) H hallucination (PromptRow attribute) has_children (NodeRow attribute) headers (CreateIntegrationRequest attribute) healthcheck() (ApiClient static method) http_url() (Config class method) HttpHeaders (class in promptquality.utils.request) I id (BaseTemplateResponse attribute) (BaseTemplateVersionResponse attribute) (CreateRunResponse attribute) (GetJobStatusResponse attribute) (ProjectResponse attribute) (RegisteredScorer attribute) (UploadDatasetResponse attribute) in_progress (JobStatus attribute) index (PromptRow attribute) indices (UserSubmittedMetrics attribute) ingest_chain_rows() (ApiClient method) (in module promptquality.helpers) inputs (NodeRow attribute) (PromptRow attribute) is_dependency_available() (in module promptquality.utils.dependencies) is_failed() (JobStatus static method) is_incomplete() (JobStatus static method) iterations (PromptOptimizationConfiguration attribute) J job_id (JobInfoMixin attribute) (UserSubmittedMetricsResponse attribute) job_name (CreateJobRequest attribute) (GetJobStatusResponse attribute) job_progress() (in module promptquality.job_progress) JobStatus (class in promptquality.constants.job) json() (HttpHeaders static method) json_serializer() (GalileoPromptCallback static method) jsonl (DatasetFormat attribute) K key (RunTag attribute) L latency (Metrics attribute) (NodeRow attribute) (Scorers attribute) (ScorersConfiguration attribute) like_dislike (Metrics attribute) (PromptRow attribute) limit (PaginationRequestMixin attribute) link (JobInfoMixin attribute) list_registered_scorers() (ApiClient method) (in module promptquality.registered_scorers) llm (NodeType attribute) log_probs_cost (EstimatedCostResponse attribute) login() (Config method) (in module promptquality.login) logout() (Config method) M make_request() (in module promptquality.utils.request) mark_step_end() (GalileoPromptCallback method) mark_step_start() (GalileoPromptCallback method) max_tokens (PromptOptimizationConfiguration attribute) (Settings attribute) merge_dataset() (Config method) merge_job() (Config method) merge_project() (Config method) merge_run() (Config method) merge_scorers() (ScorersConfiguration method) merge_template() (Config method) merge_template_version() (Config method) message (ChainIngestResponse attribute) meta_llama2_13b_chat_v1 (Models attribute) meta_llama3_70b_instruct_v1 (Models attribute) meta_llama3_8b_instruct_v1 (Models attribute) metrics (PromptRow attribute) mistral_7b_instruct (Models attribute) mistral_8x7b_instruct (Models attribute) mistral_large (Models attribute) model_alias (Settings attribute) Models (class in promptquality.constants.models) module promptquality promptquality.callback promptquality.chain_run promptquality.constants promptquality.constants.config promptquality.constants.dataset_format promptquality.constants.integrations promptquality.constants.job promptquality.constants.models promptquality.constants.prompt_optimization promptquality.constants.routes promptquality.constants.run promptquality.constants.scorers promptquality.get_metrics promptquality.get_rows promptquality.get_template promptquality.helpers promptquality.integrations promptquality.job_progress promptquality.login promptquality.prompt_optimization promptquality.registered_scorers promptquality.run promptquality.run_sweep promptquality.set_config promptquality.sweep promptquality.types promptquality.types.chains promptquality.types.chains.node_type promptquality.types.chains.row promptquality.types.config promptquality.types.custom_scorer promptquality.types.pagination promptquality.types.prompt_optimization promptquality.types.registered_scorers promptquality.types.rows promptquality.types.run promptquality.types.settings promptquality.types.user_submitted_metrics promptquality.utils promptquality.utils.api_client promptquality.utils.config promptquality.utils.dataset promptquality.utils.dependencies promptquality.utils.logger promptquality.utils.name promptquality.utils.request promptquality.utils.scorer N n (Settings attribute) name (BaseTemplateResponse attribute) (CreateIntegrationRequest attribute) (CreateProjectRequest attribute) (CreateRunRequest attribute) (CreateTemplateRequest attribute) (CustomScorer attribute) (RegisteredScorer attribute) (UserSubmittedMetrics attribute) next_starting_token (PaginationResponseMixin attribute) node_id (NodeRow attribute) node_input (NodeRow attribute) node_name (NodeRow attribute) node_output (NodeRow attribute) node_type (NodeRow attribute) NodeType (class in promptquality.types.chains.node_type) num_rows (ChainIngestResponse attribute) num_train_rows (PromptOptimizationConfiguration attribute) num_val_rows (PromptOptimizationConfiguration attribute) O on_agent_finish() (GalileoPromptCallback method) on_chain_end() (GalileoPromptCallback method) on_chain_error() (GalileoPromptCallback method) on_chain_start() (GalileoPromptCallback method) on_chat_model_start() (GalileoPromptCallback method) on_llm_end() (GalileoPromptCallback method) on_llm_error() (GalileoPromptCallback method) on_llm_start() (GalileoPromptCallback method) on_retriever_end() (GalileoPromptCallback method) on_retriever_error() (GalileoPromptCallback method) on_retriever_start() (GalileoPromptCallback method) on_tool_end() (GalileoPromptCallback method) on_tool_error() (GalileoPromptCallback method) on_tool_start() (GalileoPromptCallback method) optimize_prompt() (in module promptquality.prompt_optimization) organization_id (CreateIntegrationRequest attribute) P paginated (PaginationResponseMixin attribute) palmyra_base (Models attribute) palmyra_beta (Models attribute) palmyra_e (Models attribute) palmyra_instruct (Models attribute) palmyra_instruct_30 (Models attribute) palmyra_large (Models attribute) palmyra_med (Models attribute) palmyra_x (Models attribute) palmyra_x_32k (Models attribute) params (EstimateCostRequest property) (NodeRow attribute) (UploadDatasetRequest property) params() (GetRowsRequest method) parse_dataset() (in module promptquality.utils.dataset) password (Config attribute) pii (Metrics attribute) (Scorers attribute) (ScorersConfiguration attribute) presence_penalty (Settings attribute) progress_message (GetJobStatusResponse attribute) progress_percent (GetJobStatusResponse attribute) project_id (CreateJobRequest attribute) (CreateRunRequest attribute) (CreateTemplateRequest attribute) (CreateTemplateVersionRequest attribute) (EstimateCostRequest attribute) (GetJobStatusResponse attribute) (GetMetricsRequest attribute) (GetRowsRequest attribute) (SelectTemplateVersionRequest attribute) (UploadDatasetRequest attribute) (UserSubmittedMetricsResponse attribute) project_url (Config property) prompt (NodeRow attribute) (PromptOptimizationConfiguration attribute) (PromptRow attribute) prompt_dataset_id (CreateJobRequest attribute) prompt_injection (Scorers attribute) (ScorersConfiguration attribute) prompt_optimization_configuration (CreateJobRequest attribute) prompt_perplexity (Scorers attribute) (ScorersConfiguration attribute) prompt_registered_scorers_configuration (ChainIngestRequest attribute) (CreateJobRequest attribute) prompt_scorer_settings (CreateJobRequest attribute) prompt_scorers_configuration (ChainIngestRequest attribute) (CreateJobRequest attribute) prompt_settings (CreateJobRequest attribute) prompt_template_version_id (CreateJobRequest attribute) (UploadDatasetRequest attribute) promptquality module promptquality.callback module promptquality.chain_run module promptquality.constants module promptquality.constants.config module promptquality.constants.dataset_format module promptquality.constants.integrations module promptquality.constants.job module promptquality.constants.models module promptquality.constants.prompt_optimization module promptquality.constants.routes module promptquality.constants.run module promptquality.constants.scorers module promptquality.get_metrics module promptquality.get_rows module promptquality.get_template module promptquality.helpers module promptquality.integrations module promptquality.job_progress module promptquality.login module promptquality.prompt_optimization module promptquality.registered_scorers module promptquality.run module promptquality.run_sweep module promptquality.set_config module promptquality.sweep module promptquality.types module promptquality.types.chains module promptquality.types.chains.node_type module promptquality.types.chains.row module promptquality.types.config module promptquality.types.custom_scorer module promptquality.types.pagination module promptquality.types.prompt_optimization module promptquality.types.registered_scorers module promptquality.types.rows module promptquality.types.run module promptquality.types.settings module promptquality.types.user_submitted_metrics module promptquality.utils module promptquality.utils.api_client module promptquality.utils.config module promptquality.utils.dataset module promptquality.utils.dependencies module promptquality.utils.logger module promptquality.utils.name module promptquality.utils.request module promptquality.utils.scorer module proxy (CreateIntegrationRequest attribute) put_integration() (ApiClient method) put_template_version_selection() (ApiClient method) put_user_metrics() (ApiClient method) Q query_cost (EstimatedCostResponse attribute) query_input_tokens (NodeRow attribute) query_output_tokens (NodeRow attribute) query_total_tokens (NodeRow attribute) R RAG (TagType attribute) random() (in module promptquality.job_progress) read() (Config class method) register_scorer() (ApiClient method) (in module promptquality.registered_scorers) request_data (GetJobStatusResponse attribute) response (NodeRow attribute) (PromptRow attribute) response_format (Settings attribute) retriever (NodeType attribute) rouge (Metrics attribute) (PromptRow attribute) rows (ChainIngestRequest attribute) (PromptRows attribute) run() (in module promptquality.run) run_id (CreateJobRequest attribute) (GetJobStatusResponse attribute) (GetMetricsRequest attribute) (GetRowsRequest attribute) (UserSubmittedMetricsResponse attribute) run_sweep() (in module promptquality.run_sweep) run_tags (CreateRunRequest attribute) S scorer_fn (CustomScorer attribute) scorer_jobs_status() (in module promptquality.job_progress) scorer_name (ScorerSettings attribute) (UserSubmittedMetrics attribute) (UserSubmittedMetricsResponse attribute) Scorers (class in promptquality.constants.scorers) scorers (ListRegisteredScorers attribute) scores (UserSubmittedMetrics attribute) select_template_version() (in module promptquality.helpers) selected_version (BaseTemplateResponse attribute) selected_version_id (BaseTemplateResponse attribute) serialize_api_key() (CreateIntegrationRequest method) serialize_token() (Config method) set_config() (in module promptquality.set_config) set_relationships() (GalileoPromptCallback method) sexist (Scorers attribute) (ScorersConfiguration attribute) silk_road (Models attribute) starting_token (PaginationRequestMixin attribute) status (GetJobStatusResponse attribute) step (NodeRow attribute) steps_completed (GetJobStatusResponse attribute) steps_total (GetJobStatusResponse attribute) stop_sequences (Settings attribute) sweep() (in module promptquality.sweep) T tag_type (RunTag attribute) TagType (class in promptquality.constants.run) target (NodeRow attribute) (PromptRow attribute) task_description (PromptOptimizationConfiguration attribute) task_type (CreateJobRequest attribute) (CreateRunRequest attribute) (GetRowsRequest attribute) temperature (PromptOptimizationConfiguration attribute) (Settings attribute) template (BaseTemplateResponse attribute) (BaseTemplateVersionRequest attribute) (EstimateCostRequest attribute) template_id (CreateTemplateVersionRequest attribute) (SelectTemplateVersionRequest attribute) text_bison (Models attribute) text_bison_001 (Models attribute) token (ApiClient attribute) (Config attribute) token_login() (Config method) tone (Scorers attribute) (ScorersConfiguration attribute) tool (NodeType attribute) tools (Settings attribute) top_p (Settings attribute) total_cost (EstimatedCostResponse attribute) (PromptMetrics attribute) total_responses (PromptMetrics attribute) toxicity (Metrics attribute) (Scorers attribute) (ScorersConfiguration attribute) transpose_dict_to_rows() (in module promptquality.utils.dataset) ts_name() (in module promptquality.utils.name) type (CreateProjectRequest attribute) U uncertainty (Metrics attribute) unstarted (JobStatus attribute) upload_custom_metrics() (in module promptquality.helpers) upload_dataset() (ApiClient method) (in module promptquality.helpers) username (Config attribute) username_login() (ApiClient static method) V validate_api_url() (Config method) validation_dataset_id (PromptOptimizationConfiguration attribute) value (RunTag attribute) version (BaseTemplateVersionRequest attribute) (CreateTemplateVersionResponse attribute) (SelectTemplateVersionRequest attribute) W write() (Config method)