`nemo_gym.dataset_orchestrator`#

Module Contents#

`delete_jsonl_dataset_from_gitlab`
`upload_jsonl_dataset_to_hf_maybe_delete`
`upload_jsonl_dataset_to_hf_cli`
`upload_jsonl_dataset_to_hf_and_delete_gitlab_cli`
`download_jsonl_dataset_from_hf_cli`
`delete_jsonl_dataset_from_gitlab_cli`

nemo_gym.dataset_orchestrator.delete_jsonl_dataset_from_gitlab(gitlab_model_name: str) → None[source]#

nemo_gym.dataset_orchestrator.upload_jsonl_dataset_to_hf_maybe_delete( config: Union[nemo_gym.config_types.UploadJsonlDatasetHuggingFaceMaybeDeleteConfig, nemo_gym.config_types.UploadJsonlDatasetHuggingFaceConfig], delete_from_gitlab: bool = False, ) → None[source]#

nemo_gym.dataset_orchestrator.upload_jsonl_dataset_to_hf_cli() → None[source]#

nemo_gym.dataset_orchestrator.upload_jsonl_dataset_to_hf_and_delete_gitlab_cli() → None[source]#

nemo_gym.dataset_orchestrator.download_jsonl_dataset_from_hf_cli() → None[source]#

nemo_gym.dataset_orchestrator.delete_jsonl_dataset_from_gitlab_cli() → None[source]#