Python Backend for BEAT¶
In order to run an experiment in BEAT, the user provides the description of data formats, algorithms, data flows (also known as toolchains) and experimental details (parameters) and BEAT schedules and runs the provided recipe to produce displayable result. The algorithms can be written in Python or C++.
This package defines a backend to execute algorithms written in the Python programming language.
- Object Representation
- API
- loader
load_module()run()- hash
toPath()toUserPath()hash()hashJSON()hashJSONFile()hashFileContents()hashDataset()- baseformat
setup_scalar()setup_array()pack_array()pack_scalar()read_some()read_string()unpack_array()unpack_scalar()baseformat- dataformat
StorageDataFormatDataFormat.storageDataFormat.errorsDataFormat.dataDataFormat.resolvedDataFormat.referencedDataFormat.parentDataFormat.nameDataFormat.schema_versionDataFormat.extendsDataFormat.typeDataFormat.validDataFormat.descriptionDataFormat.documentationDataFormat.hash()DataFormat.validate()DataFormat.isparent()DataFormat.json_dumps()DataFormat.write()DataFormat.export()
- algorithm
StorageRunnerAlgorithmAlgorithm.dataformatsAlgorithm.librariesAlgorithm.input_mapAlgorithm.output_mapAlgorithm.groupsAlgorithm.errorsAlgorithm.dataAlgorithm.codeAlgorithm.LEGACYAlgorithm.SEQUENTIALAlgorithm.AUTONOMOUSAlgorithm.SEQUENTIAL_LOOP_EVALUATORAlgorithm.AUTONOMOUS_LOOP_EVALUATORAlgorithm.SEQUENTIAL_LOOP_PROCESSORAlgorithm.AUTONOMOUS_LOOP_PROCESSORAlgorithm.dataformat_klassAlgorithm.nameAlgorithm.schema_versionAlgorithm.api_versionAlgorithm.typeAlgorithm.is_autonomousAlgorithm.is_sequentialAlgorithm.is_loopAlgorithm.languageAlgorithm.clean_parameter()Algorithm.validAlgorithm.usesAlgorithm.isAnalyzerAlgorithm.resultsAlgorithm.parametersAlgorithm.splittableAlgorithm.descriptionAlgorithm.documentationAlgorithm.hash()Algorithm.result_dataformat()Algorithm.uses_dict()Algorithm.runner()Algorithm.json_dumps()Algorithm.write()Algorithm.export()
- database
StorageRunnerDatabaseDatabase.dataDatabase.nameDatabase.descriptionDatabase.documentationDatabase.hash()Database.schema_versionDatabase.validDatabase.environmentDatabase.protocolsDatabase.protocol()Database.protocol_namesDatabase.sets()Database.set()Database.set_names()Database.view_definition()Database.view()Database.json_dumps()Database.write()Database.export()
ViewDatabaseTester- data
mixDataIndices()getAllFilenames()DataSourceFileInfosCachedDataSourceDatabaseOutputDataSourceRemoteDataSourceDataSinkStdoutDataSinkCachedDataSinkload_data_index()load_data_index_db()foundSplitRanges()- data_loaders
DataViewDataLoaderDataLoaderList- Database execution
DBExecutor- Algorithm executor
AlgorithmExecutor- executor
LoopChannelLoopExecutor- Message handlers
MessageHandlerLoopMessageHandler- helpers
parse_inputs()parse_outputs()convert_loop_to_container()convert_experiment_configuration_to_container()AccessModecreate_inputs_from_configuration()create_outputs_from_configuration()- inputs
first()InputInputGroupInputList- library
StorageLibraryLibrary.storageLibrary.librariesLibrary.errorsLibrary.dataLibrary.codeLibrary.uses_dict()Library.load()Library.nameLibrary.schema_versionLibrary.languageLibrary.validLibrary.usesLibrary.descriptionLibrary.documentationLibrary.hash()Library.json_dumps()Library.write()Library.export()
- outputs
SynchronizationListenerOutputRemotelySyncedOutputOutputList- stats
io_statistics()update()- utils
hashed_or_simple()safe_rmfile()safe_rmdir()extension_for_language()PrefixFileAbstractStorageStorageCodeStorageNumpyJSONEncodererror_on_duplicate_key_hook()has_argument()