roboto.domain.topics.parquet.parquet_topic_reader
Module Contents
OUTFILE_NAME_PATTERN
roboto. domain. topics. parquet. parquet_topic_reader. OUTFILE_NAME_PATTERN = '{repr_id}_{file_id}.parquet'#View Source
Filename template for locally cached Parquet files.
ParquetTopicReader
class roboto. domain. topics. parquet. parquet_topic_reader. ParquetTopicReader(roboto_client, cache_dir=None)#View Source
Bases: roboto.domain.topics.topic_reader.TopicReader
Private interface for retrieving topic data stored in Parquet files.
Parameters
roboto_client roboto.cache_dir Optional[pathlib.ParquetTopicReader.accepts()
Parameters
message_paths_to_representations collections.Return type
bool
ParquetTopicReader.get_data()
get_data(message_paths_to_representations, start_time=None, end_time=None, timestamp_message_path_representation_mapping=None)#View Source
Parameters
message_paths_to_representations collections.start_time Optional[int]end_time Optional[int]timestamp_message_path_representation_mapping Optional[roboto.Return type
collections. abc. Generator[tuple[roboto. domain. topics. topic_reader. Timestamp, dict[str, Any]], None, None]
ParquetTopicReader.get_data_as_df()
get_data_as_df(message_paths_to_representations, start_time=None, end_time=None, timestamp_message_path_representation_mapping=None)#View Source
Parameters
message_paths_to_representations collections.start_time Optional[int]end_time Optional[int]timestamp_message_path_representation_mapping Optional[roboto.Return type
tuple[pandas. Series, pandas. DataFrame]