Skip to content
Roboto
Esc
↑↓navigate↵open⌘Jpreview
On this page

roboto.domain.topics.parquet.parquet_topic_reader

Module Contents

OUTFILE_NAME_PATTERN

roboto.domain.topics.parquet.parquet_topic_reader.OUTFILE_NAME_PATTERN = '{repr_id}_{file_id}.parquet'#View Source

Filename template for locally cached Parquet files.

ParquetTopicReader

class roboto.domain.topics.parquet.parquet_topic_reader.ParquetTopicReader(roboto_client, cache_dir=None)#View Source

Bases: roboto.domain.topics.topic_reader.TopicReader

Private interface for retrieving topic data stored in Parquet files.

Parameters

cache_dir Optional[pathlib.Path]

ParquetTopicReader.accepts()

static accepts(message_paths_to_representations)#View Source

Parameters

message_paths_to_representations collections.abc.Iterable[roboto.domain.topics.record.MessagePathRepresentationMapping]

Return type

bool

ParquetTopicReader.get_data()

get_data(message_paths_to_representations, start_time=None, end_time=None, timestamp_message_path_representation_mapping=None)#View Source

Parameters

message_paths_to_representations collections.abc.Iterable[roboto.domain.topics.record.MessagePathRepresentationMapping]
start_time Optional[int]
end_time Optional[int]
timestamp_message_path_representation_mapping Optional[roboto.domain.topics.record.MessagePathRepresentationMapping]

Return type

collections.abc.Generator[tuple[roboto.domain.topics.topic_reader.Timestamp, dict[str, Any]], None, None]

ParquetTopicReader.get_data_as_df()

get_data_as_df(message_paths_to_representations, start_time=None, end_time=None, timestamp_message_path_representation_mapping=None)#View Source

Parameters

message_paths_to_representations collections.abc.Iterable[roboto.domain.topics.record.MessagePathRepresentationMapping]
start_time Optional[int]
end_time Optional[int]
timestamp_message_path_representation_mapping Optional[roboto.domain.topics.record.MessagePathRepresentationMapping]

Return type

tuple[pandas.Series, pandas.DataFrame]

logger

roboto.domain.topics.parquet.parquet_topic_reader.logger#View Source

Was this page helpful?