• Test Data Management

    Get more information from your test data!

12.11.2024 15:00

Peak BigODS Exporter: Bridge Your ASAM ODS Data to Big Data Lakes

Data-driven decision-making is becoming increasingly important, such that the automotive and aerospace industries face growing needs for scalable test data analysis. Much of this data is stored using the ASAM ODS standard, which excels in managing test data across systems and formats. However, traditional ASAM ODS storage isn’t well-suited for advanced analytics in big data environments. To address this need, ASAM ODS has defined a new “Associate Standard” designed to connect ASAM ODS databases with big data ecosystems—an innovation that Peak Solution has already implemented in the form of the Peak BigODS Exporter as part of Peak ODS Adapter for Apache Spark.


[In der Blog-Übersicht wird hier ein Weiterlesen-Link angezeigt]


Seamless Connect ASAM ODS Data to Big Data Lakes

The Peak BigODS Exporter provides a streamlined bridge from ASAM ODS data storage to big data eco systems, enabling advanced analytics on large volumes of test data. It provides you with flexible export options to integrate with big data analysis tools, even for existing ASAM ODS solutions.


PeakBigODS Exporter connects ASAM ODS to Big Data Lakes


Structured Export for Effective Analysis

To make test data manageable and accessible, the Peak BigODS Exporter organizes ASAM ODS data into three main categories:

  • Meta Data: Information about the test context, such as test object descriptions and setups, is exported in JSON or Apache Avro formats, making it easy to read and process across multiple big data tools.
  • Mass Data: Representing data from measurement channels or vehicle bus systems, mass data is exported in Apache Parquet, optimizing it for high-speed analysis.
  • Additional Data: Any auxiliary data, such as images, audio, video, or model data, can be included to provide a complete view of the test data.


Customizable Export Definitions for Tailored Data Sets

One standout feature of the Peak BigODS Exporter is the Export Definition File, an XML-based configuration file that lets you precisely define the subset of data you want to export. This means the export can focus on the relevant data for big data needs. By using multiple Export Definition Files, you can further tailor exports to meet specific analysis goals, ensuring that the resulting data set aligns perfectly with your business needs.


Benefits of Using Parquet and Avro Formats

The Peak BigODS Exporter offers the flexibility to choose the data format that best suits your analysis needs. For column-based data access, the Apache Parquet format is optimal, enabling rapid querying and analysis. For row-based access, Apache Avro is recommended. This flexibility ensures that you can define the data export format according to your analysis requirements.


An Easy Path to Big Data Analytics for ODS Users

The Peak BigODS Exporter connects your ASAM ODS data management solution with big data ecosystems, unlocking the potential of powerful analytics without extensive IT investments. Designed to scale alongside business demands, the Peak BigODS Exporter offers a practical solution for companies looking to transform test data into actionable insights.


Ready to start maximizing your test data insights? Contact Peak Solution today to learn more about how the Peak BigODS Exporter can support your data-driven goals.

Connected solutions

You can click on the links to get more information about the individual components.

Related topics