<div class="csl-bib-body">
<div class="csl-entry">Grasmann, L., Pichler, R., & Selzer, A. (2023). Integration of Skyline Queries into Spark SQL. In F. Geerts & B. Vandevoort (Eds.), <i>Proceedings 26th International Conference on Extending Database Technology (EDBT 2023)</i> (pp. 337–350). OpenProceedings.org. https://doi.org/10.48786/edbt.2023.27</div>
</div>
-
dc.identifier.uri
http://hdl.handle.net/20.500.12708/193564
-
dc.description.abstract
Skyline queries are frequently used in data analytics and multicriteria decision support applications to filter relevant information from big amounts of data. Apache Spark is a popular framework for processing big, distributed data. The framework even provides a convenient SQL-like interface via the Spark SQL module. However, skyline queries are not natively supported and require tedious rewriting to fit the SQL standard or Spark's SQL-like language. The goal of our work is to fill this gap. We thus provide a full-fledged integration of the skyline operator into Spark SQL. This allows for a simple and easy to use syntax to input skyline queries. Moreover, our empirical results show that this integrated solution by far outperforms a solution based on rewriting into standard SQL.
en
dc.description.sponsorship
WWTF Wiener Wissenschafts-, Forschu und Technologiefonds
-
dc.description.sponsorship
FWF - Österr. Wissenschaftsfonds
-
dc.language.iso
en
-
dc.relation.ispartofseries
Advances in database technology
-
dc.rights.uri
http://creativecommons.org/licenses/by-nc-nd/4.0/
-
dc.subject
Spark SQL
en
dc.subject
Data Analytics
en
dc.subject
Skyline Queries
en
dc.subject
Solution
en
dc.subject
Apache Spark
en
dc.subject
Analyzer
en
dc.subject
Logical Plan
en
dc.subject
Algorithm
en
dc.subject
Optimizations
en
dc.title
Integration of Skyline Queries into Spark SQL
en
dc.type
Inproceedings
en
dc.type
Konferenzbeitrag
de
dc.rights.license
Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International
en
dc.rights.license
Creative Commons Namensnennung - Nicht kommerziell - Keine Bearbeitungen 4.0 International