Apache Spark
The content focuses on the applications and functionalities of Apache Spark and related technologies in big data processing and analytics. It covers workshops, real-time data pipeline implementations, challenges in data engineering, and the integration of machine learning with Spark. The resources also discuss the transformation of batch to streaming data, automation in feature extraction, and the migration from Spark to other frameworks. Users can explore scalability, performance, and practical applications of data streaming solutions in various industries.
-
Unlock faster insights with Azure Databricks
Unlock faster insights with Azure Databricks4w ago, 11 views
4w ago, 11 views -
BigData - Apache Spark Sqoop Introduce Basic
BigData - Apache Spark Sqoop Introduce Basic1m ago, 4 views
1m ago, 4 views -
If You Use Databricks, You Definitely Need FME
If You Use Databricks, You Definitely Need FME2m ago, 111 views
2m ago, 111 views -
Apache Sparkに対するKubernetesのNUMAノードを意識したリソース割り当ての性能効果 (Open Source Conference 2025 Tokyo/Spring 発表資料)
Apache Sparkに対するKubernetesのNUMAノードを意識したリソース割り当ての性能効果 (Open Source Conference 2025 Tokyo/Spring 発表資料)5m ago, 382 views
5m ago, 382 views -
FEATURE EXTRACTION AND FEATURE SELECTION: REDUCING DATA COMPLEXITY WITH APACHE SPARK
FEATURE EXTRACTION AND FEATURE SELECTION: REDUCING DATA COMPLEXITY WITH APACHE SPARK6m ago, 16 views
6m ago, 16 viewsLike FEATURE EXTRACTION AND FEATURE SELECTION: REDUCING DATA COMPLEXITY WITH APACHE SPARK SlideShare. Save FEATURE EXTRACTION AND FEATURE SELECTION: REDUCING DATA COMPLEXITY WITH APACHE SPARK SlideShare. Share FEATURE EXTRACTION AND FEATURE SELECTION: REDUCING DATA COMPLEXITY WITH APACHE SPARK SlideShare. -
data pipelines complexity human expertise and LLM era
data pipelines complexity human expertise and LLM era7m ago, 30 views
7m ago, 30 views -
scalable air quality analytics with apache spark and apache sedona
scalable air quality analytics with apache spark and apache sedona7m ago, 16 views
7m ago, 16 views -
A quick presentation on Big Data Analytics and Applications
A quick presentation on Big Data Analytics and Applications8m ago, 20 views
8m ago, 20 views -
Top 5 Data Science Tools You Should Be Using in 2024 | IABAC
Top 5 Data Science Tools You Should Be Using in 2024 | IABAC8m ago, 13 views
8m ago, 13 views -
Amazon's Exabyte-Scale Migration from Spark to Ray
Amazon's Exabyte-Scale Migration from Spark to Ray9m ago, 61 views
9m ago, 61 views -
Introduction to Big Data Engineering.pdf
Introduction to Big Data Engineering.pdf10m ago, 57 views
10m ago, 57 views -
Real-Time Data Analytics with Apache Kafka and Spark.pptx
Real-Time Data Analytics with Apache Kafka and Spark.pptx1y ago, 39 views
1y ago, 39 views -
A Master Guide To Apache Spark Application And Versatile Uses.pdf
A Master Guide To Apache Spark Application And Versatile Uses.pdf1y ago, 26 views
1y ago, 26 views -
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide1y ago, 129 views
1y ago, 129 views -
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, PostgreSQL, Redpanda, Debezium, and Benthos to master building advanced real-time data pipelines.
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, PostgreSQL, Redpanda, Debezium, and Benthos to master building advanced real-time data pipelines.1y ago, 26 views
1y ago, 26 viewsLike ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, PostgreSQL, Redpanda, Debezium, and Benthos to master building advanced real-time data pipelines. SlideShare. Save ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, PostgreSQL, Redpanda, Debezium, and Benthos to master building advanced real-time data pipelines. SlideShare. Share ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, PostgreSQL, Redpanda, Debezium, and Benthos to master building advanced real-time data pipelines. SlideShare. -
BigData e internte das coisas aplicada a engenharia
BigData e internte das coisas aplicada a engenharia1y ago, 20 views
1y ago, 20 views -
Streaming Architecture Walkthrough.pdf
Streaming Architecture Walkthrough.pdf1y ago, 72 views
1y ago, 72 views -
IOT.ppt
IOT.ppt1y ago, 12 views
1y ago, 12 views
