DP-700 - Ingest and Transform Data - Section 2.10

Process streaming data using Eventstreams, Spark structured streaming, and KQL, including windowing functions.

Process streaming data using Eventstream transformations, Spark structured streaming with checkpoints, and KQL update policies and materialised views. Apply tumbling, hopping, and session windowing functions and configure watermarking to handle out-of-order event arrival.

Eventstream processing and transformationsSpark structured streaming and checkpointsKQL update policies and materialised viewstumbling, hopping, and session windowswatermarking for streaming

Practice question for this objective

Free sampleIngest and Transform Datahard

A Real-Time Intelligence solution must enrich an incoming telemetry stream by joining it against historical device records that already exist as Delta tables in a Microsoft Fabric Lakehouse. The streaming logic requires arbitrary stateful aggregations and a custom Python machine-learning model scored per event. The team needs full control of the processing graph and is comfortable with code. Which engine best fits these requirements?

  • AA Spark structured streaming notebook that reads the stream, joins it against the Lakehouse Delta tables, and runs the custom Python model and stateful aggregations in code. Correct
  • BAn Eventstream with no-code event processor operations that joins the stream to the Lakehouse tables and applies the Python model inside the processor.
  • CA KQL update policy in the Eventhouse that scores the Python model on each ingested row and joins the historical Lakehouse Delta tables at ingestion time.
  • DA Dataflows Gen2 refresh that merges the stream with the Lakehouse tables and applies the model through a Power Query custom function on a recurring schedule.
When streaming needs arbitrary stateful logic and custom code such as a Python model, choose Spark structured streaming over a no-code Eventstream or KQL update policy. Arbitrary stateful aggregations plus a custom per-event Python model require a general-purpose code engine; Spark structured streaming gives full control of the processing graph and can read the historical Delta tables straight from the Lakehouse, whereas Eventstream and KQL update policies are limited to declarative or built-in transformations.

Why A is correct: Stateful streaming with arbitrary aggregations and a custom Python model scored per event needs full code control, which Spark structured streaming provides while reading the historical Delta tables directly from the Lakehouse.

Why B is wrong: Eventstream processors handle simple shaping such as filters and aggregates but cannot host an arbitrary custom Python model or arbitrary stateful logic, so the no-code path cannot satisfy this requirement.

Why C is wrong: Update policies run KQL at ingestion and cannot execute an arbitrary custom Python model, and joining external Lakehouse Delta tables per row at ingestion is not what an update policy is built to do.

Why D is wrong: Dataflows Gen2 is batch oriented and Power Query cannot host an arbitrary Python model with per-event stateful aggregation, so it neither streams nor performs the required custom scoring.

See more DP-700 practice questions, answers explained.

More in this domain

Back to all Ingest and Transform Data objectives, or the DP-700 cert hub.

Examworthy is not affiliated with or endorsed by Microsoft. Original, blueprint-aligned practice material only.