feat: Implemented Tiling Support for Time-Windowed Aggregations#5724

ntkathole

What this PR does / why we need it:

This PR implements tiling for computing time-windowed aggregations efficiently by pre-aggregating data into small, time-bucketed units (tiles) that can be reused across multiple queries. Instead of scanning all raw events for each window, it:

Pre-aggregates data into small time buckets (tiles)
Computes windowed aggregations by subtracting tiles: window_at_T = tile_at_T - tile_at_(T-window_size)
Stores intermediate representations (IRs) for holistic aggregations (avg, std, var) to enable correct merging
Integrates tiling into Spark and Ray compute engines for StreamFeatureView

Sawtooth Window Tiling

Tile Generation: Events bucketed into hop-sized intervals (e.g., 1-minute tiles)
Cumulative Aggregation: Each tile contains cumulative sum/count from start
Window Computation: Windowed aggregation = tile_at_T - tile_at_(T-window_size)
IR Handling: For holistic aggs, IRs subtracted separately, then final value recomputed

Enable Tiling in StreamFeatureView

sales_features = StreamFeatureView( name="sales_features", entities=[customer], source=kafka_source, aggregations=[ Aggregation( column="amount", function="avg", time_window=timedelta(minutes=5), ), Aggregation( column="amount", function="sum", time_window=timedelta(minutes=5), ), ], timestamp_field="event_timestamp", enable_tiling=True, # Enable tiling optimization tiling_hop_size=timedelta(minutes=1), # Generate tiles every 1 minute )

Architecture

┌─────────────────────────────────────────────────────────────┐ │ StreamFeatureView (enable_tiling=True) │ └────────────────────────┬────────────────────────────────────┘ │ ┌───────────────┴───────────────┐ │ │ ┌────▼────┐ ┌────▼────┐ │ Spark │ │ Ray │ │ Node │ │ Node │ └────┬────┘ └────┬────┘ │ │ │ Convert to pandas │ ▼ ▼ ┌─────────────────────────────────────────────────────────────┐ │ Tiling Logic. │ │ ┌──────────────────────────────────────────────────────┐ │ │ │ orchestrator.apply_sawtooth_window_tiling() │ │ │ │ - Group by entity + hop interval │ │ │ │ - Compute cumulative aggregations (tiles) │ │ │ │ - Output: Cumulative tiles at each hop │ │ │ └──────────────────────┬───────────────────────────────┘ │ │ │ │ │ ┌──────────────────────▼───────────────────────────────┐ │ │ │ tile_subtraction.convert_cumulative_to_windowed() │ │ │ │ - Subtract tiles: window = tile_T - tile_(T-W) │ │ │ │ - Recompute holistic aggs from IRs │ │ │ │ - Output: Windowed aggregations │ │ │ └──────────────────────┬───────────────────────────────┘ │ │ │ │ │ ┌──────────────────────▼───────────────────────────────┐ │ │ │ tile_subtraction.deduplicate_keep_latest() │ │ │ │ - Keep latest window per entity │ │ │ └──────────────────────────────────────────────────────┘ │ └─────────────────────────┬───────────────────────────────────┘ │ Convert back to engine format ▼ ┌───────────────┐ │ Online Store │ │ │ └───────────────┘

Copilot

Pull Request Overview

This PR implements tiling support for efficient time-windowed aggregations in Feast's streaming feature views. The implementation uses a sawtooth window tiling algorithm with intermediate representations (IRs) to enable correct merging of holistic aggregations (avg, std, var) while providing performance benefits for streaming scenarios.

Key Changes:

Adds core tiling logic with IR-based aggregation in new infra/tiling/ module
Extends StreamFeatureView with enable_tiling and tiling_hop_size configuration options
Integrates tiling into Spark and Ray compute engines with pandas-based processing
Updates protobuf definitions and documentation

Reviewed Changes

Copilot reviewed 17 out of 17 changed files in this pull request and generated 23 comments.

Show a summary per file File Description

sdk/python/feast/infra/tiling/base.py	Defines IR metadata structures for algebraic and holistic aggregations
sdk/python/feast/infra/tiling/orchestrator.py	Implements cumulative tile generation using sawtooth window algorithm
sdk/python/feast/infra/tiling/tile_subtraction.py	Converts cumulative tiles to windowed aggregations via tile subtraction
sdk/python/feast/infra/tiling/__init__.py	Exports tiling module public API
sdk/python/feast/stream_feature_view.py	Adds tiling configuration to StreamFeatureView class
protos/feast/core/StreamFeatureView.proto	Adds protobuf fields for tiling configuration
sdk/python/feast/protos/feast/core/StreamFeatureView_pb2.py	Generated protobuf Python code for tiling fields
sdk/python/feast/protos/feast/core/StreamFeatureView_pb2.pyi	Generated protobuf type stubs for tiling fields
sdk/python/feast/infra/compute_engines/spark/nodes.py	Implements tiling execution path for Spark engine
sdk/python/feast/infra/compute_engines/spark/feature_builder.py	Passes tiling config to Spark aggregation nodes
sdk/python/feast/infra/compute_engines/ray/nodes.py	Implements tiling execution path for Ray engine
sdk/python/feast/infra/compute_engines/ray/feature_builder.py	Passes tiling config to Ray aggregation nodes
sdk/python/feast/utils.py	Extracts input columns from aggregations for feature views
sdk/python/tests/unit/infra/compute_engines/spark/test_nodes.py	Updates test to pass required spark_session parameter
docs/getting-started/concepts/tiling.md	Comprehensive documentation on tiling concepts and usage
docs/getting-started/concepts/stream-feature-view.md	Adds reference to tiling documentation
docs/getting-started/concepts/README.md	Adds tiling.md to concepts index

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Really cool. Is there a way to merge with the Aggregation interface? Or something like
aggregation/

Aggregation -- Base aggregation interface
tiling/

yea, this make sense. Changed now to:

feast/ - aggregation/ - __init__.py (Aggregation class) - tiling/

franciscojavierarceo

Happy Thanksgiving! 🚀🚀🚀

ntkathole requested a review from a team as a code owner November 16, 2025 11:17

ntkathole force-pushed the aggregation_tiling branch from 6b05deb to 570debe Compare November 16, 2025 11:33

franciscojavierarceo requested a review from Copilot November 17, 2025 15:34

Copilot started reviewing on behalf of franciscojavierarceo November 17, 2025 15:34 View session

Copilot finished reviewing on behalf of franciscojavierarceo November 17, 2025 15:37

ntkathole force-pushed the aggregation_tiling branch from 570debe to dd83c13 Compare November 17, 2025 15:41

Copilot AI reviewed Nov 17, 2025

View reviewed changes

HaoXuAI reviewed Nov 20, 2025

View reviewed changes

ntkathole force-pushed the aggregation_tiling branch 2 times, most recently from 7189d22 to 839c7a4 Compare November 21, 2025 15:51

ntkathole added 2 commits November 21, 2025 21:24

feat: Implemented tiling support …

0df22f3

Signed-off-by: ntkathole <nikhilkathole2683@gmail.com>

chore: Created Aggregation interface …

712d5f9

Signed-off-by: ntkathole <nikhilkathole2683@gmail.com>

ntkathole force-pushed the aggregation_tiling branch from 839c7a4 to 712d5f9 Compare November 21, 2025 15:55

ntkathole added the ok-to-test label Nov 23, 2025

ntkathole requested review from HaoXuAI and franciscojavierarceo November 24, 2025 12:53

franciscojavierarceo approved these changes Nov 28, 2025

View reviewed changes

Merge branch 'master' into aggregation_tiling

49c2792

jfw-ppi pushed a commit to jfw-ppi/feast that referenced this pull request Nov 30, 2025

feat: Implemented Tiling Support for Time-Windowed Aggregations (feas… …

c980db9

…t-dev#5724)

jfw-ppi pushed a commit to jfw-ppi/feast that referenced this pull request Nov 30, 2025

feat: Implemented Tiling Support for Time-Windowed Aggregations (feas… …

04dc34f

…t-dev#5724) Signed-off-by: Jacob Weinhold <29459386+jfw-ppi@users.noreply.github.com>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat: Implemented Tiling Support for Time-Windowed Aggregations#5724