8.4 KiB
Technical Specification: Mapping Matrix & Interactive Graphical Rendering Algorithms
This document defines the interactive real-time non-linear curves system showcased.
1. UI Element Mapping Matrix
To upgrade the interface workflow from Image 1 to Image 2, a 1-to-1 mapping of graphical components is executed based on the structural breakdown below:
| --- | --- | --- |
| Horizontal blue bar at the top (Contains a node chain representing the default 0\text{ dB} volume level) | Multi-point peach-colored automation spine (Automation Spline) overlaying the waveform viewport area. | * Double-click anywhere along the spline to generate a new control node.
* Click & Drag a node vertically to scale Volume (Gain), or horizontally to adjust its chronological time position. |
| "FI" text label in the upper-left corner | Deep red arched Fade-In Bezier Curve smoothing the volume transition from 0\% up to 100\%. | * Click & Hold the "FI" handle and drag rightward to increase the target Fade-In length (L_{\text{fade\_in}}). This action automatically projects a smooth curve overlay on top of the waveform graphic. |
| "FO" text label in the upper-right corner | Deep red arched Fade-Out Bezier Curve decaying the volume envelope from 100\% down to 0\% at the end of the clip boundary. | * Click & Hold the "FO" handle and drag leftward to increase the target Fade-Out length (L_{\text{fade\_out}}). The inverse curve automatically stretches or compresses based on the active dragging cursor coordinates. |
| "VOL" button in the lower-right corner | Graphical Envelope Mode Switcher (Toggles automation layer matrices). | * Click to hot-swap between multiple interactive graphs: Volume (VOL) (peach curve), Panning (PAN) (L/R Stereo Image automation trajectory), or FX Send grids. |
2. Non-Linear Graphical Curve Rendering Algorithms (Image 2)
2.1. Multi-Point Volume Automation Curves (Smooth Monotone Spline)
To ensure the interpolating paths connecting the peach-colored nodes in Image 2 are curved smoothly without generating sharp angular peaks, the framework runs a Monotone Cubic Hermite Spline interpolation algorithm.
Given two chronologically consecutive control nodes P_a(x_a, y_a) and P_b(x_b, y_b), an arbitrary absolute timeline position x is normalized into a relative horizontal index interval t:
t = \frac{x - x_a}{x_b - x_a} \quad (0 \le t \le 1)
The target interpolated amplitude value y(x) at position x is evaluated using the cubic polynomial equation:
y(x) = (2t^3 - 3t^2 + 1)y_a + (t^3 - 2t^2 + t)h \cdot m_a + (-2t^3 + 3t^2)y_b + (t^3 - t^2)h \cdot m_b
Where: h = x_b - x_a, and m_a, m_b correspond to the localized slopes (tangents) computed from adjacent surrounding node coordinates. This constraint ensures strict monotonicity to eliminate graphical or mathematical overshoot anomalies.
2.2. Fade Curve Contours (Fade-In & Fade-Out)
The physical curvature profile of the two deep red envelopes in Image 2 is evaluated using a trigonometric Cosine S-Curve or a 3rd-order Cubic Bezier equation framework:
- Trigonometric Cosine Fade-In Curve (Across a duration bound of
L_{\text{fade\_in}}seconds):
f_{\text{in}}(t) = \frac{1 - \cos\left( \pi \cdot \frac{t}{L_{\text{fade\_in}}} \right)}{2} \quad \left( 0 \le t \le L_{\text{fade\_in}} \right)
- Trigonometric Cosine Fade-Out Curve (Across a trailing termination window of
L_{\text{fade\_out}}seconds):
f_{\text{out}}(t) = \frac{1 + \cos\left( \pi \cdot \frac{t - (T_{\text{max}} - L_{\text{fade\_out}})}{L_{\text{fade\_out}}} \right)}{2} \quad \left( T_{\text{max}} - L_{\text{fade\_out}} \le t \le T_{\text{max}} \right)
3. Client-Side Runtime Integration (HTML5 Canvas Engine)
To make the static canvas layer from Image 1 respond fluidly to drag gestures like the interactive system in Image 2, the painting routine segregates graphic elements into distinct presentation layers, driven inside a low-latency requestAnimationFrame render loop:
/**
* Renders non-linear Fade-In and Fade-Out curves over the Waveform canvas viewport.
* @param {CanvasRenderingContext2D} ctx - Target 2D rendering canvas context.
* @param {number} width - Total physical viewport tracking pixel width.
* @param {number} height - Total physical viewport tracking pixel height.
* @param {number} fadeInSec - Bounding target Fade-In duration in seconds.
* @param {number} fadeOutSec - Bounding target Fade-Out duration in seconds.
* @param {number} zoom - Current layout pixel compression scaling factor (pixels/second).
*/
function drawFadeCurves(ctx, width, height, fadeInSec, fadeOutSec, zoom) {
const fadeInWidth = fadeInSec * zoom;
const fadeOutWidth = fadeOutSec * zoom;
const midY = height / 2;
ctx.strokeStyle = '#800000'; // Professional dark deep red hue theme
ctx.lineWidth = 1.8;
// 1. Compile the non-linear Fade-In curve polyline
if (fadeInWidth > 0) {
ctx.beginPath();
for (let x = 0; x <= fadeInWidth; x++) {
const ratio = x / fadeInWidth;
// Apply trigonometric cosine to map curved vertical y-coordinates
const amp = (1 - Math.cos(Math.PI * ratio)) / 2;
const y = height - (amp * height); // Apply envelope tracking from bottom to top
if (x === 0) ctx.moveTo(x, height);
else ctx.lineTo(x, y);
}
ctx.stroke();
}
// 2. Compile the non-linear Fade-Out curve polyline
if (fadeOutWidth > 0) {
ctx.beginPath();
const startX = width - fadeOutWidth;
for (let x = 0; x <= fadeOutWidth; x++) {
const ratio = x / fadeOutWidth;
const amp = (1 + Math.cos(Math.PI * ratio)) / 2;
const y = height - (amp * height);
if (x === 0) ctx.moveTo(startX + x, 0);
else ctx.lineTo(startX + x, y);
}
ctx.stroke();
}
}
4. Server-Side DSP Automation Processing (Dockerized Python Engine)
When an operator commits tracking edits via the Frontend client layer, the mapped coordinates are encoded as a serialized JSON package and transferred down to the FastAPI server gateway. The Python core layer runs performance-optimized, vectorized array loops inside NumPy to multiply envelope filters straight into the raw source data buffer matrices:
import numpy as np
class DSPAutomationProcessor:
@staticmethod
def apply_curves_to_samples(
y: np.ndarray,
sr: int,
fade_in_sec: float,
fade_out_sec: float,
automation_points: list # [{"time": 0.5, "db": -3.0}, ...]
) -> np.ndarray:
"""
Bakes multi-point Volume Automation splines and non-linear fade curves
directly onto a raw acoustic sample NumPy array.
"""
total_samples = len(y)
duration_sec = total_samples / sr
# 1. Initialize the baseline Gain Envelope at Unity Gain (1.0 or 0 dB)
gain_envelope = np.ones(total_samples, dtype=np.float32)
# 2. Evaluate Volume Automation scaling paths (Peach-colored nodes in Image 2)
if automation_points and len(automation_points) > 0:
points = sorted(automation_points, key=lambda x: x["time"])
xp = [p["time"] for p in points]
fp = [10.0 ** (p["db"] / 20.0) for p in points] # Map decibel factors to linear scalars
# Linearly interpolate point values quickly across the full timeline width
times = np.linspace(0, duration_sec, total_samples)
gain_envelope = np.interp(times, xp, fp)
# 3. Multiply the introductory Fade-In envelope (Cosine transition mask at Image 2 boundary)
if fade_in_sec > 0:
fade_in_samples = min(total_samples, int(fade_in_sec * sr))
x_fade = np.linspace(0, np.pi, fade_in_samples)
cosine_ramp = (1.0 - np.cos(x_fade)) / 2.0
gain_envelope[:fade_in_samples] *= cosine_ramp
# 4. Multiply the trailing Fade-Out envelope (Cosine decay mask at Image 2 boundary)
if fade_out_sec > 0:
fade_out_samples = min(total_samples, int(fade_out_sec * sr))
x_fade = np.linspace(0, np.pi, fade_out_samples)
cosine_ramp = (1.0 + np.cos(x_fade)) / 2.0
gain_envelope[-fade_out_samples:] *= cosine_ramp
# 5. Execute vectorized element-wise multiplication into raw audio values
return y * gain_envelope