← The Torre work01 / TORRE · CONTRIBUTION

Metrics with consistent definitions.

Make dashboards easier to interpret responsibly.

Where this work fits

Once AI features were in use, a disappointing result could come from several places. A model call, a search result, and a dashboard count each needed different evidence before the team could decide what to fix.

MY CONTRIBUTION

I worked on SQL reporting for candidate activity, including the populations and time periods behind the numbers. I separated measures of different actions and adjusted comparisons so incomplete periods did not make a rate look worse simply because the day was still underway.

THE IDEA, ILLUSTRATED

Understand what the measurement counts

03 / PRODUCT MEASUREMENT

The denominator matters.

Different questions deserve different measures.

40submitted applications

40 applications submitted in total.

This total counts submissions. It does not tell us how many people started an application and finished it.

A completion rate compares people who finished with people who started, using the same group and time period.
THE ENGINEERING DECISION

Capture the right context without blocking the user.

The review team needed the result the user actually saw. I worked on carrying that context into the review handoff while keeping a delivery failure from interrupting search. For metrics, I checked what each count represented and kept incomplete periods from distorting comparisons.

The skills behind the work

SQL
Query and update relational data, with clear rules about which records a result represents.
Metric definitions
Make sure a report’s label and the action being counted mean the same thing.
Product measurement
Connect user behavior with a product question rather than count events without context.
THE WIDER RESULT

Engineers could inspect model failures and timing. Reviewers received search context to investigate, and product reporting used clearer definitions for the activity being measured.

READ THIS IN CONTEXTI gave the team more to investigate than a failed result. →
Related contributionsTracing the calls inside an AI operationI added model tracing with OpenTelemetry and Langfuse. Recording timing, failures, and generation context let engineers inspect individual calls inside an operation, including failed attempts that could be hidden by a successful fallback.Connecting product events to their search contextI instrumented recruiting actions such as reviewing a candidate, changing search criteria, and starting a conversation. Keeping search context with those events made the activity more useful for analysis than unrelated counts of clicks.Search context for the n8n review workflowI built the application-side integration that supplied the review team’s n8n workflow with search context and the candidates actually displayed. I worked on correlating that information and handling delivery failures without interrupting search. The review team maintained the receiving workflow.