Sprint - June 24 to July 5, 2024 #23075

benjackwhite · 2024-06-19T07:28:36Z

Global Sprint Planning

3 things that might take us down

Team sprint planning

For your team sprint planning copy this template into a comment below for each team.

# Team ___

**Support hero:** ___

## Retro

<!-- Grab the high and low priority items from last time and add whether that item was completed or not -->

- 

## Hang over items from previous sprint

<!-- For each item, decide to re-prioritise (and add below) or deprioritise -->

- Item 1. prioritised/deprioritise

## OKR

1. OKR, status (red/yellow/green) and action points if yellow/red


### High priority

-

### Low priority / side quests

-

The text was updated successfully, but these errors were encountered:

pauldambra · 2024-06-19T07:39:46Z

Team Error Tracking, Tracker of Errors

Support hero: @daibhin

paul out a day
Manoel out 2 or 3 days (TBC)

items from previous sprint

High priority

hiring (@pauldambra) 🔴
hogql filters performance (@pauldambra ) ✅
- death by a 1000 cuts here...
- turned this on for $large-eu-customer now though
- so we might be able to start deleting old code 🤞 now
masking text in the screenshot images on Android and iOS @marandaneto 🟡
- Android ✅
- iOS just research/benchmarking with the Android results - more complicated - WIP 🟡
Error tracking (@pauldambra and @daibhin) 🟡
- first pass UI out
- user interview booked with $large-eu-customer
- some grouping research done but lots of context switching 😓
- UI is under a feature flag

OKR

OKR, status (red/yellow/green) and action points if yellow/red

🟡 quality and consolidation
- mobile replay open beta
  - out free and being promoted in onboarding
- replay captures every site
  - David working with rrweb to improve CSS parsing, already a major reduction in issues as a result
- people can find the valuable recordings
  - universal filters in progress
🟡 Error tracking MVP
- started
🔴 Hire at least 2 amazing colleagues

High priority

Q3 goals - everyone
masking text in the screenshot images on iOS @marandaneto
Replay React native plugin for Android and iOS @marandaneto
- Check if it's possible to make the native plugin optional so it works with Expo OOTB.
Universal filters released for everyone @daibhin
- write transformation from simple / advanced filters to new universal filters
Error tracking @daibhin @pauldambra
- Generate embeddings in plugin server using new S3 mounted disk
- Materialized embeddings column on the events table
- Playlist of errors & associated recordings
- Figure out grouping (https://github.com/PostHog/product-internal/pull/615)

Low priority / side quests

~~persistent replay queue in posthog-js @pauldambra (TBC)~~
- switching all of replay to async just for this is bothering me, so I'm going to park for now
we are recruiting beta testers for Android and iOS - (we should have screenshots now) @marandaneto @annikaschmid

benjackwhite · 2024-06-19T08:18:34Z

fuziontech · 2024-06-19T13:20:26Z

benjackwhite · 2024-06-19T13:26:40Z

Team Infra

Retro

Ben out for 50%
Sašo out 1 day
Frank out 100%

Hang over items from previous sprint

🟢 SEIM:
- 🔴 access logs to django @benjackwhite (fix axes?)
- 🟢 cloudtrail dashboard @danielxnj
- 🟢 eks audit dashboard @danielxnj
- 🟢 documentation/policy for sharing with auditors/clients (in cloud-infra?) @danielxnj
  - https://github.com/PostHog/posthog-cloud-infra/issues/2808
- 🟢 metabase logs into loki
🟡 secrets
- 🟢 vault monitoring
- 🟢 vault is all configured with TF
- 🔴 backups @danielxnj
  - Decided to move to use a proper database backing which will take care of backups for us
- 🔴 CDP integration @ZeleniJure
  - opted against this as it isn't fit for purpose (scale we use it etc.)
🟡 VPA dashboard to understand over-provisioned resources @ZeleniJure
- Still last tweaks in prod to get it working (and then we need to implement the recommendations)
🟢 roll out new codified deployment strategy @frankh
🟢 Other cost optimization stuff
- Removed the overprovisioning deployments
- Tagged Clickhouse disks (manual atm as it is still not in terraform)
- S3 costs reducing thanks to incremental backups of clickhouse
🔴 internal RBAC review (tbc)
🟢 S3 mounted volume for Ingestion (geoip + blobby models)

OKR

💪 Deploy with confidence 🟢

Finalize our Canary Deploy process 🟡

🚨 Improved alerting and monitoring 🟢

SIEM work has made this a priority

🔒 Deeper Security 🟡
💰 Continued cost control 🟢

High priority

Q3 Planning @benjackwhite
Vault in use for production secrets (k8s configuration for example) @ZeleniJure @danielxnj
- why? We've done most of the thinking, now we just need to do it to complete our "auditable security quarter"
Over-provisioned resource review @ZeleniJure
- why? Part of cost saving efforts to reduce our over provisioned deployments
Audit all our AWS IAM accounts (we have everything in SSO so we shouldn't have any normal accounts there) @danielxnj

Side quest

access logs to django @danielxnj
Make sure all kafka topics are in IaC (e.g. clickhouse_heatmap_events)

neilkakkar · 2024-06-19T13:31:08Z

Team Feature Success

Support hero: @dmarticus
Days off:
Juraj: 5 days
Phani: 0 days
Dylan: 0 days
Neil: 2 days

Retro

release event based triggers - @Phanatic ✅
Surveys branching logic - @jurajmajerik 🟡 (almost out, some secondary stuff remains)
Survey popup UI polish (add all issues here) #20851 - @dmarticus ❌
Feature request: Survey revision history #22516 - @dmarticus ❌ - unexpectedly off more days, focused on getting delayed surveys shipped, an excellent refactor to make it all work well.
Make a monorepo (RFC: Bringing back the monorepo for rust services and main app meta#207 ) - @neilkakkar ✅
Feature Flags Rewrite: List of things to get done #22131 continue on rewrite - @neilkakkar - db access and connection to main repo for migrations sorted

Hang over items from previous sprint

OKRs

Make sure feature flags can handle 10x current scale
Polish new experiments UI & collect feedback
Add most requested surveys functionality

High priority

event based triggers with actions and filters - @Phanatic
Surveys branching logic release - @jurajmajerik
no-code experiments RFC - @jurajmajerik
Survey popup UI polish (add all issues here) #20851 - @dmarticus
Feature request: Survey revision history #22516 - @dmarticus
Feature Flags Rewrite: List of things to get done #22131 continue on rewrite - get flags from db, handle cohorts - @neilkakkar

Low priority / side quests / maybe Neil will get to this next year

Temporal queues for feature success - @neilkakkar
Setup instrumentation for flip-flopping problem of experiment significance - @neilkakkar

EDsCODE · 2024-06-19T13:37:39Z

raquelmsmith · 2024-06-19T15:17:05Z

bretthoerner · 2024-06-19T15:25:19Z

Team Pipeline

Off: Tiina
Support: Xavier

Retro

High priority

Improve ingestion efficiency by moving the last Kafka waits at the end of the batch (Brett)
New customers write to person only from $set and $identify, $create_alias, $merge_dangerously and new products also only read persons (Tiina)

OKR

✅=finished 🟢=on track to finish this quarter 🟡=might not finish 🔴=won't finish
✔️=progressed last sprint ; ➡️=planned work for this sprint

🟢✔️ Deprecate posthog-events by moving to capture-rs fully (21659)
🟢✔️ Visibility into what's in the ingestion queues and past performance (20985)
🟢✔️ Fast configuration options to speed up incident recovery, e.g. by token send to overflow or drop (21662)
🟢✔️ Iterate on person processing to make it faster and cheaper (21048)
🟢✔️ Batch exports UX improvements, e.g. error notifications and UI rewamp (21139)
🟢 Support adding new products (21665)
🟢✔️ Deprecate scheduler & jobs deployments, runEveryX plugins and kafkajs consumers (21656)

High priority

Fix excessive overrides written in support of Personless mode (Brett)
Hog support for Rusty-Hook (Brett) (This takes backburner to the one above)
capture-rs: fix billing limits (Xavier)

Low priority / side quests

Finish hog-rs to posthog repo migration (deploy out of posthog through state.yaml)
Collect rdkafka metrics (broker response latency, error rates) for all node producers & consumer (Xavier)
capture-rs: read redis out-of-band (avoid latency if redis slow)

robbie-c · 2024-06-19T15:26:08Z

Team web analytics session table

Support hero: @robbie-c

Retro

Some personless events work (low priority tidying up of posthog-js) was blocked on https://github.com/PostHog/product-internal/pull/612/files, so I got to work on the sessions table instead. It's pretty close to being ready, maybe by the end of this sprint. PR: #23023 . I've done the first 90%, just finishing off the second 90%

🟢 Start emailing customers for research (emailed ~30, spoke to 5)
🟢 Posthog-js: Rewrite posthog-js person props backfilling to include initial current url
🛑 Posthog-js: handle setPersonPropertiesForFlags properly when personless
🛑 Posthog-js: handle manually calling $set properly when personless
🛑 Write RFC for client changes for personless events based on posthog-js, to be approved by mobile sdk teams
🆕 Get the sessions table v2 ingesting events

Customer interviews were useful, mostly reasonably obvious stuff that's already on my roadmap (separating sites better, live user count, auto refreshing) but leads.io were extremely specific, and would need conversion rate per landing page.

OKR

Make querying fast enough for large customers
Do personless events work where necessary
Iterate on customer feedback
Product management work

High priority

Get session table v2 PR over the line
Start backfilling, prioritising EU, and team 2 on US for dogfooding

Stretch goal

Get a versions of WA up that is terrifyingly fast because it can just use the sessions table + it can sample

Twixes · 2024-06-19T15:33:14Z

Team Product Analytics

Support hero: @aspicer @skoob13

Time off: Michael half the sprint, Sandy two days

Retro

High priority

🟢 Getting rid of remaining legacy filters use (owner: @thmsobrmlr) – much refactoring done, though some bits still to be done
🥏 Query performance measurement (owner: @aspicer) – deprioritized overall, scope turned out to be much larger. Turned to more targeted optimizations (e.g. Py 3.12)
🔴 Project Environments finally (owner: @Twixes) – didn't get to it

Low priority / side quests

🔴 Insight background reloads monitoring/cleanup (@webjunkie) – focused on the support queue
🟢 Onboarding Georgii (owner: @Twixes) - multiple breakdowns are progressing

Extra things done

Q3 planning
Persons-on-events cleanup
Live events deployment (thanks to @fuziontech and @frankh)
3 issues with our Zapier integration that Zapier forwarded to me (@Twixes) last week
Support overflowing – Julian's been doing a great job turning the reports into solvable issues, but at our volume there isn't enough time for the hero to also ship all the fixes in time
Working with a contributor, Nikita, who's in the process of shipping analytics alerts

Hang over items from previous sprint

Getting rid of remaining legacy filters use, the remaining bits (owner: @thmsobrmlr)
Project Environments (owner: @Twixes)

OKR

HogQL-based querying
- Convert the remaining legacy queries to HogQL and release to public (Thomas, Julian, ~~Marius~~)
  - 🟢 Insights – rolled out, although fixes needed to be rock-solid
  - ⚪ Cohorts
- Remove legacy querying backend (Thomas, Julian)
  - 🟢 Clean up or rewrite dashboardLogic
  - 🟠 Convert filters to query (insights, notebooks, activity log, experiments) 👈 Thomas is on it
- Missing Product Analytics features (Thomas, Julian)
  - 🟠 Breakdowns (multiple) in literally everything 👈 Georgiy is on it
  - 🟠 Make a list based on GitHub issues from customer requests…
  - ⚪ Fix those issues
- Missing HogQL features (~~Tom~~, ~~Marius~~)
  - 🟠 Type system, JSON 👈 Tom is on this, being in Data Warehouse
  - ⚪ Missing things when building funnels
Querying and processing performance (Thomas, Julian)
- Global performance overview dashboards 👈 Sandy is on it
  - 🟠 Insights
  - ⚪ Exports
  - ⚪ Cohort recalculations
- Query request tracing
  - ⚪ Possibly query runner Python optimizations
  - ⚪ Exports improvements
- ⚪ Identify top 5 query optimizations in terms of impact
Artificial Hog / Post Intelligence (Michael)
- ⚪ Ask a question to get a magical insight (aware of your taxonomy)
- ⚪ Figure out infra for upgrading queries and models
- ⚪ Product-wide framework for opting into sharing with OpenAI
Activation (side quest: Michael)
- ⚪ Michael to work with Growth to identify optimizations to getting started with Product Analytics 👈 pending the product manager hire a bit

High priority

Experiments migrated from legacy trends/funnels to HogQL-based (owner: @thmsobrmlr)
Getting rid of remaining legacy filters use continued (owner: @thmsobrmlr)
Multiple breakdowns in Trends released to users (owner: @skoob13)
Project Environments (owner: @Twixes)
Insight background reloads monitoring/cleanup (@webjunkie)

Low priority / side quests

Working with Nikita to get analytics alerts shipped (owner: @aspicer)

benjackwhite added the sprint Sprint planning label Jun 19, 2024

benjackwhite pinned this issue Jun 19, 2024

daibhin changed the title ~~Sprint - June 24 to May 5, 2024~~ Sprint - June 24 to July 5, 2024 Jun 19, 2024

jannesblobel mentioned this issue Jun 24, 2024

Metrics and events alerting #23176

Closed

marandaneto closed this as completed Jul 8, 2024

marandaneto unpinned this issue Jul 8, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Sprint - June 24 to July 5, 2024 #23075

Sprint - June 24 to July 5, 2024 #23075

benjackwhite commented Jun 19, 2024

pauldambra commented Jun 19, 2024 •

edited by marandaneto

Loading

benjackwhite commented Jun 19, 2024 •

edited by mariusandra

Loading

fuziontech commented Jun 19, 2024 •

edited

Loading

benjackwhite commented Jun 19, 2024

neilkakkar commented Jun 19, 2024 •

edited

Loading

EDsCODE commented Jun 19, 2024 •

edited

Loading

raquelmsmith commented Jun 19, 2024 •

edited

Loading

bretthoerner commented Jun 19, 2024 •

edited

Loading

robbie-c commented Jun 19, 2024 •

edited

Loading

Twixes commented Jun 19, 2024 •

edited

Loading

Sprint - June 24 to July 5, 2024 #23075

Sprint - June 24 to July 5, 2024 #23075

Comments

benjackwhite commented Jun 19, 2024

Global Sprint Planning

3 things that might take us down

Team sprint planning

pauldambra commented Jun 19, 2024 • edited by marandaneto Loading

Team Error Tracking, Tracker of Errors

items from previous sprint

High priority

OKR

High priority

Low priority / side quests

benjackwhite commented Jun 19, 2024 • edited by mariusandra Loading

Team CDP, deliverer of Hogs

Retro

Hang over items from previous sprint

OKR

Sprint plan

Side quests

fuziontech commented Jun 19, 2024 • edited Loading

Team Click Haus, Haus of the Hogs

OKR Q2 2024

Objective

Board

Retro

High priority

benjackwhite commented Jun 19, 2024

Team Infra

Retro

Hang over items from previous sprint

OKR

High priority

Side quest

neilkakkar commented Jun 19, 2024 • edited Loading

Team Feature Success

Retro

Hang over items from previous sprint

OKRs

High priority

Low priority / side quests / maybe Neil will get to this next year

EDsCODE commented Jun 19, 2024 • edited Loading

Team Data <->, collecting of Hogs and more

OKR Q2 2024

Objective

Retro

High Priority

raquelmsmith commented Jun 19, 2024 • edited Loading

Team Growth

Retro

Q2 Goals

This sprint

High priority

bretthoerner commented Jun 19, 2024 • edited Loading

Team Pipeline

Retro

High priority

OKR

High priority

Low priority / side quests

robbie-c commented Jun 19, 2024 • edited Loading

Team web analytics session table

Retro

OKR

High priority

Stretch goal

Twixes commented Jun 19, 2024 • edited Loading

Team Product Analytics

Retro

High priority

Low priority / side quests

Extra things done

Hang over items from previous sprint

OKR

High priority

Low priority / side quests

pauldambra commented Jun 19, 2024 •

edited by marandaneto

Loading

benjackwhite commented Jun 19, 2024 •

edited by mariusandra

Loading

fuziontech commented Jun 19, 2024 •

edited

Loading

neilkakkar commented Jun 19, 2024 •

edited

Loading

EDsCODE commented Jun 19, 2024 •

edited

Loading

raquelmsmith commented Jun 19, 2024 •

edited

Loading

bretthoerner commented Jun 19, 2024 •

edited

Loading

robbie-c commented Jun 19, 2024 •

edited

Loading

Twixes commented Jun 19, 2024 •

edited

Loading