Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Sprint - Sept 16 to Sept 27 #24890

Closed
Phanatic opened this issue Sep 10, 2024 · 9 comments
Closed

Sprint - Sept 16 to Sept 27 #24890

Phanatic opened this issue Sep 10, 2024 · 9 comments
Labels
sprint Sprint planning

Comments

@Phanatic
Copy link
Contributor

Global Sprint Planning

3 things that might take us down

Urgent incident follow-ups

https://github.com/orgs/PostHog/projects/103/views/2

Team sprint planning

For your team sprint planning copy this template into a comment below for each team.

# Team ___

**Support hero:** ___

## Retro

<!-- Grab the high and low priority items from last time and add whether that item was completed or not -->

- 

## Hang over items from previous sprint

<!-- For each item, decide to re-prioritise (and add below) or deprioritise -->

- Item 1. prioritised/deprioritise

## OKR

1. OKR, status (red/yellow/green) and action points if yellow/red


### High priority

-

### Low priority / side quests

-
@Phanatic Phanatic added the sprint Sprint planning label Sep 10, 2024
@Phanatic
Copy link
Contributor Author

Phanatic commented Sep 10, 2024 •
edited by jurajmajerik
Loading

Team Feature Success

Support hero: @Phanatic

Vacation

  1. @Phanatic Sept 16-18

Retro

  • Customer support :
    • Overall really good.
    • Met a lot of SLAs

✅ No-code experiments targeting & Support hero: @Phanatic
✅ Feature flags rust rewrite, support group properties overrides : @dmarticus
⌛ HogQL rewrite for experiments : @jurajmajerik - initial groundwork done, nothing more due to 1) on-call 2) some rolled over support, 3) working on improving Experiments with the contractor.

Side Quests

⌛ Add a filter to experiments UI to show events without variants assigned to them. Make all of these hyperlinks :
image - will be done this sprint.

  • Observe queries we make to retrieve group & person properties when evaluating feature flags in /decide. Copy what we do in the rust flags service.

OKRs

  1. Make sure feature flags can handle 10x current scale
  2. No-code experiments

High priority

@pauldambra pauldambra pinned this issue Sep 11, 2024
@pauldambra
Copy link
Member

pauldambra commented Sep 11, 2024 •
edited
Loading

Team Repl-Error

TL;DR

  • Onboarding in Cambridge the first week so sort-of a one week sprint
  • borrowing @oliverb123 (maybe this sprint)

Support hero: @daibhin

a few short bits of leave but generally folk in full time

Retro

  • @pauldambra a lot of support... almost cleared the queue, blinked and it was higher than I started 🐞
  • @neilkakkar ... jumped in to something very difficult with stack traces 💖 but exhausting
  • @marandaneto ... lots of iOS bugs - but managed to fix them 🚀 but exhausting
  • @daibhin ... error tracking still a lot of back and forth 🤯

High priority

✅ done
🟢 in progress, on track
🟡 in progress, off track
🔴 missed

High priority

Mobile

  • Masking and redacting Jetpack Compose views (issue) @marandaneto 🔴
    • Tried once more for Jetpack and SwiftUI, but both are just images, I don't see a way to do this now (unless we do image processing on the client or server).
  • Support person_profiles in Android and iOS @marandaneto 🟢
    • Android and iOS done
  • RN session replay more automatic via npm, not copying code snippets @marandaneto 🟡
    • Automatic installation (WIP), will test the npm publish steps tomorrow

Error tracking

Session replay

  • 🟢 Network logs not capturing everything @pauldambra
    • will need follow-up since this is going to be really site dependent but made progress with posthog-js 1.160.3
  • 🟢 Sessions >24 hours bug (browser online / offline events) @pauldambra
  • 🟢 Dropped / compressed messages work revisited @pauldambra
    • lost some custom signal with rust capture / warp stream. but now accepting much larger messages. still getting some which means we do have messages >64MB, want to get examples of these so we can target next steps

Low priority / side quests

OKR

  1. OKR, status (red/yellow/green) and action points if yellow/red
  • 📱Goal 1: People think of PostHog as a mobile solution 🟡
  • 🪲 Goal 2: Error tracking in people's hands 🟢
  • ⁉️ Goal 3: Hiring ✅
    • Neil's joining the team! 🟢
    • Richard joingin the team! 🟢
    • iOS Engineer 🔴

High priority

WEEK 1

  • Get Richard up and running
  • Get @oliverb123 up and running
  • Get Q4 planning done

WEEK 2

Mobile

  • RN replay - publishing should still be done by 16th and then we get people testing @marandaneto
  • start investigating flutter @marandaneto

Error tracking

a lot of the error issue UX is done, really need the connection between those issues/groups and the events
very good RFC in progress https://github.com/PostHog/product-internal/pull/646

  • need to get Olly spun up and start building something to learn from it @pauldambra
  • need to get out of the mud and ingesting errors for our teams
    • what are we doing with post-processing @pauldambra
      • issues/fingerprints work for python already
    • get JS exception autocapture tested in prod - needs demangling
    • we've got python autocapture running - needs no demangling
    • by the end of the sprint, have a good understanding of what the load and the events look like @pauldambra
    • use python events to improve UX flows, actionability @daibhin @neilkakkar

Session replay

Low priority / side quests

  • uncaptured network requests
  • error assignment into activity log @pauldambra
  • step based debug playback @daibhin

@pauldambra pauldambra mentioned this issue Sep 11, 2024
Closed
@pauldambra pauldambra changed the title Sprint - Sept 16 - Sept 27 Sprint - Sept 16 to Sept 27 Sep 11, 2024
@benjackwhite
Copy link
Contributor

benjackwhite commented Sep 11, 2024 •
edited by mariusandra
Loading

Team Cyclotron Does Petabytes (CDP)

Support: @oliverb123

Retro

  • 🟢 Metrics side of cyclotron @bretthoerner
    • Dead letter depth
    • Queue depth
    • Anything else we can think of
  • 🟢 Roll out rust Property/Event definitions service @oliverb123
  • 🟢 Get the new hog services running in a way that is ready to test cyclotron @benjackwhite
  • 🟡 Wrapping up remaining list of Destination UX work to get it rolled out @mariusandra

High priority

  • Goal - quiet launch of the new CDP destinations
    • Everything running on Cyclotron ensuring alerting and metrics etc. @benjackwhite
      • visibility / alerting for DLQ plus management commands @oliverb123
    • All destinations ready to migrated @mariusandra @MarconLP
    • Take it out of feature preview so that no new destinations are made as plugins
  • Slow burner getting more info about capture rust so we can finally get rid of django capture
  • Exception ingestion PoC with team replay

@benjackwhite
Copy link
Contributor

Team Infra

Retro / hangover

OKR

  1. 🦹 Zero-trust security 🟢
  2. 🤓 10x Developer Experience 🟡
  3. 💪 Every service lives and dies alone 🟢
  4. 💰 Save big on cost 🟡

High priority

  • Comply with blockage of IPs from Russia @frankh
    • Add a region block notice to Django
    • Block if not logged in on all endpoints redirecting to page explaining why
    • If logged in also block but with team override (or something)
  • PostHog JS - deploy its own assets
    • Move away from posthog being the source of truth for JS assets to posthog-js
  • Frank to focus on "infra sessions" for onboarding Bryan
  • ArgoCD @danielxnj @Daesgar
    • have a full E2E CI/CD flow for an app
    • One by one migrated all "internal" services
  • Make sure we do a great onboarding for Bryan

Side quest

  • Split envoy into 1 deployment per AZ and disable cross-AZ balancing
  • Investigate external secrets options (param store / secret manager etc.)

@fuziontech
Copy link
Member

Team Click Haus, Haus of the Hogs

OKR Q2 2024

Objective

James as a Service -> Clickhouse as a Service

  • P0 tasks such as
    • 🟡 Deletes
    • 🟢 Keeping clusters happy
    • 🟢 Provisioning more disks
    • 🟢 Schema Reviews
    • 🟢 Debugging
    • 🟢 Performance < Thanks @tkaemming
    • 🟢 Backups/Restores
    • 🟢 Understand performance options concretely we have with ByConity and written down.
    • 🟢 Support the goals of the Data Fusion RFC

Board

https://github.com/orgs/PostHog/projects/85/views/2

Retro

@Daesgar - Pretty fine - able to collab with infra really well now. Happy to have a plan for clickhouse with a few different options including ByConity and DataFusion

@fuziontech - Strangely not productive but productive sprint. I'm very happy that Altinity is looking into ByConity as something they would support. I'm excited at the prospect of using DataFusion as an abstraction layer that we can build functionality into.

Board Snapshot

image

@raquelmsmith
Copy link
Member

raquelmsmith commented Sep 11, 2024 •
edited
Loading

Team Growth

Retro

Retro items
  • @raquelmsmith
  • @zlwaterfield
    • Session replay migration from free plans
    • Fix the off by one error for annual credits mrr splits
    • Self serve annual credits - get v1 done and behind a feature flag in productions (without the monthly distributions yet)
    • Update + design self serve annual credits monthly distributions
    • Confirm ICP scoring data from Mine and start deeper analysis
    • Email churned subscribers (on going)
    • Don't auto turn of group analytics and data pipelines
    • Shadow 1-2 technicals, move Google doc for arch technical into https://github.com/PostHog/interview-test and add more context on answers. Improve some of the grammar in the challenge.

Q3 Goals

✅=finished 🟡=in progress 🔴=won't finish ⚪=not started

  1. 🟡 Make onboarding awesome for Product analytics and Data warehouse (Raquel)
  2. 🟡 Support self-serve annual commitments (Zach)
  3. 🟡 Dive into the data to understand our billing metrics and customers better (Zach)
  4. ✅ Launch pricing for data warehouse (Raquel)
  5. 🟡 Hire 2 people (one for billing, one for auth/permissions focus)

This sprint

Time off:

  • @zlwaterfield
    • Get annual credits based fully rolled out to first users
    • Iterate on annual credits based on usage / feedback
    • Annual credits monthly distributions
    • RBAC PR hand off from Ben
    • Continue ICP analysis with new data from Mine
    • Confirm customer.io integration is now working - work with Joe to get mailgun emails moved over
    • Work with Joe to get existing startups onboarded to a campaign for roll out notifications
    • if time
      • WorkOS splike for SAML and SCIM (limited to 1 day)
  • @raquelmsmith
    • Implement Personless default switch
    • Organize work for https://github.com/PostHog/company-internal/issues/1452 with data science contractor
    • Ship analytics onboarding templates
    • Don't delete all upcoming invoices at once when we sync them - so we don't see daily big drops in revenue for half the day
    • Move all activation metrics to backend

@robbie-c
Copy link
Collaborator

robbie-c commented Sep 11, 2024 •
edited
Loading

Team Web Analytics

Support hero: @robbie-c

The marketing launch is happening tomorrow (Thursday 12th Sept)

Retro

I missed a few days this sprint (out sick)

🟢 Page-level conversion goals
🟢 Save web analytics page state
🔴 Delete v1 sessions table after US people have been on v2 for ~a week without incident. - a couple of customers have been reverted as they were doing custom session ids and need us to support v1 a little longer

🟢 Outbound clicks tile
🟡 Polish the loading state on web analytics

OKR

  1. Make querying fast enough for large customers
  2. Heavily requested features
  3. Work better with other products
  4. Product and growth

High priority

  • Add web analytics to onboarding flow
  • Work with customers still on sessions v1 to figure out a timeline for delete it
  • Spike for whether we can speed up web analytics by querying all the breakdowns at once using clickhouse maps

Stretch goals

  • Doc updates
    • Cross domain tracking
    • Changes to attribution
  • Start backfilling the 4 new columns in sessions v2 (will likely take a few weekends)
  • Live-code something self-contained for content (likely the time of day query or some minor github feature requests)
  • RFC writing
    • Improve Cookieless tracking
    • Server-side posthog-js config

@Twixes
Copy link
Collaborator

Twixes commented Sep 11, 2024 •
edited
Loading

Team Product Analytics

Support hero: @skoob13, then @Twixes – back to single person on support

Retro

High priority

Low priority / side quests

  • Testing & deploying new funnels code - @aspicer
  • feature requests around dashboard previewing filter changes - @anirudhpillai
  • Upgrade to Django 5 ➡️ Postponed until Julian comes back – perfect timing for the 5.2 LTS version

OKR

  1. Rock-solid analytics
    1. 🟢 Legacy Minus – removing legacy insights code so that we can move fast
      • urgent and important: cohorts need to be rewritten
      • important: migrate insights having filters to query
      • rewrite property name and value suggestions to HogQL for caching layer
    2. 🟡 Tests Plus – shipping fewer bugs in the first place.
    3. 🟢 Metrics Plus – catching issues before users report
    4. 🟡 Performance Plus - eliminating UX pain via maximum query performance/reliability, based on Metrics Plus data
    5. 🟢 Support Plus – sparking joy for users when they’re led to report a bug
  2. Answering more product questions, deeper (@thmsobrmlr + @webjunkie + @aspicer + @anirudhpillai)
    1. 🟡 Growth Plus - increasing ease of onboarding, and subsequent retention
    2. 🟡 Analysis Plus - answering more product questions, more deeply
  3. 🟡 ArtificialHog – an LLM-based chat-like interface for answering product questions.

High priority

@EDsCODE
Copy link
Member

EDsCODE commented Sep 11, 2024 •
edited
Loading

Team Data House

OKR Q2 2024

Objective

Query 3000

  • Key Results:
    • Autocomplete
    • Increase general BI experience/product BI meta#157
    • Declutter the data warehouse UI and make the features intuitive to find

Data Modeling MVP

  • Key Results:
    • Infrastructure decided and implemented
    • Integrating external data with feature flags
    • External data everywhere in insights/persons/cohorts
    • Get billing team to use modeling in posthog for their invoices_with_annual table

Retro

  • release data modeling beta. The components for this are in place but got backed up by outages/support
  • Quality improvements
    • first class credential support
    • schema realignment when it's changed for a source (new schema or postgres table etc.)
    • high priority customer support
    • vitaly source
    • conditional formatting (colored labels on revenue charts)
  • memory overuse by temporal workers caused an incident by eating up memory usage on k8s nodes. This is under investigation. I've pinpointed it to some areas of DLT

Priority

  • Data Modeling MVP beta shipped
  • data warehouse data in funnels (+ rest of insights)
  • more of this BI meta#157
  • dashboard filters, links in columns

Needs addressing

  • can't guarantee clickhouse distributed table lag will always be stable so batch exports has a chance at missing events

@marandaneto marandaneto unpinned this issue Sep 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
sprint Sprint planning
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
9 participants
@Phanatic @fuziontech @pauldambra @robbie-c @benjackwhite @Twixes @marandaneto @EDsCODE @raquelmsmith