Page MenuHomePhabricator

lbowmaker (Luke Bowmaker)
Disabled

User Details

User Since
Sep 21 2021, 7:38 PM (163 w, 4 d)
Roles
Disabled
LDAP User
Unknown
MediaWiki User
LBowmaker (WMF) [ Global Accounts ]

Recent Activity

Aug 26 2024

lbowmaker added a comment to T357856: Replace or deprecate WMCS uses of report updater.

@Andrew - this was migrated from ReportUpdater to Airflow

Aug 26 2024, 12:44 PM · cloud-services-team

Jul 30 2024

lbowmaker created T371357: [Request] Support Data Platform Engineering with data usage interviews.
Jul 30 2024, 11:28 AM · Essential-Work, Research

Jul 25 2024

lbowmaker assigned T306896: Integrate Spark with DataHub with lineage to tchin.
Jul 25 2024, 5:21 PM · Data-Engineering (Q2 2024 October 1st - December 31th), Patch-For-Review, Data-Catalog, Data Pipelines
lbowmaker moved T360924: Replace service runner with a simplified library to better support metrics and debugging: service-utils from In progress to Blocked/Paused on the Data-Engineering (Q1 2024 July 1st - September 30th) board.
Jul 25 2024, 4:20 PM · Data-Engineering (Q2 2024 October 1st - December 31th)

Jul 24 2024

lbowmaker moved T370948: Spike: MediaWiki db schema and reconciliation from Incoming to Kanban Board on the Dumps 2.0 board.
Jul 24 2024, 6:54 PM · Dumps 2.0 (Kanban Board)
lbowmaker moved T369900: Develop Airflow ExternalTaskSensor to orchestrate DAG dependencies from Sprint Backlog to In Process on the Dumps 2.0 (Kanban Board) board.
Jul 24 2024, 6:39 PM · Dumps 2.0 (Kanban Board), Data-Engineering (Q1 2024 July 1st - September 30th)
lbowmaker moved T369900: Develop Airflow ExternalTaskSensor to orchestrate DAG dependencies from Incoming to Kanban Board on the Dumps 2.0 board.
Jul 24 2024, 6:39 PM · Dumps 2.0 (Kanban Board), Data-Engineering (Q1 2024 July 1st - September 30th)
lbowmaker added a project to T369900: Develop Airflow ExternalTaskSensor to orchestrate DAG dependencies: Dumps 2.0.
Jul 24 2024, 6:39 PM · Dumps 2.0 (Kanban Board), Data-Engineering (Q1 2024 July 1st - September 30th)

Jul 22 2024

lbowmaker moved T369900: Develop Airflow ExternalTaskSensor to orchestrate DAG dependencies from Next Up to In progress on the Data-Engineering (Q1 2024 July 1st - September 30th) board.
Jul 22 2024, 2:29 PM · Dumps 2.0 (Kanban Board), Data-Engineering (Q1 2024 July 1st - September 30th)
lbowmaker moved T367134: [Refine Refactoring] Changes to EventStreamConfig needed for scheduling Refine via airflow from In progress to In Review on the Data-Engineering (Q1 2024 July 1st - September 30th) board.
Jul 22 2024, 2:07 PM · MW-1.43-notes (1.43.0-wmf.15; 2024-07-23), Data-Engineering (Q1 2024 July 1st - September 30th)
lbowmaker moved T366537: Create gitlab ci npm publish pipeline and job in workflow_utils gitlab_ci_templates from In Review to Done on the Data-Engineering (Q1 2024 July 1st - September 30th) board.
Jul 22 2024, 2:07 PM · Data-Engineering (Q1 2024 July 1st - September 30th)
lbowmaker moved T368753: Implement production mechanism that emits (wiki_db, revision_id) pairs for missing or inaccurate rows from Sprint Backlog to In Process on the Dumps 2.0 (Kanban Board) board.
Jul 22 2024, 1:26 PM · Dumps 2.0 (Kanban Board)
lbowmaker moved T367810: Spike: Can we recreate a skeleton page_change (revision_change) event from DB replica alone? from Code Review / Tech Input to Done on the Dumps 2.0 (Kanban Board) board.
Jul 22 2024, 1:22 PM · Dumps 2.0 (Kanban Board)

Jul 19 2024

lbowmaker added a comment to T309622: Create Airflow Pipeline for Ingesting/Updating Superset data into DataHub.

@Mayakp.wiki I think so, chatted to Ben briefly about this and we probably need to play around with the job when we pick this up as lost of things have changed but ideally we would want charts and dashboards ingested with table lineage. Something like this (but hopefully with the tables used to create the charts):

Jul 19 2024, 2:25 PM · Data-Platform-SRE, Data-Catalog, Patch-For-Review

Jul 18 2024

lbowmaker added a comment to T309622: Create Airflow Pipeline for Ingesting/Updating Superset data into DataHub.

@Mayakp.wiki - updated the description, previous work was done as a one off load. We will look at automating this load now on a more regular basis.

Jul 18 2024, 5:43 PM · Data-Platform-SRE, Data-Catalog, Patch-For-Review
lbowmaker updated the task description for T309622: Create Airflow Pipeline for Ingesting/Updating Superset data into DataHub.
Jul 18 2024, 5:42 PM · Data-Platform-SRE, Data-Catalog, Patch-For-Review
lbowmaker edited projects for T367403: Validate CI integration so that Ci can release Maven artifacts on user's demand, added: Data-Engineering (Q1 2024 July 1st - September 30th); removed Data-Engineering.
Jul 18 2024, 4:28 PM · Discovery-Search (Current work), Release-Engineering-Team (Radar), Data-Engineering (Q1 2024 July 1st - September 30th), Java-Scala-Standardization, Data-Platform-SRE
lbowmaker added a comment to T360794: Implement stream of HTML content on mw.page_change event.

Hi @Isaac - we were hoping to get to this last quarter but didn’t manage to. This quarter, we are now working on the Dumps 2.0 implementation, annual plan KR for data lineage, probably temp account changes now, essential work and lots of vacations in the team.

Jul 18 2024, 1:27 PM · Data-Engineering, Event-Platform
lbowmaker moved T369758: [SPIKE] Define process to build out lineage in DataHub from Q1 2024 July 1st - September 30th to Estimated (To be planned) on the Data-Engineering board.
Jul 18 2024, 1:20 PM · Data-Engineering (Q2 2024 October 1st - December 31th)
lbowmaker added a comment to T369758: [SPIKE] Define process to build out lineage in DataHub.

Moving to backlog for now. We will try this approach first:

Jul 18 2024, 1:19 PM · Data-Engineering (Q2 2024 October 1st - December 31th)
lbowmaker moved T366487: Event Platform schemas should not support type changes to structs as array element or map value types from To be estimated to If we have time on the Data-Engineering (Q1 2024 July 1st - September 30th) board.
Jul 18 2024, 1:17 PM · Data-Engineering, Event-Platform
lbowmaker set the point value for T366487: Event Platform schemas should not support type changes to structs as array element or map value types to 5.
Jul 18 2024, 1:17 PM · Data-Engineering, Event-Platform
lbowmaker moved T362832: Migrate refinery HQL files to CI/CD supported GitLab repository from To be estimated to Next Up on the Data-Engineering (Q1 2024 July 1st - September 30th) board.
Jul 18 2024, 1:17 PM · Data-Engineering (Q2 2024 October 1st - December 31th)
lbowmaker moved T357833: [Data Quality] Implement basic data quality metrics for Unique Devices datasets from To be estimated to If we have time on the Data-Engineering (Q1 2024 July 1st - September 30th) board.
Jul 18 2024, 1:16 PM · Data-Engineering (Q2 2024 October 1st - December 31th), Epic, Movement-Insights
lbowmaker set the point value for T357833: [Data Quality] Implement basic data quality metrics for Unique Devices datasets to 5.
Jul 18 2024, 1:16 PM · Data-Engineering (Q2 2024 October 1st - December 31th), Epic, Movement-Insights
lbowmaker moved T365659: Implement automatic sync of refinery HQL files to HDFS from To be estimated to Next Up on the Data-Engineering (Q1 2024 July 1st - September 30th) board.
Jul 18 2024, 1:14 PM · Data-Engineering (Q2 2024 October 1st - December 31th)
lbowmaker set the point value for T367405: Migrate existing Java packages to deploying to Gitlab, including new version of parent pom, validation that all dependencies are available, and validation that deployment to production still works to 8.
Jul 18 2024, 1:14 PM · Data-Engineering (Q2 2024 October 1st - December 31th), Discovery-Search (Current work), Java-Scala-Standardization, Data-Platform-SRE
lbowmaker set the point value for T362832: Migrate refinery HQL files to CI/CD supported GitLab repository to 5.
Jul 18 2024, 1:13 PM · Data-Engineering (Q2 2024 October 1st - December 31th)
lbowmaker set the point value for T365659: Implement automatic sync of refinery HQL files to HDFS to 13.
Jul 18 2024, 1:12 PM · Data-Engineering (Q2 2024 October 1st - December 31th)
lbowmaker moved T366562: [Event Platform] - Add schema CI test that array ensures properties with object types also enumerate object properties from To be estimated to If we have time on the Data-Engineering (Q1 2024 July 1st - September 30th) board.
Jul 18 2024, 1:12 PM · Data-Engineering (Q1 2024 July 1st - September 30th), Event-Platform
lbowmaker set the point value for T366562: [Event Platform] - Add schema CI test that array ensures properties with object types also enumerate object properties to 3.
Jul 18 2024, 1:12 PM · Data-Engineering (Q1 2024 July 1st - September 30th), Event-Platform
lbowmaker moved T368788: 8 new wikis missing from mediawiki_history from To be estimated to Next Up on the Data-Engineering (Q1 2024 July 1st - September 30th) board.
Jul 18 2024, 1:11 PM · Data-Engineering (Q2 2024 October 1st - December 31th), Data-Platform
lbowmaker set the point value for T368788: 8 new wikis missing from mediawiki_history to 3.
Jul 18 2024, 1:11 PM · Data-Engineering (Q2 2024 October 1st - December 31th), Data-Platform
lbowmaker moved T368944: Improve Airflow DAG testing process from To be estimated to If we have time on the Data-Engineering (Q1 2024 July 1st - September 30th) board.
Jul 18 2024, 1:10 PM · Data-Engineering, Data Pipelines
lbowmaker set the point value for T368944: Improve Airflow DAG testing process to 13.
Jul 18 2024, 1:10 PM · Data-Engineering, Data Pipelines
lbowmaker moved T369845: [Refine Refactoring] Refine jobs should be scheduled by Airflow: deployment from To be estimated to Next Up on the Data-Engineering (Q1 2024 July 1st - September 30th) board.
Jul 18 2024, 1:09 PM · Patch-For-Review, Data-Engineering (Q2 2024 October 1st - December 31th)
lbowmaker set the point value for T369845: [Refine Refactoring] Refine jobs should be scheduled by Airflow: deployment to 13.
Jul 18 2024, 1:09 PM · Patch-For-Review, Data-Engineering (Q2 2024 October 1st - December 31th)
lbowmaker moved T369900: Develop Airflow ExternalTaskSensor to orchestrate DAG dependencies from To be estimated to Next Up on the Data-Engineering (Q1 2024 July 1st - September 30th) board.
Jul 18 2024, 1:09 PM · Dumps 2.0 (Kanban Board), Data-Engineering (Q1 2024 July 1st - September 30th)
lbowmaker set the point value for T369900: Develop Airflow ExternalTaskSensor to orchestrate DAG dependencies to 8.
Jul 18 2024, 1:07 PM · Dumps 2.0 (Kanban Board), Data-Engineering (Q1 2024 July 1st - September 30th)

Jul 17 2024

lbowmaker created T370354: [SPIKE] Experiment with approaches for a incremental updates of MediaWiki data in the Data Lake.
Jul 17 2024, 7:34 PM · Data-Engineering (Q2 2024 October 1st - December 31th), Patch-For-Review, Product-Analytics
lbowmaker updated subscribers of T309622: Create Airflow Pipeline for Ingesting/Updating Superset data into DataHub.

@BTullis @Gehel - could I ask this to be prioritized please or let me know if this is something someone from DE could do. We discussed this in the DPE sync and it seems this might be possible now that Superset is migrated to k8s.

Jul 17 2024, 6:28 PM · Data-Platform-SRE, Data-Catalog, Patch-For-Review
lbowmaker added a subtask for T369756: All things DataHub: T309622: Create Airflow Pipeline for Ingesting/Updating Superset data into DataHub.
Jul 17 2024, 6:21 PM · Data-Engineering, Epic
lbowmaker added a parent task for T309622: Create Airflow Pipeline for Ingesting/Updating Superset data into DataHub: T369756: All things DataHub.
Jul 17 2024, 6:21 PM · Data-Platform-SRE, Data-Catalog, Patch-For-Review
lbowmaker removed a subtask for T369756: All things DataHub: T306896: Integrate Spark with DataHub with lineage.
Jul 17 2024, 6:20 PM · Data-Engineering, Epic
lbowmaker added a subtask for T369758: [SPIKE] Define process to build out lineage in DataHub: T306896: Integrate Spark with DataHub with lineage.
Jul 17 2024, 6:20 PM · Data-Engineering (Q2 2024 October 1st - December 31th)
lbowmaker edited parent tasks for T306896: Integrate Spark with DataHub with lineage, added: T369758: [SPIKE] Define process to build out lineage in DataHub; removed: T369756: All things DataHub.
Jul 17 2024, 6:20 PM · Data-Engineering (Q2 2024 October 1st - December 31th), Patch-For-Review, Data-Catalog, Data Pipelines
lbowmaker edited projects for T306896: Integrate Spark with DataHub with lineage, added: Data-Engineering (Q1 2024 July 1st - September 30th); removed Data-Engineering.
Jul 17 2024, 6:20 PM · Data-Engineering (Q2 2024 October 1st - December 31th), Patch-For-Review, Data-Catalog, Data Pipelines
lbowmaker added a parent task for T306896: Integrate Spark with DataHub with lineage: T369756: All things DataHub.
Jul 17 2024, 6:16 PM · Data-Engineering (Q2 2024 October 1st - December 31th), Patch-For-Review, Data-Catalog, Data Pipelines
lbowmaker added a subtask for T369756: All things DataHub: T306896: Integrate Spark with DataHub with lineage.
Jul 17 2024, 6:16 PM · Data-Engineering, Epic

Jul 16 2024

lbowmaker added a project to T370108: Missed pageview data over API: Data Products.
Jul 16 2024, 12:44 PM · Data-Engineering, Analytics-Data-Problem, Data Products, Pageviews-API

Jul 15 2024

lbowmaker edited projects for T360968: [Developer Experience] [SPIKE] Investigate process to automate deployment of folders and artifacts to HDFS, added: Data-Engineering (Q1 2024 July 1st - September 30th); removed Data-Engineering (Q4 2024 April 1st - June 30th).
Jul 15 2024, 7:54 PM · Data-Engineering (Q1 2024 July 1st - September 30th), Release-Engineering-Team, Spike
lbowmaker archived Data-Engineering (Q4 2024 April 1st - June 30th).
Jul 15 2024, 7:53 PM
lbowmaker moved T363587: [Event Platform] Instrument EventBus with prometheus MW Statslib from In progress to In Review on the Data-Engineering (Q1 2024 July 1st - September 30th) board.
Jul 15 2024, 7:52 PM · MW-1.43-notes (1.43.0-wmf.22; 2024-09-10), Patch-For-Review, Data-Engineering (Q1 2024 July 1st - September 30th), Dumps 2.0 (Kanban Board), Event-Platform
lbowmaker moved T361509: [Spike] Define technology roadmap around Airflow / k8s / ceph from Q4 2024 April 1st - June 30th to Estimated (To be planned) on the Data-Engineering board.
Jul 15 2024, 2:39 PM · Data-Engineering
lbowmaker moved T357468: [Dataset Config Store] Setup initial CI checks from Q4 2024 April 1st - June 30th to Dataset Config Store on the Data-Engineering board.
Jul 15 2024, 2:39 PM · Data-Engineering
lbowmaker moved T361770: Support metrics platform backend migration to new service runner from Q4 2024 April 1st - June 30th to Estimated (To be planned) on the Data-Engineering board.
Jul 15 2024, 2:39 PM · Data-Engineering
lbowmaker moved T361768: Migrate and re-deploy eventgate using new service runner from Q4 2024 April 1st - June 30th to Maintenance on the Data-Engineering board.
Jul 15 2024, 2:39 PM · Data-Engineering
lbowmaker moved T356866: [Data Quality] Update data_quality schemas to be compatible with Iceberg tables from Q4 2024 April 1st - June 30th to Q1 2024 July 1st - September 30th on the Data-Engineering board.
Jul 15 2024, 2:38 PM · Data-Engineering (Q2 2024 October 1st - December 31th), Dumps 2.0 (Kanban Board)
lbowmaker moved T358210: Delete reportupdater jobs data/puppet-code from Q4 2024 April 1st - June 30th to Estimated (To be planned) on the Data-Engineering board.
Jul 15 2024, 2:38 PM · Data-Engineering
lbowmaker closed T357938: [Maintenance] Migrate wmcs to Airflow, a subtask of T307540: [Airflow Migration] Migrate reportupdater jobs, as Resolved.
Jul 15 2024, 2:38 PM · Data-Engineering, Data Pipelines
lbowmaker moved T360896: [SPIKE] [Dataset Config Store] - Design how config store feeds DataHub from Q4 2024 April 1st - June 30th to Dataset Config Store on the Data-Engineering board.
Jul 15 2024, 2:38 PM · Data-Engineering, Spike
lbowmaker closed T357938: [Maintenance] Migrate wmcs to Airflow as Resolved.
Jul 15 2024, 2:38 PM · Data-Engineering (Q4 2024 April 1st - June 30th)
lbowmaker moved T305688: Make HTML Dumps available in hadoop from Q4 2024 April 1st - June 30th to Estimated (To be planned) on the Data-Engineering board.
Jul 15 2024, 2:38 PM · Data-Engineering, Research, Structured-Data-Backlog
lbowmaker moved T360794: Implement stream of HTML content on mw.page_change event from Q4 2024 April 1st - June 30th to Estimated (To be planned) on the Data-Engineering board.
Jul 15 2024, 2:35 PM · Data-Engineering, Event-Platform
lbowmaker moved T361503: [Spike] [Maintenance] Define late arrival event strategy and idem-potent backfilling concept. from Q4 2024 April 1st - June 30th to Estimated (To be planned) on the Data-Engineering board.
Jul 15 2024, 2:35 PM · Data-Engineering
lbowmaker moved T361507: [Spike] List out SystemD timers migration targets from Q4 2024 April 1st - June 30th to Estimated (To be planned) on the Data-Engineering board.
Jul 15 2024, 2:35 PM · Data-Engineering
lbowmaker moved T360210: Document instructions for deleting an event stream and its usages from Q4 2024 April 1st - June 30th to Estimated (To be planned) on the Data-Engineering board.
Jul 15 2024, 2:35 PM · Data-Engineering, Metrics Platform, Event-Platform
lbowmaker moved T361014: [Data Quality] Migrate the anomaly detection job to DeeQu checks from Q4 2024 April 1st - June 30th to Data Quality on the Data-Engineering board.
Jul 15 2024, 2:35 PM · Data-Engineering
lbowmaker moved T306896: Integrate Spark with DataHub with lineage from Q4 2024 April 1st - June 30th to Data Lineage on the Data-Engineering board.
Jul 15 2024, 2:34 PM · Data-Engineering (Q2 2024 October 1st - December 31th), Patch-For-Review, Data-Catalog, Data Pipelines
lbowmaker moved T362291: [Datasets Config] Define and implement SLOs, monitoring and logging from Q4 2024 April 1st - June 30th to Dataset Config Store on the Data-Engineering board.
Jul 15 2024, 2:34 PM · Data-Engineering
lbowmaker moved T368176: [Dumps 2] Spike: Figure root causes of missing rows when doing reconciliation from Incoming (new tickets) to Event Platform Backlog on the Data-Engineering board.
Jul 15 2024, 2:33 PM · Event-Platform, Data-Engineering, Dumps 2.0 (Kanban Board)
lbowmaker moved T369492: Migrate dse cluster off of Pod Security Policies from Incoming (new tickets) to Radar (External Teams) on the Data-Engineering board.
Jul 15 2024, 2:33 PM · Data-Platform-SRE (2024.09.06 - 2024.09.27), Data-Engineering, Kubernetes
lbowmaker moved T369649: Remove stale GDI Equity Landscape jobs. from Incoming (new tickets) to Radar (External Teams) on the Data-Engineering board.
Jul 15 2024, 2:33 PM · Data-Engineering (Q2 2024 October 1st - December 31th)
lbowmaker moved T369851: NEW BUG REPORT Mediawiki_history contains duplicate rows for some revisions from Incoming (new tickets) to Q1 2024 July 1st - September 30th on the Data-Engineering board.
Jul 15 2024, 2:33 PM · Data-Engineering (Q1 2024 July 1st - September 30th), Movement-Insights, Analytics-Data-Problem, Data-Platform
lbowmaker moved T369756: All things DataHub from Incoming (new tickets) to Data Lineage on the Data-Engineering board.
Jul 15 2024, 2:33 PM · Data-Engineering, Epic
lbowmaker moved T369829: Degraded RAID on dumpsdata1007 from Incoming (new tickets) to Radar (External Teams) on the Data-Engineering board.
Jul 15 2024, 2:33 PM · Data-Platform-SRE, Data-Engineering, DC-Ops, SRE, ops-eqiad
lbowmaker moved T369851: NEW BUG REPORT Mediawiki_history contains duplicate rows for some revisions from Next Up to In progress on the Data-Engineering (Q1 2024 July 1st - September 30th) board.
Jul 15 2024, 2:32 PM · Data-Engineering (Q1 2024 July 1st - September 30th), Movement-Insights, Analytics-Data-Problem, Data-Platform
lbowmaker moved T365658: Update Airflow Developer Guide on WikiTech from Q4 2024 April 1st - June 30th to Maintenance on the Data-Engineering board.
Jul 15 2024, 2:32 PM · Data-Engineering
lbowmaker moved T365829: Fix DPE alerts dashboard to work with Google Groups from Q4 2024 April 1st - June 30th to Maintenance on the Data-Engineering board.
Jul 15 2024, 2:31 PM · Data-Engineering
lbowmaker edited projects for T367923: Event validation errors for mediawiki.page_change.v1 due to missing performer field on revision suppressions, added: Data-Engineering (Q1 2024 July 1st - September 30th); removed Data-Engineering (Q4 2024 April 1st - June 30th).
Jul 15 2024, 2:31 PM · Data-Engineering (Q1 2024 July 1st - September 30th), MW-1.43-notes (1.43.0-wmf.11; 2024-06-25), Event-Platform
lbowmaker moved T363587: [Event Platform] Instrument EventBus with prometheus MW Statslib from In Process to To Deploy on the Dumps 2.0 (Kanban Board) board.
Jul 15 2024, 2:27 PM · MW-1.43-notes (1.43.0-wmf.22; 2024-09-10), Patch-For-Review, Data-Engineering (Q1 2024 July 1st - September 30th), Dumps 2.0 (Kanban Board), Event-Platform
lbowmaker edited projects for T266641: [Data Platform] Test Alluxio as cache layer for Presto, added: Data-Engineering (Q1 2024 July 1st - September 30th); removed Data-Engineering (Q4 2024 April 1st - June 30th).
Jul 15 2024, 2:27 PM · Data-Engineering, Data-Platform-SRE, Patch-For-Review
lbowmaker edited projects for T338796: Rewrite all Airflow sensors that use datacenter prepartitions to depend on both datacenters, added: Data-Engineering (Q1 2024 July 1st - September 30th); removed Data-Engineering (Q4 2024 April 1st - June 30th).
Jul 15 2024, 2:26 PM · Data-Engineering, Data Products (Data Products Sprint 05), serviceops-radar
lbowmaker moved T368782: MediaWiki Reconciliation API from Sprint Backlog to In Process on the Dumps 2.0 (Kanban Board) board.
Jul 15 2024, 2:26 PM · Data-Engineering (Q2 2024 October 1st - December 31th), Patch-For-Review, Dumps 2.0 (Kanban Board)
lbowmaker edited projects for T347561: [Maintenance] Set up deletion jobs for Structured Data's data pipelines, added: Data-Engineering (Q1 2024 July 1st - September 30th); removed Data-Engineering (Q4 2024 April 1st - June 30th).
Jul 15 2024, 2:25 PM · Data-Engineering, Structured-Data-Backlog
lbowmaker assigned T368782: MediaWiki Reconciliation API to gmodena.
Jul 15 2024, 2:25 PM · Data-Engineering (Q2 2024 October 1st - December 31th), Patch-For-Review, Dumps 2.0 (Kanban Board)
lbowmaker edited projects for T360924: Replace service runner with a simplified library to better support metrics and debugging: service-utils, added: Data-Engineering (Q1 2024 July 1st - September 30th); removed Data-Engineering (Q4 2024 April 1st - June 30th).
Jul 15 2024, 2:25 PM · Data-Engineering (Q2 2024 October 1st - December 31th)
lbowmaker edited projects for T347430: [Data Platform] Install a Prometheus connector for Presto, pointed at thanos-query, added: Data-Engineering (Q1 2024 July 1st - September 30th); removed Data-Engineering (Q4 2024 April 1st - June 30th).
Jul 15 2024, 2:25 PM · Data-Engineering, Data-Platform-SRE, SRE Observability
lbowmaker edited projects for T356362: [Refine Refactoring] [Spike] Define a concept and provide a PoC for dynamic DAG execution in Airflow, added: Data-Engineering (Q1 2024 July 1st - September 30th); removed Data-Engineering (Q4 2024 April 1st - June 30th).
Jul 15 2024, 2:25 PM · Data-Engineering (Q1 2024 July 1st - September 30th)
lbowmaker edited projects for T357430: Airflow mapped tasks UI & metrics, added: Data-Engineering (Q1 2024 July 1st - September 30th); removed Data-Engineering (Q4 2024 April 1st - June 30th).
Jul 15 2024, 2:24 PM · Data-Engineering (Q2 2024 October 1st - December 31th)
lbowmaker edited projects for T354694: [Maintenance] Safeguard VarnishKafka to HAProxy analytics transition, added: Data-Engineering (Q1 2024 July 1st - September 30th); removed Data-Engineering (Q4 2024 April 1st - June 30th).
Jul 15 2024, 2:24 PM · Patch-For-Review, Data-Engineering (Q2 2024 October 1st - December 31th), Epic
lbowmaker edited projects for T362785: Add host level instrumentation on webrequest, added: Data-Engineering (Q1 2024 July 1st - September 30th); removed Data-Engineering (Q4 2024 April 1st - June 30th).
Jul 15 2024, 2:19 PM · Data-Engineering (Q1 2024 July 1st - September 30th), Patch-For-Review
lbowmaker edited projects for T362783: Add instrumentation for actor signatures, added: Data-Engineering (Q1 2024 July 1st - September 30th); removed Data-Engineering (Q4 2024 April 1st - June 30th).
Jul 15 2024, 2:18 PM · Data-Engineering (Q1 2024 July 1st - September 30th), Patch-For-Review
lbowmaker edited projects for T360922: [Status Store] [SPIKE] Investigate and document approach for Iceberg Sensors, added: Data-Engineering (Q1 2024 July 1st - September 30th); removed Data-Engineering (Q4 2024 April 1st - June 30th).
Jul 15 2024, 2:18 PM · Data-Engineering (Q2 2024 October 1st - December 31th), Dumps 2.0 (Kanban Board), Spike
lbowmaker moved T360922: [Status Store] [SPIKE] Investigate and document approach for Iceberg Sensors from Next Up to In Review on the Data-Engineering (Q4 2024 April 1st - June 30th) board.
Jul 15 2024, 2:16 PM · Data-Engineering (Q2 2024 October 1st - December 31th), Dumps 2.0 (Kanban Board), Spike
lbowmaker closed T357434: [Dataset Config Store] Deploy poc to dse-k8s as Resolved.
Jul 15 2024, 2:15 PM · Data-Engineering (Q4 2024 April 1st - June 30th)
lbowmaker closed T357434: [Dataset Config Store] Deploy poc to dse-k8s, a subtask of T354557: Dataset Config Store, as Resolved.
Jul 15 2024, 2:15 PM · Epic, Data-Engineering
lbowmaker updated the task description for T357434: [Dataset Config Store] Deploy poc to dse-k8s.
Jul 15 2024, 2:15 PM · Data-Engineering (Q4 2024 April 1st - June 30th)
lbowmaker closed T361853: [Datasets Config][Spike] Understand and document the details and conflicts between Datasets Config, Refine refactor, Dynamic EventStreamConfig, and Metrics Platform Instrumentation Configurator, a subtask of T356762: [Refine refactoring] Refine jobs should be scheduled by Airflow: implementation, as Resolved.
Jul 15 2024, 2:15 PM · Data-Engineering (Q2 2024 October 1st - December 31th), Patch-For-Review
lbowmaker closed T361853: [Datasets Config][Spike] Understand and document the details and conflicts between Datasets Config, Refine refactor, Dynamic EventStreamConfig, and Metrics Platform Instrumentation Configurator, a subtask of T354557: Dataset Config Store, as Resolved.
Jul 15 2024, 2:15 PM · Epic, Data-Engineering