{"id":124303,"date":"2024-03-18T15:37:13","date_gmt":"2024-03-18T15:37:13","guid":{"rendered":"https:\/\/showbizztoday.com\/index.php\/2024\/03\/18\/sequential-testing-keeps-the-world-streaming-netflix-part-2-counting-processes-by-netflix-technology-blog-mar-2024\/"},"modified":"2024-03-18T15:37:13","modified_gmt":"2024-03-18T15:37:13","slug":"sequential-testing-keeps-the-world-streaming-netflix-part-2-counting-processes-by-netflix-technology-blog-mar-2024","status":"publish","type":"post","link":"https:\/\/showbizztoday.com\/index.php\/2024\/03\/18\/sequential-testing-keeps-the-world-streaming-netflix-part-2-counting-processes-by-netflix-technology-blog-mar-2024\/","title":{"rendered":"Sequential Testing Keeps the World Streaming Netflix Part 2: Counting Processes | by Netflix Technology Blog | Mar, 2024"},"content":{"rendered":"<p> [ad_1]<br \/>\n<\/p>\n<div>\n<p id=\"4241\" class=\"pw-post-body-paragraph mz na gt nb b nc nd ne nf ng nh ni nj nk nl nm nn no np nq nr ns nt nu nv nw gm bj\">The counting processes are features that increment by 1 every time a brand new occasion arrives. Clearly, there are fewer occasions occurring within the therapy than within the management. If these had been login occasions, this might recommend that the brand new code comprises a bug that stops some customers from having the ability to log in efficiently.<\/p>\n<p id=\"8cfb\" class=\"pw-post-body-paragraph mz na gt nb b nc nd ne nf ng nh ni nj nk nl nm nn no np nq nr ns nt nu nv nw gm bj\">This is a standard state of affairs when coping with occasion timestamps. To give one other instance, if occasions corresponded to errors or crashes, we wish to know if these are accruing quicker within the therapy than within the management. Moreover, we need to reply that query <em class=\"om\">as rapidly as doable <\/em>to forestall any additional disruption to the service<em class=\"om\">.<\/em> This necessitates sequential testing strategies which had been launched in <a class=\"af nx\" href=\"https:\/\/medium.com\/p\/cba6c7ed49df\" rel=\"noopener\" target=\"_blank\">half 1<\/a>.<\/p>\n<h2 id=\"71fe\" class=\"oq or gt be os ot ou dx ov ow ox dz oy nk oz pa pb no pc pd pe ns pf pg ph pi bj\"><strong class=\"al\">Time-Inhomogeneous Poisson Process<\/strong><\/h2>\n<p id=\"e0dc\" class=\"pw-post-body-paragraph mz na gt nb b nc pj ne nf ng pk ni nj nk pl nm nn no pm nq nr ns pn nu nv nw gm bj\">Our information for every therapy group is a realization of a one-dimensional level course of, that&#8217;s, a sequence of timestamps. As the speed at which the occasions arrive is time-varying (in each therapy and management), we mannequin the purpose course of as a time-inhomogeneous <a class=\"af nx\" href=\"https:\/\/en.wikipedia.org\/wiki\/Poisson_point_process#Inhomogeneous_Poisson_point_process\" rel=\"noopener ugc nofollow\" target=\"_blank\">Poisson level course of<\/a>. This level course of is outlined by an depth perform \u03bb: \u211d \u2192 [0, \u221e). The number of events in the interval [0,t), denoted N(t), has the following Poisson distribution<\/p>\n<p id=\"abde\" class=\"pw-post-body-paragraph mz na gt nb b nc nd ne nf ng nh ni nj nk nl nm nn no np nq nr ns nt nu nv nw gm bj\">N(t) ~ Poisson(\u039b(t)), where \u039b(t) = \u222b\u2080\u1d57 \u03bb(s) ds.<\/p>\n<p id=\"1c83\" class=\"pw-post-body-paragraph mz na gt nb b nc nd ne nf ng nh ni nj nk nl nm nn no np nq nr ns nt nu nv nw gm bj\">We seek to test the null hypothesis H\u2080: \u03bb\u1d2c(t) = \u03bb\u1d2e(t) for all t i.e. the intensity functions for control (A) and treatment (B) are the same. This can be done semiparametrically without making any assumptions about the intensity functions \u03bb\u1d2c and \u03bb\u1d2e. Moreover, the novelty of the research is that this can be done sequentially, as described in <a class=\"af nx\" href=\"https:\/\/openreview.net\/pdf?id=a4zg0jiuVi\" rel=\"noopener ugc nofollow\" target=\"_blank\">section 4<\/a> of our paper. Conveniently, the only data required to test this hypothesis at time t is N\u1d2c(t) and N\u1d2e(t), the total number of events observed so far in control and treatment. In other words, all you need to test the null hypothesis is two integers, which can easily be updated as new events arrive. Here is an example from a simulated A\/A test, in which we know by design that the intensity function is the same for the control (A) and the treatment (B), albeit nonstationary.<\/p>\n<\/div>\n<p>[ad_2]<\/p>\n","protected":false},"excerpt":{"rendered":"<p>[ad_1] The counting processes are features that increment by 1 every time a brand new occasion arrives. Clearly, there are fewer occasions occurring within the therapy than within the management. If these had been login occasions, this might recommend that the brand new code comprises a bug that stops some customers from having the ability [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":124305,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[37],"tags":[],"class_list":{"0":"post-124303","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-netflix"},"_links":{"self":[{"href":"https:\/\/showbizztoday.com\/index.php\/wp-json\/wp\/v2\/posts\/124303","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/showbizztoday.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/showbizztoday.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/showbizztoday.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/showbizztoday.com\/index.php\/wp-json\/wp\/v2\/comments?post=124303"}],"version-history":[{"count":0,"href":"https:\/\/showbizztoday.com\/index.php\/wp-json\/wp\/v2\/posts\/124303\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/showbizztoday.com\/index.php\/wp-json\/wp\/v2\/media\/124305"}],"wp:attachment":[{"href":"https:\/\/showbizztoday.com\/index.php\/wp-json\/wp\/v2\/media?parent=124303"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/showbizztoday.com\/index.php\/wp-json\/wp\/v2\/categories?post=124303"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/showbizztoday.com\/index.php\/wp-json\/wp\/v2\/tags?post=124303"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}