{"id":10980,"date":"2022-11-09T15:11:57","date_gmt":"2022-11-09T15:11:57","guid":{"rendered":"https:\/\/build.pamco.co.uk\/?page_id=10980"},"modified":"2023-04-05T07:48:11","modified_gmt":"2023-04-05T07:48:11","slug":"statistical-significance","status":"publish","type":"page","link":"https:\/\/pamco.co.uk\/methodology\/fieldwork-and-response-rates\/statistical-significance\/","title":{"rendered":"Statistical significance"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-page\" data-elementor-id=\"10980\" class=\"elementor elementor-10980\" data-elementor-post-type=\"page\">\n\t\t\t\t\t\t<div class=\"elementor-inner\">\n\t\t\t\t<div class=\"elementor-section-wrap\">\n\t\t\t\t\t\t\t\t\t<section data-dce-background-image-url=\"https:\/\/build.pamco.co.uk\/wp-content\/uploads\/2022\/11\/unsplash_Q1p7bh3SHj8.png\" class=\"elementor-section elementor-top-section elementor-element elementor-element-dd7846b elementor-section-height-min-height elementor-section-content-top elementor-section-boxed elementor-section-height-default elementor-section-items-middle\" data-id=\"dd7846b\" data-element_type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t\t\t<div class=\"elementor-row\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-80c98fd\" data-id=\"80c98fd\" data-element_type=\"column\">\n\t\t\t<div class=\"elementor-column-wrap elementor-element-populated\">\n\t\t\t\t\t\t\t<div class=\"elementor-widget-wrap\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-486e33e elementor-widget elementor-widget-heading\" data-id=\"486e33e\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Statistical significance<\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-e95a874 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"e95a874\" data-element_type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t\t\t<div class=\"elementor-row\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-72f6b86\" data-id=\"72f6b86\" data-element_type=\"column\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t<div class=\"elementor-column-wrap elementor-element-populated\">\n\t\t\t\t\t\t\t<div class=\"elementor-widget-wrap\">\n\t\t\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-eea8d98 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"eea8d98\" data-element_type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t\t\t<div class=\"elementor-row\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-436c347\" data-id=\"436c347\" data-element_type=\"column\">\n\t\t\t<div class=\"elementor-column-wrap elementor-element-populated\">\n\t\t\t\t\t\t\t<div class=\"elementor-widget-wrap\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-6e21f29 elementor-widget elementor-widget-text-editor\" data-id=\"6e21f29\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t<div class=\"elementor-text-editor elementor-clearfix\">\n\t\t\t\tAll estimates based on a sample are subject to what is known as \u2018sample variation\u2019. However tightly controlled, the answers from one sample of people will differ somewhat from another sample of people drawn in exactly the same way.\t\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-2d05a94 elementor-widget elementor-widget-text-editor\" data-id=\"2d05a94\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t<div class=\"elementor-text-editor elementor-clearfix\">\n\t\t\t\t<p>There are various statistical tests which can be used to assess whether changes in PAMCo data from period to period (or between publications) are actually real changes rather than the result of sample variation. For any estimate taken from PAMCo it is possible to work out a \u2018confidence limit\u2019. This is a way of expressing how much variation we might expect. For instance:<\/p>\n<ul>\n<li>Magazine X has estimated readership of 1,900,000 adults (3.5% of adults)<\/li>\n<li>The 95% confidence limits for this estimate are +\/- 120,000<\/li>\n<li>This means we can be 95% certain that the true estimate for Magazine X is between 2,020,000 and 1,780,000 (3.3% to 3.7% of adults)<\/li>\n<\/ul>\n<p>PAMCo has created&nbsp;two easy-to-use spreadsheets&nbsp;to:<\/p>\n<ul>\n<li>Find out the confidence limits for a particular estimate, be it readership or any other estimate on the survey.<\/li>\n<li>Find out whether the difference between two estimates is statistically significant<\/li>\n<\/ul>\n<p>All users need to do is to enter the estimates they wish to test into the boxes shown on the spreadsheet, along with the population and sample size on which the estimates are based.<\/p>\t\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-7250c73 elementor-widget elementor-widget-button\" data-id=\"7250c73\" data-element_type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm\" href=\"https:\/\/pamco.co.uk\/wp-content\/uploads\/2023\/04\/statistical-tests-spreadsheet-PAMCo-March-2023.xls\" target=\"_blank\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t<span class=\"elementor-button-text\">Download Spreadsheets<\/span>\n\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>All estimates based on a sample are subject to what is known as \u2018sample variation\u2019. However tightly controlled, the answers from one sample of people will differ somewhat from another sample of people drawn in exactly the same way. There are various statistical tests which can be used to assess whether changes in PAMCo data [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":10968,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v21.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Statistical significance - PAMCo<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/pamco.co.uk\/methodology\/fieldwork-and-response-rates\/statistical-significance\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Statistical significance - PAMCo\" \/>\n<meta property=\"og:description\" content=\"All estimates based on a sample are subject to what is known as \u2018sample variation\u2019. However tightly controlled, the answers from one sample of people will differ somewhat from another sample of people drawn in exactly the same way. There are various statistical tests which can be used to assess whether changes in PAMCo data [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/pamco.co.uk\/methodology\/fieldwork-and-response-rates\/statistical-significance\/\" \/>\n<meta property=\"og:site_name\" content=\"PAMCo\" \/>\n<meta property=\"article:modified_time\" content=\"2023-04-05T07:48:11+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/pamco.co.uk\/wp-content\/uploads\/2023\/04\/PAMCo-Logo-Final.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"848\" \/>\n\t<meta property=\"og:image:height\" content=\"600\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/pamco.co.uk\/methodology\/fieldwork-and-response-rates\/statistical-significance\/\",\"url\":\"https:\/\/pamco.co.uk\/methodology\/fieldwork-and-response-rates\/statistical-significance\/\",\"name\":\"Statistical significance - PAMCo\",\"isPartOf\":{\"@id\":\"https:\/\/pamco.co.uk\/#website\"},\"datePublished\":\"2022-11-09T15:11:57+00:00\",\"dateModified\":\"2023-04-05T07:48:11+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/pamco.co.uk\/methodology\/fieldwork-and-response-rates\/statistical-significance\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/pamco.co.uk\/methodology\/fieldwork-and-response-rates\/statistical-significance\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/pamco.co.uk\/methodology\/fieldwork-and-response-rates\/statistical-significance\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/pamco.co.uk\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Methodology\",\"item\":\"https:\/\/pamco.co.uk\/methodology\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Fieldwork and response rates\",\"item\":\"https:\/\/pamco.co.uk\/methodology\/fieldwork-and-response-rates\/\"},{\"@type\":\"ListItem\",\"position\":4,\"name\":\"Statistical significance\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/pamco.co.uk\/#website\",\"url\":\"https:\/\/pamco.co.uk\/\",\"name\":\"PAMCo\",\"description\":\"Audience Measurement for Publishers\",\"publisher\":{\"@id\":\"https:\/\/pamco.co.uk\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/pamco.co.uk\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/pamco.co.uk\/#organization\",\"name\":\"PAMCo\",\"url\":\"https:\/\/pamco.co.uk\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/pamco.co.uk\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/pamco.co.uk\/wp-content\/uploads\/2022\/11\/PAMCo-Logo-Final.svg\",\"contentUrl\":\"https:\/\/pamco.co.uk\/wp-content\/uploads\/2022\/11\/PAMCo-Logo-Final.svg\",\"width\":545,\"height\":153,\"caption\":\"PAMCo\"},\"image\":{\"@id\":\"https:\/\/pamco.co.uk\/#\/schema\/logo\/image\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Statistical significance - PAMCo","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/pamco.co.uk\/methodology\/fieldwork-and-response-rates\/statistical-significance\/","og_locale":"en_GB","og_type":"article","og_title":"Statistical significance - PAMCo","og_description":"All estimates based on a sample are subject to what is known as \u2018sample variation\u2019. However tightly controlled, the answers from one sample of people will differ somewhat from another sample of people drawn in exactly the same way. There are various statistical tests which can be used to assess whether changes in PAMCo data [&hellip;]","og_url":"https:\/\/pamco.co.uk\/methodology\/fieldwork-and-response-rates\/statistical-significance\/","og_site_name":"PAMCo","article_modified_time":"2023-04-05T07:48:11+00:00","og_image":[{"width":848,"height":600,"url":"https:\/\/pamco.co.uk\/wp-content\/uploads\/2023\/04\/PAMCo-Logo-Final.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Estimated reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/pamco.co.uk\/methodology\/fieldwork-and-response-rates\/statistical-significance\/","url":"https:\/\/pamco.co.uk\/methodology\/fieldwork-and-response-rates\/statistical-significance\/","name":"Statistical significance - PAMCo","isPartOf":{"@id":"https:\/\/pamco.co.uk\/#website"},"datePublished":"2022-11-09T15:11:57+00:00","dateModified":"2023-04-05T07:48:11+00:00","breadcrumb":{"@id":"https:\/\/pamco.co.uk\/methodology\/fieldwork-and-response-rates\/statistical-significance\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/pamco.co.uk\/methodology\/fieldwork-and-response-rates\/statistical-significance\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/pamco.co.uk\/methodology\/fieldwork-and-response-rates\/statistical-significance\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/pamco.co.uk\/"},{"@type":"ListItem","position":2,"name":"Methodology","item":"https:\/\/pamco.co.uk\/methodology\/"},{"@type":"ListItem","position":3,"name":"Fieldwork and response rates","item":"https:\/\/pamco.co.uk\/methodology\/fieldwork-and-response-rates\/"},{"@type":"ListItem","position":4,"name":"Statistical significance"}]},{"@type":"WebSite","@id":"https:\/\/pamco.co.uk\/#website","url":"https:\/\/pamco.co.uk\/","name":"PAMCo","description":"Audience Measurement for Publishers","publisher":{"@id":"https:\/\/pamco.co.uk\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/pamco.co.uk\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/pamco.co.uk\/#organization","name":"PAMCo","url":"https:\/\/pamco.co.uk\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/pamco.co.uk\/#\/schema\/logo\/image\/","url":"https:\/\/pamco.co.uk\/wp-content\/uploads\/2022\/11\/PAMCo-Logo-Final.svg","contentUrl":"https:\/\/pamco.co.uk\/wp-content\/uploads\/2022\/11\/PAMCo-Logo-Final.svg","width":545,"height":153,"caption":"PAMCo"},"image":{"@id":"https:\/\/pamco.co.uk\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/pamco.co.uk\/wp-json\/wp\/v2\/pages\/10980"}],"collection":[{"href":"https:\/\/pamco.co.uk\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/pamco.co.uk\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/pamco.co.uk\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/pamco.co.uk\/wp-json\/wp\/v2\/comments?post=10980"}],"version-history":[{"count":34,"href":"https:\/\/pamco.co.uk\/wp-json\/wp\/v2\/pages\/10980\/revisions"}],"predecessor-version":[{"id":25387,"href":"https:\/\/pamco.co.uk\/wp-json\/wp\/v2\/pages\/10980\/revisions\/25387"}],"up":[{"embeddable":true,"href":"https:\/\/pamco.co.uk\/wp-json\/wp\/v2\/pages\/10968"}],"wp:attachment":[{"href":"https:\/\/pamco.co.uk\/wp-json\/wp\/v2\/media?parent=10980"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}