{"id":411823,"date":"2020-10-15T00:00:00","date_gmt":"2020-10-15T00:00:00","guid":{"rendered":"https:\/\/adevinta.es\/stories\/articles\/spark-unit-integration-and-end-to-end-tests-by-gustavo-martin"},"modified":"2020-10-15T00:00:00","modified_gmt":"2020-10-15T00:00:00","slug":"spark-unit-integration-and-end-to-end-tests-by-gustavo-martin","status":"publish","type":"story","link":"https:\/\/adevinta.com\/es\/cuentos\/articulos\/spark-unit-integration-and-end-to-end-tests-by-gustavo-martin\/","title":{"rendered":"Spark: unit, integration and end-to-end tests by Gustavo Martin"},"content":{"rendered":"<p>&nbsp;<\/p>\n<h2>Spark: unit, integration and end-to-end tests<\/h2>\n<p>In this article Gustavo Martin,\u00a0 Senior Data Engineer, explains the way Spark tests are run at <strong>Adevinta Spain<\/strong>. Hopefully, it will be useful for other big data developers seeking for <strong>ways to improve the quality of their code<\/strong> and at the same time <strong>their CI pipelines.<\/strong> Article in our dev.to account. <a href=\"https:\/\/dev.to\/adevintaspain\/spark-unit-integration-and-end-to-end-tests-f52\" target=\"_blank\" rel=\"noopener noreferrer\">Read here<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>&nbsp; Spark: unit, integration and end-to-end tests In this article Gustavo Martin,\u00a0 Senior Data Engineer, explains the way Spark tests are run at Adevinta Spain. Hopefully, it will be useful for other big data developers seeking for ways to improve the quality of their code and at the same time their CI pipelines. Article in [&hellip;]<\/p>\n","protected":false},"featured_media":213174,"template":"","categories":[],"classification":[146],"culture":[],"class_list":["post-411823","story","type-story","status-publish","has-post-thumbnail","hentry","classification-noticias-corporativas"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v27.9 (Yoast SEO v27.9) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Spark: unit, integration and end-to-end tests by Gustavo Martin - Adevinta<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/adevinta.com\/es\/cuentos\/articulos\/spark-unit-integration-and-end-to-end-tests-by-gustavo-martin\/\" \/>\n<meta property=\"og:locale\" content=\"es_ES\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Spark: unit, integration and end-to-end tests by Gustavo Martin\" \/>\n<meta property=\"og:description\" content=\"&nbsp; Spark: unit, integration and end-to-end tests In this article Gustavo Martin,\u00a0 Senior Data Engineer, explains the way Spark tests are run at Adevinta Spain. Hopefully, it will be useful for other big data developers seeking for ways to improve the quality of their code and at the same time their CI pipelines. Article in [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/adevinta.com\/es\/cuentos\/articulos\/spark-unit-integration-and-end-to-end-tests-by-gustavo-martin\/\" \/>\n<meta property=\"og:site_name\" content=\"Adevinta\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.linkedin.com\/company\/adevinta\/\" \/>\n<meta property=\"og:image\" content=\"https:\/\/adevinta.com\/wp-content\/uploads\/2020\/10\/Spark-unit-integration-and-end-to-end-tests-by-Gustavo-Martin.png\" \/>\n\t<meta property=\"og:image:width\" content=\"2374\" \/>\n\t<meta property=\"og:image:height\" content=\"1335\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/adevinta.com\\\/es\\\/cuentos\\\/articulos\\\/spark-unit-integration-and-end-to-end-tests-by-gustavo-martin\\\/\",\"url\":\"https:\\\/\\\/adevinta.com\\\/es\\\/cuentos\\\/articulos\\\/spark-unit-integration-and-end-to-end-tests-by-gustavo-martin\\\/\",\"name\":\"Spark: unit, integration and end-to-end tests by Gustavo Martin - Adevinta\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/adevinta.com\\\/es\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/adevinta.com\\\/es\\\/cuentos\\\/articulos\\\/spark-unit-integration-and-end-to-end-tests-by-gustavo-martin\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/adevinta.com\\\/es\\\/cuentos\\\/articulos\\\/spark-unit-integration-and-end-to-end-tests-by-gustavo-martin\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/adevinta.com\\\/wp-content\\\/uploads\\\/2020\\\/10\\\/Spark-unit-integration-and-end-to-end-tests-by-Gustavo-Martin.png\",\"datePublished\":\"2020-10-15T00:00:00+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/adevinta.com\\\/es\\\/cuentos\\\/articulos\\\/spark-unit-integration-and-end-to-end-tests-by-gustavo-martin\\\/#breadcrumb\"},\"inLanguage\":\"es\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/adevinta.com\\\/es\\\/cuentos\\\/articulos\\\/spark-unit-integration-and-end-to-end-tests-by-gustavo-martin\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"es\",\"@id\":\"https:\\\/\\\/adevinta.com\\\/es\\\/cuentos\\\/articulos\\\/spark-unit-integration-and-end-to-end-tests-by-gustavo-martin\\\/#primaryimage\",\"url\":\"https:\\\/\\\/adevinta.com\\\/wp-content\\\/uploads\\\/2020\\\/10\\\/Spark-unit-integration-and-end-to-end-tests-by-Gustavo-Martin.png\",\"contentUrl\":\"https:\\\/\\\/adevinta.com\\\/wp-content\\\/uploads\\\/2020\\\/10\\\/Spark-unit-integration-and-end-to-end-tests-by-Gustavo-Martin.png\",\"width\":2374,\"height\":1335},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/adevinta.com\\\/es\\\/cuentos\\\/articulos\\\/spark-unit-integration-and-end-to-end-tests-by-gustavo-martin\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/adevinta.com\\\/es\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Historias\",\"item\":\"https:\\\/\\\/adevinta.com\\\/es\\\/cuentos\\\/articulos\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Spark: unit, integration and end-to-end tests by Gustavo Martin\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/adevinta.com\\\/es\\\/#website\",\"url\":\"https:\\\/\\\/adevinta.com\\\/es\\\/\",\"name\":\"Adevinta\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\\\/\\\/adevinta.com\\\/es\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/adevinta.com\\\/es\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"es\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/adevinta.com\\\/es\\\/#organization\",\"name\":\"Adevinta\",\"url\":\"https:\\\/\\\/adevinta.com\\\/es\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"es\",\"@id\":\"https:\\\/\\\/adevinta.com\\\/es\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/adevinta.com\\\/wp-content\\\/uploads\\\/2024\\\/03\\\/adevinta_logo_blue.png\",\"contentUrl\":\"https:\\\/\\\/adevinta.com\\\/wp-content\\\/uploads\\\/2024\\\/03\\\/adevinta_logo_blue.png\",\"width\":7680,\"height\":4320,\"caption\":\"Adevinta\"},\"image\":{\"@id\":\"https:\\\/\\\/adevinta.com\\\/es\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.linkedin.com\\\/company\\\/adevinta\\\/\",\"https:\\\/\\\/www.instagram.com\\\/adevintalife\\\/\"]}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Spark: unit, integration and end-to-end tests by Gustavo Martin - Adevinta","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/adevinta.com\/es\/cuentos\/articulos\/spark-unit-integration-and-end-to-end-tests-by-gustavo-martin\/","og_locale":"es_ES","og_type":"article","og_title":"Spark: unit, integration and end-to-end tests by Gustavo Martin","og_description":"&nbsp; Spark: unit, integration and end-to-end tests In this article Gustavo Martin,\u00a0 Senior Data Engineer, explains the way Spark tests are run at Adevinta Spain. Hopefully, it will be useful for other big data developers seeking for ways to improve the quality of their code and at the same time their CI pipelines. Article in [&hellip;]","og_url":"https:\/\/adevinta.com\/es\/cuentos\/articulos\/spark-unit-integration-and-end-to-end-tests-by-gustavo-martin\/","og_site_name":"Adevinta","article_publisher":"https:\/\/www.linkedin.com\/company\/adevinta\/","og_image":[{"width":2374,"height":1335,"url":"https:\/\/adevinta.com\/wp-content\/uploads\/2020\/10\/Spark-unit-integration-and-end-to-end-tests-by-Gustavo-Martin.png","type":"image\/png"}],"twitter_card":"summary_large_image","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/adevinta.com\/es\/cuentos\/articulos\/spark-unit-integration-and-end-to-end-tests-by-gustavo-martin\/","url":"https:\/\/adevinta.com\/es\/cuentos\/articulos\/spark-unit-integration-and-end-to-end-tests-by-gustavo-martin\/","name":"Spark: unit, integration and end-to-end tests by Gustavo Martin - Adevinta","isPartOf":{"@id":"https:\/\/adevinta.com\/es\/#website"},"primaryImageOfPage":{"@id":"https:\/\/adevinta.com\/es\/cuentos\/articulos\/spark-unit-integration-and-end-to-end-tests-by-gustavo-martin\/#primaryimage"},"image":{"@id":"https:\/\/adevinta.com\/es\/cuentos\/articulos\/spark-unit-integration-and-end-to-end-tests-by-gustavo-martin\/#primaryimage"},"thumbnailUrl":"https:\/\/adevinta.com\/wp-content\/uploads\/2020\/10\/Spark-unit-integration-and-end-to-end-tests-by-Gustavo-Martin.png","datePublished":"2020-10-15T00:00:00+00:00","breadcrumb":{"@id":"https:\/\/adevinta.com\/es\/cuentos\/articulos\/spark-unit-integration-and-end-to-end-tests-by-gustavo-martin\/#breadcrumb"},"inLanguage":"es","potentialAction":[{"@type":"ReadAction","target":["https:\/\/adevinta.com\/es\/cuentos\/articulos\/spark-unit-integration-and-end-to-end-tests-by-gustavo-martin\/"]}]},{"@type":"ImageObject","inLanguage":"es","@id":"https:\/\/adevinta.com\/es\/cuentos\/articulos\/spark-unit-integration-and-end-to-end-tests-by-gustavo-martin\/#primaryimage","url":"https:\/\/adevinta.com\/wp-content\/uploads\/2020\/10\/Spark-unit-integration-and-end-to-end-tests-by-Gustavo-Martin.png","contentUrl":"https:\/\/adevinta.com\/wp-content\/uploads\/2020\/10\/Spark-unit-integration-and-end-to-end-tests-by-Gustavo-Martin.png","width":2374,"height":1335},{"@type":"BreadcrumbList","@id":"https:\/\/adevinta.com\/es\/cuentos\/articulos\/spark-unit-integration-and-end-to-end-tests-by-gustavo-martin\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/adevinta.com\/es\/"},{"@type":"ListItem","position":2,"name":"Historias","item":"https:\/\/adevinta.com\/es\/cuentos\/articulos\/"},{"@type":"ListItem","position":3,"name":"Spark: unit, integration and end-to-end tests by Gustavo Martin"}]},{"@type":"WebSite","@id":"https:\/\/adevinta.com\/es\/#website","url":"https:\/\/adevinta.com\/es\/","name":"Adevinta","description":"","publisher":{"@id":"https:\/\/adevinta.com\/es\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/adevinta.com\/es\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"es"},{"@type":"Organization","@id":"https:\/\/adevinta.com\/es\/#organization","name":"Adevinta","url":"https:\/\/adevinta.com\/es\/","logo":{"@type":"ImageObject","inLanguage":"es","@id":"https:\/\/adevinta.com\/es\/#\/schema\/logo\/image\/","url":"https:\/\/adevinta.com\/wp-content\/uploads\/2024\/03\/adevinta_logo_blue.png","contentUrl":"https:\/\/adevinta.com\/wp-content\/uploads\/2024\/03\/adevinta_logo_blue.png","width":7680,"height":4320,"caption":"Adevinta"},"image":{"@id":"https:\/\/adevinta.com\/es\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.linkedin.com\/company\/adevinta\/","https:\/\/www.instagram.com\/adevintalife\/"]}]}},"_links":{"self":[{"href":"https:\/\/adevinta.com\/es\/wp-json\/wp\/v2\/story\/411823","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/adevinta.com\/es\/wp-json\/wp\/v2\/story"}],"about":[{"href":"https:\/\/adevinta.com\/es\/wp-json\/wp\/v2\/types\/story"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/adevinta.com\/es\/wp-json\/wp\/v2\/media\/213174"}],"wp:attachment":[{"href":"https:\/\/adevinta.com\/es\/wp-json\/wp\/v2\/media?parent=411823"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/adevinta.com\/es\/wp-json\/wp\/v2\/categories?post=411823"},{"taxonomy":"classification","embeddable":true,"href":"https:\/\/adevinta.com\/es\/wp-json\/wp\/v2\/classification?post=411823"},{"taxonomy":"culture","embeddable":true,"href":"https:\/\/adevinta.com\/es\/wp-json\/wp\/v2\/culture?post=411823"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}