[et_pb_section fb_built=”1″ admin_label=”Hero” _builder_version=”4.27.4″ _module_preset=”default” background_enable_color=”off” use_background_color_gradient=”on” background_color_gradient_stops=”#0798ff 0%|rgba(0,92,156,0.79) 0%|rgba(0,92,156,0.55) 48%|rgba(0,92,156,0.67) 100%” background_color_gradient_overlays_image=”on” background_image=”https:\/\/eclat-lab.fr\/wp-content\/uploads\/2025\/02\/Hackathon-ECLAT-janvier-2025-3.jpg” background_enable_video_mp4=”off” min_height=”350px” custom_padding=”4vw||4vw||true|false” locked=”off” collapsed=”on” global_colors_info=”{%22gcid-primary-color%22:%91%22background_color%22%93}” theme_builder_area=”post_content”][et_pb_row _builder_version=”4.27.4″ _module_preset=”5138c454-be54-4233-bd3b-f8e6a8747976″ custom_margin=”2vw||2vw||true|false” locked=”off” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_column type=”4_4″ _builder_version=”4.23.1″ _module_preset=”73121f80-a3ef-4484-8763-c3f18e3c56d2″ global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_heading title=”First ECLAT Hackathon” _builder_version=”4.27.4″ _module_preset=”ddeb8c09-9078-4424-bc15-2efb6572e28e” title_font=”–et_global_heading_font|700|||||||” title_text_align=”center” title_text_color=”#FFFFFF” custom_margin=”||||false|false” locked=”off” global_colors_info=”{}” theme_builder_area=”post_content”][\/et_pb_heading][\/et_pb_column][\/et_pb_row][\/et_pb_section][et_pb_section fb_built=”1″ admin_label=”Testimonials” _builder_version=”4.27.4″ _module_preset=”default” background_color=”#f7f7f7″ custom_padding=”5px||5px||true|false” locked=”off” collapsed=”on” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_row _builder_version=”4.17.6″ _module_preset=”5138c454-be54-4233-bd3b-f8e6a8747976″ global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_column type=”4_4″ _builder_version=”4.16″ _module_preset=”73121f80-a3ef-4484-8763-c3f18e3c56d2″ global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_text _builder_version=”4.27.4″ _module_preset=”default” custom_margin=”1vw||1vw||true|false” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n
The ECLAT hackathon, held from 3 to 5 February 2025, brought together researchers and engineers to optimise the DDF pipeline, which is essential for processing the LOFAR radio telescope’s vast data streams, by consolidating MPI integration, I\/O optimisation and application algorithms.<\/strong><\/p>\n [\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section][et_pb_section fb_built=”1″ admin_label=”Testimonials” _builder_version=”4.27.4″ _module_preset=”default” custom_padding=”5px||5px||true|false” locked=”off” collapsed=”on” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_row _builder_version=”4.27.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_column type=”4_4″ _builder_version=”4.27.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_text _builder_version=”4.27.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n The aim of the ECLAT hackathon, which took place from Monday 3 to Wednesday 5 February 2025 at Paris Observatory, was to optimise and increase the computing capacity of DDF-pipeline (Direction-Dependent Facet calibration) reduction. Used to process the huge data streams generated by the Low Frequency Array Radiotelescope (LOFAR), DDF-pipeline is a set of tools and algorithms that plays a key role in improving image quality by correcting for instrumental distortions and ionospheric effects that vary according to the direction in which the antennas are positioned. [\/et_pb_text][\/et_pb_column][\/et_pb_row][et_pb_row column_structure=”3_5,2_5″ _builder_version=”4.27.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_column type=”3_5″ _builder_version=”4.27.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_text _builder_version=”4.27.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n During the ECLAT hackathon, which brought together 14 researchers, engineers and doctoral students from ECLAT’s partner laboratories, several teams worked together on three main areas of optimisation:<\/p>\n 1. Consolidation of MPI integration: Implementation of multi-node parallelization on the calibration and imaging tool, and deployment on the French Jean Zay supercomputer dedicated to scientific computing, to improve the efficiency of distributed computing; [\/et_pb_text][\/et_pb_column][et_pb_column type=”2_5″ _builder_version=”4.27.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_image src=”https:\/\/eclat-lab.fr\/wp-content\/uploads\/2025\/02\/Hackathon-ECLAT-janvier-2025-14.jpg” title_text=”Hackathon-ECLAT-janvier-2025-14″ _builder_version=”4.27.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][\/et_pb_image][\/et_pb_column][\/et_pb_row][et_pb_row _builder_version=”4.27.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_column type=”4_4″ _builder_version=”4.27.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_text _builder_version=”4.27.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n The aim of the hackathon was to make tangible progress:<\/p>\n [\/et_pb_text][\/et_pb_column][\/et_pb_row][et_pb_row _builder_version=”4.27.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_column type=”4_4″ _builder_version=”4.27.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_testimonial author=”Cyril Tasse” job_title=”Astronomer at the Paris Observatory” portrait_url=”https:\/\/eclat-lab.fr\/wp-content\/uploads\/2025\/02\/eclat-cyril-tasse-2025.jpg” _builder_version=”4.27.4″ _module_preset=”default” text_orientation=”justified” border_radii=”on|15px|15px|15px|15px” border_width_all=”0px” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n “This ECLAT hackathon was a great human experience, marked by great enthusiasm and a real exchange of ideas between the teams. Working on optimising our codes and scaling them up represents a major technical challenge. And the stakes are considerable, especially with the arrival of LOFAR 2.0 and the prospects of the SKA, which are forcing us to push back the limits of our computing capacity. We have managed to make progress on certain critical points, such as MPI parallelization, but we still have a long way to go to fully resolve this large and complex numerical problem. The hackathon has laid some solid foundations, and I’m convinced that the advances made here will pave the way for innovative solutions for processing SKA data.”<\/em><\/p>\n [\/et_pb_testimonial][et_pb_image src=”https:\/\/eclat-lab.fr\/wp-content\/uploads\/2025\/02\/Hackathon-ECLAT-janvier-2025-4.jpg” title_text=”Hackathon ECLAT – janvier 2025-4″ align=”center” _builder_version=”4.27.4″ _module_preset=”default” width=”80%” global_colors_info=”{}” theme_builder_area=”post_content”][\/et_pb_image][et_pb_text _builder_version=”4.27.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n Participants in the January 2025 ECLAT hackathon at Paris Observatory<\/em><\/p>\n [\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section]<\/p>\n","protected":false},"excerpt":{"rendered":" The ECLAT hackathon, held from 3 to 5 February 2025, brought together researchers and engineers to optimise the DDF pipeline, which is essential for processing the LOFAR radio telescope’s vast data streams, by consolidating MPI integration, I\/O optimisation and application algorithms.ECLAT Hackathon: Optimising the DDF pipeline for large-scale astronomical surveys The aim of the ECLAT […]<\/p>\n","protected":false},"author":2,"featured_media":855,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"on","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"categories":[18],"tags":[],"class_list":["post-878","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-events-en"],"yoast_head":"\nECLAT Hackathon: Optimising the DDF pipeline for large-scale astronomical surveys<\/span><\/h3>\n
With the arrival of LOFAR 2.0 and the prospects of the Square Kilometre Array Observatory (SKAO), the need to scale up is becoming crucial if ever-larger volumes of data are to be processed efficiently. It is becoming imperative to improve performance by exploiting distributed computing architectures and optimising the use of hardware resources.<\/p>\nThree areas of focus<\/h4>\n
2. I\/O and memory access optimisation: Analysis and optimisation of I\/O operations to minimise bottlenecks;
3. Developing new application algorithms: In particular, improving deconvolution methods for more accurate reconstruction of radio images.<\/p>\nTangible, open results<\/span><\/h4>\n
\n