Extreme CFD workshop - User contributions [en]

Ecfd:ecfd 9th edition

2026-02-02T13:12:19Z

Mathieu.laignel: /* C8 - Optimization of chemical source terms stiff integration - Y. Bechane (CORIA), G. Lartigue (CORIA), K. Bioche (CORIA), Q. Cerutt (CORIAi, M. El Moatamid (CORIA) & M. Laignel (CORIA) */

{{DISPLAYTITLE: ECFD workshop, 9th edition, 2026}}

== Description ==

* Event from '''19th of January to 30th of January 2026'''
* Location: [https://www.sport-normandie.fr/le-centre/le-site-de-houlgate Centre Sportif de Normandie], Houlgate, near Caen (14)
* Two types of sessions:
** common technical presentations: roadmaps, specific points
** mini-workshops. Potential workshops are listed below
* Free of charge
* Participants from academics, HPC center/experts and industry are welcome
* The number of participants is limited to 80.


* Organizers
** Guillaume Balarac (LEGI), Simon Mendez (IMAG), Pierre Bénard, Vincent Moureau, Léa Voivenel (CORIA).

[[File:Logo_ECFD9.png|center|frameless|900px|link=https://ecfd.coria-cfd.fr/index.php/Ecfd:ecfd_9th_edition]]



== News ==

* 22/09/2025: First announcement of the '''9th Extreme CFD Workshop & Hackathon''' !
* 15/11/2025: Deadline to submit your project

== Thematics / Mini-workshops ==

To be announced...

== Projects ==

The projects will be selected after the end of the submission phase (end of November).

=== Numerics & User Interface - M. Bernard (LEGI), G. Lartigue (CORIA) & S. Mendez (IMAG) ===

==== N6 - Relaxation of the IBM stability constraint - PL. Martin (IMAG) & S. Mendez (IMAG) ====
Many simulations done in the YALES2BIO framework involve fluid-structure interactions handled with the Immersed Boundary Method (IBM).
This model allows for the fluid/solid coupling, with the forces from the solid acting as a source term in the Navier-Stokes equations.
In some cases for red blood cells simulations, and for most cases for von Willebrand Factor simulations, the governing time step is the force time step. When this is the case, we also notice artifacts in the fluid velocity and pressure fields.
The robustness of our IBM implementation was improved for embedded surfaces by shifting our regularization/interpolation kernels away from the wall in case we work with an embedded solid.
Since these simulations are done at low Reynolds and CFL number (0.01 - 0.001), the stability constraint was relaxed by doing substeps without:
1. advancing the convective velocity, 2. correcting the velocity to make it divergence-free.
The artifacts showing when solids are a lot stiffer than the fluid viscous forces were reduced by projecting the regularized solid forces into a divergence-free space.

=== Turbulence - L. Voivenel (CORIA), P. Bénard, CORIA & T. Berthelon (LEGI) ===

==== T5 – Hybrid RANS/LES based on dual mesh and LES of fluctuations - G. Balarac (LEGI), T. Berthelon (LEGI) & R. Letournel (Safran) ====

This project is devoted to a fully coupled hybrid RANS/LES strategy based on a dual-mesh framework, where the mean flow is solved by RANS on a mesh tailored for the mean field, while only the turbulent fluctuations are resolved by LES on a second mesh. In addition to deterministic drift (relaxation) terms that drive the resolved velocities in each model toward target fields provided by the other one (RANS mean for LES, LES statistics for RANS), a stochastic forcing built from RANS turbulent quantities is introduced in the LES of fluctuations. These combined forcing terms allow a controlled generation of fluctuations at the RANS/LES interface and reduce the sensitivity to interface location. Two-way coupling is achieved by feeding back the Reynolds stresses computed in the LES into the RANS equations in the resolved regions. The approach is demonstrated on turbulent pipe flows, including a fully coupled simulation at high Reynolds number (Re = 44,000), showing that the method enables wall-resolved hybrid simulations at a fraction of the cost of a full LES.

==== T9 - LES-based aero-servo-elastic simulation of wind turbines - E. Muller (CORIA & SGRE), P. Benard (CORIA), F. Houtin-Mongrolle (SGRE), B. Duboc (SGRE) & H. Hamdani (GDTech) ====
The YALES2 library includes an advanced modular implementation of the Actuator Line Method (ALM). This approach remains state-of-the-art when performing an LES-based analysis of a wind turbine wake. The method also provides an accurate assessment of the aerodynamic loads applied on the turbine as well as the structural deformation when Yales2 is coupled to an external library/code. In the past years two coupling library have been developed, one to BHawC (SGRE certification tool) and one to OpenFast (NREL open access/open source). To improve the user and developer experience a generalization of the two coupling is conducted in this project.

'''WP1/2''': Update the existing coupling libraries for OpenFast and BHawC coupling with ALM of YALES2.

'''WP3''': Generalize/uniformalize the coupling DLL and the calls to it in YALES2.

'''WP4''': Enable both coupling to work with both Actuator lines and Actuator Disks.

'''WP5''': Implementation and integration of the Risoe Dynamic stall model. Following ECFD6 T5 (Turbulence flow project 5).

'''WP6''': Miscellaneous related to actuator line covered through this ECFD9.

=== Combustion - Y. Bechane (CORIA), R. Letournel (Safran) & S. Dillon (Safran) ===

==== C8 - Optimization of chemical source terms stiff integration - Y. Bechane, G. Lartigue, K. Bioche, Q. Cerutti, M. El Moatamid & M. Laignel (CORIA) ====

Integration of chemical source terms remains computationally expensive in configurations that rely on detailed chemistry approach. This project aimed to reduce that cost by (1) modifying the CVODE integration strategy and (2) applying source-term clustering. A first attempt was to modify CVODE’s internal step-size control strategy but it produced only minor gains as some unnecessary integration steps still occurred, mainly in the unburned gases region. This has finally been addressed by enforcing an initial step based on the CFD time step which reduced the computational cost by a factor 2 in these regions. More importantly, relaxing the relative and absolute tolerances used to determine the accuracy of the method reduced the computational cost by approximately 40% while introducing negligible error in physical properties and flame topology for a 1D premixed flame. These results were confirmed on three methane flame configurations: a 1D premixed flame, a 2D triple flame, and the PRECCINSTA burner. Numerical experiments on the PRECCINSTA burner show a reduction in integration cost by a factor of 2.5 using the adjusted CVODE strategy and by a factor of 4.4 when that strategy is combined with clustering.

Ecfd:ecfd 9th edition

2026-02-02T13:11:38Z

{{DISPLAYTITLE: ECFD workshop, 9th edition, 2026}}

== Description ==

* Event from '''19th of January to 30th of January 2026'''
* Location: [https://www.sport-normandie.fr/le-centre/le-site-de-houlgate Centre Sportif de Normandie], Houlgate, near Caen (14)
* Two types of sessions:
** common technical presentations: roadmaps, specific points
** mini-workshops. Potential workshops are listed below
* Free of charge
* Participants from academics, HPC center/experts and industry are welcome
* The number of participants is limited to 80.


* Organizers
** Guillaume Balarac (LEGI), Simon Mendez (IMAG), Pierre Bénard, Vincent Moureau, Léa Voivenel (CORIA).

[[File:Logo_ECFD9.png|center|frameless|900px|link=https://ecfd.coria-cfd.fr/index.php/Ecfd:ecfd_9th_edition]]



== News ==

* 22/09/2025: First announcement of the '''9th Extreme CFD Workshop & Hackathon''' !
* 15/11/2025: Deadline to submit your project

== Thematics / Mini-workshops ==

To be announced...

== Projects ==

The projects will be selected after the end of the submission phase (end of November).

=== Numerics & User Interface - M. Bernard (LEGI), G. Lartigue (CORIA) & S. Mendez (IMAG) ===

==== N6 - Relaxation of the IBM stability constraint - PL. Martin (IMAG) & S. Mendez (IMAG) ====
Many simulations done in the YALES2BIO framework involve fluid-structure interactions handled with the Immersed Boundary Method (IBM).
This model allows for the fluid/solid coupling, with the forces from the solid acting as a source term in the Navier-Stokes equations.
In some cases for red blood cells simulations, and for most cases for von Willebrand Factor simulations, the governing time step is the force time step. When this is the case, we also notice artifacts in the fluid velocity and pressure fields.
The robustness of our IBM implementation was improved for embedded surfaces by shifting our regularization/interpolation kernels away from the wall in case we work with an embedded solid.
Since these simulations are done at low Reynolds and CFL number (0.01 - 0.001), the stability constraint was relaxed by doing substeps without:
1. advancing the convective velocity, 2. correcting the velocity to make it divergence-free.
The artifacts showing when solids are a lot stiffer than the fluid viscous forces were reduced by projecting the regularized solid forces into a divergence-free space.

=== Turbulence - L. Voivenel (CORIA), P. Bénard, CORIA & T. Berthelon (LEGI) ===

==== T5 – Hybrid RANS/LES based on dual mesh and LES of fluctuations - G. Balarac (LEGI), T. Berthelon (LEGI) & R. Letournel (Safran) ====

This project is devoted to a fully coupled hybrid RANS/LES strategy based on a dual-mesh framework, where the mean flow is solved by RANS on a mesh tailored for the mean field, while only the turbulent fluctuations are resolved by LES on a second mesh. In addition to deterministic drift (relaxation) terms that drive the resolved velocities in each model toward target fields provided by the other one (RANS mean for LES, LES statistics for RANS), a stochastic forcing built from RANS turbulent quantities is introduced in the LES of fluctuations. These combined forcing terms allow a controlled generation of fluctuations at the RANS/LES interface and reduce the sensitivity to interface location. Two-way coupling is achieved by feeding back the Reynolds stresses computed in the LES into the RANS equations in the resolved regions. The approach is demonstrated on turbulent pipe flows, including a fully coupled simulation at high Reynolds number (Re = 44,000), showing that the method enables wall-resolved hybrid simulations at a fraction of the cost of a full LES.

==== T9 - LES-based aero-servo-elastic simulation of wind turbines - E. Muller (CORIA & SGRE), P. Benard (CORIA), F. Houtin-Mongrolle (SGRE), B. Duboc (SGRE) & H. Hamdani (GDTech) ====
The YALES2 library includes an advanced modular implementation of the Actuator Line Method (ALM). This approach remains state-of-the-art when performing an LES-based analysis of a wind turbine wake. The method also provides an accurate assessment of the aerodynamic loads applied on the turbine as well as the structural deformation when Yales2 is coupled to an external library/code. In the past years two coupling library have been developed, one to BHawC (SGRE certification tool) and one to OpenFast (NREL open access/open source). To improve the user and developer experience a generalization of the two coupling is conducted in this project.

'''WP1/2''': Update the existing coupling libraries for OpenFast and BHawC coupling with ALM of YALES2.

'''WP3''': Generalize/uniformalize the coupling DLL and the calls to it in YALES2.

'''WP4''': Enable both coupling to work with both Actuator lines and Actuator Disks.

'''WP5''': Implementation and integration of the Risoe Dynamic stall model. Following ECFD6 T5 (Turbulence flow project 5).

'''WP6''': Miscellaneous related to actuator line covered through this ECFD9.

=== Combustion - Y. Bechane (CORIA), R. Letournel (Safran) & S. Dillon (Safran) ===

==== C8 - Optimization of chemical source terms stiff integration - Y. Bechane (CORIA), G. Lartigue (CORIA), K. Bioche (CORIA), Q. Cerutt (CORIAi, M. El Moatamid (CORIA) & M. Laignel (CORIA) ====

Integration of chemical source terms remains computationally expensive in configurations that rely on detailed chemistry approach. This project aimed to reduce that cost by (1) modifying the CVODE integration strategy and (2) applying source-term clustering. A first attempt was to modify CVODE’s internal step-size control strategy but it produced only minor gains as some unnecessary integration steps still occurred, mainly in the unburned gases region. This has finally been addressed by enforcing an initial step based on the CFD time step which reduced the computational cost by a factor 2 in these regions. More importantly, relaxing the relative and absolute tolerances used to determine the accuracy of the method reduced the computational cost by approximately 40% while introducing negligible error in physical properties and flame topology for a 1D premixed flame. These results were confirmed on three methane flame configurations: a 1D premixed flame, a 2D triple flame, and the PRECCINSTA burner. Numerical experiments on the PRECCINSTA burner show a reduction in integration cost by a factor of 2.5 using the adjusted CVODE strategy and by a factor of 4.4 when that strategy is combined with clustering.

Ecfd:ecfd 9th edition

2026-02-02T10:31:02Z

Mathieu.laignel: /* C8 - Optimization of chemical source terms stiff integration - Y. Bechane (CORIA), G. Lartigue (CORIA), K. Bioche (CORIA), Q. Cerutti (CORIA), M. El Moatamid (CORIA), M. Laignel (CORIA) */

Ecfd:ecfd 9th edition

2026-02-02T10:30:26Z

Mathieu.laignel: /* Projects */

Ecfd:ecfd 8th edition

2025-02-10T10:14:11Z

Mathieu.laignel: /* C8 - A first step toward hybrid CPU / GPU for reactive flow in YALES2 */

{{DISPLAYTITLE: ECFD workshop, 8th edition, 2025}}

== Description ==

* Event from '''27th of January to 7th of February 2025'''
* Location: [https://www.sport-normandie.fr/le-centre/le-site-de-houlgate Centre Sportif de Normandie], Houlgate, near Caen (14)
* Two types of sessions:
** common technical presentations: roadmaps, specific points
** mini-workshops. Potential workshops are listed below
* Free of charge
* Participants from academics, HPC center/experts and industry are welcome
* The number of participants is limited to 68.

* Objectives
** Bring together experts in high-performance computing, applied mathematics and multi-physics CFDs
** Identify the technological barriers of exaflopic CFD via numerical experiments
** Identify industrial needs and challenges in high-performance computing
** Propose action plans to add to the development roadmaps of the CFD codes
* Organizers
** Guillaume Balarac (LEGI), Simon Mendez (IMAG), Pierre Bénard, Vincent Moureau, Léa Voivenel (CORIA).

[[File:ecfd8.png|600px|link=https://ecfd.coria-cfd.fr/index.php/Ecfd:ecfd_8th_edition]]

[[File:Acknowledgments_ecfd8.png|text-bottom|600px]]

== News ==

* 23/10/2024: First announcement of the '''8th Extreme CFD Workshop & Hackathon''' !
* 22/11/2024: Deadline to submit your project

== Thematics / Mini-workshops ==

These mini-workshops may change and cover more or less topics. This page will be adapted according to your feedback.

To come...

== Projects ==

=== Hackathon GENCI - P. Begou, LEGI ===
This ECFD8 GENCI Hackathon was a rich event, involving 4 differents CFD codes (AVBP, ParaDIGM, SONICS and YALES2) using various paradigms (C++/cuda/hip, Fortran/OpenMP/OpenACC) with several SDKs (AMD, Cray/HPE, Nvidia, Gnu) on a large range of GPU architectures (Nvidia A100, GH100, AMD instinct Mi210, Mi250, Mi300). This two-week event benefited from a high level support from three HPC mentors, two on-site from AMD (J. Noudohouenou and A. Tsetoglou) and one remote from CINES (M. Boudaoud).

==== H1 - ParaDIGM and SONICS on GPU, B. Maugars, G. Staffelbach, R.Cazalbou and B. Michel (ONERA)====

==== H2 - AVBP GPU offloading based on OpenMP, M.Ghenai, L. Legaux and A. Dauptain (CERFACS) ====

==== H3 - YALES2 GPU from OpenACC to OpenMP, P. Bégou (LEGI), V. Moureau, G. Lartigue (CORIA) and R. Dubois (IMAG) ====
This Hackathon focuses on running Yales2 code on AMD Instinct Mi250 and Mi300 GPUs of the Adastra supercomputer (CINES).
Previously, a first solver in the Yales2 CFD code was successfully ported on the GPU accelerators of the Jean-Zay supercomputer (IDRIS) using Nvidia SDK but difficulties remain on Adastra AMD GPUs, mainly related to the available development tools. High compilation time and the impossibility to use debug flags at compile time as soon as OpenACC is enabled are a real challenge when tracking errors. The current project is to evaluate a freshly deployed version (at the begining of the workshop) of the AMD Fortran compiler. This requires moving to OpenMP paradigm, starting from scratch since the OpenACC branch has largely diverged from the master one while tracking spurious remaining bugs.
If the AMD compiler is able to build the cpu version of Yales2 "out of the box" (wich is not the case for Cray Fortran), the compilation time for each file is significantly higher. However, setting up a 2 stages dynamic compilation process allows for high parallelism that is not possible with Cray Fortran 18 and the library build time drops from nearly 2 hours (Cray Fortran 18) to 17 minutes (Amd Fortran compiler).
Large kernels have been ported from OpenACC to OpenMP, raising some difficulties when offloading intrinsics functions or using strutures attributes in kernels loops. These limitations were also known in the previous OpenACC work. The goal was mainly to check the correctness of the results. The offloading of the complex data structure of Yales2 code was then investigated. Here again some limitations of the "young" compiler were discovered and workarounds were implemented. Several reproducers were built during this ECFD8 and provided to developpers by the 2 on-site AMD engineers.
Preliminary tests on micro-applications show good performances of the generated binaries proving that this compiler could be a serious alternative on AMD GPUs and the goal is now to focus on this SDK in an OpenMP strategy while checking the portablility of this new implementation in Nvidia, Cray/HPE (and Gnu ?) environments.

=== Mesh adaptation - A. Grenouilloux, ONERA & G. Balarac, LEGI ===

=== Numerics - M. Bernard, LEGI & G. Lartigue, CORIA ===

==== N2 - Treatment of Inlet/Outlet conditions in High-Order solver. M. Bernard (LEGI), Ghislain Lartigue (CORIA), Guillaume Balarac (LEGI) ====

==== N3 - Conservative mesh-to-mesh interpolation. M. Bernard (LEGI), Ghislain Lartigue (CORIA), Guillaume Balarac (LEGI) ====

Mesh to mesh interpolations occur quite often in CFD simulations : in the context of adaptative mesh convergence or in the case of dynamic mesh adaptation for for example.
Quality of the solution on the destination grid will depend on the characteristics of the interpolation method.
In this project, we did not focus on accuracy of the interpolation method but rather on conservativity characteristics.
A conservative interpolation ensures that the integral of the data on the source grid is exactly retrieved on the destination grid.
This property is highly interesting when dealing with scalar quantities or phase indicators, whose values should remained bounded.
In the context of nodes centered Finite Volume schemes, the methodology we used consists in (i) reconstructing element quantity from average nodal quantities on source grid.
Then, for a cell of the destination mesh, (ii) computing the geometrical intersection between cells of source and destination meshes to evaluate to evaluate the rate of quantities they.
Eventually, (iii) redistributing the solution from elements to control volumes of the destination mesh.
The overall process is fully conservative as it is based on geometrical intersection of locally integrated quantities.
The methodology as been implemented and tested on a few basic configurations and the conservativity is retrieved.

==== N7 - Implicit time advancement for low-Reynolds number flows with particles. S. Mendez, C. Raveleau (IMAG), M. El Moatamid, V. Moureau (CORIA) ====
IMAG runs numerous simulations of red blood cells under flow. Those simulations are at low Reynolds number (0.001 to 1.0, typically). Splitting of the time advancement is used to treat the diffusion terms implicitly, albeit with an important numerical cost: implicit diffusion is 50 to 60% of the computational cost. Recently, M. El Moatamid implemented a genral framework to deal with implicit time advancement for scalars. In this project, the general method has been transposed to the advancement of the velocity field in the ICS and RBC solvers of YALES2/YALES2BIO. This enables testing various linear solvers (GMRES based). However, such solvers do not decrease the CPU time compared to the existing implementation. However, while working on this, it was identified that residual recycling was not activated in the current implementation of the implicit diffusion. This sped up the implicit diffusion cost by 35%, for a total gain of 20% for the computation. In addition to this achievement, moving to the framework coded by Moncef will have other beneficial side effects: we anticipate simplifying the implementation, with an easier merging between YALES2BIO and YALES2. The method will also be implemented in the electrosatic solver, for which the Poisson problem should benefit from the new GMRES-based solvers. In addition, this project highlights the importance of improving the treatment of stiff source terms in the red blood cells simulations, to be able to overcome the current limitation in time step due to those term and have a chance to benefit from higher-order time schemes, efficient at high Fourier numbers.

=== Turbulence - L. Voivenel, CORIA & P. Bénard, CORIA ===

==== T1 - FSI-1D strategy for internal flows====

==== T2 - Dynamic Smagorinsky in Dorothy ====

==== T3 - Turbulence injection strategy for compressible flows ====

==== T4 - Improve wind farm modeling and simulation workflow ====
The YALES2 library includes an advanced modular implementation of the Actuator Line Method (ALM). This approach remains state-of-the-art when performing an LES-based analysis of a wind turbine wake. The method also provides an accurate assessment of the aerodynamic loads applied on the turbine. Still, applying this method to investigate a wind farm flow can be challenging, both in terms of computational cost and simulation setup. For instance, an inadequate management of the wind turbine individual modeling parts in a HPC context can end up being the main bottleneck of the simulation. From another perspective, a wind farm is usually composed of more than 50 wind turbines. For such a case, setting up all YALES2 required inputs manually can be very tedious and error-prone. This project thus mainly aimed to optimize the YALES2 ALM implementation and the user experience around it. Additionally, a cost-effective alternative to the ALM when modeling wind farm flows, namely the Rotating Actuator Disk Method (ADM-R), has been implemented for further investigations.

'''WP1''': Improve Actuator set rotor modelling
* Parallel processing of the ''actuator sets'' used to model the wind turbines
(Felix)

* Rotating Actuator Disk Model (ADM-R):
According to the usual guidelines, the mesh requirements of the ALM, to profit entirely from its reachable accuracy, can be difficult to achieve or even unaffordable when simulating a wind farm flow, especially from the industrial point of view. Alternatives are available in the literature for this kind of application. Likely, the methods from the Actuator Disk family are the most prominent ones. Several kinds of implementation exist, which mostly differ by their capability to include the wake rotation. During the workshop, a new method from the Rotating Actuator Disk kind has been implemented and underwent an early validation on a single turbine setup. Applications to wind farm flows will follow.

'''WP2''': Improve tools User Experience

Three Python tools have been developed or improved :
*The first tool is the wind farm previsualisation tool, 'y2_wind_previsualization', which is used before the calculation run. This provides an interactive HTML interface for viewing global data for each turbine on the farm (position, hub height, yaw angle, etc.). The tool traces all of these via the parsing of the input file.
* The second tool is for duplicating rotor templates for a wind farm (`y2_wind_duplication`). This tool was developed in the previous ECFD, but this time it has been refactored and incorporated into the y2tools package.
* The third and final tool is a post-processing tool for the temporal processing of global wind turbine simulation metrics (Thrust, Power, etc.), `y2_post_wind`. This tool generates an interactive HTML plot of time-dependent global quantities.

==== T5 - Improve atmospheric inflow turbulence ====
Atmospheric inflow turbulence is generated using the precursor database method. A half-channel flow driven by a pressure gradient is used to obtain the inflow which is used as inlet boundary condition for the wind turbine simulation domain. This project aimed to improve the whole methodology, from generation to injection.

* WP1: Improve inflow generation
Anand: pressure controller

* WP2: Improve injection methodology (method A)
The previous workflow used plane probes in the ASCII format to sample the flow. The COWIT2 toolbox was used to convert the file into turbulence box (.man format). While functioning, this methodology had two major flaws. First the probe files are heavy ~O(10Go). Second, the method requires a lot of human effort, allowing numerous sources of errors.
During this workshop, a new methodology has been developed. First, the probes are generated using the HDF5 format (now available for all probe types), leading to lighter file ~O(1Go). Second, Y2_tools is used to read HDF5 format (working for probes and temporals). HDF5 file is then converted into a Look-up Table. Finally, the Look-up Table is read directly by YALES2 as a boundary conditions.

* WP3: Improve injection methodology (method B)
Even though improvements achieved in WP2 prove to be very handy while removing many potential human errors, injecting a turbulent inflow through wind boxes ('offline' precursor approach) can sometimes remain cumbersome for several reasons: (1) no periodicity is enforced in the streamwise direction of those boxes, (2) potential high memory consumption, and (3) the boxes need to be moved to other cores whenever a mesh adaptation occurs. An alternative consists in co-simulating the precursor flow and the flow of interest (refered as the 'successor' simulation) at the same time ('online' precursor approach). The inlet boundary condition for the successor flow is then obtained by mapping the outflow of the precursor domain. During the workshop, some work has been initiated to implement this kind of coupling using the CWIPI library, for which YALES2 provides already an interface.

==== T6 - FSI model in Dorothy ====

=== Two Phase Flow - J. Leparoux, SAFRAN & J. Carmona, CORIA ===

==== TP1 - Towards very small contact angles in Nucleate boiling ====

Participants: Henri Lam (LEGI), Mohammad Umair (LEGI), Manuel Bernard (LEGI), Robin Barbera (LEGI) and Giovanni Ghigliotti (LPSC)

==== TP2 - Modeling spray-film interactions ====

Participants: Nicolas Gasnier (EM2C-SafranTech), Julien Leparoux (SafranTech), Mehdi Helal (CORIA-SafranTech) and Julien Carmona (CORIA)

==== TP3 - High-fidelity two-phase flow simulations of the purge of a fuel feed line ====

Participants: Thomas LAROCHE (Safran HE), Romain JANODET (Safran AE), Julien Leparoux (Safran Tech) and Melody Cailler (Safran Tech)

==== TP4 - Volume of Fluid solver in YALES2 ====

Participants: Léa Voivenel (CORIA), Julien Carmona (CORIA), Mehdi Helal (CORIA), Pierre Portais (CORIA), Julien Leparoux (Safran Tech), Mélody Cailler (Safran Tech) and Nicolas Gasnier (EM2C / Safran Tech)

==== TP5 - Implement a local operator to distribute the solid volume of a particle over multiple cells ====

Participants: Théo Ndereyimana (Université de Sherbrooke), Stéphane Moreau (Université de Sherbrooke)

==== TP6 - Complex thermodynamics in sloshing tanks ====

Participants: C. Merlin (AGS), D. Fouquet (CORIA), V. Moureau (CORIA), J. Carmona (CORIA) and G. Lartigue (CORIA)

=== Combustion - Y. Bechane, CORIA & S. Dillon, SAFRAN & K. Bioche, CORIA ===

==== C1 - LES of the thermal degradation of a composite material ====
Participants: A. Grenouilloux (ONERA), K. Bioche (CORIA), N. Dellinger (ONERA) and R. Letournel (SafranTech)

==== C2 - Flame stabilization by NRP plasma discharge ====

==== C3 - Extending and validating a generalized formalism of virtual chemistry ====

==== C4 - Turbulent combustion model for NOx prediction ====

==== C5 - Towards 3D simulation of detonation combustion ====

==== C6 - Flame stabilitity of flame-holders within reheat conditions ====

==== C7 - Thermal radiation in oxyflames ====

==== C8 - A first step toward hybrid CPU / GPU for reactive flow in YALES2 ====

In numerical simulations of reacting flows, one of the most computationally intensive tasks is the evaluation of source terms resulting from chemical reactions in the species transport equations. This step can account for up to 90% of the total simulation cost , depending on the complexity of the kinetic mechanism involved. To reduce this cost, various techniques such as mechanism reduction, virtual chemistry, etc. have been explored. However, the emergence of GPUs as powerful accelerators offers a promising alternative by providing massive parallelism. Despite their potential, GPUs often require significant adaptation of CPU-based codes. This project aims to address this challenge by taking a first step towards a hybrid CPU/GPU framework for reactive flow simulations. Specifically, the focus is on coupling Y2 with the updated version of the stiff time integration solver (CVODE), which is compatible with GPU (CUDA, HIP, OpenMP). The ultimate goal is to establish a foundation for hybrid computations by implementing and testing the updated solver on simplified test cases.

==== C9 - Soots numerical modeling ====

==== C10 - TECERACT : Tabulated chemistry generator for aeronautical combustion ====

==== C11 - Exploring efficient tabulation strategies for detailed chemistry ====

==== C12 - Dynamic sub-grid-scale modelling of multi-regime flame wrinkling ====

==== C13 - LES of a semi-industrial burner using a non-adiabatic virtual chemical scheme ====

=== User Experience & Data - L. Korzeczek, GDTECH ===

==== U1 - Low-fidelity (RANS) rotor/stator simulations, application to Kaplan Turbine - Y. Lakrifi, G. Balarac (LEGI), R. Mercier (SAFRAN), V. Moureau (CORIA) ====

==== U2 - Coupling PyTorch/YALES2, combustion cartesian look-up tables - J. Leparoux, N. Treleaven, S. Dillon (SAFRAN), K. Bioche, G. Lartigue (CORIA) ====

==== U3 - Yales2 Trame Editor, toward a fully featured graphical user interface for YALES2 - L. Korzeczek, S. Meynet (GDTECH), J. Leparoux, M. Cailler (SAFRAN) ====

Ecfd:ecfd 8th edition

2025-02-10T10:13:12Z

Mathieu.laignel: /* C8 - A first step toward hybrid CPU / GPU for reactive flow in YALES2 */

{{DISPLAYTITLE: ECFD workshop, 8th edition, 2025}}

== Description ==

* Event from '''27th of January to 7th of February 2025'''
* Location: [https://www.sport-normandie.fr/le-centre/le-site-de-houlgate Centre Sportif de Normandie], Houlgate, near Caen (14)
* Two types of sessions:
** common technical presentations: roadmaps, specific points
** mini-workshops. Potential workshops are listed below
* Free of charge
* Participants from academics, HPC center/experts and industry are welcome
* The number of participants is limited to 68.

* Objectives
** Bring together experts in high-performance computing, applied mathematics and multi-physics CFDs
** Identify the technological barriers of exaflopic CFD via numerical experiments
** Identify industrial needs and challenges in high-performance computing
** Propose action plans to add to the development roadmaps of the CFD codes
* Organizers
** Guillaume Balarac (LEGI), Simon Mendez (IMAG), Pierre Bénard, Vincent Moureau, Léa Voivenel (CORIA).

[[File:ecfd8.png|600px|link=https://ecfd.coria-cfd.fr/index.php/Ecfd:ecfd_8th_edition]]

[[File:Acknowledgments_ecfd8.png|text-bottom|600px]]

== News ==

* 23/10/2024: First announcement of the '''8th Extreme CFD Workshop & Hackathon''' !
* 22/11/2024: Deadline to submit your project

== Thematics / Mini-workshops ==

These mini-workshops may change and cover more or less topics. This page will be adapted according to your feedback.

To come...

== Projects ==

=== Hackathon GENCI - P. Begou, LEGI ===
This ECFD8 GENCI Hackathon was a rich event, involving 4 differents CFD codes (AVBP, ParaDIGM, SONICS and YALES2) using various paradigms (C++/cuda/hip, Fortran/OpenMP/OpenACC) with several SDKs (AMD, Cray/HPE, Nvidia, Gnu) on a large range of GPU architectures (Nvidia A100, GH100, AMD instinct Mi210, Mi250, Mi300). This two-week event benefited from a high level support from three HPC mentors, two on-site from AMD (J. Noudohouenou and A. Tsetoglou) and one remote from CINES (M. Boudaoud).

==== H1 - ParaDIGM and SONICS on GPU, B. Maugars, G. Staffelbach, R.Cazalbou and B. Michel (ONERA)====

==== H2 - AVBP GPU offloading based on OpenMP, M.Ghenai, L. Legaux and A. Dauptain (CERFACS) ====

==== H3 - YALES2 GPU from OpenACC to OpenMP, P. Bégou (LEGI), V. Moureau, G. Lartigue (CORIA) and R. Dubois (IMAG) ====
This Hackathon focuses on running Yales2 code on AMD Instinct Mi250 and Mi300 GPUs of the Adastra supercomputer (CINES).
Previously, a first solver in the Yales2 CFD code was successfully ported on the GPU accelerators of the Jean-Zay supercomputer (IDRIS) using Nvidia SDK but difficulties remain on Adastra AMD GPUs, mainly related to the available development tools. High compilation time and the impossibility to use debug flags at compile time as soon as OpenACC is enabled are a real challenge when tracking errors. The current project is to evaluate a freshly deployed version (at the begining of the workshop) of the AMD Fortran compiler. This requires moving to OpenMP paradigm, starting from scratch since the OpenACC branch has largely diverged from the master one while tracking spurious remaining bugs.
If the AMD compiler is able to build the cpu version of Yales2 "out of the box" (wich is not the case for Cray Fortran), the compilation time for each file is significantly higher. However, setting up a 2 stages dynamic compilation process allows for high parallelism that is not possible with Cray Fortran 18 and the library build time drops from nearly 2 hours (Cray Fortran 18) to 17 minutes (Amd Fortran compiler).
Large kernels have been ported from OpenACC to OpenMP, raising some difficulties when offloading intrinsics functions or using strutures attributes in kernels loops. These limitations were also known in the previous OpenACC work. The goal was mainly to check the correctness of the results. The offloading of the complex data structure of Yales2 code was then investigated. Here again some limitations of the "young" compiler were discovered and workarounds were implemented. Several reproducers were built during this ECFD8 and provided to developpers by the 2 on-site AMD engineers.
Preliminary tests on micro-applications show good performances of the generated binaries proving that this compiler could be a serious alternative on AMD GPUs and the goal is now to focus on this SDK in an OpenMP strategy while checking the portablility of this new implementation in Nvidia, Cray/HPE (and Gnu ?) environments.

=== Mesh adaptation - A. Grenouilloux, ONERA & G. Balarac, LEGI ===

=== Numerics - M. Bernard, LEGI & G. Lartigue, CORIA ===

==== N2 - Treatment of Inlet/Outlet conditions in High-Order solver. M. Bernard (LEGI), Ghislain Lartigue (CORIA), Guillaume Balarac (LEGI) ====

==== N3 - Conservative mesh-to-mesh interpolation. M. Bernard (LEGI), Ghislain Lartigue (CORIA), Guillaume Balarac (LEGI) ====

Mesh to mesh interpolations occur quite often in CFD simulations : in the context of adaptative mesh convergence or in the case of dynamic mesh adaptation for for example.
Quality of the solution on the destination grid will depend on the characteristics of the interpolation method.
In this project, we did not focus on accuracy of the interpolation method but rather on conservativity characteristics.
A conservative interpolation ensures that the integral of the data on the source grid is exactly retrieved on the destination grid.
This property is highly interesting when dealing with scalar quantities or phase indicators, whose values should remained bounded.
In the context of nodes centered Finite Volume schemes, the methodology we used consists in (i) reconstructing element quantity from average nodal quantities on source grid.
Then, for a cell of the destination mesh, (ii) computing the geometrical intersection between cells of source and destination meshes to evaluate to evaluate the rate of quantities they.
Eventually, (iii) redistributing the solution from elements to control volumes of the destination mesh.
The overall process is fully conservative as it is based on geometrical intersection of locally integrated quantities.
The methodology as been implemented and tested on a few basic configurations and the conservativity is retrieved.

==== N7 - Implicit time advancement for low-Reynolds number flows with particles. S. Mendez, C. Raveleau (IMAG), M. El Moatamid, V. Moureau (CORIA) ====
IMAG runs numerous simulations of red blood cells under flow. Those simulations are at low Reynolds number (0.001 to 1.0, typically). Splitting of the time advancement is used to treat the diffusion terms implicitly, albeit with an important numerical cost: implicit diffusion is 50 to 60% of the computational cost. Recently, M. El Moatamid implemented a genral framework to deal with implicit time advancement for scalars. In this project, the general method has been transposed to the advancement of the velocity field in the ICS and RBC solvers of YALES2/YALES2BIO. This enables testing various linear solvers (GMRES based). However, such solvers do not decrease the CPU time compared to the existing implementation. However, while working on this, it was identified that residual recycling was not activated in the current implementation of the implicit diffusion. This sped up the implicit diffusion cost by 35%, for a total gain of 20% for the computation. In addition to this achievement, moving to the framework coded by Moncef will have other beneficial side effects: we anticipate simplifying the implementation, with an easier merging between YALES2BIO and YALES2. The method will also be implemented in the electrosatic solver, for which the Poisson problem should benefit from the new GMRES-based solvers. In addition, this project highlights the importance of improving the treatment of stiff source terms in the red blood cells simulations, to be able to overcome the current limitation in time step due to those term and have a chance to benefit from higher-order time schemes, efficient at high Fourier numbers.

=== Turbulence - L. Voivenel, CORIA & P. Bénard, CORIA ===

==== T1 - FSI-1D strategy for internal flows====

==== T2 - Dynamic Smagorinsky in Dorothy ====

==== T3 - Turbulence injection strategy for compressible flows ====

==== T4 - Improve wind farm modeling and simulation workflow ====
The YALES2 library includes an advanced modular implementation of the Actuator Line Method (ALM). This approach remains state-of-the-art when performing an LES-based analysis of a wind turbine wake. The method also provides an accurate assessment of the aerodynamic loads applied on the turbine. Still, applying this method to investigate a wind farm flow can be challenging, both in terms of computational cost and simulation setup. For instance, an inadequate management of the wind turbine individual modeling parts in a HPC context can end up being the main bottleneck of the simulation. From another perspective, a wind farm is usually composed of more than 50 wind turbines. For such a case, setting up all YALES2 required inputs manually can be very tedious and error-prone. This project thus mainly aimed to optimize the YALES2 ALM implementation and the user experience around it. Additionally, a cost-effective alternative to the ALM when modeling wind farm flows, namely the Rotating Actuator Disk Method (ADM-R), has been implemented for further investigations.

'''WP1''': Improve Actuator set rotor modelling
* Parallel processing of the ''actuator sets'' used to model the wind turbines
(Felix)

* Rotating Actuator Disk Model (ADM-R):
According to the usual guidelines, the mesh requirements of the ALM, to profit entirely from its reachable accuracy, can be difficult to achieve or even unaffordable when simulating a wind farm flow, especially from the industrial point of view. Alternatives are available in the literature for this kind of application. Likely, the methods from the Actuator Disk family are the most prominent ones. Several kinds of implementation exist, which mostly differ by their capability to include the wake rotation. During the workshop, a new method from the Rotating Actuator Disk kind has been implemented and underwent an early validation on a single turbine setup. Applications to wind farm flows will follow.

'''WP2''': Improve tools User Experience

Three Python tools have been developed or improved :
*The first tool is the wind farm previsualisation tool, 'y2_wind_previsualization', which is used before the calculation run. This provides an interactive HTML interface for viewing global data for each turbine on the farm (position, hub height, yaw angle, etc.). The tool traces all of these via the parsing of the input file.
* The second tool is for duplicating rotor templates for a wind farm (`y2_wind_duplication`). This tool was developed in the previous ECFD, but this time it has been refactored and incorporated into the y2tools package.
* The third and final tool is a post-processing tool for the temporal processing of global wind turbine simulation metrics (Thrust, Power, etc.), `y2_post_wind`. This tool generates an interactive HTML plot of time-dependent global quantities.

==== T5 - Improve atmospheric inflow turbulence ====
Atmospheric inflow turbulence is generated using the precursor database method. A half-channel flow driven by a pressure gradient is used to obtain the inflow which is used as inlet boundary condition for the wind turbine simulation domain. This project aimed to improve the whole methodology, from generation to injection.

* WP1: Improve inflow generation
Anand: pressure controller

* WP2: Improve injection methodology (method A)
The previous workflow used plane probes in the ASCII format to sample the flow. The COWIT2 toolbox was used to convert the file into turbulence box (.man format). While functioning, this methodology had two major flaws. First the probe files are heavy ~O(10Go). Second, the method requires a lot of human effort, allowing numerous sources of errors.
During this workshop, a new methodology has been developed. First, the probes are generated using the HDF5 format (now available for all probe types), leading to lighter file ~O(1Go). Second, Y2_tools is used to read HDF5 format (working for probes and temporals). HDF5 file is then converted into a Look-up Table. Finally, the Look-up Table is read directly by YALES2 as a boundary conditions.

* WP3: Improve injection methodology (method B)
Even though improvements achieved in WP2 prove to be very handy while removing many potential human errors, injecting a turbulent inflow through wind boxes ('offline' precursor approach) can sometimes remain cumbersome for several reasons: (1) no periodicity is enforced in the streamwise direction of those boxes, (2) potential high memory consumption, and (3) the boxes need to be moved to other cores whenever a mesh adaptation occurs. An alternative consists in co-simulating the precursor flow and the flow of interest (refered as the 'successor' simulation) at the same time ('online' precursor approach). The inlet boundary condition for the successor flow is then obtained by mapping the outflow of the precursor domain. During the workshop, some work has been initiated to implement this kind of coupling using the CWIPI library, for which YALES2 provides already an interface.

==== T6 - FSI model in Dorothy ====

=== Two Phase Flow - J. Leparoux, SAFRAN & J. Carmona, CORIA ===

==== TP1 - Towards very small contact angles in Nucleate boiling ====

Participants: Henri Lam (LEGI), Mohammad Umair (LEGI), Manuel Bernard (LEGI), Robin Barbera (LEGI) and Giovanni Ghigliotti (LPSC)

==== TP2 - Modeling spray-film interactions ====

Participants: Nicolas Gasnier (EM2C-SafranTech), Julien Leparoux (SafranTech), Mehdi Helal (CORIA-SafranTech) and Julien Carmona (CORIA)

==== TP3 - High-fidelity two-phase flow simulations of the purge of a fuel feed line ====

Participants: Thomas LAROCHE (Safran HE), Romain JANODET (Safran AE), Julien Leparoux (Safran Tech) and Melody Cailler (Safran Tech)

==== TP4 - Volume of Fluid solver in YALES2 ====

Participants: Léa Voivenel (CORIA), Julien Carmona (CORIA), Mehdi Helal (CORIA), Pierre Portais (CORIA), Julien Leparoux (Safran Tech), Mélody Cailler (Safran Tech) and Nicolas Gasnier (EM2C / Safran Tech)

==== TP5 - Implement a local operator to distribute the solid volume of a particle over multiple cells ====

Participants: Théo Ndereyimana (Université de Sherbrooke), Stéphane Moreau (Université de Sherbrooke)

==== TP6 - Complex thermodynamics in sloshing tanks ====

Participants: C. Merlin (AGS), D. Fouquet (CORIA), V. Moureau (CORIA), J. Carmona (CORIA) and G. Lartigue (CORIA)

=== Combustion - Y. Bechane, CORIA & S. Dillon, SAFRAN & K. Bioche, CORIA ===

==== C1 - LES of the thermal degradation of a composite material ====
Participants: A. Grenouilloux (ONERA), K. Bioche (CORIA), N. Dellinger (ONERA) and R. Letournel (SafranTech)

==== C2 - Flame stabilization by NRP plasma discharge ====

==== C3 - Extending and validating a generalized formalism of virtual chemistry ====

==== C4 - Turbulent combustion model for NOx prediction ====

==== C5 - Towards 3D simulation of detonation combustion ====

==== C6 - Flame stabilitity of flame-holders within reheat conditions ====

==== C7 - Thermal radiation in oxyflames ====

==== C8 - A first step toward hybrid CPU / GPU for reactive flow in YALES2 ====

In numerical simulations of reacting flows, one of the most computationally intensive tasks is the evaluation of source terms resulting from chemical reactions in the species transport equations. This step can account for up to 90% of the total simulation cost (1) , depending on the complexity of the kinetic mechanism involved. To reduce this cost, various techniques such as mechanism reduction, virtual chemistry, etc. have been explored. However, the emergence of GPUs as powerful accelerators offers a promising alternative by providing massive parallelism. Despite their potential, GPUs often require significant adaptation of CPU-based codes. This project aims to address this challenge by taking a first step towards a hybrid CPU/GPU framework for reactive flow simulations. Specifically, the focus is on coupling Y2 with the updated version of the stiff time integration solver (CVODE), which is compatible with GPU. The ultimate goal is to establish a foundation for hybrid computations by implementing and testing the updated solver on simplified test cases.

==== C9 - Soots numerical modeling ====

==== C10 - TECERACT : Tabulated chemistry generator for aeronautical combustion ====

==== C11 - Exploring efficient tabulation strategies for detailed chemistry ====

==== C12 - Dynamic sub-grid-scale modelling of multi-regime flame wrinkling ====

==== C13 - LES of a semi-industrial burner using a non-adiabatic virtual chemical scheme ====

=== User Experience & Data - L. Korzeczek, GDTECH ===

==== U1 - Low-fidelity (RANS) rotor/stator simulations, application to Kaplan Turbine - Y. Lakrifi, G. Balarac (LEGI), R. Mercier (SAFRAN), V. Moureau (CORIA) ====

==== U2 - Coupling PyTorch/YALES2, combustion cartesian look-up tables - J. Leparoux, N. Treleaven, S. Dillon (SAFRAN), K. Bioche, G. Lartigue (CORIA) ====

==== U3 - Yales2 Trame Editor, toward a fully featured graphical user interface for YALES2 - L. Korzeczek, S. Meynet (GDTECH), J. Leparoux, M. Cailler (SAFRAN) ====