How to calculate the carbon footprint of training/running a large AI model in the cloud

GPT-3, GPT-4, ChatGPT, Bard, Stable Diffusion, Midjourney, DALL-E, etc., are Generative AI systems, made by large AI models. Systems that can generate text, images, or other media in response to prompts. A large amount of data and computing resources are necessary to train a large model like that. However, the question is: how big are...

Lire la suite

Working with data files from S3 in your local pySpark environment

Even though AWS provides more and more resources and possibilities to work with your data in the Cloud, some people still feeling the need to work with their data into their local pySpark environment. The idea of this article / tutorial is to show how to do that and help you to understand what happens under the hood. This article was ...

Lire la suite

Coding versus Modeling: The modern life without the Pythagorean theorem…

What will happen if, today, hypothetically, we had just found the records of thePythagorean triple? Pythagorean triple from Babylonian times (Wikipedia.com). First, I believe we would like to translate/re-write the content using modern notation. After some work with the help of experts, that's how would probably look like that ...

Lire la suite

La détection d’anomalies expliquée avec le football

C'est dimanche matin, vous prenez votre café et vous lisez le journal comme d'habitude. En tant que fan de football, vous allez à la page des sports pour voir les derniers résultats des matchs et alors… quelque chose attire votre attention (et vous manquez de renverser votre café!)… Une équipe de deuxième division a remporté le championn...

Lire la suite

Anomaly detection explained with football

It is Sunday morning, you are having your coffee, and you’re reading the newspaper as you usually do. As a football fan, you go to the sports session to see the last results of the previous matches and then… something grabs your attention (and also almost make you drop the coffee on yourself!)… A second division team won the most competi...

Lire la suite