How AI Is Transforming the Search for the Universe’s Hidden Structures

Welcome to Bedtime Astronomy. Explore the wonders of the cosmos with our soothing Bedtime Astronomy podcast. Each episode offers a gentle journey through the stars, planets, and beyond, perfect for unwinding after a long day. Let's travel through the mysteries of the universe as you drift off into a peaceful slumber under the night sky.

Imagine you are holding a map. But instead of tracing the coastlines of continents or, you know, the borders of nations, this map charts the very architecture of the cosmos itself.

Right. It's a completely different scale of geography.

Exactly. You are looking at a data set containing 4 billion individual celestial objects. And to just capture all of that information, this map takes up 5.6 trillion pixels.

Yeah.

That's trillion with a T.

Trillion. I mean, it is a scale of data that completely... Short circuits human intuition.

Oh, absolutely.

If you are standing in a control room staring at a canvas of 5.6 trillion pixels and your goal is to find a specific microscopic anomaly, an anomaly that is fundamentally invisible to the naked eye, how do you even begin?

Well, the sheer volume of that data, it really demands a complete reimagining of observational astronomy. We are looking at the culmination of a massive coordinated effort here. Right. This was highlighted in the October 2026 publication in the Astrophysical Journal Supplement Series. The research was spearheaded by Emerald Lynn and Yvonne Toro Bertolone, and it represents a profound shift.

Because they weren't just taking pictures, right?

Exactly.

They were not simply cataloging galaxies or mapping the coordinates of stars. They were executing a highly targeted search for 70 newly confirmed gravitational lenses.

Gravitational lenses.

Yeah. These are incredibly rare cosmic alignments that essentially function as nature's own telescopes. And finding them is, well, it's perhaps our most reliable method for tracing the dark matter that physically holds the universe together.

Which means we are essentially talking about using the universe's own mass to see further into the past.

That is exactly what's happening.

Yeah.

But, you know, before we get to the actual mechanisms of these natural telescopes, the canvas itself is the first thing we really need to comprehend.

Oh, for sure. The scale of the map is just staggering.

Right.

So in August 2026, the DESE Legacy Imaging Surveys team released this map. And you don't build a 5.6 trillion pixel map by just pointing a single telescope at the sky and leaving the shutter open.

Far from it.

Yeah.

Building a map of this fidelity, it required 13 years of continuous coordinated observation.

13 years.

Yeah. Across multiple continents and, you know, multiple wavelengths of light.

Let's look at the hardware involved because the engineering alone is just staggering. You have three massive ground-based sky surveys feeding into this single unified database.

Right.

First, down in the Southern Hemisphere, there is the Dark Energy Camera Legacy Survey, or DECALS.

Yeah, DECALS.

They're using the Dark Energy Camera, which is a 570-megapixel instrument fabricated by the Department of Energy, and it's mounted on the Victor M. Blanco 4-meter telescope in Chile.

And that facility is located at the Cerro Tololo Inter-American Observatory. The geography there is just critical.

To the whole operation.

Why is that? Like, why put it all the way out there?

Well, you are high in the Chilean Andes, right, in the Atacama Desert region. The air there is incredibly thin, it's dry, and it's remarkably stable.

Okay.

In astronomy, we talk about this concept of seeing, which refers to the blurring effect of the Earth's atmosphere.

Like when stars twinkle?

Exactly.

That twinkling is atmospheric distortion. If the atmosphere is turbulent, the light from a distant galaxy literally smears across your camera sensor. The Atacama offers some of the most pristine seeing conditions on the entire planet.

Which is pretty vital when you are trying to resolve objects billions of light years away.

Oh, it's absolutely essential.

But, I mean, Chile only gives you a view of the southern sky. To build a comprehensive map, you obviously need the northern hemisphere as well. You do. So, simultaneously... You have the Mayall Z-band Legacy Survey operating the four-meter Mayall telescope at Kitt Peak National Observatory in Arizona.

Right up in Arizona, yeah.

And right next door at Kitt Peak, you also have the Beijing-Arizona Sky Survey utilizing the Bach 2.3-meter telescope.

Exactly.

And as if stitching together data from two different continents wasn't complex enough, they overlaid all of this optical data with years of infrared observations from NASA's WISE satellite mission.

Yeah, and if we connect this to the bigger picture, the logistical execution of combining these discrete data sources into a unified map is a foundational achievement in astrometric and photometric calibration.

It sounds like a total nightmare to organize.

It really is.

Think about the variables at play here. You have three different massive mirrors, each with its own microscopic imperfections.

Right, no two mirrors are identical.

Exactly.

You have different sensor architectures, the CCDs, the charge couple devices that actually capture the light. They have different sensitivities to different wavelengths. You are dealing with different atmospheric turbulence profiles in Chile versus Arizona. And then on top of all that, you are integrating space-based infrared data, which has no atmospheric distortion at all.

Okay, let's unpack this because you have 13 years of data from different hemispheres, different cameras, and different atmospheres. To make all of that act as a single map. You have to standardize the light somehow.

That is exactly the challenge. If you photograph a specific type of galaxy using the Blanco telescope in Chile, and you photograph that exact same type of galaxy using the Mayall telescope in Arizona, they must register with the exact same brightness and color profile in the final database.

Otherwise, the map is completely uneven.

Precisely.

The software pipelines required to normalize the background noise, correct for the atmospheric extinction of light, and perfectly align the astrometric coordinates of 5.6 trillion pixels, it is just a staggering computational feat.

I could only imagine.

The map has to be perfectly flush. If the coordinates are off by even a fraction of an arc second, the entire database becomes completely useless for the kind of precision cosmology they were attempting to do.

But even with a perfectly calibrated flush map, there is a massive conceptual hurdle here. The universe is three-dimensional.

Very much so, yeah.

It has incredible depth. We were talking about structures that span billions of light years. But the DESE Legacy Imaging Survey's release is definitively a 2D map. So how does a flat image contain meaningful data about a 3D universe?

That's a great question.

A 2D celestial map is essentially a projection. When a photon hits the camera sensor, it registers on an X and Y axis, what astronomers call right ascension and declination. Right. These are basically the celestial equivalents of longitude and latitude. But the sensor doesn't intrinsically know how long that photon.

Has been traveling.

It just knows that it hit the sensor. Exactly.

A photon from a star four light years away hits the exact same two-dimensional plane as a photon from a quasar four billion light years away.

Flattening the universe creates a really severe geometric ambiguity. You look at a dense cluster of light on the map, And you don't know if those galaxies are physically interacting in a massive gravitational dance, or if one is just photobombing the other from 3 billion light years further back in space. Right.

The z-axis, the depth, is just missing. And that limitation is vital to keep in mind because it sets the stage for the specific.

Anomaly they were hunting for.

Okay. A flat map is highly efficient for taking a wide field inventory. It tells you the angular position of 4 billion objects, but it forces researchers to look for highly specific morphological shapes, shapes that betray the hidden 3D geometry of the universe.

Which brings us to the actual target of this search. We have this impeccably calibrated 5.6 trillion pixel canvas. What anomaly are they actually hoping to stumble across?

Well, they're looking for gravitational lenses.

Let's dive into the mechanics of that. Sure.

The phenomenon of gravitational lensing is rooted in Albert Einstein's theory of general relativity. Right. Prior to Einstein, the Newtonian view of gravity treated space as this sort of static, empty stage where massive objects just pulled on each other.

Across a distance.

Like invisible strings.

Exactly.

But relativity redefined that entirely. Massive objects do not simply sit in space. They interact with it. They physically curve the four-dimensional fabric of space-time around them.

And the more massive the object... The deeper the curve.

That's right.

The stress-energy tensor dictates the curvature of the spacetime metric. Now, consider a photon of light emitted by a galaxy in the very early universe.

Okay, way back in time.

Right. That photon begins traveling toward Earth. In an empty universe, it travels in a perfectly straight line. But if a ridiculously massive object, say an entire elliptical galaxy or a dense cluster of galaxies encased in a massive dark matter halo... happens to lie perfectly between that distant source and our telescopes on Earth, the path of the light changes.

But the light itself isn't changing course on its own, right? It's just following the topography of space.

Exactly.

The photon is following a geodesic, which is the straightest possible path through curved spacetime. As the light from the background source passes through the deep gravitational well of the foreground galaxy, the local spacetime is warped, so the photon's path is deflected.

Let me offer a mechanical way to visualize this for you. Think about looking at a distant street lamp through the curved base of a thick glass tumbler.

Oh, that's a good analogy.

Yeah.

If you hold the glass at the right angle, the single point of light from the street lamp doesn't look like a dot anymore. It gets stretched out.

Right.

The curved glass takes the incoming light paths and forces them to cross, warping the image into glowing arcs, or a complete ring of light. or sometimes splitting the single street lamp into multiple duplicated images floating around the edge of the glass.

The optical physics of your glass tumbler analogy perfectly mirrors the gravitational physics, but instead of the refractive index of glass altering the speed and direction of the light wave, it is the unimaginable density of a galaxy altering the geometry of space.

The gravity is acting as a literal lens.

It is.

And that manifests as highly specific visual signatures in the 2D map, We categorize this into two main types, weak lensing and strong lensing. OK. Weak lensing is a subtle statistical shearing effect across millions of background galaxies. But what the DESI researchers were looking for is strong lensing.

And that requires a very specific setup, right?

Yes. It requires a near perfect alignment. When the alignment is exact, you see an Einstein ring, a perfect circle of lensed light surrounding the foreground galaxy. Wow. If the alignment is slightly off-center, or if the mass distribution of the foreground lens is elliptical rather than perfectly spherical, that ring breaks apart into elongated, glowing arcs. Sometimes you even see an Einstein cross, where the background source is duplicated into four distinct, highly magnified images surrounding the central lens.

But honestly, it mostly just looks like a smudge. If you don't know what you are looking at, an Einstein ring or a lensing arc just looks like a printing error in the digital data.

It really does.

But the scientific utility of those smudges cannot be overstated. These alignments are nature's own telescopes. The foreground mass doesn't just distort the background light, it magnifies it. This magnification allows astronomers to study galaxies from the epoch of reionization, galaxies that existed just.

After the Big Bang.

Because they'd be way too dim otherwise.

Exactly.

These sources are so distant and intrinsically faint that even our most advanced human-made observatories like the James Webb Space Telescope.

would really struggle to.

Resolve them without the magnification boost provided by a gravitational lens.

It's a cosmic cheat code. We don't have to wait centuries to build a telescope with a mirror 100 miles wide. The universe already built massive optical infrastructure. We just have to figure out how to look through it.

That's a great way to put it.

But the value goes far beyond just seeing the background object, right? The lens itself, the foreground galaxy, is hiding the biggest mystery in modern physics.

You are referring to dark matter.

Yes, absolutely.

And this is where gravitational lensing transitions from a neat optical trick into an essential cosmological tool. We know from observing the rotational speeds of galaxies that visible baryonic matter, the stars, the gas, the dust, accounts for only a tiny fraction of a galaxy's total mass.

Right, the stuff we can actually see.

The vast majority, roughly 85% of the matter in the universe is dark matter.

And it's called dark because it does not interact with the electromagnetic force. It doesn't emit light. It doesn't reflect light. It doesn't block light. It is completely invisible.

It is entirely transparent, which makes mapping it incredibly difficult. You cannot point a radio telescope or an X-ray observatory at a dark matter halo and just see it glow. You can only observe it indirectly through its gravitational influence.

And that's where the lensing comes in.

Exactly.

Because the curvature of spacetime is dictated by the total mass of an object, A gravitational lens bends light based on the combined mass of the visible stars and the invisible dark matter halo encompassing them.

So by measuring the distortion, we can basically weigh the invisible.

The math behind it is incredibly elegant. The angle of deflection is directly proportional to the mass of the lensing object. By looking at an Einstein ring and measuring its exact radius, the Einstein radius, we can calculate the exact mass enclosed within that boundary.

Okay.

We then look at the light emitting from the visible stars within that same boundary and calculate their mass. You subtract the mass of the stars from the total mass dictated by the lens, and the remainder is the dark matter profile.

That's brilliant.

It really is.

Lensing provides a.

Direct, irrefutable map of where dark matter is distributed, how dense its core is, and how far its halo extends into intergalactic space.

Which is why finding these lenses is so critical. But let's look at the reality of the search. You have 5.6 trillion pixels. You have four billion objects.

Yeah, it's a lot.

Knowing that these natural telescopes exist out there is one thing. Actually locating a faint glowing blue arc wrapped around a distant red elliptical galaxy is another entirely. If you put a team of graduate students in front of high-resolution monitors and ask them to visually scan through four billion galaxies looking for a subtle ring of light, how long would that take?

It is mathematically impractical. Human visual processing is remarkable, but at this scale, it just fails. The data set is too vast. Observers would experience eye fatigue, the false positive rate would skyrocket as human brains naturally try to find patterns in random noise. And ultimately, it is a catastrophic waste of research time.

We just aren't built to do it.

No, we aren't. The era of manual cosmological surveys is over. To scour the heavens at the trillion pixel scale, you have to remove the human eye from the initial search entirely.

We need a machine. And not just any machine, but a highly specific algorithmic architecture. Which brings us to the work of the team led by Xiaosheng Huang from Santa Clara University and the DOE's Lawrence Berkeley National Laboratory.

Right.

To find these 70 new lenses, they deployed a residual neural network.

This is a fascinating intersection of astrophysics and modern computer science. To understand why a residual neural network or a ResNet is so effective for this, we have to contrast it with earlier machine learning approaches. The foundational tool for image recognition is the convolutional neural network, or CNN.

Right. And a CNN basically works by sliding mathematical filters across an image.

It processes an image hierarchically. Yeah.

The first layer of a CNN might look at a cluster of pixels and detect simple edges or gradients, the boundary between a dark pixel and a light pixel. Okay. It passes that information to the next layer, which might combine those edges into a curve. The next layer combines curves into a circle. It builds complexity layer by layer.

But there is a massive bottleneck in that architecture, especially when you are looking for something as incredibly subtle as a faint lensing arc buried in the background noise of deep space.

Yes, the bottleneck is known as the vanishing gradient problem. As you make a traditional neural network deeper, adding dozens or hundreds of layers to make it smarter and capable of recognizing more complex patterns, The mathematical signal used to train the network degrades.

It's like the telephone game.

Oh, exactly.

You have a line of 50 people. The first person whispers a highly detailed, complex instruction into the ear of the second person. As that message gets passed down the line, tiny misinterpretations occur. People drop a word or change an emphasis. By the time the message reaches the 50th person, the original nuance is completely lost. The signal has vanished.

That analogy captures the mechanics perfectly.

In a deep network, during the back propagation process, where the AI updates its internal weights to learn from a mistake, the mathematical gradient gets multiplied by small fractions over and over.

So it just shrinks.

Exactly.

By the time the update reaches the earliest layers, the number is so infinitesimally small that the network essentially stops learning. It forgets the initial foundational features it extracted.

Enter the ResNet.

The innovation of the residual network is the skip connection. Instead of forcing the data to flow strictly sequentially through every single layer, a ResNet allows the original signal to bypass certain layers and be added directly to the output further down the network.

Oh, wow.

Mathematically, instead of a layer trying to learn a completely new underlying mapping, it learns a residual function.

So in the telephone game, instead of relying entirely on the 50th person's warped version of the message, The ResNet allows the first person to just walk down the line and hand a written note directly to the 50th person saying, here's the original context. Add this to whatever you just heard.

Yes.

The skip connection preserves the integrity of the initial feature extraction. It allows the network to be hundreds of layers deep without suffering from gradient degradation.

Which is exactly what you need for this.

It is vital for finding gravitational lenses because the visual signature is often mixed with complex noise. The AI has to look at a galaxy and separate the light of the central core from the light of spiral arms, separate that from neighboring stars, and then identify a mathematically precise curve of light that doesn't belong to any of the local geometry.

Here's where it gets really interesting. How do you actually train the dog to sniff out the bomb? You have this incredibly powerful ResNet. You have to feed it data so it knows what to look for.

The training data is the foundation of the AI's success. You cannot just show it the few hundred known gravitational lenses. That isn't a large enough data set for a deep neural network to generalize.

So what do they do?

The team relies on extensive simulations. They take real images of galaxies from the DESE surveys, and they mathematically inject simulated gravitational lenses into the data.

They fake it?

Basically, yes.

They use the known equations of general relativity to artificially warp background light around foreground objects. creating millions of highly realistic mock lenses.

So you feed the ResNet a massive diet of these simulated images. You tell it, this is what the pixel contrast looks like. This is how the color gradients shift across an Einstein ring. And the AI internalizes the mathematical scent of a gravitational lens.

Exactly.

It learns the underlying physics of light distortion without ever being explicitly programmed with the equations of relativity.

Once the ResNet is trained, its efficiency is just unmatched. It doesn't blink. It doesn't suffer from eye fatigue. It processes the 5.6 trillion pixel map with ruthless mathematical precision.

And the funneling process is dramatic. From an initial catalog that contained around 3,500 potential lens candidates, the AI-powered search acts as an ultra-fine filter. It narrows those thousands of maybes down to 76 highly promising candidates.

Just 76?

76 specific coordinates out of 4 billion objects.

What's fascinating here is how this infrastructure redefines the pace of discovery. Alexander Chikota, an associate scientist at NSF NOI AR Lab and co-author.

Of the study, framed it perfectly.

He pointed out that the combination of massive sky surveys and AI-powered data mining is transforming how we locate rare celestial objects. We are no longer reliant on serendipity.

Before this, an astronomer might be studying a specific galaxy cluster for a paper on gas dynamics and just happened to notice a weird blue streak in the background. It was luck.

Yeah, it was very lucky.

But we have transitioned from accidental discovery to systematic automated mining of the cosmos. But we must acknowledge the invisible infrastructure making that possible. The AI processing didn't happen on a laptop.

Definitely not.

No. It required the massive computational power of the National Energy Research Scientific Computing Center, or NERSC.

It's a striking contradiction that I really love. We rely on the most massive physical structures humanity has ever constructed. Four meter wide mirrors housed in gigantic rotating domes on the peaks of isolated mountains in Chile and Arizona just to physically collect the ancient photons. Right. But all of that towering macro scale hardware is entirely useless without the invisible microscopic processing power of AI supercomputers sitting in a server farm. The macro engineering of the telescope and the micro architecture of the silicon chip have to perfectly align.

It's true. The data generation has completely outpaced human analytical capacity. We are entirely dependent on machine learning to bridge the gap between collection and comprehension. However, a highly probable candidate generated by an AI is still just a candidate. Right.

Because AI is not infallible. It can hallucinate. It can misinterpret the geometry. Yes.

The ResNet looks at the pixel contrast and the color gradients and it flags an object. But a blue ring around a red galaxy in a 2D image is not definitive.

Proof of warped spacetime.

What else could it be?

Well, it could be a ring galaxy, where a collision billions of years ago caused a shockwave of star formation, creating a physical ring of blue, young stars surrounding an older red core. Or it could just be a chance alignment, two completely unrelated galaxies that just happen to sit along our line of sight, mimicking the geometry of a lens but lacking the required mass to actually bend light.

So we have 76 candidates from the AI. How do we prove they are real? If the ResNet looks at the pixels and says, This has the exact morphological signature of an Einstein ring. Why isn't that enough to publish the discovery?

Because morphology in a 2D projection is circumstantial evidence. The fundamental requirement of a gravitational lens is the 3D geometry. Mass A, the lens, must be physically located between Earth and mass B, the source.

Okay.

Therefore, mass A must be vastly closer to us than mass B. To definitively confirm a lens, you have to restore the z-axis. You have to measure the exact physical distance to the central galaxy and the exact physical distance to the glowing arc wrapping around it.

You have to prove the illusion. If the central dot is 2 billion light years away and the glowing ring is mathematically proven to be 6 billion light years away, then it's physically impossible for them to be a single interacting structure. The ring must be a mirage caused by the foreground mass.

And measuring that distance requires an entirely different type of observation. which was the focus of the follow-up study led by Lin and Toro Bortola. They had to transition from imaging to spectroscopy.

Let's dive deep into the physics of spectroscopy, because this is how we actually measure the depth of the universe. To get the 3D proof, the team used an instrument called the Multi-Unit Spectroscopic Explorer, or MUSE. And MUSE is attached to the European Southern Observatory's Very Large Telescope.

Yeah, the VLT is one of the most advanced optical facilities on Earth, utilizing a system of four-unit telescopes. But the MUSE instrument itself is the key here. It is an integral field spectrograph. To understand why MUSE is so revolutionary, we first have to understand the limitations of a traditional spectrograph. Right.

A traditional spectrograph works by taking incoming light and passing it through a prism or diffraction grating, splitting it into its component wavelengths. You get a rainbow. But you don't just see a smooth gradient of color. You see dark lines cutting across the rainbow.

Those dark lines are absorption lines. As light from a galaxy's core travels outward, it passes through the cooler gas surrounding the galaxy. The atoms in that gas, hydrogen, helium, oxygen, absorb specific wavelengths of light based on their electron configurations.

So they leave a mark.

Exactly.

When we look at the spectrum on Earth, we see gaps where those specific photons were absorbed. It acts as a chemical fingerprint.

But more importantly for this research, those lines tell us the distance. Because the universe is expanding. Right.

The expansion of space stretches the wavelength of the light traveling through it. This is cosmological redshift.

The Doppler effect, basically.

Very similar, yes.

The longer the light has been traveling, the more its wavelength has been stretched toward the red end of the spectrum. By looking at a known chemical fingerprint, say the absorption lines of hydrogen, and measuring exactly how far those lines have been shifted toward the red, we can calculate the exact velocity at which the galaxy is receding from us. Wow.

And using Hubble's law, that velocity translates directly into physical distance.

Redshift equals distance.

But here is the problem with a traditional spectrograph. You usually have to isolate a tiny sliver of the sky using a slit. You position the slit over the central foreground galaxy, take a long exposure, and get the redshift. Right. Then you have to reposition the telescope, align the slit perfectly over the faint glowing arc of the background galaxy, take another long exposure, and get the redshift.

It is incredibly inefficient and incredibly vulnerable to alignment errors. The background lensing arcs are often exceptionally faint, and tightly wrapped around the incredibly bright foreground galaxy.

So they bleed together.

Oh yeah. Trying to isolate the light of the arc from the light of the core using a traditional slit spectrograph is a nightmare of optical contamination. The light from the bright foreground object spills over and drowns out the faint signal of the background source. Which is why MUSE is so vital. MUSE doesn't use a single slit. It employs integral field spectroscopy.

The engineering behind an integral field unit, or IFU, is breathtaking. MUSE does not just take a picture, and it doesn't just take a single spectrum. It does both simultaneously across the entire focal plane.

How?

When the light from the 76 lens candidates enters the MUSE instrument, it hits an image slicer. This is an array of microscopic mirrors that physically chops the 2D image of the galaxy into dozens of thin slivers.

It's slicing up the light before it hits the sensors.

Exactly.

It slices the continuous image, reformats those slices into a single long line of light, and feeds that line into 24 separate spectrographs. The spectrographs split the light into its component wavelengths, and then the software pipeline perfectly reconstructs the original 2D image.

So the end result is that you don't just have an image made of pixels. You have an image made of spaxels, spatial pixels.

That's it exactly.

Every single point of light in the entire field of view, every point in the central galaxy, every point along the glowing arc, every patch of seemingly empty space around it has its own independent continuous spectrum attached to it.

That's incredible.

It creates a 3D spectral data cube.

You have the X and Y axes providing the high resolution spatial morphology and you have the Z axis providing the deep spectral data.

This solves the contamination problem completely. You don't have to perfectly align a mechanical slit over the arc. You just point Muse at the AI candidate, take the data cube, and then in the software you can say, show me the redshift of the pixels in the center. And it tells you the foreground galaxy is 3 billion light years away.

Then you say, show me the redshift of the pixels forming the ring. And it tells you the background source is 8 billion light years away.

The precision is absolute. Because Muse captures such a broad wavelength range from the visible out into the near-infrared, It is exquisitely sensitive to the faint emission lines like the Lyman-alpha transition of hydrogen that are characteristic of the highly distant star-forming galaxies typically acting as the background sources in these strong lensing events.

So between 2022 and 2024, the team utilized the Very Large Telescope and the MUSE instrument to observe the 76 candidates flagged by the ResNet. And the results speak to the incredible synergy of this pipeline.

They really do.

By reading the faint spectral lines embedded in the 3D data cubes, measuring the exact physical distances to both the central mass and the surrounding arcs, they confirmed that 70 out of the 76 candidates were definitively irrefutably true gravitational lenses.

A confirmation rate of 70 out of 76 is an astonishing validation of the entire methodology. It proves that the residual neural network wasn't just recognizing arbitrary pixel structures.

It actually learned it.

Yes, it had successfully internalized the underlying optical physics of spacetime curvature. The AI learned to differentiate between a physical ring galaxy and an optical illusion generated by a dark matter halo, based purely on subtle gradients in the 2D data, with an accuracy rate exceeding 90%.

So, out of an initial pool of 4 billion celestial objects, we successfully utilized an AI to find a needle in a 5.6 trillion pixel haystack, and then used a 3D spectrograph to mathematically prove the needle was real. We now have 70 brand new, perfectly aligned cosmic magnifying glasses. What do we actually do with this new arsenal?

This brings us to the profound legacy of the DESE surveys. These 70 newly confirmed lenses are scientifically fascinating case studies on their own, but their true enduring value lies in what they enable for the broader astrophysical community. They have been integrated into the DESE Strong Lens Foundry project.

The Strong Lens Foundry. I love the industrial nature of that name. It implies we are forging the tools required to build the next era of cosmology.

It is a highly accurate description. The Foundry now represents one of the largest and most robust collections of confirmed strong gravitational lenses ever assembled. And these 70 lenses are no longer just targets for observation. They are the lenses through which future observations will be made.

We are going to use them to boost our own hardware.

Precisely. These specific coordinates will dictate the observation schedules for the most powerful facilities humanity possesses. We are talking about utilizing the Hubble Space Telescope for high-resolution optical imaging, the James Webb Space Telescope for incredibly deep infrared spectroscopy, the upcoming Nancy Grace Roman Space Telescope for wide-field space-based surveys, and the Vera C. Rubin Observatory's Legacy Survey of Space and Time.

So essentially, the DESE ground-based network And the AI did the grueling work of planetary-scale scouting. They surveyed billions of objects to find the absolute best natural telescopes available in the sky. And now we are going to point our multibillion-dollar space telescopes through those natural telescopes.

This raises an important question about the evolution of the DESI project itself. It was conceived as a mapping project, a massive imaging campaign to create a 2D projection of the universe to study dark energy. But because of its unprecedented scale, its rigorous photometric calibration, and its sheer depth, it has transcended its original mandate.

It's become something bigger.

It has become a foundational catalog that will guide the trajectory of space-based astronomy for decades.

And the scientific questions we can answer using these 70 lenses are the biggest questions in physics. It all comes back to dark matter.

By utilizing instruments like the James Webb Space Telescope to observe these specific lenses, researchers will be able to probe the distribution of dark matter with a level of precision that was previously impossible. We are not just weighing the total mass of the foreground galaxy anymore. We are looking for subhalos.

Okay, let's unpack subhalos. Because dark matter isn't just a smooth, uniform sphere of invisible mass, right?

No, the leading theoretical framework is the cold dark matter model. It predicts that dark matter should clump together hierarchically. A massive dark matter halo surrounding a galaxy shouldn't be perfectly smooth. It should be filled with smaller, dense clumps of dark matter, known as subhalos. But because these subhalos don't have enough gravity to ignite star formation, they remain completely dark. We can't see them.

Unless they happen to sit perfectly in front of a lensed background arc.

Exactly.

If a small dark matter subhalo sits near the path of the lensed light, Its gravity will cause an incredibly subtle localized distortion in the already warped Einstein ring.

Like a smudge on the magnifying glass.

That's a perfect way to think of it. By using JWST to measure the microscopic fluctuations in the brightness and geometry of these 70 newly confirmed arcs, astronomers can mathematically reconstruct the clumpiness of the dark matter halo.

We can map the invisible texture of the universe. We can test if the cold dark matter model is actually correct by counting how many invisible clumps we find altering the light.

It is the ultimate test of our fundamental models of cosmic evolution. Furthermore, the extreme magnification provided by the lenses allows us to study the internal kinematics of the background galaxies themselves. We can see how gas was flowing, how stars were forming, and how supermassive black holes were feeding in galaxies that existed just a billion years after.

The Big Bang.

So what does this all mean? Let's trace the epic, multi-billion year journey of the data we've been discussing. It starts as ancient light, emitted by a primordial galaxy at the edge of the observable universe. It travels for 8 billion years across the expanding void of space. Right. Eventually, it encounters the deep gravitational well of a massive elliptical galaxy encased in a dark matter halo. The invisible mass physically curves the fabric of space-time. forcing the photons to bend, warping their trajectory into an Einstein ring.

And the light continues for another 3 billion years.

Finally, it hits the Earth. It survives the turbulent plunge through the atmosphere above the Atacama Desert or the Arizona mountains. It strikes a silicon CCD chip at the focal plane of a 4-meter mirror. It is converted into a digital signal, becoming just a few faint blue pixels buried within a staggering 5.6 trillion pixel map carefully calibrated over 13 years.

Yeah, the journey is amazing.

That map is shipped to a Department of Energy supercomputer facility, where a residual neural network mathematically bypasses the vanishing gradient problem to sift through 4 billion distinct celestial objects. The machine triggers on the mathematical scent of curved spacetime, flagging the anomaly.

Right.

Then, the very large telescope in Chile deploys an integral field unit to physically slice the light. feeding it into two dozen spectrographs. The software reads the redshift of the hydrogen emission lines, proving geometrically that the anomaly is a true cosmic illusion.

And finally, that specific coordinate is logged into the Strong Lens Foundry, where it will guide the James Webb Space Telescope to peer deeper into the origins of our universe than any human-made instrument ever could.

On its own. For you, the listener, I think there is a direct, visceral connection here to your physical place in the cosmos. We often default to thinking of space as this empty, static void where things occasionally happen. But mapping these lenses, understanding the geometry of space-time curvature, testing the clumpiness of dark matter, this isn't just abstract academic trivia.

The dark matter that these 70 lenses allow us to weigh and measure is the hidden scaffolding of reality.

It really is. It is the architectural foundation of the universe.

Without the immense gravitational pull of dark matter operating in the early universe, regular baryonic matter, the hydrogen and helium gas, would never have clumped together densely enough to form the first stars. Without dark matter, galaxies would fly apart as they spin. The Milky Way would not hold together. Our solar system would never have coalesced from a nebula. You would not exist. By finding these 70 lenses, utilizing an AI to decipher the 5.6 trillion pixel map. We are literally mapping the invisible skeleton that allows us to be here, asking these profound questions in the first place.

It is a humbling realization. We are utilizing the universe's own mass to understand the origins of its structure. The synergy between the massive optical hardware and the microscopic neural network code has granted us unprecedented access to the deep universe.

But if we step back and look at the broader implications of this methodology... the fact that we had to use a ResNet to find something hidden in data we already possessed, it leaves us with a truly provocative reality to consider.

Yeah, it really does. The DESI team spent 13 years painstakingly building the largest 2D map of the universe ever conceived. The light from those gravitational lenses had already been captured. The morphological evidence of warped spacetime was already sitting right there on the servers, fully documented in the data. Right.

But the limits of human visual processing meant we were completely blind to it. It required an artificial intelligence, an algorithm unburdened by scale or fatigue to see the optical illusions we had missed. Yeah. It forces you to wonder what other fundamental secrets of the universe, what other paradigm shifting anomalies are currently sitting quietly on hard drives right now.

The data has already been collected. The answers are already there, completely unnoticed, just waiting for the right algorithmic architecture to finally ask the right question.

How AI Is Transforming the Search for the Universe’s Hidden Structures

Kapitelklicken springt direkt hin

Shownotes

Transkriptvom Podcast bereitgestellt · Zeitmarken springen hin