Back to the NIKA2 main page

NIKA2 Re-Commissioning

March 18th-25th, 2025 + ...

NIKA2 run 72
Cryo run 84

Tuesday, March 18th, 2025

@10:30 a.m. Angel, Carsten, Monica, Stefano and maaany others arrived at the Telescope. There is a lot of snow 2-3m or more, accumulated by the wind in some spots), the windows of the dining room are completely covered. The sky is cloudy, but it seems that it might clear up a bit later. No precipitation at the moment

There's a bit of snow...

In the morning we check the NIKA2 traces:

We have a briefing to make the point of what needs to be done first.

We decide also that if we have dead times, there's no problem: we will avoid to put ourselves under pressure/stress and we will take the needed time to tackle possible problems/mistakes, discuss ideas and analyze the situation.

@13:15 LT: De-icing is switched on full power, but it's not fully working, there's some ice on the dish.

@15:25 LT: the Ar3 bump moved from 0.3 Hz to 0.6 Hz

@17:20 LT: it's still slightly snowing. Sometimes we see blu patches of sky. We check the main dish: it's mostly clean, except the upper-right rim and one of the four sub-reflectors supports. We park the antenna facing the "faint" sun, hoping it helps.

@19:00-19:30 LT: Frederic went up on the platform, but the ice on the legs of the subreflector is too hard and too far away to be reached and removed. Therefore we need to wait for the Sun to melt it tomorrow morning. Meanwhile the sky cleared up. Current air temperature: -4 C. Later the sky got foggy again.

Frederic checks the ice conditions

Wednesday, March 19th, 2025

Good morning!

@07:00 LT: We wake up with a wonderful clear sky... and wind at 20-25 m/s. The current air temperture is -6 C. The telescope is facing the rising sun, in the hope that the ice melts, but the wind forecast predicts even stronger winds later today.

@10:00 LT: The wind has surpassed 32 m/s some time ago and some clouds are coming.

@12:30 LT: we have our first daily meeting.

Thursday, March 20th, 2025

Tonight it's windy 60 m/s!!! ...

During the night, we enjoy the wind show...

@08:00 LT: Current conditions: Temperature 0 C; wind speed ~20-30 m/s; sky partially cloudy. We now wait patiently for the wind to slow down further and give us a chance to start the NIKA2 operations.

@12:00 LT: Wind stays at 30-35 m/s. Transport cancelled. Based on input from SL, dedicated PIMP page created.

@12:30 LT: we have our daily meeting.

Friday, March 21st, 2025

@09:00 LT: stopped. Wind meter frozen, but wind is probably still around 20 m/s. There is a lot of ice at the subreflector and in the lower part of the dish. Outside temperature -6deg. De-icing at full power. Low lying clouds above the telescope. AB tested the new ini file for acquisition with pimp.

@10:00 LT: Dave arriving. NIKA2 cooling ok, though 1 fan is stopped due to a block of ice.

@12:30 LT: PIMP work started:

@13:00 LT SB and CK join the PIMP work and we all test it together:

Example of RFdIdQ vs. pimp_pos, one of the first tests done this morning. We were not aware of how to set the temperatures of the cold/hot loads properly, hence this was taken with both temperatures at ~19 C.
One of the frst interferograms

@14:30 LT: DJ & AB are working on exchanging the Ar3 synthesizer, but they interrupt because it requires more operations than expected.

@14:40 LT: we continue the PIMP work. Here follow a list of the important things we do and learn. This can be used as a "practical guide" to use the PIMP in the future, and a condensed shortlist has been copied to the dedicated PIMP IRAM-ES wiki page:

@16:00-17:00 LT we are almost ready to start the PIMP integrations. Only the hot load temperature needs to reach 110 C. Meanwhile we take some test scans, to verify that the files are now correctly written, using the manual procedure. And here start some problems:

@17:20 LT it's time to go on

Summary of scan file names (in the run84_X/X36_2025_03_21/ directory):

@17:55 LT: the NIKA2 window cover is back in place. We give it some time and then we'll check the tuning again, to see if the KIDs will be back. And @18:10 they're all back, all three Arrays, with lost KIDS: 11/13/11 (Ar1,2,3). It seems that the PIMP (hot) load was too hot (we used ~110 C as recommended).

We did not find the convergent lens.

Synthesizer exchanged. However, there is no effect on the power spectra.

Saturday, March 22nd, 2025

@09:40 LT: Stopped. blue sky, low wind. But there is a lot of ice in the dish and it is -10deg. Pointing towards the sun.

@10:00 LT: Changed back to old synthesizer. One of the two NIKA2 fans starts hitting ice. Difficult to access due to risk of ice fall.

@10:40 LT: PIMP restarted. Checking black-bodies temperature settings for the PIMP. Today we keep the hot load colder (~50 C) than yesterday (~110 C). DAQ restarted; bad KIDs: 70/953, 8/578, 24/1000 (look better than yesterday). Today's data are in the run84_X/X36_2025_03_22/ directory. Here's a summary of the scans we took:

One example of today's PIMP signal (RFdIdQ vs. pimp_pos):
Today's PIMP signal

@15:00 LT: after talking with Juan, we do it again, switching the auto-tune OFF! Nevertheless, we don't solve the problem of the "plateau" at the peak signal. It takes another 2 hours, with the online live support of Juan and Andrea, to figure it out. Basically, the problem was that the moving mirror was not going all the way to 78200 steps (39 mm) as designated, but it was stopping (and coming back) at 61000 (30 mm). The illuminating point was the suggetsion by Andrea and Juan to try to "go a bit further" or move the fixed mirror - or the polarizer - by at least ~1 cm. The solution was to change the frequency resolution from 5 GHz to 3.85 GHz. Therefore, now, the best set of parameters values is:

List of scans (run84_X/X36_2025_03_22/X_2025_03_22_*_AA_man )

The last scan (nr. 90) is a test to see the effect of the auto-tune switched ON. Result: on the Ar2 traces no obvious difference is seen with respect to the scans with the auto-tune switched OFF.

Examples for Ar2 vs sample (left) and vs pimp_pos (right):
Ar2 vs sample Ar2 vs pimp_pos

Example for Ar3 vs sample (left) and bonus image of today (right):
Ar3 vs sample Brrrrr... when is Spring coming?

Fast (and dirty) spectral analysis of scan 77
WD spectra BWD spectra

Sunday, March 23rd, 2025

@09:30 LT: Still stopped, like every other day since we arrived. Snowing, foggy, -7deg.

@11:00 LT: Angel found the convergent lens of the PIMP. It was located 2 m away from the PIMP box, in a bubble wrap, with no labels whatsoever, on top of a pile of random cartoon boxes. Perfect! Than you Angel for your sharp eye! Now we mount it and re-do the PIMP story once again with this convergent lens. Note that the divergent lens is much thicker at the edge than the convergent one, therefore the screws that hold it are too long for the convergent lens (SB: no comment). Dave retrieves shorted screws. We adopt the same parameters as yesterday (see above for details).

SB thanks personally Dave for spending the weekend with us in the snow storm(s), instead of enjoying a warm sunshine down in Granada.

List of scans (run84_X/X36_2025_03_23/X_2025_03_23_*_AA_man )

@ 13:00 LT: PIMP has been de-installed, packed, and craned down again. With some more experience, the PIMP page has been updated.

Craning down PIMP's wooden box and support

@ 17:00 LT: Still stopped: windy, foggy, snowing.

@ 19:45 LT: Before craning down the PIMP, Dave closed the NIKA2 window and shielded its borders with aluminum tape. Switched to run84_tp.ini file. DAQ restarted and re-tuned: 7/953, 16/578, 9/1000 KIDs lost (Ar1,2,3). Screenshots below show the monitor and bottom-line noise traces at this time:

monitor_20250323 noisetr_ar1_20250323 noisetr_ar2_20250323 noisetr_ar3_20250323

@21:30 LT: we start the new and old make-imbf, just in case there will be a chance to go on sky during the night (so we don't have to start it at 3 a.m.)

Monday, March 24th, 2025

@ 03:30 LT: Midnight snowfall was quite intense. Frédéric removed as much ice as he could from the legs and the sub-reflector cell. Thanks, Frédéric! But a couple of large ice sticks in the upper outer rim/layers on the lower part of M1 prevent the operations. Likewise, hard ice patches in the central part of M2 are also reported. The de-icing is still on, but the effect of the sun will be essential to have the telescope in good shape. Waiting for mid-morning.

@ 08:30 LT: Telescope oriented to the Sun position, 0 deg. elevation, for contributing to the de-icing. Switching off the telescope's de-icing system. Vertex cannot be opened (hinges are probably frozen).

@ 09:40 LT: After sunlight exposition, the telescope is under minimal conditions for starting observations (a thin layer of ice in the lower part of M1 remains at the beginning). Vertex opening system works properly. Moving the telescope close to 2251+158. DAQ restarted and re-tuned: 4/953, 16/578, 9/1000 KIDs lost. Nicolas Ponthieu joins us through skype. Adopting previous DAFs of array 2 for quick-look reduction using PIIC.

The first surprise of the morning was the absence of data from box C (array 2) after the first pointing and focus scans. See the results from PIIC and IDL for (e.g.) scan 20250324s35 in the screenshots below:

scan35_ar2_PIIC scan35_ar2_IDL

Several hypotheses are being managed. Firstly, DAQ was restarted twice and a hard reset of the Ar2 electronics was done. There is a suspicion that some KIDs of box C are noisier than expected, for any unknown reason so far. Stefano and Nicolas are editing the corresponding rejection thresholds -provisionally- in the KIDs signal in the PIIC and IDL-RTA codes, respectively, with the intention of recovering as many of them as possible in box C. Preliminary DAFs and KidPars are in progress.

Before the daily meeting, a partial beam map (scan 20250324s22; 25 scans) and two full beam maps (s23 and s37) were obtained, all of them on 2251+158. Beam shape was improving quickly since the beginning of the observations, getting a FWHM ~ 17.46" x 18.32" about 2.5 hours after the beginning of the observations.

@ 12:30 LT: Daily meeting (MR, SB, CK, DJ, IM, SA, SL, AS, AM, MS, AB). Updating about re-commissioning progress since last Friday. AM asked for obtaining some timelines for each array during scans on (e.g.) a planet.

@ 13:00 LT: Moving to Uranus when El. ~40 deg. From focus sequences, beam geometry is improving clearly. The screenshots below show the timelines of focus scans on Uranus per arrays 2 (box C), 1 and 3:

timelines_Uranus_ar2 timelines_Uranus_ar1 timelines_Uranus_ar3

Note by SL: For A2 it seems you have plotted KIDs from box C which has a problem as you mentioned previously, so this is not representative of how the signal is for the boxes which don't have problem... Could you display the timelines of another box?

Getting skydips (s44, s99) and a full beam map (on-focus) on Uranus (s58).

@ 14:35 LT: Starting a calib_1scan session: Uranus (s61), MWC349 (s68), CRL2688 (s69), NGC7027 (s70), W3OH (s82)

@ 16:00 LT: Becoming cloudy. Last pointing corrections tell us about possible anomalous refraction in the l.o.s. Inside the cloud at 16:10 (LT). Observations stopped.

@ 17:30 LT: quick update on the preparation of the PIIC DAFs by SB:

While processing the beam maps with PIIC, it happened that the "new" imbf have a number of record couples with the same time. Jean has been notified. Meanwhile the imbf produced by the old make-imbf are being used.

List of KIDs numbering correspondences:

KID-ID (NIKA2 run 72 .ini)

NAME

Array

PIIC (run 68 sweep)

PIIC (run 72 sweep)

NOtes

821

KC016

2

363

363

OLD reference KID

813

KC009

2

355

355

Temp used by Stefano but failed on Ar1 and Ar3 w/ segm. fault!

416

KB013

2

202

202

Temp used by Stefano

6083

KP004

3

520

425

Temp used by Nicolas

@ 18:35 LT: Resuming observations. DAQ restarted and re-tuned: 9/953, 13/578, 22/1000 KIDs lost.

The screenshots below show a new set of timelines from focus scans on Mars per arrays 2 (box B), 1 (box H), and 3 (box Q):

timelines3_Mars_ar2 timelines3_Mars_ar1 timelines3_Mars_ar3

@20:00 LT: the POLAMI group of Ivan Agudo takes over, for 4 hours of POLAMI observations,.

@20:30 LT: we welcome back our old good friends, the Spindle / Hexapod Errors.. this time with some extra twist that complicate the recovery (Frederic et al. are working on it). We did not miss you!

@22:00 LT: after fighting with Box C, NIKA2 and PIIC for the whole day, Stefano finally converges to a preliminary PIIC analysis of the beam-maps. Sorry for the delay: I re-did it N times, seeking different solutions for the reference KID and trying different tricks to solve the missing KID 363, but without success. Therefore now the preliminary version is based on KID 202 of Ar2 (see table above). The best beam map so far is scan 20250324s58, in my opinion. To be improved in the +/- near future with new data.

Here follow some plots that visualize the current status of the arrays, via the beam-maps analysis.

IDL results by Nicolas (thank you!), based on beam map 20250324s58:
IDL results on 20250324s58 IDL results on 20250324s58

PIIC results by Stefano, based on beam map 20250324s58:
PIIC results on 20250324s58, Ar2 PIIC results on 20250324s58, Ar2 PIIC results on 20250324s58, Ar2 PIIC results on 20250324s58, Ar2
PIIC results on 20250324s58, Ar1 PIIC results on 20250324s58, Ar1
PIIC results on 20250324s58, Ar3 PIIC results on 20250324s58, Ar3

Note that in the reduction/analysis of beam maps the Ar2 Box C is (much) more populated than in the on the fly reduction of pointing/focus/maps scans. This is because of different thresholds (values/types) adopted in the different kinds of data reduction. The reference KID (363 Ar2) is rejected by PIIC because of very low (bad) flat field correction and also because of very low correlation coefficient. This happens likely because of the enhanced noise of Ar2 Box C.

As a comparison, the flat fields given by Perotto et al. 2020 are shown here:

Flat fields from Perotto+2020

Moreover, when reducing the pointing/focus or calib_1scan maps on the fly with PIIC, we noticed that Ar2 Box C is rejected systematically, but when the noise of the timelines is very high, few KIDs of Box C are retained. This likely happens because the rejection is done based on the noise of the given KID vs. the median noise of the whole array. Here follows a couple of examples: scans 20250324s7 and s103 (focus the attention on the top-right panel).

PIIC example of noisy scan, keeping some of the Ar2 Box C KIDs PIIC example of noisy scan, keeping few of the Ar2 Box C KIDs

Despite the fact that the beams did not look so nice today (especially at 1mm, likely due to bad sky conditions, but we cannot exclude some bad optics effects at this stage), here come some focus statistics (20250324s...), to be taken with a lot of grains of salt (approximative values, plus some targets are intrinsically extended). [NOTE: I later added also the 2025/03/25 (better) scans.]

2025/03/24

2025/03/25

scans

target

Ar2

Ar1

Ar3

scans

target

Ar2

Ar1

Ar3

6-10

2251+158

bad

bad

bad

6-10

1253-055

1.30

1.28

1.55

11-15

2251+158

2.18

bad

bad

13-17

MWC349

1.32

1.30

1.60

16-20

2251+158

2.50

2.55

2.72

21-25

NGC7027

1.25

1.25

1.52

24-28

2251+158

2.00

-

2.20

28-32

K3-50A

1.34

1.29

1.64

29-33

2251+158

1.90

-

2.15

35-39

CRL2688

1.29

1.30

1.56

39-43

Uranus

1.35

-

-

42-46

MWC349

1.25

1.24

1.50

47-51

Uranus

1.10

-

-

49-53

CRL2688

1.28

1.30

>1.70

52-56

Uranus

1.10

-

-

56-60

NGC7027

1.40

1.35

>1.70

63-67

MWC349

0.80

0.83

0.95

63-67

K3-50A

1.30

1.33

1.53

72-76

W3OH

0.95

1.00

1.10

71-75

MWC349

1.36

1.45

1.75

77-81

W3OH

0.80

1.05

bad

78-82

CRL2688

1.35

1.41

>1.70

88-92

Uranus

1.20

-

-

85-89

NGC7027

1.47

1.53

>1.70

93-97

Uranus

1.25

-

-

92-96

MWC349

1.55

1.63

1.90

103-107

Mars

1.30

1.51

1.60

112-116

W3OH

bad

bad

bad

150-154

Mars

1.40

1.45

1.53

117-121

W3OH

1.25

1.26

1.49

156-160

Mars

1.30

1.30

1.50

Tuesday, March 25th, 2025

@00:00 LT: we restart the NIKA2 observations. Lost KIDs: 4/8/19

A nice example of focus (the best so far, scan 156):
PIIC Ar2 focus scans 156-160 PIIC Ar1 focus scans 156-160 PIIC Ar3 focus scans 156-160

@01:00 LT. Lost KIDs 15/11/54 on the DAQ

@01:20 LT we try to work on the electronics:

@03:20 Wonderful sky, we continue looping on pointing/focus/calibrators

@03:40 LT: Beammap on 1253-055 (scan 20250325s11). Very stable conditions: +-1Jy. tau225~0.23.

@04:40 LT: pointing, focus, calib_1scan on MWC349 (3 calib_1scans: 19,47,76), NGC7027 (3 calib_1scans; 26,61,90), K3-50A (2 calib_1scans; 33,69), CRL2688 (3 calib_1scans; 40,54,83).

@08:19 LT: Telescope alarm activated; hexapod error (Hxp limit XY triggered, according to the ACU prompter; it happens for the second time in ~12h as far as there is news). Stopped. Trying to recover the telescope. Enrique Lobato and Manuel Nieto (TG) are working on that.

@10:00 LT: After several tries, we continue with the problem. Trying again on W3OH. Pointing & focus okay. Then, a calib_1scan. Week finished.

@12:00-16:00 LT: Nicolas: Early analysis of March 24th and 25th focus sequences (IDL):

focus_3 focus_1 focus_2

The last plot shows the calib per kid mJy/Hz and the beam FWHM. No straightforward correlation between the central disk visible in calib and the beam FWHM. There's a hint of the same NW-SE band on A3 beam as on A2 calib... ? True or fake ? Could the dichroic explain this ?

focus_3 focus_1 focus_2 focus_2

@14:39 LT: explanation of the noisier BOX C, by Alessandro and Dave:

Friday, March 28th, 2025

Angel, Dave and Stefano arrived again, safe, at the telescope.

@12:00 LT: Dave changed the (blue) polarisation box of channel 7 with a spare unit, but the ADC value of box C did not change.

@12:30 LT: we have our re-commissioning daily meeting:

@13:30 LT: Detailed plan, decided in the post-teleconf briefing here on site:

Good night!

Saturday, March 29th, 2025

We start the day with some "real astronomers" work...

Real astronomers at work! After a bit of stretch and unsharp masking