Sep 17 03:12:37.701491 ip-10-0-131-70 systemd[1]: Starting Kubernetes Kubelet... Sep 17 03:12:38.057182 ip-10-0-131-70 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 03:12:38.057182 ip-10-0-131-70 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 03:12:38.057182 ip-10-0-131-70 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 03:12:38.057182 ip-10-0-131-70 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 03:12:38.057182 ip-10-0-131-70 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 03:12:38.059697 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.059622 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 03:12:38.064117 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064096 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:12:38.064117 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064115 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:12:38.064117 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064121 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:12:38.064241 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064125 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:12:38.064241 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064128 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:12:38.064241 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064131 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:12:38.064241 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064134 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:12:38.064241 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064137 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:12:38.064241 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064140 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:12:38.064241 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064143 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:12:38.064241 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064146 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:12:38.064241 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064149 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:12:38.064241 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064151 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:12:38.064241 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064154 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:12:38.064241 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064156 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:12:38.064241 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064159 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:12:38.064241 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064162 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:12:38.064241 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064165 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:12:38.064241 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064167 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:12:38.064241 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064170 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:12:38.064241 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064175 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:12:38.064241 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064179 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:12:38.064241 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064182 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:12:38.064717 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064185 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:12:38.064717 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064188 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:12:38.064717 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064191 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:12:38.064717 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064194 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:12:38.064717 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064202 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:12:38.064717 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064205 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:12:38.064717 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064208 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:12:38.064717 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064211 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:12:38.064717 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064214 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:12:38.064717 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064216 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:12:38.064717 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064219 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:12:38.064717 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064222 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:12:38.064717 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064225 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:12:38.064717 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064228 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:12:38.064717 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064231 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:12:38.064717 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064236 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:12:38.064717 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064239 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:12:38.064717 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064243 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:12:38.064717 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064246 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:12:38.065203 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064248 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:12:38.065203 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064252 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:12:38.065203 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064254 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:12:38.065203 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064257 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:12:38.065203 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064260 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:12:38.065203 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064262 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:12:38.065203 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064265 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:12:38.065203 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064268 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:12:38.065203 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064272 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:12:38.065203 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064274 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:12:38.065203 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064277 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:12:38.065203 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064281 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:12:38.065203 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064283 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:12:38.065203 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064286 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:12:38.065203 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064289 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:12:38.065203 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064292 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:12:38.065203 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064294 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:12:38.065203 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064297 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:12:38.065203 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064301 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:12:38.065651 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064303 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:12:38.065651 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064306 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:12:38.065651 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064309 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:12:38.065651 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064311 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:12:38.065651 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064314 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:12:38.065651 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064316 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:12:38.065651 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064319 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:12:38.065651 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064324 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:12:38.065651 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064328 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:12:38.065651 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064331 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:12:38.065651 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064333 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:12:38.065651 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064336 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:12:38.065651 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064339 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:12:38.065651 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064341 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:12:38.065651 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064344 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:12:38.065651 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064347 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:12:38.065651 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064350 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:12:38.065651 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064352 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:12:38.065651 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064355 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:12:38.065651 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064357 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:12:38.066153 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064360 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:12:38.066153 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064363 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:12:38.066153 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064366 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:12:38.066153 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064369 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:12:38.066153 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064371 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:12:38.066153 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064374 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:12:38.066153 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064377 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:12:38.066153 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064380 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:12:38.066153 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064382 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:12:38.066153 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064385 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:12:38.066153 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064387 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:12:38.066153 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064390 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:12:38.066153 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064392 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:12:38.066153 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064395 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:12:38.066153 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064397 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:12:38.066153 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064400 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:12:38.066153 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064403 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:12:38.066153 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.064405 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:12:38.066153 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065149 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:12:38.066153 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065157 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:12:38.066629 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065160 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:12:38.066629 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065163 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:12:38.066629 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065166 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:12:38.066629 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065169 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:12:38.066629 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065171 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:12:38.066629 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065174 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:12:38.066629 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065177 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:12:38.066629 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065180 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:12:38.066629 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065183 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:12:38.066629 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065185 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:12:38.066629 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065188 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:12:38.066629 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065190 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:12:38.066629 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065193 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:12:38.066629 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065195 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:12:38.066629 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065198 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:12:38.066629 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065201 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:12:38.066629 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065204 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:12:38.066629 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065206 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:12:38.066629 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065209 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:12:38.066629 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065212 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:12:38.067145 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065214 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:12:38.067145 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065217 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:12:38.067145 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065219 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:12:38.067145 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065222 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:12:38.067145 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065225 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:12:38.067145 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065227 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:12:38.067145 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065229 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:12:38.067145 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065234 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:12:38.067145 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065238 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:12:38.067145 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065240 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:12:38.067145 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065243 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:12:38.067145 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065246 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:12:38.067145 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065249 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:12:38.067145 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065252 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:12:38.067145 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065255 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:12:38.067145 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065257 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:12:38.067145 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065260 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:12:38.067145 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065262 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:12:38.067145 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065265 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:12:38.067611 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065268 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:12:38.067611 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065270 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:12:38.067611 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065273 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:12:38.067611 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065275 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:12:38.067611 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065278 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:12:38.067611 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065280 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:12:38.067611 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065282 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:12:38.067611 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065285 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:12:38.067611 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065287 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:12:38.067611 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065291 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:12:38.067611 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065293 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:12:38.067611 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065296 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:12:38.067611 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065298 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:12:38.067611 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065301 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:12:38.067611 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065303 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:12:38.067611 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065305 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:12:38.067611 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065308 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:12:38.067611 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065310 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:12:38.067611 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065313 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:12:38.067611 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065316 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:12:38.068110 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065318 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:12:38.068110 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065321 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:12:38.068110 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065323 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:12:38.068110 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065325 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:12:38.068110 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065328 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:12:38.068110 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065331 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:12:38.068110 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065352 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:12:38.068110 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065355 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:12:38.068110 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065359 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:12:38.068110 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065362 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:12:38.068110 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065365 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:12:38.068110 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065368 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:12:38.068110 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065370 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:12:38.068110 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065373 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:12:38.068110 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065376 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:12:38.068110 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065378 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:12:38.068110 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065381 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:12:38.068110 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065383 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:12:38.068110 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065386 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:12:38.068110 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065388 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:12:38.068593 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065391 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:12:38.068593 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065393 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:12:38.068593 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065396 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:12:38.068593 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065399 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:12:38.068593 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065401 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:12:38.068593 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065406 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:12:38.068593 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065410 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:12:38.068593 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065413 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:12:38.068593 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065415 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:12:38.068593 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065418 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:12:38.068593 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065421 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:12:38.068593 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065424 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:12:38.068593 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065427 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:12:38.068593 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065430 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:12:38.068593 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065433 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:12:38.068593 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065435 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:12:38.068593 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065438 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:12:38.068593 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065441 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:12:38.068593 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065842 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:12:38.069081 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065847 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:12:38.069081 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065850 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:12:38.069081 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065853 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:12:38.069081 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065856 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:12:38.069081 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065859 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:12:38.069081 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065864 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:12:38.069081 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065867 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:12:38.069081 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065869 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:12:38.069081 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065872 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:12:38.069081 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065874 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:12:38.069081 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065877 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:12:38.069081 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065879 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:12:38.069081 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065882 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:12:38.069081 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065885 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:12:38.069081 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065887 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:12:38.069081 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065890 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:12:38.069081 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065892 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:12:38.069081 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065895 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:12:38.069081 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065897 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:12:38.069081 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065900 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:12:38.069591 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065903 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:12:38.069591 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065905 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:12:38.069591 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065908 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:12:38.069591 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065910 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:12:38.069591 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065913 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:12:38.069591 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065915 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:12:38.069591 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065917 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:12:38.069591 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065920 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:12:38.069591 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065922 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:12:38.069591 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065928 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:12:38.069591 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065931 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:12:38.069591 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065934 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:12:38.069591 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065937 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:12:38.069591 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065940 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:12:38.069591 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065944 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:12:38.069591 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065947 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:12:38.069591 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065950 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:12:38.069591 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065955 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:12:38.069591 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065958 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:12:38.070064 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065961 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:12:38.070064 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065963 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:12:38.070064 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065967 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:12:38.070064 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065969 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:12:38.070064 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065972 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:12:38.070064 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065974 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:12:38.070064 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065977 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:12:38.070064 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065979 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:12:38.070064 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065982 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:12:38.070064 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.065984 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:12:38.070064 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066003 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:12:38.070064 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066006 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:12:38.070064 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066008 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:12:38.070064 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066011 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:12:38.070064 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066013 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:12:38.070064 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066016 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:12:38.070064 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066018 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:12:38.070064 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066021 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:12:38.070064 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066023 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:12:38.070064 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066025 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:12:38.070572 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066028 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:12:38.070572 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066030 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:12:38.070572 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066034 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:12:38.070572 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066037 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:12:38.070572 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066039 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:12:38.070572 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066042 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:12:38.070572 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066044 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:12:38.070572 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066047 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:12:38.070572 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066049 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:12:38.070572 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066053 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:12:38.070572 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066056 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:12:38.070572 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066059 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:12:38.070572 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066061 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:12:38.070572 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066064 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:12:38.070572 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066066 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:12:38.070572 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066069 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:12:38.070572 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066071 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:12:38.070572 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066074 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:12:38.070572 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066076 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:12:38.070572 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066079 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:12:38.071083 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066081 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:12:38.071083 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066084 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:12:38.071083 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066087 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:12:38.071083 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066089 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:12:38.071083 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066093 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:12:38.071083 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066096 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:12:38.071083 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066099 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:12:38.071083 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066101 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:12:38.071083 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066104 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:12:38.071083 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066106 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:12:38.071083 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066109 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:12:38.071083 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066111 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:12:38.071083 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066114 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:12:38.071083 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066116 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:12:38.071083 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066120 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:12:38.071083 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066122 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:12:38.071083 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066124 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:12:38.071083 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066127 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:12:38.071083 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066129 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:12:38.071083 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066194 2574 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 03:12:38.071570 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066232 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 03:12:38.071570 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066239 2574 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 03:12:38.071570 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066245 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 03:12:38.071570 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066250 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 03:12:38.071570 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066253 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 03:12:38.071570 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066257 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 03:12:38.071570 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066261 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 03:12:38.071570 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066264 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 03:12:38.071570 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066267 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 03:12:38.071570 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066270 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 03:12:38.071570 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066273 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 03:12:38.071570 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066276 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 03:12:38.071570 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066279 2574 flags.go:64] FLAG: --cgroup-root="" Sep 17 03:12:38.071570 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066282 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 03:12:38.071570 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066285 2574 flags.go:64] FLAG: --client-ca-file="" Sep 17 03:12:38.071570 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066288 2574 flags.go:64] FLAG: --cloud-provider="external" Sep 17 03:12:38.071570 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066291 2574 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 03:12:38.071570 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066295 2574 flags.go:64] FLAG: --cluster-domain="" Sep 17 03:12:38.071570 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066298 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 03:12:38.071570 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066301 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 03:12:38.071570 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066304 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 03:12:38.071570 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066307 2574 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 03:12:38.071570 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066310 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 03:12:38.071570 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066314 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 03:12:38.072200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066317 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 03:12:38.072200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066320 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 03:12:38.072200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066324 2574 flags.go:64] FLAG: --contention-profiling="false" Sep 17 03:12:38.072200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066327 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 03:12:38.072200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066330 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 03:12:38.072200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066333 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 03:12:38.072200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066335 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 03:12:38.072200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066340 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 03:12:38.072200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066342 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 03:12:38.072200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066345 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 03:12:38.072200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066349 2574 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 03:12:38.072200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066352 2574 flags.go:64] FLAG: --enable-server="true" Sep 17 03:12:38.072200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066355 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 03:12:38.072200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066359 2574 flags.go:64] FLAG: --event-burst="100" Sep 17 03:12:38.072200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066362 2574 flags.go:64] FLAG: --event-qps="50" Sep 17 03:12:38.072200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066377 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 03:12:38.072200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066381 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 03:12:38.072200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066384 2574 flags.go:64] FLAG: --eviction-hard="" Sep 17 03:12:38.072200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066388 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 03:12:38.072200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066390 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 03:12:38.072200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066393 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 03:12:38.072200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066396 2574 flags.go:64] FLAG: --eviction-soft="" Sep 17 03:12:38.072200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066399 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 03:12:38.072200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066402 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 03:12:38.072200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066405 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 03:12:38.072910 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066408 2574 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 03:12:38.072910 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066411 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 03:12:38.072910 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066414 2574 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 03:12:38.072910 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066417 2574 flags.go:64] FLAG: --feature-gates="" Sep 17 03:12:38.072910 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066420 2574 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 03:12:38.072910 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066423 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 03:12:38.072910 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066426 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 03:12:38.072910 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066429 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 03:12:38.072910 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066431 2574 flags.go:64] FLAG: --healthz-port="10248" Sep 17 03:12:38.072910 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066435 2574 flags.go:64] FLAG: --help="false" Sep 17 03:12:38.072910 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066438 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-131-70.ec2.internal" Sep 17 03:12:38.072910 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066442 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 03:12:38.072910 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066445 2574 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 03:12:38.072910 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066448 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 03:12:38.072910 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066451 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 03:12:38.072910 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066454 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 03:12:38.072910 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066457 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 03:12:38.072910 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066461 2574 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 03:12:38.072910 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066464 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 03:12:38.072910 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066467 2574 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 03:12:38.072910 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066470 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 03:12:38.072910 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066473 2574 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 03:12:38.072910 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066476 2574 flags.go:64] FLAG: --kube-reserved="" Sep 17 03:12:38.072910 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066478 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 03:12:38.073571 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066481 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 03:12:38.073571 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066484 2574 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 03:12:38.073571 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066486 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 03:12:38.073571 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066489 2574 flags.go:64] FLAG: --lock-file="" Sep 17 03:12:38.073571 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066492 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 03:12:38.073571 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066495 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 03:12:38.073571 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066497 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 03:12:38.073571 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066503 2574 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 03:12:38.073571 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066506 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 03:12:38.073571 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066509 2574 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 03:12:38.073571 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066511 2574 flags.go:64] FLAG: --logging-format="text" Sep 17 03:12:38.073571 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066514 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 03:12:38.073571 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066517 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 03:12:38.073571 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066520 2574 flags.go:64] FLAG: --manifest-url="" Sep 17 03:12:38.073571 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066523 2574 flags.go:64] FLAG: --manifest-url-header="" Sep 17 03:12:38.073571 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066527 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 03:12:38.073571 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066529 2574 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 03:12:38.073571 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066534 2574 flags.go:64] FLAG: --max-pods="110" Sep 17 03:12:38.073571 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066537 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 03:12:38.073571 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066540 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 03:12:38.073571 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066543 2574 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 03:12:38.073571 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066546 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 03:12:38.073571 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066549 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 03:12:38.073571 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066552 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 03:12:38.073571 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066555 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 03:12:38.074216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066563 2574 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 03:12:38.074216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066566 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 03:12:38.074216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066569 2574 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 03:12:38.074216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066572 2574 flags.go:64] FLAG: --pod-cidr="" Sep 17 03:12:38.074216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066575 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 17 03:12:38.074216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066581 2574 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 03:12:38.074216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066583 2574 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 03:12:38.074216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066586 2574 flags.go:64] FLAG: --pods-per-core="0" Sep 17 03:12:38.074216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066589 2574 flags.go:64] FLAG: --port="10250" Sep 17 03:12:38.074216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066592 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 03:12:38.074216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066595 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01451656d2e2a4606" Sep 17 03:12:38.074216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066598 2574 flags.go:64] FLAG: --qos-reserved="" Sep 17 03:12:38.074216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066601 2574 flags.go:64] FLAG: --read-only-port="10255" Sep 17 03:12:38.074216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066604 2574 flags.go:64] FLAG: --register-node="true" Sep 17 03:12:38.074216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066607 2574 flags.go:64] FLAG: --register-with-taints="" Sep 17 03:12:38.074216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066610 2574 flags.go:64] FLAG: --registry-burst="10" Sep 17 03:12:38.074216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066620 2574 flags.go:64] FLAG: --registry-qps="5" Sep 17 03:12:38.074216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066623 2574 flags.go:64] FLAG: --reserved-cpus="" Sep 17 03:12:38.074216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066626 2574 flags.go:64] FLAG: --reserved-memory="" Sep 17 03:12:38.074216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066633 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 03:12:38.074216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066637 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 03:12:38.074216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066639 2574 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 03:12:38.074216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066642 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 03:12:38.074216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066645 2574 flags.go:64] FLAG: --runonce="false" Sep 17 03:12:38.074216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066648 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 03:12:38.074822 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066653 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 03:12:38.074822 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066656 2574 flags.go:64] FLAG: --seccomp-default="false" Sep 17 03:12:38.074822 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066659 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 03:12:38.074822 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066662 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 03:12:38.074822 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066665 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 03:12:38.074822 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066668 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 03:12:38.074822 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066671 2574 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 03:12:38.074822 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066674 2574 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 03:12:38.074822 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066677 2574 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 03:12:38.074822 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066680 2574 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 03:12:38.074822 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066683 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 03:12:38.074822 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066686 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 03:12:38.074822 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066689 2574 flags.go:64] FLAG: --system-cgroups="" Sep 17 03:12:38.074822 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066692 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 03:12:38.074822 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066697 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 03:12:38.074822 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066700 2574 flags.go:64] FLAG: --tls-cert-file="" Sep 17 03:12:38.074822 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066702 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 03:12:38.074822 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066706 2574 flags.go:64] FLAG: --tls-min-version="" Sep 17 03:12:38.074822 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066709 2574 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 03:12:38.074822 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066712 2574 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 03:12:38.074822 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066714 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 03:12:38.074822 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066717 2574 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 03:12:38.074822 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066720 2574 flags.go:64] FLAG: --v="2" Sep 17 03:12:38.074822 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066724 2574 flags.go:64] FLAG: --version="false" Sep 17 03:12:38.074822 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066728 2574 flags.go:64] FLAG: --vmodule="" Sep 17 03:12:38.075446 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066732 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 03:12:38.075446 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.066735 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 03:12:38.075446 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066850 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:12:38.075446 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066855 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:12:38.075446 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066858 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:12:38.075446 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066861 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:12:38.075446 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066864 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:12:38.075446 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066870 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:12:38.075446 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066872 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:12:38.075446 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066875 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:12:38.075446 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066877 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:12:38.075446 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066880 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:12:38.075446 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066882 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:12:38.075446 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066885 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:12:38.075446 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066887 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:12:38.075446 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066890 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:12:38.075446 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066893 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:12:38.075446 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066895 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:12:38.075446 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066899 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:12:38.075934 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066903 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:12:38.075934 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066905 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:12:38.075934 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066908 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:12:38.075934 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066910 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:12:38.075934 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066913 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:12:38.075934 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066916 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:12:38.075934 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066918 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:12:38.075934 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066920 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:12:38.075934 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066923 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:12:38.075934 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066926 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:12:38.075934 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066928 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:12:38.075934 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066931 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:12:38.075934 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066933 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:12:38.075934 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066936 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:12:38.075934 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066939 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:12:38.075934 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066942 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:12:38.075934 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066944 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:12:38.075934 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066946 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:12:38.075934 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066949 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:12:38.076420 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066953 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:12:38.076420 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066959 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:12:38.076420 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066963 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:12:38.076420 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066968 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:12:38.076420 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066971 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:12:38.076420 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066975 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:12:38.076420 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066978 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:12:38.076420 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066981 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:12:38.076420 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.066984 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:12:38.076420 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067001 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:12:38.076420 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067005 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:12:38.076420 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067007 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:12:38.076420 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067011 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:12:38.076420 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067014 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:12:38.076420 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067017 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:12:38.076420 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067020 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:12:38.076420 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067023 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:12:38.076420 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067025 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:12:38.076420 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067028 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:12:38.076883 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067031 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:12:38.076883 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067033 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:12:38.076883 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067036 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:12:38.076883 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067038 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:12:38.076883 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067040 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:12:38.076883 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067043 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:12:38.076883 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067046 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:12:38.076883 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067048 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:12:38.076883 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067051 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:12:38.076883 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067054 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:12:38.076883 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067057 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:12:38.076883 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067059 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:12:38.076883 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067061 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:12:38.076883 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067064 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:12:38.076883 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067068 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:12:38.076883 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067071 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:12:38.076883 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067073 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:12:38.076883 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067076 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:12:38.076883 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067078 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:12:38.076883 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067081 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:12:38.077394 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067083 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:12:38.077394 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067086 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:12:38.077394 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067088 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:12:38.077394 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067091 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:12:38.077394 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067093 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:12:38.077394 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067096 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:12:38.077394 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067099 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:12:38.077394 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067101 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:12:38.077394 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067104 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:12:38.077394 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067108 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:12:38.077394 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067110 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:12:38.077394 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067113 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:12:38.077394 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067115 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:12:38.077394 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067118 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:12:38.077394 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067121 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:12:38.077394 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067123 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:12:38.077394 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067126 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:12:38.077394 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067128 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:12:38.077394 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067131 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:12:38.077394 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067133 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:12:38.077874 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067136 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:12:38.077874 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067139 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:12:38.077874 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067141 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:12:38.077874 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.067144 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:12:38.077874 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.067698 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 03:12:38.077874 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.074593 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 03:12:38.077874 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.074608 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 03:12:38.077874 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.075337 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 03:12:38.077874 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.075345 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 03:12:38.077874 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075406 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:12:38.077874 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075411 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:12:38.077874 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075414 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:12:38.077874 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075417 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:12:38.077874 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075420 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:12:38.077874 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075423 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:12:38.078280 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075425 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:12:38.078280 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075428 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:12:38.078280 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075430 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:12:38.078280 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075433 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:12:38.078280 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075436 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:12:38.078280 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075438 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:12:38.078280 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075441 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:12:38.078280 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075444 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:12:38.078280 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075447 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:12:38.078280 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075449 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:12:38.078280 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075452 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:12:38.078280 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075455 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:12:38.078280 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075457 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:12:38.078280 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075460 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:12:38.078280 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075462 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:12:38.078280 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075465 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:12:38.078280 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075468 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:12:38.078280 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075470 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:12:38.078280 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075473 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:12:38.078280 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075476 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:12:38.078773 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075479 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:12:38.078773 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075481 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:12:38.078773 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075484 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:12:38.078773 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075488 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:12:38.078773 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075491 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:12:38.078773 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075493 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:12:38.078773 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075496 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:12:38.078773 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075499 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:12:38.078773 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075501 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:12:38.078773 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075504 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:12:38.078773 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075506 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:12:38.078773 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075509 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:12:38.078773 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075511 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:12:38.078773 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075514 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:12:38.078773 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075516 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:12:38.078773 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075519 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:12:38.078773 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075521 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:12:38.078773 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075523 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:12:38.078773 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075526 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:12:38.079296 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075529 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:12:38.079296 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075533 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:12:38.079296 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075536 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:12:38.079296 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075539 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:12:38.079296 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075542 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:12:38.079296 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075545 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:12:38.079296 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075548 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:12:38.079296 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075550 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:12:38.079296 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075553 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:12:38.079296 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075555 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:12:38.079296 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075558 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:12:38.079296 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075560 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:12:38.079296 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075563 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:12:38.079296 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075565 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:12:38.079296 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075568 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:12:38.079296 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075571 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:12:38.079296 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075573 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:12:38.079296 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075576 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:12:38.079296 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075579 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:12:38.079296 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075582 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:12:38.079775 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075584 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:12:38.079775 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075586 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:12:38.079775 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075589 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:12:38.079775 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075592 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:12:38.079775 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075594 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:12:38.079775 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075597 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:12:38.079775 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075599 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:12:38.079775 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075602 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:12:38.079775 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075604 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:12:38.079775 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075607 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:12:38.079775 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075609 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:12:38.079775 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075613 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:12:38.079775 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075616 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:12:38.079775 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075619 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:12:38.079775 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075622 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:12:38.079775 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075625 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:12:38.079775 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075628 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:12:38.079775 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075630 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:12:38.079775 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075633 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:12:38.080307 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075635 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:12:38.080307 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075639 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:12:38.080307 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075643 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:12:38.080307 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075646 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:12:38.080307 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075649 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:12:38.080307 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075651 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:12:38.080307 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075653 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:12:38.080307 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075656 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:12:38.080307 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075660 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:12:38.080307 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075663 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:12:38.080307 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075665 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:12:38.080307 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075668 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:12:38.080307 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075671 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:12:38.080307 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075673 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:12:38.080307 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075675 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:12:38.080663 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.075680 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 03:12:38.080663 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075830 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:12:38.080663 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075835 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:12:38.080663 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075838 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:12:38.080663 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075841 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:12:38.080663 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075844 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:12:38.080663 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075847 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:12:38.080663 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075850 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:12:38.080663 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075852 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:12:38.080663 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075855 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:12:38.080663 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075858 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:12:38.080663 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075860 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:12:38.080663 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075862 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:12:38.080663 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075865 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:12:38.080663 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075867 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:12:38.081060 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075870 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:12:38.081060 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075872 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:12:38.081060 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075875 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:12:38.081060 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075877 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:12:38.081060 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075879 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:12:38.081060 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075882 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:12:38.081060 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075884 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:12:38.081060 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075886 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:12:38.081060 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075889 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:12:38.081060 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075892 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:12:38.081060 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075894 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:12:38.081060 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075898 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:12:38.081060 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075900 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:12:38.081060 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075903 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:12:38.081060 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075906 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:12:38.081060 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075908 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:12:38.081060 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075911 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:12:38.081060 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075913 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:12:38.081060 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075916 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:12:38.081060 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075918 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:12:38.081536 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075920 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:12:38.081536 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075924 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:12:38.081536 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075928 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:12:38.081536 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075931 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:12:38.081536 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075933 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:12:38.081536 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075936 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:12:38.081536 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075939 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:12:38.081536 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075942 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:12:38.081536 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075945 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:12:38.081536 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075947 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:12:38.081536 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075951 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:12:38.081536 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075954 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:12:38.081536 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075956 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:12:38.081536 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075959 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:12:38.081536 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075962 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:12:38.081536 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075965 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:12:38.081536 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075967 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:12:38.081536 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075969 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:12:38.081536 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075972 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:12:38.082024 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075974 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:12:38.082024 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075976 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:12:38.082024 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075979 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:12:38.082024 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075982 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:12:38.082024 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.075985 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:12:38.082024 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076004 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:12:38.082024 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076009 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:12:38.082024 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076011 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:12:38.082024 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076015 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:12:38.082024 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076018 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:12:38.082024 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076020 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:12:38.082024 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076023 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:12:38.082024 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076025 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:12:38.082024 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076028 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:12:38.082024 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076030 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:12:38.082024 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076032 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:12:38.082024 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076035 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:12:38.082024 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076037 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:12:38.082024 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076040 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:12:38.082024 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076042 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:12:38.082518 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076045 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:12:38.082518 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076047 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:12:38.082518 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076049 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:12:38.082518 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076052 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:12:38.082518 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076056 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:12:38.082518 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076059 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:12:38.082518 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076062 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:12:38.082518 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076064 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:12:38.082518 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076067 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:12:38.082518 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076070 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:12:38.082518 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076072 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:12:38.082518 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076075 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:12:38.082518 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076077 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:12:38.082518 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076080 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:12:38.082518 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076082 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:12:38.082518 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076085 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:12:38.082518 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076088 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:12:38.082518 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076090 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:12:38.082518 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076093 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:12:38.082968 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076095 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:12:38.082968 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076098 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:12:38.082968 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076107 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:12:38.082968 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076110 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:12:38.082968 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076112 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:12:38.082968 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076114 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:12:38.082968 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:38.076117 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:12:38.082968 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.076121 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 03:12:38.082968 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.076234 2574 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 03:12:38.082968 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.078112 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 03:12:38.082968 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.078879 2574 server.go:1019] "Starting client certificate rotation" Sep 17 03:12:38.082968 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.078982 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 03:12:38.082968 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.079753 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 03:12:38.083310 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.082029 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 03:12:38.083432 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.083404 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 03:12:38.094809 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.094789 2574 log.go:25] "Validated CRI v1 runtime API" Sep 17 03:12:38.099102 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.099087 2574 log.go:25] "Validated CRI v1 image API" Sep 17 03:12:38.099922 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.099907 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 03:12:38.103008 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.102977 2574 fs.go:135] Filesystem UUIDs: map[33ec446d-1339-4454-8683-b9928059003e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9d272600-2321-46c3-819d-c923499e46d6:/dev/nvme0n1p4] Sep 17 03:12:38.103047 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.103008 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 03:12:38.107798 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.107696 2574 manager.go:216] Machine: {Timestamp:2026-09-17 03:12:38.10724648 +0000 UTC m=+0.299188706 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102983 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22d11f0c38874a03e9ac8d6acb2ffd SystemUUID:ec22d11f-0c38-874a-03e9-ac8d6acb2ffd BootID:ea4df219-3674-4477-ab85-ca9b7f64059c Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c2:c6:f8:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c2:c6:f8:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:61:c8:e3:54:28 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 03:12:38.107798 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.107796 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 03:12:38.107903 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.107886 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 03:12:38.108869 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.108854 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 03:12:38.108970 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.108947 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 03:12:38.109122 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.108977 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-70.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 03:12:38.109616 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.109606 2574 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 03:12:38.109651 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.109618 2574 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 03:12:38.109651 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.109626 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 03:12:38.110181 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.110172 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 03:12:38.110927 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.110918 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 03:12:38.115214 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.115202 2574 state_mem.go:36] "Initialized new in-memory state store" Sep 17 03:12:38.115327 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.115318 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 03:12:38.115356 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.115349 2574 kubelet.go:486] "Attempting to sync node with API server" Sep 17 03:12:38.115389 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.115362 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 03:12:38.115389 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.115385 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 03:12:38.115441 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.115398 2574 kubelet.go:398] "Adding apiserver pod source" Sep 17 03:12:38.115441 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.115410 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 03:12:38.115846 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.115834 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 03:12:38.115891 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.115858 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 03:12:38.117905 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.117887 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 17 03:12:38.119923 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.119909 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 03:12:38.119972 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.119940 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 03:12:38.121623 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.121603 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 03:12:38.121694 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.121631 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 03:12:38.121694 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.121641 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 03:12:38.121694 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.121649 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 03:12:38.121694 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.121669 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 03:12:38.121694 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.121679 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 03:12:38.121862 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.121699 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 03:12:38.121862 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.121707 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 03:12:38.121862 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.121718 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 03:12:38.121862 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.121728 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 03:12:38.121862 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.121742 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 03:12:38.121862 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.121751 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 03:12:38.122415 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.122399 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 03:12:38.122463 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.122428 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 03:12:38.126978 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.126964 2574 server.go:1268] "Started kubelet" Sep 17 03:12:38.127141 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.127079 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 03:12:38.127202 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.127105 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 03:12:38.127202 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.127190 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 03:12:38.127704 ip-10-0-131-70 systemd[1]: Started Kubernetes Kubelet. Sep 17 03:12:38.128456 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.128229 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 03:12:38.128456 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.128361 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-70.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 03:12:38.129008 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:38.128963 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-70.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 03:12:38.129285 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:38.129265 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 03:12:38.129665 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.129647 2574 server.go:310] "Adding debug handlers to kubelet server" Sep 17 03:12:38.131469 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:38.131448 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 03:12:38.133575 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.133560 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 03:12:38.133647 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.133577 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 03:12:38.133708 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:38.133650 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-70.ec2.internal\" not found" Sep 17 03:12:38.134222 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.134200 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 03:12:38.134222 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.134200 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 03:12:38.134339 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.134230 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 03:12:38.134394 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.134348 2574 reconstruct.go:97] "Volume reconstruction finished" Sep 17 03:12:38.134394 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:38.133140 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-70.ec2.internal.18d5fd2406f3e33f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-70.ec2.internal,UID:ip-10-0-131-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-70.ec2.internal,},FirstTimestamp:2026-09-17 03:12:38.126936895 +0000 UTC m=+0.318879121,LastTimestamp:2026-09-17 03:12:38.126936895 +0000 UTC m=+0.318879121,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-70.ec2.internal,}" Sep 17 03:12:38.134394 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.134359 2574 reconciler.go:29] "Reconciler: start to sync state" Sep 17 03:12:38.134705 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.134597 2574 factory.go:153] Registering CRI-O factory Sep 17 03:12:38.134705 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.134608 2574 factory.go:223] Registration of the crio container factory successfully Sep 17 03:12:38.134705 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.134662 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 03:12:38.134705 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.134669 2574 factory.go:55] Registering systemd factory Sep 17 03:12:38.134705 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.134674 2574 factory.go:223] Registration of the systemd container factory successfully Sep 17 03:12:38.134705 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.134686 2574 factory.go:103] Registering Raw factory Sep 17 03:12:38.134705 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.134695 2574 manager.go:1196] Started watching for new ooms in manager Sep 17 03:12:38.135517 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.135501 2574 manager.go:349] Starting recovery of all containers Sep 17 03:12:38.140493 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:38.140464 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 03:12:38.140818 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:38.140791 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-70.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 03:12:38.146091 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.146069 2574 manager.go:354] Recovery completed Sep 17 03:12:38.152086 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.152073 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:12:38.153914 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.153891 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-70.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:12:38.153978 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.153943 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-70.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:12:38.153978 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.153955 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-70.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:12:38.154496 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.154481 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 03:12:38.154496 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.154489 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:12:38.154596 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.154495 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 03:12:38.154596 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.154549 2574 state_mem.go:36] "Initialized new in-memory state store" Sep 17 03:12:38.155122 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.155108 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-70.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:12:38.155166 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.155133 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-70.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:12:38.155166 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.155143 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-70.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:12:38.156538 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:38.156477 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-70.ec2.internal.18d5fd24088f8028 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-70.ec2.internal,UID:ip-10-0-131-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-70.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-70.ec2.internal,},FirstTimestamp:2026-09-17 03:12:38.15391236 +0000 UTC m=+0.345854588,LastTimestamp:2026-09-17 03:12:38.15391236 +0000 UTC m=+0.345854588,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-70.ec2.internal,}" Sep 17 03:12:38.156752 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.156740 2574 policy_none.go:49] "None policy: Start" Sep 17 03:12:38.156801 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.156768 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 03:12:38.156801 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.156779 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 03:12:38.158751 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.158740 2574 policy_none.go:47] "Start" Sep 17 03:12:38.163799 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:38.163738 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-70.ec2.internal.18d5fd2408901063 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-70.ec2.internal,UID:ip-10-0-131-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-70.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-70.ec2.internal,},FirstTimestamp:2026-09-17 03:12:38.153949283 +0000 UTC m=+0.345891508,LastTimestamp:2026-09-17 03:12:38.153949283 +0000 UTC m=+0.345891508,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-70.ec2.internal,}" Sep 17 03:12:38.175814 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:38.175754 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-70.ec2.internal.18d5fd2408903581 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-70.ec2.internal,UID:ip-10-0-131-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-131-70.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-131-70.ec2.internal,},FirstTimestamp:2026-09-17 03:12:38.153958785 +0000 UTC m=+0.345901011,LastTimestamp:2026-09-17 03:12:38.153958785 +0000 UTC m=+0.345901011,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-70.ec2.internal,}" Sep 17 03:12:38.178765 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.178745 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q9b6r" Sep 17 03:12:38.184329 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.184309 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q9b6r" Sep 17 03:12:38.184444 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:38.184382 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-131-70.ec2.internal.18d5fd24088f8028\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-70.ec2.internal.18d5fd24088f8028 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-70.ec2.internal,UID:ip-10-0-131-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-70.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-70.ec2.internal,},FirstTimestamp:2026-09-17 03:12:38.15391236 +0000 UTC m=+0.345854588,LastTimestamp:2026-09-17 03:12:38.155122665 +0000 UTC m=+0.347064893,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-70.ec2.internal,}" Sep 17 03:12:38.190588 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.190574 2574 manager.go:337] "Starting Device Plugin manager" Sep 17 03:12:38.217264 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:38.190614 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 03:12:38.217264 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.190626 2574 server.go:87] "Starting device plugin registration server" Sep 17 03:12:38.217264 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.190833 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 03:12:38.217264 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.190842 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 03:12:38.217264 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.190930 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 03:12:38.217264 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.191019 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 03:12:38.217264 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.191028 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 03:12:38.217264 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:38.191565 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 03:12:38.217264 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:38.191614 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-70.ec2.internal\" not found" Sep 17 03:12:38.231132 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.231107 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 03:12:38.232391 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.232370 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 03:12:38.232475 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.232413 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 03:12:38.232475 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.232434 2574 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 03:12:38.232475 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:38.232467 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 03:12:38.234380 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.234361 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:12:38.291890 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.291813 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:12:38.292687 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.292671 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-70.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:12:38.292750 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.292701 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-70.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:12:38.292750 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.292711 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-70.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:12:38.292750 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.292733 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-70.ec2.internal" Sep 17 03:12:38.301499 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.301484 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-70.ec2.internal" Sep 17 03:12:38.301539 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:38.301510 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-70.ec2.internal\": node \"ip-10-0-131-70.ec2.internal\" not found" Sep 17 03:12:38.327849 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:38.327828 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-70.ec2.internal\" not found" Sep 17 03:12:38.332907 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.332890 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-70.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-70.ec2.internal"] Sep 17 03:12:38.332955 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.332949 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:12:38.333735 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.333720 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-70.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:12:38.333797 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.333748 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-70.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:12:38.333797 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.333757 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-70.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:12:38.335963 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.335951 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:12:38.336107 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.336092 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-70.ec2.internal" Sep 17 03:12:38.336165 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.336129 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:12:38.336607 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.336595 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-70.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:12:38.336666 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.336618 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-70.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:12:38.336666 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.336625 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-70.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:12:38.336666 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.336641 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-70.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:12:38.336666 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.336652 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-70.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:12:38.336795 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.336641 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-70.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:12:38.339035 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.339022 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-70.ec2.internal" Sep 17 03:12:38.339085 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.339046 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:12:38.339818 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.339806 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-70.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:12:38.339887 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.339831 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-70.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:12:38.339887 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.339841 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-70.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:12:38.360591 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:38.360572 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-70.ec2.internal\" not found" node="ip-10-0-131-70.ec2.internal" Sep 17 03:12:38.372477 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:38.372460 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-70.ec2.internal\" not found" node="ip-10-0-131-70.ec2.internal" Sep 17 03:12:38.428585 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:38.428562 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-70.ec2.internal\" not found" Sep 17 03:12:38.435901 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.435866 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3161444eef5dd45f0fbeea3258eaade1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-70.ec2.internal\" (UID: \"3161444eef5dd45f0fbeea3258eaade1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-70.ec2.internal" Sep 17 03:12:38.435983 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.435908 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3161444eef5dd45f0fbeea3258eaade1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-70.ec2.internal\" (UID: \"3161444eef5dd45f0fbeea3258eaade1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-70.ec2.internal" Sep 17 03:12:38.435983 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.435924 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/21c858cc32c6191885a49e3c88c5f4d0-config\") pod \"kube-apiserver-proxy-ip-10-0-131-70.ec2.internal\" (UID: \"21c858cc32c6191885a49e3c88c5f4d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-70.ec2.internal" Sep 17 03:12:38.529095 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:38.529056 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-70.ec2.internal\" not found" Sep 17 03:12:38.536408 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.536370 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3161444eef5dd45f0fbeea3258eaade1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-70.ec2.internal\" (UID: \"3161444eef5dd45f0fbeea3258eaade1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-70.ec2.internal" Sep 17 03:12:38.536474 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.536415 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/21c858cc32c6191885a49e3c88c5f4d0-config\") pod \"kube-apiserver-proxy-ip-10-0-131-70.ec2.internal\" (UID: \"21c858cc32c6191885a49e3c88c5f4d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-70.ec2.internal" Sep 17 03:12:38.536474 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.536431 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3161444eef5dd45f0fbeea3258eaade1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-70.ec2.internal\" (UID: \"3161444eef5dd45f0fbeea3258eaade1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-70.ec2.internal" Sep 17 03:12:38.536474 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.536457 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3161444eef5dd45f0fbeea3258eaade1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-70.ec2.internal\" (UID: \"3161444eef5dd45f0fbeea3258eaade1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-70.ec2.internal" Sep 17 03:12:38.536474 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.536465 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/21c858cc32c6191885a49e3c88c5f4d0-config\") pod \"kube-apiserver-proxy-ip-10-0-131-70.ec2.internal\" (UID: \"21c858cc32c6191885a49e3c88c5f4d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-70.ec2.internal" Sep 17 03:12:38.536598 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.536465 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3161444eef5dd45f0fbeea3258eaade1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-70.ec2.internal\" (UID: \"3161444eef5dd45f0fbeea3258eaade1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-70.ec2.internal" Sep 17 03:12:38.629886 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:38.629815 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-70.ec2.internal\" not found" Sep 17 03:12:38.663348 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.663312 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-70.ec2.internal" Sep 17 03:12:38.675444 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:38.675421 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-70.ec2.internal" Sep 17 03:12:38.730748 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:38.730712 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-70.ec2.internal\" not found" Sep 17 03:12:38.831323 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:38.831289 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-70.ec2.internal\" not found" Sep 17 03:12:38.931859 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:38.931794 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-70.ec2.internal\" not found" Sep 17 03:12:39.032374 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:39.032347 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-70.ec2.internal\" not found" Sep 17 03:12:39.078833 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:39.078806 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 03:12:39.079229 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:39.078970 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 03:12:39.132482 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:39.132455 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-70.ec2.internal\" not found" Sep 17 03:12:39.189332 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:39.189246 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 03:07:39 +0000 UTC" deadline="2028-05-28 20:02:50.5704417 +0000 UTC" Sep 17 03:12:39.189332 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:39.189282 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14872h50m11.38116337s" Sep 17 03:12:39.205715 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:39.205691 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:12:39.232927 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:39.232904 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-70.ec2.internal\" not found" Sep 17 03:12:39.274961 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:39.274938 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:12:39.331054 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:39.331037 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:12:39.332337 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:39.332321 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-70.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:12:39.332424 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:39.332350 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-70.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:12:39.332424 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:39.332360 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-70.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:12:39.333561 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:39.333540 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-70.ec2.internal\" not found" Sep 17 03:12:39.434099 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:39.434073 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-70.ec2.internal\" not found" Sep 17 03:12:39.435361 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:39.435341 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:12:39.453361 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:39.453221 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c858cc32c6191885a49e3c88c5f4d0.slice/crio-0641daba4f4fe26f559e053be92ec8b5776b92cd8816a5b9d0a5030c58dbc50a WatchSource:0}: Error finding container 0641daba4f4fe26f559e053be92ec8b5776b92cd8816a5b9d0a5030c58dbc50a: Status 404 returned error can't find the container with id 0641daba4f4fe26f559e053be92ec8b5776b92cd8816a5b9d0a5030c58dbc50a Sep 17 03:12:39.453801 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:39.453772 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3161444eef5dd45f0fbeea3258eaade1.slice/crio-c6a44b3683fc484f33481188890b7c6ce63208acfda628200f4ba715a4df941c WatchSource:0}: Error finding container c6a44b3683fc484f33481188890b7c6ce63208acfda628200f4ba715a4df941c: Status 404 returned error can't find the container with id c6a44b3683fc484f33481188890b7c6ce63208acfda628200f4ba715a4df941c Sep 17 03:12:39.458707 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:39.458692 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 03:12:39.534604 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:39.534568 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-70.ec2.internal" Sep 17 03:12:39.544082 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:39.544063 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 03:12:39.545172 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:39.545160 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-70.ec2.internal" Sep 17 03:12:39.562834 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:39.562817 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 03:12:41.775273 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.775237 2574 apiserver.go:52] "Watching apiserver" Sep 17 03:12:41.785748 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.785719 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 03:12:41.786264 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.786238 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-bfbnk","kube-system/konnectivity-agent-f59hh","kube-system/kube-apiserver-proxy-ip-10-0-131-70.ec2.internal","openshift-image-registry/node-ca-2dr88","openshift-multus/multus-fxnnk","openshift-multus/network-metrics-daemon-bgwwg","openshift-network-diagnostics/network-check-target-8m8pj","openshift-ovn-kubernetes/ovnkube-node-tj7x2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm","openshift-cluster-node-tuning-operator/tuned-f7d9c","openshift-dns/node-resolver-246d2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-70.ec2.internal","openshift-multus/multus-additional-cni-plugins-hxr44","openshift-network-operator/iptables-alerter-k74r5"] Sep 17 03:12:41.788880 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.788850 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.791558 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.791538 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k74r5" Sep 17 03:12:41.791675 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.791638 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 03:12:41.791962 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.791946 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 03:12:41.792364 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.792350 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 03:12:41.792473 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.792380 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 03:12:41.793271 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.793249 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 03:12:41.793551 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.793532 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 03:12:41.793982 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.793800 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tvd6h\"" Sep 17 03:12:41.795485 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.794210 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:12:41.795485 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.794461 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 03:12:41.795485 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.794673 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 03:12:41.795485 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.795034 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:12:41.795485 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:41.795134 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m8pj" podUID="2580ca6b-3260-4448-a21c-9f9ee7e2e1b7" Sep 17 03:12:41.795794 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.795651 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jcvgx\"" Sep 17 03:12:41.795918 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.795896 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 03:12:41.796171 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.796157 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2dr88" Sep 17 03:12:41.800533 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.800011 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fxnnk" Sep 17 03:12:41.800962 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.800940 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m7ndm\"" Sep 17 03:12:41.804362 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.802089 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 03:12:41.804362 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.802295 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 03:12:41.804362 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.802646 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:12:41.804362 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:41.802711 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgwwg" podUID="eca0ae2b-bd17-447e-9784-04f94225f000" Sep 17 03:12:41.804362 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.802989 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 03:12:41.804362 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.803312 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 03:12:41.804362 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.803262 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-n6j98\"" Sep 17 03:12:41.804362 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.803616 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 03:12:41.804362 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.803811 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 03:12:41.804362 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.803829 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 03:12:41.804362 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.803955 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twzbm\" (UniqueName: \"kubernetes.io/projected/a07b8242-870d-4be1-827d-d5b5e41d45ec-kube-api-access-twzbm\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.804362 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.803982 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ab8e005-1922-4e32-ac38-5e7883c55d0c-host-slash\") pod \"iptables-alerter-k74r5\" (UID: \"0ab8e005-1922-4e32-ac38-5e7883c55d0c\") " pod="openshift-network-operator/iptables-alerter-k74r5" Sep 17 03:12:41.804362 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.804044 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-host-run-netns\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.804362 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.804096 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-run-ovn\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.804362 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.804125 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-log-socket\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.804362 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.804154 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.804362 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.804177 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a07b8242-870d-4be1-827d-d5b5e41d45ec-ovn-node-metrics-cert\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.804362 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.804221 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8fhq\" (UniqueName: \"kubernetes.io/projected/2580ca6b-3260-4448-a21c-9f9ee7e2e1b7-kube-api-access-k8fhq\") pod \"network-check-target-8m8pj\" (UID: \"2580ca6b-3260-4448-a21c-9f9ee7e2e1b7\") " pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:12:41.804362 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.804276 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-host-kubelet\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.804362 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.804299 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-systemd-units\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.804362 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.804321 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a07b8242-870d-4be1-827d-d5b5e41d45ec-ovnkube-config\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.805488 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.804364 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a07b8242-870d-4be1-827d-d5b5e41d45ec-env-overrides\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.805488 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.804395 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg6xq\" (UniqueName: \"kubernetes.io/projected/0ab8e005-1922-4e32-ac38-5e7883c55d0c-kube-api-access-lg6xq\") pod \"iptables-alerter-k74r5\" (UID: \"0ab8e005-1922-4e32-ac38-5e7883c55d0c\") " pod="openshift-network-operator/iptables-alerter-k74r5" Sep 17 03:12:41.805488 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.804440 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-var-lib-openvswitch\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.805488 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.804475 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-node-log\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.805488 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.804497 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-host-cni-bin\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.805488 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.804517 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-host-cni-netd\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.805488 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.804557 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a07b8242-870d-4be1-827d-d5b5e41d45ec-ovnkube-script-lib\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.805488 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.804582 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ab8e005-1922-4e32-ac38-5e7883c55d0c-iptables-alerter-script\") pod \"iptables-alerter-k74r5\" (UID: \"0ab8e005-1922-4e32-ac38-5e7883c55d0c\") " pod="openshift-network-operator/iptables-alerter-k74r5" Sep 17 03:12:41.805488 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.804607 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-host-slash\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.805488 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.804629 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-run-systemd\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.805488 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.804655 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-etc-openvswitch\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.805488 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.804706 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-run-openvswitch\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.805488 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.804729 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-host-run-ovn-kubernetes\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.805488 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.804995 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:12:41.805488 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:41.805055 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfbnk" podUID="6c98ae40-3a0b-4d27-b060-510431eb9770" Sep 17 03:12:41.810225 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.808792 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" Sep 17 03:12:41.811273 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.811249 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:41.817078 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.815681 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:12:41.817078 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.815933 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qtz4w\"" Sep 17 03:12:41.817078 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.816200 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 03:12:41.817078 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.816542 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 03:12:41.817078 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.816683 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5v6l5\"" Sep 17 03:12:41.818531 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.818503 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 03:12:41.819454 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.819437 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-246d2" Sep 17 03:12:41.820018 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.819993 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 03:12:41.820193 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.820173 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 03:12:41.821878 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.821860 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hxr44" Sep 17 03:12:41.822641 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.822598 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dv9bk\"" Sep 17 03:12:41.823125 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.822900 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 03:12:41.823125 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.823000 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 03:12:41.824119 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.824094 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f59hh" Sep 17 03:12:41.824757 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.824737 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mx645\"" Sep 17 03:12:41.824848 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.824798 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 03:12:41.824949 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.824748 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 03:12:41.828135 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.828114 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 03:12:41.828633 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.828484 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 03:12:41.829113 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.829096 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ktv5m\"" Sep 17 03:12:41.844218 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.844196 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pqv7b" Sep 17 03:12:41.852258 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.852236 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pqv7b" Sep 17 03:12:41.893468 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.893443 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 03:12:41.900870 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.900816 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-70.ec2.internal" event={"ID":"3161444eef5dd45f0fbeea3258eaade1","Type":"ContainerStarted","Data":"c6a44b3683fc484f33481188890b7c6ce63208acfda628200f4ba715a4df941c"} Sep 17 03:12:41.904352 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.904313 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-70.ec2.internal" event={"ID":"21c858cc32c6191885a49e3c88c5f4d0","Type":"ContainerStarted","Data":"0641daba4f4fe26f559e053be92ec8b5776b92cd8816a5b9d0a5030c58dbc50a"} Sep 17 03:12:41.908323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.904866 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-var-lib-openvswitch\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.908323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.904901 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-host-cni-bin\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.908323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.904925 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-host-cni-netd\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.908323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.904955 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/213e7818-aa1d-4020-9b98-fc9dc7ec8c48-device-dir\") pod \"aws-ebs-csi-driver-node-n96sm\" (UID: \"213e7818-aa1d-4020-9b98-fc9dc7ec8c48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" Sep 17 03:12:41.908323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.904980 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-etc-sysctl-conf\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:41.908323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905003 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6c98ae40-3a0b-4d27-b060-510431eb9770-dbus\") pod \"global-pull-secret-syncer-bfbnk\" (UID: \"6c98ae40-3a0b-4d27-b060-510431eb9770\") " pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:12:41.908323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905027 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72dfc96b-596c-4f3f-93f7-7a323067dae4-tmp-dir\") pod \"node-resolver-246d2\" (UID: \"72dfc96b-596c-4f3f-93f7-7a323067dae4\") " pod="openshift-dns/node-resolver-246d2" Sep 17 03:12:41.908323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905060 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-system-cni-dir\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:41.908323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905087 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-run-openvswitch\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.908323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905112 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-host-run-ovn-kubernetes\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.908323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905143 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twzbm\" (UniqueName: \"kubernetes.io/projected/a07b8242-870d-4be1-827d-d5b5e41d45ec-kube-api-access-twzbm\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.908323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905165 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/213e7818-aa1d-4020-9b98-fc9dc7ec8c48-registration-dir\") pod \"aws-ebs-csi-driver-node-n96sm\" (UID: \"213e7818-aa1d-4020-9b98-fc9dc7ec8c48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" Sep 17 03:12:41.908323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905190 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-lib-modules\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:41.908323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905213 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs\") pod \"network-metrics-daemon-bgwwg\" (UID: \"eca0ae2b-bd17-447e-9784-04f94225f000\") " pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:12:41.908323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905235 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f26c059a-e57c-4f3f-bdaf-15df31142402-system-cni-dir\") pod \"multus-additional-cni-plugins-hxr44\" (UID: \"f26c059a-e57c-4f3f-bdaf-15df31142402\") " pod="openshift-multus/multus-additional-cni-plugins-hxr44" Sep 17 03:12:41.908323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905262 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f26c059a-e57c-4f3f-bdaf-15df31142402-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hxr44\" (UID: \"f26c059a-e57c-4f3f-bdaf-15df31142402\") " pod="openshift-multus/multus-additional-cni-plugins-hxr44" Sep 17 03:12:41.909213 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905288 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-run-ovn\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.909213 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905312 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-log-socket\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.909213 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905337 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a07b8242-870d-4be1-827d-d5b5e41d45ec-ovn-node-metrics-cert\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.909213 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905371 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-etc-systemd\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:41.909213 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905398 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f26c059a-e57c-4f3f-bdaf-15df31142402-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hxr44\" (UID: \"f26c059a-e57c-4f3f-bdaf-15df31142402\") " pod="openshift-multus/multus-additional-cni-plugins-hxr44" Sep 17 03:12:41.909213 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905440 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ade8d91a-ea36-43e4-8754-afea35aaaeed-host\") pod \"node-ca-2dr88\" (UID: \"ade8d91a-ea36-43e4-8754-afea35aaaeed\") " pod="openshift-image-registry/node-ca-2dr88" Sep 17 03:12:41.909213 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905463 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-multus-conf-dir\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:41.909213 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905486 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-host-kubelet\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.909213 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905509 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-systemd-units\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.909213 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905532 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a07b8242-870d-4be1-827d-d5b5e41d45ec-ovnkube-config\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.909213 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905560 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/213e7818-aa1d-4020-9b98-fc9dc7ec8c48-etc-selinux\") pod \"aws-ebs-csi-driver-node-n96sm\" (UID: \"213e7818-aa1d-4020-9b98-fc9dc7ec8c48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" Sep 17 03:12:41.909213 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905594 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3043780c-edd9-40a8-bed5-a58f0265801e-konnectivity-ca\") pod \"konnectivity-agent-f59hh\" (UID: \"3043780c-edd9-40a8-bed5-a58f0265801e\") " pod="kube-system/konnectivity-agent-f59hh" Sep 17 03:12:41.909213 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905618 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-cnibin\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:41.909213 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905642 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e0230bb-9ec2-4733-a2ea-a51f9650184f-multus-daemon-config\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:41.909213 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905672 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whvdg\" (UniqueName: \"kubernetes.io/projected/2e0230bb-9ec2-4733-a2ea-a51f9650184f-kube-api-access-whvdg\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:41.909213 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905707 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-node-log\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.909213 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905739 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a07b8242-870d-4be1-827d-d5b5e41d45ec-ovnkube-script-lib\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.910027 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905762 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-etc-modprobe-d\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:41.910027 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905786 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/72dfc96b-596c-4f3f-93f7-7a323067dae4-hosts-file\") pod \"node-resolver-246d2\" (UID: \"72dfc96b-596c-4f3f-93f7-7a323067dae4\") " pod="openshift-dns/node-resolver-246d2" Sep 17 03:12:41.910027 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905810 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-host-run-multus-certs\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:41.910027 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905834 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-run-systemd\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.910027 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905866 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-etc-openvswitch\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.910027 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905891 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ab8e005-1922-4e32-ac38-5e7883c55d0c-host-slash\") pod \"iptables-alerter-k74r5\" (UID: \"0ab8e005-1922-4e32-ac38-5e7883c55d0c\") " pod="openshift-network-operator/iptables-alerter-k74r5" Sep 17 03:12:41.910027 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905908 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-etc-sysconfig\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:41.910027 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905921 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-sys\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:41.910027 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905934 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-host\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:41.910027 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905951 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6c98ae40-3a0b-4d27-b060-510431eb9770-kubelet-config\") pod \"global-pull-secret-syncer-bfbnk\" (UID: \"6c98ae40-3a0b-4d27-b060-510431eb9770\") " pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:12:41.910027 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905965 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-host-var-lib-cni-bin\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:41.910027 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905981 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a07b8242-870d-4be1-827d-d5b5e41d45ec-env-overrides\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.910027 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.905994 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/213e7818-aa1d-4020-9b98-fc9dc7ec8c48-socket-dir\") pod \"aws-ebs-csi-driver-node-n96sm\" (UID: \"213e7818-aa1d-4020-9b98-fc9dc7ec8c48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" Sep 17 03:12:41.910027 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906016 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-host-var-lib-kubelet\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:41.910027 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906037 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ab8e005-1922-4e32-ac38-5e7883c55d0c-iptables-alerter-script\") pod \"iptables-alerter-k74r5\" (UID: \"0ab8e005-1922-4e32-ac38-5e7883c55d0c\") " pod="openshift-network-operator/iptables-alerter-k74r5" Sep 17 03:12:41.910027 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906052 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvwwb\" (UniqueName: \"kubernetes.io/projected/d5ecacab-3a47-4307-bea6-93d0085456c2-kube-api-access-lvwwb\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:41.910027 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906068 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-host-slash\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.910605 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906082 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d5ecacab-3a47-4307-bea6-93d0085456c2-etc-tuned\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:41.910605 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906096 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-host-var-lib-cni-multus\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:41.910605 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906113 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.910605 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906129 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/213e7818-aa1d-4020-9b98-fc9dc7ec8c48-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n96sm\" (UID: \"213e7818-aa1d-4020-9b98-fc9dc7ec8c48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" Sep 17 03:12:41.910605 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906152 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-etc-sysctl-d\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:41.910605 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906166 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-var-lib-kubelet\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:41.910605 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906181 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ade8d91a-ea36-43e4-8754-afea35aaaeed-serviceca\") pod \"node-ca-2dr88\" (UID: \"ade8d91a-ea36-43e4-8754-afea35aaaeed\") " pod="openshift-image-registry/node-ca-2dr88" Sep 17 03:12:41.910605 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906195 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-host-run-k8s-cni-cncf-io\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:41.910605 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906210 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-etc-kubernetes\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:41.910605 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906232 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-run\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:41.910605 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906255 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgss6\" (UniqueName: \"kubernetes.io/projected/f26c059a-e57c-4f3f-bdaf-15df31142402-kube-api-access-lgss6\") pod \"multus-additional-cni-plugins-hxr44\" (UID: \"f26c059a-e57c-4f3f-bdaf-15df31142402\") " pod="openshift-multus/multus-additional-cni-plugins-hxr44" Sep 17 03:12:41.910605 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906278 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-multus-cni-dir\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:41.910605 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906293 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e0230bb-9ec2-4733-a2ea-a51f9650184f-cni-binary-copy\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:41.910605 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906313 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbx7j\" (UniqueName: \"kubernetes.io/projected/213e7818-aa1d-4020-9b98-fc9dc7ec8c48-kube-api-access-pbx7j\") pod \"aws-ebs-csi-driver-node-n96sm\" (UID: \"213e7818-aa1d-4020-9b98-fc9dc7ec8c48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" Sep 17 03:12:41.910605 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906336 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c98ae40-3a0b-4d27-b060-510431eb9770-original-pull-secret\") pod \"global-pull-secret-syncer-bfbnk\" (UID: \"6c98ae40-3a0b-4d27-b060-510431eb9770\") " pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:12:41.910605 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906351 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f26c059a-e57c-4f3f-bdaf-15df31142402-cnibin\") pod \"multus-additional-cni-plugins-hxr44\" (UID: \"f26c059a-e57c-4f3f-bdaf-15df31142402\") " pod="openshift-multus/multus-additional-cni-plugins-hxr44" Sep 17 03:12:41.911063 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906366 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f26c059a-e57c-4f3f-bdaf-15df31142402-cni-binary-copy\") pod \"multus-additional-cni-plugins-hxr44\" (UID: \"f26c059a-e57c-4f3f-bdaf-15df31142402\") " pod="openshift-multus/multus-additional-cni-plugins-hxr44" Sep 17 03:12:41.911063 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906383 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc8hx\" (UniqueName: \"kubernetes.io/projected/ade8d91a-ea36-43e4-8754-afea35aaaeed-kube-api-access-lc8hx\") pod \"node-ca-2dr88\" (UID: \"ade8d91a-ea36-43e4-8754-afea35aaaeed\") " pod="openshift-image-registry/node-ca-2dr88" Sep 17 03:12:41.911063 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906410 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-multus-socket-dir-parent\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:41.911063 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906449 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-host-run-netns\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:41.911063 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906473 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-etc-kubernetes\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:41.911063 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906495 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f26c059a-e57c-4f3f-bdaf-15df31142402-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hxr44\" (UID: \"f26c059a-e57c-4f3f-bdaf-15df31142402\") " pod="openshift-multus/multus-additional-cni-plugins-hxr44" Sep 17 03:12:41.911063 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906516 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-hostroot\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:41.911063 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906534 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-host-run-netns\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.911063 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906537 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-var-lib-openvswitch\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.911063 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906551 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8fhq\" (UniqueName: \"kubernetes.io/projected/2580ca6b-3260-4448-a21c-9f9ee7e2e1b7-kube-api-access-k8fhq\") pod \"network-check-target-8m8pj\" (UID: \"2580ca6b-3260-4448-a21c-9f9ee7e2e1b7\") " pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:12:41.911063 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906589 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5ecacab-3a47-4307-bea6-93d0085456c2-tmp\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:41.911063 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906617 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3043780c-edd9-40a8-bed5-a58f0265801e-agent-certs\") pod \"konnectivity-agent-f59hh\" (UID: \"3043780c-edd9-40a8-bed5-a58f0265801e\") " pod="kube-system/konnectivity-agent-f59hh" Sep 17 03:12:41.911063 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906636 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2wsk\" (UniqueName: \"kubernetes.io/projected/eca0ae2b-bd17-447e-9784-04f94225f000-kube-api-access-v2wsk\") pod \"network-metrics-daemon-bgwwg\" (UID: \"eca0ae2b-bd17-447e-9784-04f94225f000\") " pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:12:41.911063 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906668 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg6xq\" (UniqueName: \"kubernetes.io/projected/0ab8e005-1922-4e32-ac38-5e7883c55d0c-kube-api-access-lg6xq\") pod \"iptables-alerter-k74r5\" (UID: \"0ab8e005-1922-4e32-ac38-5e7883c55d0c\") " pod="openshift-network-operator/iptables-alerter-k74r5" Sep 17 03:12:41.911063 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906688 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-run-openvswitch\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.911063 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906693 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/213e7818-aa1d-4020-9b98-fc9dc7ec8c48-sys-fs\") pod \"aws-ebs-csi-driver-node-n96sm\" (UID: \"213e7818-aa1d-4020-9b98-fc9dc7ec8c48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" Sep 17 03:12:41.911827 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906720 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btstf\" (UniqueName: \"kubernetes.io/projected/72dfc96b-596c-4f3f-93f7-7a323067dae4-kube-api-access-btstf\") pod \"node-resolver-246d2\" (UID: \"72dfc96b-596c-4f3f-93f7-7a323067dae4\") " pod="openshift-dns/node-resolver-246d2" Sep 17 03:12:41.911827 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906737 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-host-run-ovn-kubernetes\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.911827 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906817 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-run-systemd\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.911827 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906864 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-etc-openvswitch\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.911827 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906905 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ab8e005-1922-4e32-ac38-5e7883c55d0c-host-slash\") pod \"iptables-alerter-k74r5\" (UID: \"0ab8e005-1922-4e32-ac38-5e7883c55d0c\") " pod="openshift-network-operator/iptables-alerter-k74r5" Sep 17 03:12:41.911827 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.907097 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-run-ovn\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.911827 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.907149 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-log-socket\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.911827 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.907462 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a07b8242-870d-4be1-827d-d5b5e41d45ec-env-overrides\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.911827 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.907636 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-host-kubelet\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.911827 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.907690 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-systemd-units\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.911827 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.907800 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 03:12:41.911827 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.907967 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ab8e005-1922-4e32-ac38-5e7883c55d0c-iptables-alerter-script\") pod \"iptables-alerter-k74r5\" (UID: \"0ab8e005-1922-4e32-ac38-5e7883c55d0c\") " pod="openshift-network-operator/iptables-alerter-k74r5" Sep 17 03:12:41.911827 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.908026 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-host-slash\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.911827 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.908075 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.911827 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.908203 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-host-run-netns\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.911827 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.906590 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-host-cni-bin\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.911827 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.908245 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-host-cni-netd\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.912991 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.912833 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a07b8242-870d-4be1-827d-d5b5e41d45ec-ovnkube-config\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.913163 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.913141 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a07b8242-870d-4be1-827d-d5b5e41d45ec-node-log\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.913830 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.913795 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a07b8242-870d-4be1-827d-d5b5e41d45ec-ovnkube-script-lib\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.915986 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.914758 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a07b8242-870d-4be1-827d-d5b5e41d45ec-ovn-node-metrics-cert\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.917628 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.917589 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twzbm\" (UniqueName: \"kubernetes.io/projected/a07b8242-870d-4be1-827d-d5b5e41d45ec-kube-api-access-twzbm\") pod \"ovnkube-node-tj7x2\" (UID: \"a07b8242-870d-4be1-827d-d5b5e41d45ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:41.920371 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:41.920351 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:12:41.920474 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:41.920394 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:12:41.920474 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:41.920407 2574 projected.go:196] Error preparing data for projected volume kube-api-access-k8fhq for pod openshift-network-diagnostics/network-check-target-8m8pj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:41.920595 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:41.920551 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2580ca6b-3260-4448-a21c-9f9ee7e2e1b7-kube-api-access-k8fhq podName:2580ca6b-3260-4448-a21c-9f9ee7e2e1b7 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:42.420518159 +0000 UTC m=+2.954028845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-k8fhq" (UniqueName: "kubernetes.io/projected/2580ca6b-3260-4448-a21c-9f9ee7e2e1b7-kube-api-access-k8fhq") pod "network-check-target-8m8pj" (UID: "2580ca6b-3260-4448-a21c-9f9ee7e2e1b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:41.923452 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.923416 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg6xq\" (UniqueName: \"kubernetes.io/projected/0ab8e005-1922-4e32-ac38-5e7883c55d0c-kube-api-access-lg6xq\") pod \"iptables-alerter-k74r5\" (UID: \"0ab8e005-1922-4e32-ac38-5e7883c55d0c\") " pod="openshift-network-operator/iptables-alerter-k74r5" Sep 17 03:12:41.948449 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:41.944739 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:12:42.007882 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.007851 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-etc-modprobe-d\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.008058 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.007950 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/72dfc96b-596c-4f3f-93f7-7a323067dae4-hosts-file\") pod \"node-resolver-246d2\" (UID: \"72dfc96b-596c-4f3f-93f7-7a323067dae4\") " pod="openshift-dns/node-resolver-246d2" Sep 17 03:12:42.008058 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008044 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-etc-modprobe-d\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.008058 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008011 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-host-run-multus-certs\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.008229 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008072 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/72dfc96b-596c-4f3f-93f7-7a323067dae4-hosts-file\") pod \"node-resolver-246d2\" (UID: \"72dfc96b-596c-4f3f-93f7-7a323067dae4\") " pod="openshift-dns/node-resolver-246d2" Sep 17 03:12:42.008229 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008164 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-host-run-multus-certs\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.008325 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008252 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-etc-sysconfig\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.008325 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008285 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-sys\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.008325 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008306 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-host\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.008492 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008331 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6c98ae40-3a0b-4d27-b060-510431eb9770-kubelet-config\") pod \"global-pull-secret-syncer-bfbnk\" (UID: \"6c98ae40-3a0b-4d27-b060-510431eb9770\") " pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:12:42.008492 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008356 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-host-var-lib-cni-bin\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.008492 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008380 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/213e7818-aa1d-4020-9b98-fc9dc7ec8c48-socket-dir\") pod \"aws-ebs-csi-driver-node-n96sm\" (UID: \"213e7818-aa1d-4020-9b98-fc9dc7ec8c48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" Sep 17 03:12:42.008492 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008403 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-host-var-lib-kubelet\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.008492 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008402 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-sys\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.008492 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008447 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvwwb\" (UniqueName: \"kubernetes.io/projected/d5ecacab-3a47-4307-bea6-93d0085456c2-kube-api-access-lvwwb\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.008492 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008471 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d5ecacab-3a47-4307-bea6-93d0085456c2-etc-tuned\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.008492 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008471 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6c98ae40-3a0b-4d27-b060-510431eb9770-kubelet-config\") pod \"global-pull-secret-syncer-bfbnk\" (UID: \"6c98ae40-3a0b-4d27-b060-510431eb9770\") " pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:12:42.008492 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008485 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-etc-sysconfig\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.008492 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008494 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-host-var-lib-cni-multus\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.008940 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008519 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-host\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.008940 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008520 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/213e7818-aa1d-4020-9b98-fc9dc7ec8c48-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n96sm\" (UID: \"213e7818-aa1d-4020-9b98-fc9dc7ec8c48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" Sep 17 03:12:42.008940 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008542 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-host-var-lib-cni-bin\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.008940 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008547 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-etc-sysctl-d\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.008940 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008575 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/213e7818-aa1d-4020-9b98-fc9dc7ec8c48-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n96sm\" (UID: \"213e7818-aa1d-4020-9b98-fc9dc7ec8c48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" Sep 17 03:12:42.008940 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008584 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-var-lib-kubelet\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.008940 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008610 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ade8d91a-ea36-43e4-8754-afea35aaaeed-serviceca\") pod \"node-ca-2dr88\" (UID: \"ade8d91a-ea36-43e4-8754-afea35aaaeed\") " pod="openshift-image-registry/node-ca-2dr88" Sep 17 03:12:42.008940 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008636 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-host-var-lib-cni-multus\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.008940 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008635 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-host-run-k8s-cni-cncf-io\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.008940 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008659 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-etc-kubernetes\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.008940 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008673 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-host-var-lib-kubelet\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.008940 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008681 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-run\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.008940 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008725 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgss6\" (UniqueName: \"kubernetes.io/projected/f26c059a-e57c-4f3f-bdaf-15df31142402-kube-api-access-lgss6\") pod \"multus-additional-cni-plugins-hxr44\" (UID: \"f26c059a-e57c-4f3f-bdaf-15df31142402\") " pod="openshift-multus/multus-additional-cni-plugins-hxr44" Sep 17 03:12:42.008940 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008749 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-multus-cni-dir\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.008940 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008769 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-run\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.008940 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008777 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e0230bb-9ec2-4733-a2ea-a51f9650184f-cni-binary-copy\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.008940 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008810 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbx7j\" (UniqueName: \"kubernetes.io/projected/213e7818-aa1d-4020-9b98-fc9dc7ec8c48-kube-api-access-pbx7j\") pod \"aws-ebs-csi-driver-node-n96sm\" (UID: \"213e7818-aa1d-4020-9b98-fc9dc7ec8c48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" Sep 17 03:12:42.008940 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008835 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c98ae40-3a0b-4d27-b060-510431eb9770-original-pull-secret\") pod \"global-pull-secret-syncer-bfbnk\" (UID: \"6c98ae40-3a0b-4d27-b060-510431eb9770\") " pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:12:42.009782 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008871 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f26c059a-e57c-4f3f-bdaf-15df31142402-cnibin\") pod \"multus-additional-cni-plugins-hxr44\" (UID: \"f26c059a-e57c-4f3f-bdaf-15df31142402\") " pod="openshift-multus/multus-additional-cni-plugins-hxr44" Sep 17 03:12:42.009782 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008883 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/213e7818-aa1d-4020-9b98-fc9dc7ec8c48-socket-dir\") pod \"aws-ebs-csi-driver-node-n96sm\" (UID: \"213e7818-aa1d-4020-9b98-fc9dc7ec8c48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" Sep 17 03:12:42.009782 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008909 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f26c059a-e57c-4f3f-bdaf-15df31142402-cni-binary-copy\") pod \"multus-additional-cni-plugins-hxr44\" (UID: \"f26c059a-e57c-4f3f-bdaf-15df31142402\") " pod="openshift-multus/multus-additional-cni-plugins-hxr44" Sep 17 03:12:42.009782 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008927 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc8hx\" (UniqueName: \"kubernetes.io/projected/ade8d91a-ea36-43e4-8754-afea35aaaeed-kube-api-access-lc8hx\") pod \"node-ca-2dr88\" (UID: \"ade8d91a-ea36-43e4-8754-afea35aaaeed\") " pod="openshift-image-registry/node-ca-2dr88" Sep 17 03:12:42.009782 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008934 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-var-lib-kubelet\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.009782 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008960 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-multus-socket-dir-parent\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.009782 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008989 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-host-run-netns\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.009782 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009003 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-etc-kubernetes\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.009782 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.008613 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-etc-sysctl-d\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.009782 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009072 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f26c059a-e57c-4f3f-bdaf-15df31142402-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hxr44\" (UID: \"f26c059a-e57c-4f3f-bdaf-15df31142402\") " pod="openshift-multus/multus-additional-cni-plugins-hxr44" Sep 17 03:12:42.009782 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009125 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-hostroot\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.009782 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009180 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-host-run-k8s-cni-cncf-io\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.009782 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009212 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5ecacab-3a47-4307-bea6-93d0085456c2-tmp\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.009782 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009219 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-hostroot\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.009782 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009240 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3043780c-edd9-40a8-bed5-a58f0265801e-agent-certs\") pod \"konnectivity-agent-f59hh\" (UID: \"3043780c-edd9-40a8-bed5-a58f0265801e\") " pod="kube-system/konnectivity-agent-f59hh" Sep 17 03:12:42.009782 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009266 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2wsk\" (UniqueName: \"kubernetes.io/projected/eca0ae2b-bd17-447e-9784-04f94225f000-kube-api-access-v2wsk\") pod \"network-metrics-daemon-bgwwg\" (UID: \"eca0ae2b-bd17-447e-9784-04f94225f000\") " pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:12:42.009782 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009293 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/213e7818-aa1d-4020-9b98-fc9dc7ec8c48-sys-fs\") pod \"aws-ebs-csi-driver-node-n96sm\" (UID: \"213e7818-aa1d-4020-9b98-fc9dc7ec8c48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" Sep 17 03:12:42.010576 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009317 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btstf\" (UniqueName: \"kubernetes.io/projected/72dfc96b-596c-4f3f-93f7-7a323067dae4-kube-api-access-btstf\") pod \"node-resolver-246d2\" (UID: \"72dfc96b-596c-4f3f-93f7-7a323067dae4\") " pod="openshift-dns/node-resolver-246d2" Sep 17 03:12:42.010576 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009344 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/213e7818-aa1d-4020-9b98-fc9dc7ec8c48-device-dir\") pod \"aws-ebs-csi-driver-node-n96sm\" (UID: \"213e7818-aa1d-4020-9b98-fc9dc7ec8c48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" Sep 17 03:12:42.010576 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009367 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-etc-sysctl-conf\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.010576 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009392 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6c98ae40-3a0b-4d27-b060-510431eb9770-dbus\") pod \"global-pull-secret-syncer-bfbnk\" (UID: \"6c98ae40-3a0b-4d27-b060-510431eb9770\") " pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:12:42.010576 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009417 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72dfc96b-596c-4f3f-93f7-7a323067dae4-tmp-dir\") pod \"node-resolver-246d2\" (UID: \"72dfc96b-596c-4f3f-93f7-7a323067dae4\") " pod="openshift-dns/node-resolver-246d2" Sep 17 03:12:42.010576 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009465 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-system-cni-dir\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.010576 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009492 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/213e7818-aa1d-4020-9b98-fc9dc7ec8c48-registration-dir\") pod \"aws-ebs-csi-driver-node-n96sm\" (UID: \"213e7818-aa1d-4020-9b98-fc9dc7ec8c48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" Sep 17 03:12:42.010576 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009516 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-lib-modules\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.010576 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009539 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs\") pod \"network-metrics-daemon-bgwwg\" (UID: \"eca0ae2b-bd17-447e-9784-04f94225f000\") " pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:12:42.010576 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009565 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f26c059a-e57c-4f3f-bdaf-15df31142402-system-cni-dir\") pod \"multus-additional-cni-plugins-hxr44\" (UID: \"f26c059a-e57c-4f3f-bdaf-15df31142402\") " pod="openshift-multus/multus-additional-cni-plugins-hxr44" Sep 17 03:12:42.010576 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009590 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f26c059a-e57c-4f3f-bdaf-15df31142402-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hxr44\" (UID: \"f26c059a-e57c-4f3f-bdaf-15df31142402\") " pod="openshift-multus/multus-additional-cni-plugins-hxr44" Sep 17 03:12:42.010576 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009596 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ade8d91a-ea36-43e4-8754-afea35aaaeed-serviceca\") pod \"node-ca-2dr88\" (UID: \"ade8d91a-ea36-43e4-8754-afea35aaaeed\") " pod="openshift-image-registry/node-ca-2dr88" Sep 17 03:12:42.010576 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009620 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-etc-systemd\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.010576 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009672 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-etc-systemd\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.010576 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009732 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-etc-sysctl-conf\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.010576 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009764 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f26c059a-e57c-4f3f-bdaf-15df31142402-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hxr44\" (UID: \"f26c059a-e57c-4f3f-bdaf-15df31142402\") " pod="openshift-multus/multus-additional-cni-plugins-hxr44" Sep 17 03:12:42.010576 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009773 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6c98ae40-3a0b-4d27-b060-510431eb9770-dbus\") pod \"global-pull-secret-syncer-bfbnk\" (UID: \"6c98ae40-3a0b-4d27-b060-510431eb9770\") " pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:12:42.011382 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009795 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ade8d91a-ea36-43e4-8754-afea35aaaeed-host\") pod \"node-ca-2dr88\" (UID: \"ade8d91a-ea36-43e4-8754-afea35aaaeed\") " pod="openshift-image-registry/node-ca-2dr88" Sep 17 03:12:42.011382 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009828 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-multus-conf-dir\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.011382 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009849 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/213e7818-aa1d-4020-9b98-fc9dc7ec8c48-etc-selinux\") pod \"aws-ebs-csi-driver-node-n96sm\" (UID: \"213e7818-aa1d-4020-9b98-fc9dc7ec8c48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" Sep 17 03:12:42.011382 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009863 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3043780c-edd9-40a8-bed5-a58f0265801e-konnectivity-ca\") pod \"konnectivity-agent-f59hh\" (UID: \"3043780c-edd9-40a8-bed5-a58f0265801e\") " pod="kube-system/konnectivity-agent-f59hh" Sep 17 03:12:42.011382 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009878 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-cnibin\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.011382 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009896 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e0230bb-9ec2-4733-a2ea-a51f9650184f-multus-daemon-config\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.011382 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009910 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whvdg\" (UniqueName: \"kubernetes.io/projected/2e0230bb-9ec2-4733-a2ea-a51f9650184f-kube-api-access-whvdg\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.011382 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009921 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-multus-cni-dir\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.011382 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.009965 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-etc-kubernetes\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.011382 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.010081 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72dfc96b-596c-4f3f-93f7-7a323067dae4-tmp-dir\") pod \"node-resolver-246d2\" (UID: \"72dfc96b-596c-4f3f-93f7-7a323067dae4\") " pod="openshift-dns/node-resolver-246d2" Sep 17 03:12:42.011382 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.010201 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-system-cni-dir\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.011382 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.010250 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/213e7818-aa1d-4020-9b98-fc9dc7ec8c48-registration-dir\") pod \"aws-ebs-csi-driver-node-n96sm\" (UID: \"213e7818-aa1d-4020-9b98-fc9dc7ec8c48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" Sep 17 03:12:42.011382 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.010325 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-lib-modules\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.011382 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:42.010403 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:42.011382 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:42.010492 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs podName:eca0ae2b-bd17-447e-9784-04f94225f000 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:42.51047485 +0000 UTC m=+3.043985532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs") pod "network-metrics-daemon-bgwwg" (UID: "eca0ae2b-bd17-447e-9784-04f94225f000") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:42.011382 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.010676 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f26c059a-e57c-4f3f-bdaf-15df31142402-system-cni-dir\") pod \"multus-additional-cni-plugins-hxr44\" (UID: \"f26c059a-e57c-4f3f-bdaf-15df31142402\") " pod="openshift-multus/multus-additional-cni-plugins-hxr44" Sep 17 03:12:42.011382 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.010863 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e0230bb-9ec2-4733-a2ea-a51f9650184f-cni-binary-copy\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.011382 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:42.011157 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:42.012225 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.011180 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f26c059a-e57c-4f3f-bdaf-15df31142402-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hxr44\" (UID: \"f26c059a-e57c-4f3f-bdaf-15df31142402\") " pod="openshift-multus/multus-additional-cni-plugins-hxr44" Sep 17 03:12:42.012225 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:42.011220 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c98ae40-3a0b-4d27-b060-510431eb9770-original-pull-secret podName:6c98ae40-3a0b-4d27-b060-510431eb9770 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:42.51120646 +0000 UTC m=+3.044717143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c98ae40-3a0b-4d27-b060-510431eb9770-original-pull-secret") pod "global-pull-secret-syncer-bfbnk" (UID: "6c98ae40-3a0b-4d27-b060-510431eb9770") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:42.012225 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.011257 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f26c059a-e57c-4f3f-bdaf-15df31142402-cnibin\") pod \"multus-additional-cni-plugins-hxr44\" (UID: \"f26c059a-e57c-4f3f-bdaf-15df31142402\") " pod="openshift-multus/multus-additional-cni-plugins-hxr44" Sep 17 03:12:42.012225 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.011369 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f26c059a-e57c-4f3f-bdaf-15df31142402-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hxr44\" (UID: \"f26c059a-e57c-4f3f-bdaf-15df31142402\") " pod="openshift-multus/multus-additional-cni-plugins-hxr44" Sep 17 03:12:42.012225 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.011465 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d5ecacab-3a47-4307-bea6-93d0085456c2-etc-tuned\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.012225 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.011530 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ade8d91a-ea36-43e4-8754-afea35aaaeed-host\") pod \"node-ca-2dr88\" (UID: \"ade8d91a-ea36-43e4-8754-afea35aaaeed\") " pod="openshift-image-registry/node-ca-2dr88" Sep 17 03:12:42.012225 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.011534 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/213e7818-aa1d-4020-9b98-fc9dc7ec8c48-etc-selinux\") pod \"aws-ebs-csi-driver-node-n96sm\" (UID: \"213e7818-aa1d-4020-9b98-fc9dc7ec8c48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" Sep 17 03:12:42.012225 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.011552 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-cnibin\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.012225 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.011585 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-multus-conf-dir\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.012225 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.011622 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-host-run-netns\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.012225 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.011634 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/213e7818-aa1d-4020-9b98-fc9dc7ec8c48-sys-fs\") pod \"aws-ebs-csi-driver-node-n96sm\" (UID: \"213e7818-aa1d-4020-9b98-fc9dc7ec8c48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" Sep 17 03:12:42.012225 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.011682 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e0230bb-9ec2-4733-a2ea-a51f9650184f-multus-socket-dir-parent\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.012225 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.011831 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f26c059a-e57c-4f3f-bdaf-15df31142402-cni-binary-copy\") pod \"multus-additional-cni-plugins-hxr44\" (UID: \"f26c059a-e57c-4f3f-bdaf-15df31142402\") " pod="openshift-multus/multus-additional-cni-plugins-hxr44" Sep 17 03:12:42.012225 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.011895 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5ecacab-3a47-4307-bea6-93d0085456c2-etc-kubernetes\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.012225 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.011944 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/213e7818-aa1d-4020-9b98-fc9dc7ec8c48-device-dir\") pod \"aws-ebs-csi-driver-node-n96sm\" (UID: \"213e7818-aa1d-4020-9b98-fc9dc7ec8c48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" Sep 17 03:12:42.012225 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.012092 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3043780c-edd9-40a8-bed5-a58f0265801e-konnectivity-ca\") pod \"konnectivity-agent-f59hh\" (UID: \"3043780c-edd9-40a8-bed5-a58f0265801e\") " pod="kube-system/konnectivity-agent-f59hh" Sep 17 03:12:42.012225 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.012149 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e0230bb-9ec2-4733-a2ea-a51f9650184f-multus-daemon-config\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.013231 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.012190 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f26c059a-e57c-4f3f-bdaf-15df31142402-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hxr44\" (UID: \"f26c059a-e57c-4f3f-bdaf-15df31142402\") " pod="openshift-multus/multus-additional-cni-plugins-hxr44" Sep 17 03:12:42.014506 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.014480 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3043780c-edd9-40a8-bed5-a58f0265801e-agent-certs\") pod \"konnectivity-agent-f59hh\" (UID: \"3043780c-edd9-40a8-bed5-a58f0265801e\") " pod="kube-system/konnectivity-agent-f59hh" Sep 17 03:12:42.019931 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.019907 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5ecacab-3a47-4307-bea6-93d0085456c2-tmp\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.023900 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.023874 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvwwb\" (UniqueName: \"kubernetes.io/projected/d5ecacab-3a47-4307-bea6-93d0085456c2-kube-api-access-lvwwb\") pod \"tuned-f7d9c\" (UID: \"d5ecacab-3a47-4307-bea6-93d0085456c2\") " pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.024699 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.024599 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2wsk\" (UniqueName: \"kubernetes.io/projected/eca0ae2b-bd17-447e-9784-04f94225f000-kube-api-access-v2wsk\") pod \"network-metrics-daemon-bgwwg\" (UID: \"eca0ae2b-bd17-447e-9784-04f94225f000\") " pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:12:42.025514 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.025413 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whvdg\" (UniqueName: \"kubernetes.io/projected/2e0230bb-9ec2-4733-a2ea-a51f9650184f-kube-api-access-whvdg\") pod \"multus-fxnnk\" (UID: \"2e0230bb-9ec2-4733-a2ea-a51f9650184f\") " pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.025985 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.025958 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgss6\" (UniqueName: \"kubernetes.io/projected/f26c059a-e57c-4f3f-bdaf-15df31142402-kube-api-access-lgss6\") pod \"multus-additional-cni-plugins-hxr44\" (UID: \"f26c059a-e57c-4f3f-bdaf-15df31142402\") " pod="openshift-multus/multus-additional-cni-plugins-hxr44" Sep 17 03:12:42.026396 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.026371 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btstf\" (UniqueName: \"kubernetes.io/projected/72dfc96b-596c-4f3f-93f7-7a323067dae4-kube-api-access-btstf\") pod \"node-resolver-246d2\" (UID: \"72dfc96b-596c-4f3f-93f7-7a323067dae4\") " pod="openshift-dns/node-resolver-246d2" Sep 17 03:12:42.027613 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.027589 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbx7j\" (UniqueName: \"kubernetes.io/projected/213e7818-aa1d-4020-9b98-fc9dc7ec8c48-kube-api-access-pbx7j\") pod \"aws-ebs-csi-driver-node-n96sm\" (UID: \"213e7818-aa1d-4020-9b98-fc9dc7ec8c48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" Sep 17 03:12:42.028138 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.028119 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc8hx\" (UniqueName: \"kubernetes.io/projected/ade8d91a-ea36-43e4-8754-afea35aaaeed-kube-api-access-lc8hx\") pod \"node-ca-2dr88\" (UID: \"ade8d91a-ea36-43e4-8754-afea35aaaeed\") " pod="openshift-image-registry/node-ca-2dr88" Sep 17 03:12:42.102613 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.102580 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:12:42.116681 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:42.116647 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda07b8242_870d_4be1_827d_d5b5e41d45ec.slice/crio-833b2c5e2818bfdf905f43a1b5f6375499466727904ead53e6d4ede4d69eddc7 WatchSource:0}: Error finding container 833b2c5e2818bfdf905f43a1b5f6375499466727904ead53e6d4ede4d69eddc7: Status 404 returned error can't find the container with id 833b2c5e2818bfdf905f43a1b5f6375499466727904ead53e6d4ede4d69eddc7 Sep 17 03:12:42.120649 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.120391 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k74r5" Sep 17 03:12:42.129337 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:42.129307 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ab8e005_1922_4e32_ac38_5e7883c55d0c.slice/crio-58c03036dd97f07f2c70357f2cde7185d594061a344a58dce3206a7926404a2c WatchSource:0}: Error finding container 58c03036dd97f07f2c70357f2cde7185d594061a344a58dce3206a7926404a2c: Status 404 returned error can't find the container with id 58c03036dd97f07f2c70357f2cde7185d594061a344a58dce3206a7926404a2c Sep 17 03:12:42.130473 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.130445 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2dr88" Sep 17 03:12:42.137541 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.137338 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fxnnk" Sep 17 03:12:42.139793 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:42.139771 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podade8d91a_ea36_43e4_8754_afea35aaaeed.slice/crio-dbdbab5ceabfd7b99f43b5b50e60bad668ff5c84f427be5e41992e6ab1771983 WatchSource:0}: Error finding container dbdbab5ceabfd7b99f43b5b50e60bad668ff5c84f427be5e41992e6ab1771983: Status 404 returned error can't find the container with id dbdbab5ceabfd7b99f43b5b50e60bad668ff5c84f427be5e41992e6ab1771983 Sep 17 03:12:42.144455 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.144381 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" Sep 17 03:12:42.146566 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:42.146542 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e0230bb_9ec2_4733_a2ea_a51f9650184f.slice/crio-0d3569cf95b94028c08c4f57047ff8ca5a8dd138b11cad31c308b4678b3bb595 WatchSource:0}: Error finding container 0d3569cf95b94028c08c4f57047ff8ca5a8dd138b11cad31c308b4678b3bb595: Status 404 returned error can't find the container with id 0d3569cf95b94028c08c4f57047ff8ca5a8dd138b11cad31c308b4678b3bb595 Sep 17 03:12:42.152259 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.152237 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" Sep 17 03:12:42.155499 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:42.155475 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod213e7818_aa1d_4020_9b98_fc9dc7ec8c48.slice/crio-4f2368c0ec76ea6de63a467499dfe10dd8c1616ec4b7e1da4924afbeddefc4b8 WatchSource:0}: Error finding container 4f2368c0ec76ea6de63a467499dfe10dd8c1616ec4b7e1da4924afbeddefc4b8: Status 404 returned error can't find the container with id 4f2368c0ec76ea6de63a467499dfe10dd8c1616ec4b7e1da4924afbeddefc4b8 Sep 17 03:12:42.159858 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.159835 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-246d2" Sep 17 03:12:42.162504 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:42.162481 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5ecacab_3a47_4307_bea6_93d0085456c2.slice/crio-548021c7a6ae806333599935641cfefdf00f5ba9b1dfeddc041ec6e0bebf8026 WatchSource:0}: Error finding container 548021c7a6ae806333599935641cfefdf00f5ba9b1dfeddc041ec6e0bebf8026: Status 404 returned error can't find the container with id 548021c7a6ae806333599935641cfefdf00f5ba9b1dfeddc041ec6e0bebf8026 Sep 17 03:12:42.168813 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.168405 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hxr44" Sep 17 03:12:42.169646 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:42.169614 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72dfc96b_596c_4f3f_93f7_7a323067dae4.slice/crio-b198e55879c7edf9c99fbbf12eac22f69e66239c91f12ec5dd13f5d719d8ca4f WatchSource:0}: Error finding container b198e55879c7edf9c99fbbf12eac22f69e66239c91f12ec5dd13f5d719d8ca4f: Status 404 returned error can't find the container with id b198e55879c7edf9c99fbbf12eac22f69e66239c91f12ec5dd13f5d719d8ca4f Sep 17 03:12:42.175350 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.175318 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f59hh" Sep 17 03:12:42.179807 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:42.179782 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf26c059a_e57c_4f3f_bdaf_15df31142402.slice/crio-1b4d807de4e3ed424cc945975f20b1878343a2789b9eda92712f23b75935a153 WatchSource:0}: Error finding container 1b4d807de4e3ed424cc945975f20b1878343a2789b9eda92712f23b75935a153: Status 404 returned error can't find the container with id 1b4d807de4e3ed424cc945975f20b1878343a2789b9eda92712f23b75935a153 Sep 17 03:12:42.188034 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:12:42.188007 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3043780c_edd9_40a8_bed5_a58f0265801e.slice/crio-c61808ffb4c258694811e1ab14a936eb783c50dfbf2d126df4b2979261d85b1d WatchSource:0}: Error finding container c61808ffb4c258694811e1ab14a936eb783c50dfbf2d126df4b2979261d85b1d: Status 404 returned error can't find the container with id c61808ffb4c258694811e1ab14a936eb783c50dfbf2d126df4b2979261d85b1d Sep 17 03:12:42.514027 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.513931 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs\") pod \"network-metrics-daemon-bgwwg\" (UID: \"eca0ae2b-bd17-447e-9784-04f94225f000\") " pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:12:42.514027 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.513999 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c98ae40-3a0b-4d27-b060-510431eb9770-original-pull-secret\") pod \"global-pull-secret-syncer-bfbnk\" (UID: \"6c98ae40-3a0b-4d27-b060-510431eb9770\") " pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:12:42.514027 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.514028 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8fhq\" (UniqueName: \"kubernetes.io/projected/2580ca6b-3260-4448-a21c-9f9ee7e2e1b7-kube-api-access-k8fhq\") pod \"network-check-target-8m8pj\" (UID: \"2580ca6b-3260-4448-a21c-9f9ee7e2e1b7\") " pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:12:42.514275 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:42.514101 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:42.514275 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:42.514148 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:12:42.514275 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:42.514150 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:42.514275 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:42.514165 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:12:42.514275 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:42.514177 2574 projected.go:196] Error preparing data for projected volume kube-api-access-k8fhq for pod openshift-network-diagnostics/network-check-target-8m8pj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:42.514275 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:42.514195 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs podName:eca0ae2b-bd17-447e-9784-04f94225f000 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:43.514172502 +0000 UTC m=+4.047683182 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs") pod "network-metrics-daemon-bgwwg" (UID: "eca0ae2b-bd17-447e-9784-04f94225f000") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:42.514275 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:42.514220 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2580ca6b-3260-4448-a21c-9f9ee7e2e1b7-kube-api-access-k8fhq podName:2580ca6b-3260-4448-a21c-9f9ee7e2e1b7 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:43.514204959 +0000 UTC m=+4.047715652 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8fhq" (UniqueName: "kubernetes.io/projected/2580ca6b-3260-4448-a21c-9f9ee7e2e1b7-kube-api-access-k8fhq") pod "network-check-target-8m8pj" (UID: "2580ca6b-3260-4448-a21c-9f9ee7e2e1b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:42.514275 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:42.514238 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c98ae40-3a0b-4d27-b060-510431eb9770-original-pull-secret podName:6c98ae40-3a0b-4d27-b060-510431eb9770 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:43.514229255 +0000 UTC m=+4.047739941 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c98ae40-3a0b-4d27-b060-510431eb9770-original-pull-secret") pod "global-pull-secret-syncer-bfbnk" (UID: "6c98ae40-3a0b-4d27-b060-510431eb9770") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:42.857625 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.857509 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 03:07:41 +0000 UTC" deadline="2028-05-18 14:28:51.984140045 +0000 UTC" Sep 17 03:12:42.857625 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.857573 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14627h16m9.126571573s" Sep 17 03:12:42.907194 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.907157 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f59hh" event={"ID":"3043780c-edd9-40a8-bed5-a58f0265801e","Type":"ContainerStarted","Data":"c61808ffb4c258694811e1ab14a936eb783c50dfbf2d126df4b2979261d85b1d"} Sep 17 03:12:42.908246 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.908223 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxr44" event={"ID":"f26c059a-e57c-4f3f-bdaf-15df31142402","Type":"ContainerStarted","Data":"1b4d807de4e3ed424cc945975f20b1878343a2789b9eda92712f23b75935a153"} Sep 17 03:12:42.909241 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.909218 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" event={"ID":"d5ecacab-3a47-4307-bea6-93d0085456c2","Type":"ContainerStarted","Data":"548021c7a6ae806333599935641cfefdf00f5ba9b1dfeddc041ec6e0bebf8026"} Sep 17 03:12:42.910315 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.910295 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" event={"ID":"213e7818-aa1d-4020-9b98-fc9dc7ec8c48","Type":"ContainerStarted","Data":"4f2368c0ec76ea6de63a467499dfe10dd8c1616ec4b7e1da4924afbeddefc4b8"} Sep 17 03:12:42.911497 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.911479 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fxnnk" event={"ID":"2e0230bb-9ec2-4733-a2ea-a51f9650184f","Type":"ContainerStarted","Data":"0d3569cf95b94028c08c4f57047ff8ca5a8dd138b11cad31c308b4678b3bb595"} Sep 17 03:12:42.912521 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.912504 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k74r5" event={"ID":"0ab8e005-1922-4e32-ac38-5e7883c55d0c","Type":"ContainerStarted","Data":"58c03036dd97f07f2c70357f2cde7185d594061a344a58dce3206a7926404a2c"} Sep 17 03:12:42.913478 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.913442 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" event={"ID":"a07b8242-870d-4be1-827d-d5b5e41d45ec","Type":"ContainerStarted","Data":"833b2c5e2818bfdf905f43a1b5f6375499466727904ead53e6d4ede4d69eddc7"} Sep 17 03:12:42.914403 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.914385 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-246d2" event={"ID":"72dfc96b-596c-4f3f-93f7-7a323067dae4","Type":"ContainerStarted","Data":"b198e55879c7edf9c99fbbf12eac22f69e66239c91f12ec5dd13f5d719d8ca4f"} Sep 17 03:12:42.915355 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:42.915336 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2dr88" event={"ID":"ade8d91a-ea36-43e4-8754-afea35aaaeed","Type":"ContainerStarted","Data":"dbdbab5ceabfd7b99f43b5b50e60bad668ff5c84f427be5e41992e6ab1771983"} Sep 17 03:12:43.520923 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:43.520890 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c98ae40-3a0b-4d27-b060-510431eb9770-original-pull-secret\") pod \"global-pull-secret-syncer-bfbnk\" (UID: \"6c98ae40-3a0b-4d27-b060-510431eb9770\") " pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:12:43.521053 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:43.520946 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8fhq\" (UniqueName: \"kubernetes.io/projected/2580ca6b-3260-4448-a21c-9f9ee7e2e1b7-kube-api-access-k8fhq\") pod \"network-check-target-8m8pj\" (UID: \"2580ca6b-3260-4448-a21c-9f9ee7e2e1b7\") " pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:12:43.521053 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:43.521010 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs\") pod \"network-metrics-daemon-bgwwg\" (UID: \"eca0ae2b-bd17-447e-9784-04f94225f000\") " pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:12:43.521204 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:43.521168 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:43.521258 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:43.521235 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs podName:eca0ae2b-bd17-447e-9784-04f94225f000 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:45.521218215 +0000 UTC m=+6.054728906 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs") pod "network-metrics-daemon-bgwwg" (UID: "eca0ae2b-bd17-447e-9784-04f94225f000") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:43.521974 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:43.521868 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:12:43.521974 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:43.521880 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:43.521974 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:43.521895 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:12:43.521974 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:43.521911 2574 projected.go:196] Error preparing data for projected volume kube-api-access-k8fhq for pod openshift-network-diagnostics/network-check-target-8m8pj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:43.521974 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:43.521942 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c98ae40-3a0b-4d27-b060-510431eb9770-original-pull-secret podName:6c98ae40-3a0b-4d27-b060-510431eb9770 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:45.521924356 +0000 UTC m=+6.055435044 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c98ae40-3a0b-4d27-b060-510431eb9770-original-pull-secret") pod "global-pull-secret-syncer-bfbnk" (UID: "6c98ae40-3a0b-4d27-b060-510431eb9770") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:43.521974 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:43.521960 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2580ca6b-3260-4448-a21c-9f9ee7e2e1b7-kube-api-access-k8fhq podName:2580ca6b-3260-4448-a21c-9f9ee7e2e1b7 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:45.521951426 +0000 UTC m=+6.055462109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8fhq" (UniqueName: "kubernetes.io/projected/2580ca6b-3260-4448-a21c-9f9ee7e2e1b7-kube-api-access-k8fhq") pod "network-check-target-8m8pj" (UID: "2580ca6b-3260-4448-a21c-9f9ee7e2e1b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:43.857971 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:43.857881 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 03:07:41 +0000 UTC" deadline="2028-06-01 05:39:39.97846154 +0000 UTC" Sep 17 03:12:43.857971 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:43.857924 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14954h26m56.120542498s" Sep 17 03:12:43.894183 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:43.894152 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:12:43.894332 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:43.894275 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m8pj" podUID="2580ca6b-3260-4448-a21c-9f9ee7e2e1b7" Sep 17 03:12:43.894702 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:43.894682 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:12:43.894817 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:43.894795 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgwwg" podUID="eca0ae2b-bd17-447e-9784-04f94225f000" Sep 17 03:12:43.894883 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:43.894873 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:12:43.894981 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:43.894946 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfbnk" podUID="6c98ae40-3a0b-4d27-b060-510431eb9770" Sep 17 03:12:43.927128 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:43.927070 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-70.ec2.internal" event={"ID":"21c858cc32c6191885a49e3c88c5f4d0","Type":"ContainerStarted","Data":"3a2d2c0d4520aa790ca4d4fde9ed5686bd422a1103129bae2c1b187cf29fbcde"} Sep 17 03:12:43.941975 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:43.941916 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-70.ec2.internal" podStartSLOduration=2.941897533 podStartE2EDuration="2.941897533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:12:43.941277543 +0000 UTC m=+4.474788246" watchObservedRunningTime="2026-09-17 03:12:43.941897533 +0000 UTC m=+4.475408236" Sep 17 03:12:44.953662 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:44.952787 2574 generic.go:356] "Generic (PLEG): container finished" podID="3161444eef5dd45f0fbeea3258eaade1" containerID="5e9700f2e52718c6ee578e1d168ef716ba8396b91f10f912fd1306c4179f4350" exitCode=0 Sep 17 03:12:44.953662 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:44.952950 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-70.ec2.internal" event={"ID":"3161444eef5dd45f0fbeea3258eaade1","Type":"ContainerDied","Data":"5e9700f2e52718c6ee578e1d168ef716ba8396b91f10f912fd1306c4179f4350"} Sep 17 03:12:45.537914 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:45.537873 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c98ae40-3a0b-4d27-b060-510431eb9770-original-pull-secret\") pod \"global-pull-secret-syncer-bfbnk\" (UID: \"6c98ae40-3a0b-4d27-b060-510431eb9770\") " pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:12:45.538112 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:45.537935 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8fhq\" (UniqueName: \"kubernetes.io/projected/2580ca6b-3260-4448-a21c-9f9ee7e2e1b7-kube-api-access-k8fhq\") pod \"network-check-target-8m8pj\" (UID: \"2580ca6b-3260-4448-a21c-9f9ee7e2e1b7\") " pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:12:45.538112 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:45.537997 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs\") pod \"network-metrics-daemon-bgwwg\" (UID: \"eca0ae2b-bd17-447e-9784-04f94225f000\") " pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:12:45.538222 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:45.538167 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:45.538274 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:45.538230 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs podName:eca0ae2b-bd17-447e-9784-04f94225f000 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:49.538211512 +0000 UTC m=+10.071722198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs") pod "network-metrics-daemon-bgwwg" (UID: "eca0ae2b-bd17-447e-9784-04f94225f000") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:45.538656 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:45.538631 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:45.538755 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:45.538692 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c98ae40-3a0b-4d27-b060-510431eb9770-original-pull-secret podName:6c98ae40-3a0b-4d27-b060-510431eb9770 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:49.538677167 +0000 UTC m=+10.072187852 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c98ae40-3a0b-4d27-b060-510431eb9770-original-pull-secret") pod "global-pull-secret-syncer-bfbnk" (UID: "6c98ae40-3a0b-4d27-b060-510431eb9770") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:45.538816 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:45.538771 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:12:45.538816 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:45.538785 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:12:45.538816 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:45.538797 2574 projected.go:196] Error preparing data for projected volume kube-api-access-k8fhq for pod openshift-network-diagnostics/network-check-target-8m8pj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:45.538958 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:45.538867 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2580ca6b-3260-4448-a21c-9f9ee7e2e1b7-kube-api-access-k8fhq podName:2580ca6b-3260-4448-a21c-9f9ee7e2e1b7 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:49.538852182 +0000 UTC m=+10.072362884 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8fhq" (UniqueName: "kubernetes.io/projected/2580ca6b-3260-4448-a21c-9f9ee7e2e1b7-kube-api-access-k8fhq") pod "network-check-target-8m8pj" (UID: "2580ca6b-3260-4448-a21c-9f9ee7e2e1b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:45.894349 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:45.894213 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:12:45.894349 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:45.894338 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m8pj" podUID="2580ca6b-3260-4448-a21c-9f9ee7e2e1b7" Sep 17 03:12:45.894565 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:45.894465 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:12:45.894565 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:45.894554 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgwwg" podUID="eca0ae2b-bd17-447e-9784-04f94225f000" Sep 17 03:12:45.894678 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:45.894615 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:12:45.894738 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:45.894715 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfbnk" podUID="6c98ae40-3a0b-4d27-b060-510431eb9770" Sep 17 03:12:45.958719 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:45.958675 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-70.ec2.internal" event={"ID":"3161444eef5dd45f0fbeea3258eaade1","Type":"ContainerStarted","Data":"610ace5ea4b46d06eaab0669f076cdeb31ec44bf90b4a3505f2a64b758caf15a"} Sep 17 03:12:47.891850 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:47.891804 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:12:47.892283 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:47.891939 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m8pj" podUID="2580ca6b-3260-4448-a21c-9f9ee7e2e1b7" Sep 17 03:12:47.892373 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:47.892354 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:12:47.892538 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:47.892488 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgwwg" podUID="eca0ae2b-bd17-447e-9784-04f94225f000" Sep 17 03:12:47.892538 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:47.892514 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:12:47.892677 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:47.892623 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfbnk" podUID="6c98ae40-3a0b-4d27-b060-510431eb9770" Sep 17 03:12:49.573730 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:49.573694 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c98ae40-3a0b-4d27-b060-510431eb9770-original-pull-secret\") pod \"global-pull-secret-syncer-bfbnk\" (UID: \"6c98ae40-3a0b-4d27-b060-510431eb9770\") " pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:12:49.574198 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:49.573742 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8fhq\" (UniqueName: \"kubernetes.io/projected/2580ca6b-3260-4448-a21c-9f9ee7e2e1b7-kube-api-access-k8fhq\") pod \"network-check-target-8m8pj\" (UID: \"2580ca6b-3260-4448-a21c-9f9ee7e2e1b7\") " pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:12:49.574198 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:49.573777 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs\") pod \"network-metrics-daemon-bgwwg\" (UID: \"eca0ae2b-bd17-447e-9784-04f94225f000\") " pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:12:49.574198 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:49.573873 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:49.574198 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:49.573934 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs podName:eca0ae2b-bd17-447e-9784-04f94225f000 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:57.573915627 +0000 UTC m=+18.107426319 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs") pod "network-metrics-daemon-bgwwg" (UID: "eca0ae2b-bd17-447e-9784-04f94225f000") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:49.574412 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:49.574261 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:49.574412 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:49.574310 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c98ae40-3a0b-4d27-b060-510431eb9770-original-pull-secret podName:6c98ae40-3a0b-4d27-b060-510431eb9770 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:57.574294641 +0000 UTC m=+18.107805334 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c98ae40-3a0b-4d27-b060-510431eb9770-original-pull-secret") pod "global-pull-secret-syncer-bfbnk" (UID: "6c98ae40-3a0b-4d27-b060-510431eb9770") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:49.574412 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:49.574390 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:12:49.574412 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:49.574405 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:12:49.574412 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:49.574417 2574 projected.go:196] Error preparing data for projected volume kube-api-access-k8fhq for pod openshift-network-diagnostics/network-check-target-8m8pj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:49.574687 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:49.574470 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2580ca6b-3260-4448-a21c-9f9ee7e2e1b7-kube-api-access-k8fhq podName:2580ca6b-3260-4448-a21c-9f9ee7e2e1b7 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:57.57445745 +0000 UTC m=+18.107968134 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8fhq" (UniqueName: "kubernetes.io/projected/2580ca6b-3260-4448-a21c-9f9ee7e2e1b7-kube-api-access-k8fhq") pod "network-check-target-8m8pj" (UID: "2580ca6b-3260-4448-a21c-9f9ee7e2e1b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:49.892636 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:49.892549 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:12:49.892636 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:49.892553 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:12:49.893603 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:49.893569 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m8pj" podUID="2580ca6b-3260-4448-a21c-9f9ee7e2e1b7" Sep 17 03:12:49.893603 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:49.893588 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:12:49.893768 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:49.893677 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgwwg" podUID="eca0ae2b-bd17-447e-9784-04f94225f000" Sep 17 03:12:49.893768 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:49.893733 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfbnk" podUID="6c98ae40-3a0b-4d27-b060-510431eb9770" Sep 17 03:12:51.892370 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:51.892336 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:12:51.892832 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:51.892480 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m8pj" podUID="2580ca6b-3260-4448-a21c-9f9ee7e2e1b7" Sep 17 03:12:51.892894 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:51.892865 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:12:51.892997 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:51.892970 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgwwg" podUID="eca0ae2b-bd17-447e-9784-04f94225f000" Sep 17 03:12:51.893292 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:51.893273 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:12:51.893389 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:51.893370 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfbnk" podUID="6c98ae40-3a0b-4d27-b060-510431eb9770" Sep 17 03:12:53.892086 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:53.892056 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:12:53.892393 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:53.892063 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:12:53.892393 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:53.892197 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m8pj" podUID="2580ca6b-3260-4448-a21c-9f9ee7e2e1b7" Sep 17 03:12:53.892393 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:53.892264 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:12:53.892393 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:53.892271 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgwwg" podUID="eca0ae2b-bd17-447e-9784-04f94225f000" Sep 17 03:12:53.892393 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:53.892376 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfbnk" podUID="6c98ae40-3a0b-4d27-b060-510431eb9770" Sep 17 03:12:55.891861 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:55.891374 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:12:55.891861 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:55.891385 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:12:55.891861 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:55.891512 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m8pj" podUID="2580ca6b-3260-4448-a21c-9f9ee7e2e1b7" Sep 17 03:12:55.891861 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:55.891531 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:12:55.891861 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:55.891612 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgwwg" podUID="eca0ae2b-bd17-447e-9784-04f94225f000" Sep 17 03:12:55.891861 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:55.891715 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfbnk" podUID="6c98ae40-3a0b-4d27-b060-510431eb9770" Sep 17 03:12:57.630921 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:57.630882 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs\") pod \"network-metrics-daemon-bgwwg\" (UID: \"eca0ae2b-bd17-447e-9784-04f94225f000\") " pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:12:57.631489 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:57.630942 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c98ae40-3a0b-4d27-b060-510431eb9770-original-pull-secret\") pod \"global-pull-secret-syncer-bfbnk\" (UID: \"6c98ae40-3a0b-4d27-b060-510431eb9770\") " pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:12:57.631489 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:57.630965 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8fhq\" (UniqueName: \"kubernetes.io/projected/2580ca6b-3260-4448-a21c-9f9ee7e2e1b7-kube-api-access-k8fhq\") pod \"network-check-target-8m8pj\" (UID: \"2580ca6b-3260-4448-a21c-9f9ee7e2e1b7\") " pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:12:57.631489 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:57.631041 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:57.631489 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:57.631068 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:57.631489 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:57.631073 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:12:57.631489 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:57.631093 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:12:57.631489 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:57.631105 2574 projected.go:196] Error preparing data for projected volume kube-api-access-k8fhq for pod openshift-network-diagnostics/network-check-target-8m8pj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:57.631489 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:57.631124 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs podName:eca0ae2b-bd17-447e-9784-04f94225f000 nodeName:}" failed. No retries permitted until 2026-09-17 03:13:13.631096989 +0000 UTC m=+34.164607668 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs") pod "network-metrics-daemon-bgwwg" (UID: "eca0ae2b-bd17-447e-9784-04f94225f000") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:57.631489 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:57.631141 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c98ae40-3a0b-4d27-b060-510431eb9770-original-pull-secret podName:6c98ae40-3a0b-4d27-b060-510431eb9770 nodeName:}" failed. No retries permitted until 2026-09-17 03:13:13.631133859 +0000 UTC m=+34.164644537 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c98ae40-3a0b-4d27-b060-510431eb9770-original-pull-secret") pod "global-pull-secret-syncer-bfbnk" (UID: "6c98ae40-3a0b-4d27-b060-510431eb9770") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:57.631489 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:57.631156 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2580ca6b-3260-4448-a21c-9f9ee7e2e1b7-kube-api-access-k8fhq podName:2580ca6b-3260-4448-a21c-9f9ee7e2e1b7 nodeName:}" failed. No retries permitted until 2026-09-17 03:13:13.631145515 +0000 UTC m=+34.164656195 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8fhq" (UniqueName: "kubernetes.io/projected/2580ca6b-3260-4448-a21c-9f9ee7e2e1b7-kube-api-access-k8fhq") pod "network-check-target-8m8pj" (UID: "2580ca6b-3260-4448-a21c-9f9ee7e2e1b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:57.891369 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:57.891291 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:12:57.891521 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:57.891291 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:12:57.891521 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:57.891407 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgwwg" podUID="eca0ae2b-bd17-447e-9784-04f94225f000" Sep 17 03:12:57.891521 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:57.891290 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:12:57.891521 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:57.891487 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfbnk" podUID="6c98ae40-3a0b-4d27-b060-510431eb9770" Sep 17 03:12:57.891660 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:57.891539 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m8pj" podUID="2580ca6b-3260-4448-a21c-9f9ee7e2e1b7" Sep 17 03:12:59.892665 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:59.892633 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:12:59.893079 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:59.892704 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:12:59.893079 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:59.892719 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m8pj" podUID="2580ca6b-3260-4448-a21c-9f9ee7e2e1b7" Sep 17 03:12:59.893079 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:59.892779 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfbnk" podUID="6c98ae40-3a0b-4d27-b060-510431eb9770" Sep 17 03:12:59.893079 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:12:59.892832 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:12:59.893079 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:12:59.892907 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgwwg" podUID="eca0ae2b-bd17-447e-9784-04f94225f000" Sep 17 03:13:01.891806 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:01.891635 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:13:01.892569 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:01.891636 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:13:01.892569 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:01.891905 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m8pj" podUID="2580ca6b-3260-4448-a21c-9f9ee7e2e1b7" Sep 17 03:13:01.892569 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:01.891641 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:13:01.892569 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:01.891966 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgwwg" podUID="eca0ae2b-bd17-447e-9784-04f94225f000" Sep 17 03:13:01.892569 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:01.892032 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfbnk" podUID="6c98ae40-3a0b-4d27-b060-510431eb9770" Sep 17 03:13:01.991746 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:01.991711 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f59hh" event={"ID":"3043780c-edd9-40a8-bed5-a58f0265801e","Type":"ContainerStarted","Data":"93fcb966e59da2f6a95dcb0c828f81871f4e9b5a602d85822641c36812868508"} Sep 17 03:13:01.993215 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:01.993191 2574 generic.go:356] "Generic (PLEG): container finished" podID="f26c059a-e57c-4f3f-bdaf-15df31142402" containerID="a501f72304b8c8f7355c876a791c910baf8ac97cf5f3d44cfbbc90bdcb10e13b" exitCode=0 Sep 17 03:13:01.993319 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:01.993243 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxr44" event={"ID":"f26c059a-e57c-4f3f-bdaf-15df31142402","Type":"ContainerDied","Data":"a501f72304b8c8f7355c876a791c910baf8ac97cf5f3d44cfbbc90bdcb10e13b"} Sep 17 03:13:01.994864 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:01.994838 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" event={"ID":"d5ecacab-3a47-4307-bea6-93d0085456c2","Type":"ContainerStarted","Data":"7ef51e017579ffe2fffe6ca6e9e8ef1abad4f7af7f0ae4a4d998a0d2370f42f6"} Sep 17 03:13:01.996543 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:01.996520 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" event={"ID":"213e7818-aa1d-4020-9b98-fc9dc7ec8c48","Type":"ContainerStarted","Data":"7150ca3d6f6ece5cf7a007a13d9b7c525873a5f1c88d2a286b3da321ca86dee7"} Sep 17 03:13:01.998127 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:01.998107 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fxnnk" event={"ID":"2e0230bb-9ec2-4733-a2ea-a51f9650184f","Type":"ContainerStarted","Data":"c11dc981a98f87d61992c7e22810d7d3c378bf0d2766d889f733b4a3c2b16050"} Sep 17 03:13:02.001932 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:02.001905 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" event={"ID":"a07b8242-870d-4be1-827d-d5b5e41d45ec","Type":"ContainerStarted","Data":"9e342df29bba6f00c42319d241be4f81919d30aee3baddd39bfffdff9d6e118e"} Sep 17 03:13:02.002035 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:02.001984 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" event={"ID":"a07b8242-870d-4be1-827d-d5b5e41d45ec","Type":"ContainerStarted","Data":"b502d14aa872c86df386589d4853c1f8334f135a0d5d2e152c6f479575996ef6"} Sep 17 03:13:02.002095 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:02.002038 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" event={"ID":"a07b8242-870d-4be1-827d-d5b5e41d45ec","Type":"ContainerStarted","Data":"1d4f26542cd9d5c61d45c89f6cb2b6c480b7e4cecbf3da65343a22b3ffcdc975"} Sep 17 03:13:02.002095 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:02.002086 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" event={"ID":"a07b8242-870d-4be1-827d-d5b5e41d45ec","Type":"ContainerStarted","Data":"f62f3c02e14b213bce1277fb9789bd748fd8cb8565bd220217a62495674163dd"} Sep 17 03:13:02.002182 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:02.002133 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" event={"ID":"a07b8242-870d-4be1-827d-d5b5e41d45ec","Type":"ContainerStarted","Data":"de6b6850bf32b9198d3afc644246e149d44c1fad4ba4f4b42d405d29fa477902"} Sep 17 03:13:02.003600 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:02.003578 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-246d2" event={"ID":"72dfc96b-596c-4f3f-93f7-7a323067dae4","Type":"ContainerStarted","Data":"8c795605d523d058293c7650d2a113e64b240e5d3c02c520de9a1eb03fbe1aa9"} Sep 17 03:13:02.004833 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:02.004813 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2dr88" event={"ID":"ade8d91a-ea36-43e4-8754-afea35aaaeed","Type":"ContainerStarted","Data":"de88005d5fdb9ace3a9e7019b2ef79edb6f32a1db68bb05748514b64361aeb24"} Sep 17 03:13:02.006505 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:02.006462 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f59hh" podStartSLOduration=2.846869105 podStartE2EDuration="22.006448987s" totalImagesPullingTime="19.159579882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:02.006289575 +0000 UTC m=+22.539800277" watchObservedRunningTime="2026-09-17 03:13:02.006448987 +0000 UTC m=+22.539959690" Sep 17 03:13:02.006999 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:02.006977 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-70.ec2.internal" podStartSLOduration=21.006968711 podStartE2EDuration="21.006968711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:12:45.975009025 +0000 UTC m=+6.508519726" watchObservedRunningTime="2026-09-17 03:13:02.006968711 +0000 UTC m=+22.540479415" Sep 17 03:13:02.021145 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:02.021089 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2dr88" podStartSLOduration=2.864362236 podStartE2EDuration="22.021068283s" totalImagesPullingTime="19.156706047s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:02.020982007 +0000 UTC m=+22.554492707" watchObservedRunningTime="2026-09-17 03:13:02.021068283 +0000 UTC m=+22.554578986" Sep 17 03:13:02.042475 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:02.042391 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fxnnk" podStartSLOduration=2.731738432 podStartE2EDuration="22.042374661s" totalImagesPullingTime="19.310636229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:02.042245922 +0000 UTC m=+22.575756623" watchObservedRunningTime="2026-09-17 03:13:02.042374661 +0000 UTC m=+22.575885362" Sep 17 03:13:02.060516 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:02.060461 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-f7d9c" podStartSLOduration=2.897091022 podStartE2EDuration="22.060446325s" totalImagesPullingTime="19.163355303s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:02.060021976 +0000 UTC m=+22.593532679" watchObservedRunningTime="2026-09-17 03:13:02.060446325 +0000 UTC m=+22.593957026" Sep 17 03:13:02.113539 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:02.113446 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-246d2" podStartSLOduration=2.985798741 podStartE2EDuration="22.113413403s" totalImagesPullingTime="19.127614662s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:02.112228578 +0000 UTC m=+22.645739281" watchObservedRunningTime="2026-09-17 03:13:02.113413403 +0000 UTC m=+22.646924103" Sep 17 03:13:03.008205 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:03.008168 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k74r5" event={"ID":"0ab8e005-1922-4e32-ac38-5e7883c55d0c","Type":"ContainerStarted","Data":"88dd25d34da778a05bb0e545987574c0c323beb4ffc0f2759a7102344bee2402"} Sep 17 03:13:03.012964 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:03.012466 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" event={"ID":"a07b8242-870d-4be1-827d-d5b5e41d45ec","Type":"ContainerStarted","Data":"1eba2d4cf3951ac9914681788742bbea70e341c20df6c7cecdc3c2419a2531cb"} Sep 17 03:13:03.025932 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:03.025684 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-k74r5" podStartSLOduration=4.805220919 podStartE2EDuration="24.025662831s" totalImagesPullingTime="19.220441912s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:03.024906432 +0000 UTC m=+23.558417135" watchObservedRunningTime="2026-09-17 03:13:03.025662831 +0000 UTC m=+23.559173534" Sep 17 03:13:03.163479 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:03.163449 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 03:13:03.861533 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:03.861434 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T03:13:03.163473168Z","UUID":"d5a5be9f-2ed4-4313-872f-216151097f93","Handler":null,"Name":"","Endpoint":""} Sep 17 03:13:03.863174 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:03.863150 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 03:13:03.863303 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:03.863186 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 03:13:03.891174 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:03.891145 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:13:03.891174 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:03.891184 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:13:03.891443 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:03.891145 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:13:03.891443 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:03.891276 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgwwg" podUID="eca0ae2b-bd17-447e-9784-04f94225f000" Sep 17 03:13:03.891443 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:03.891378 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m8pj" podUID="2580ca6b-3260-4448-a21c-9f9ee7e2e1b7" Sep 17 03:13:03.891604 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:03.891485 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfbnk" podUID="6c98ae40-3a0b-4d27-b060-510431eb9770" Sep 17 03:13:04.016518 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:04.016462 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" event={"ID":"213e7818-aa1d-4020-9b98-fc9dc7ec8c48","Type":"ContainerStarted","Data":"d1f3622451eb038c6e6038b82b999bd91b62731eefd2ae0c11eeac918c0b9480"} Sep 17 03:13:05.022986 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:05.022950 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" event={"ID":"a07b8242-870d-4be1-827d-d5b5e41d45ec","Type":"ContainerStarted","Data":"c05223d72b2c28208165fd531b651c18c94d7132a97c778cfb89963c4a9312a1"} Sep 17 03:13:05.025349 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:05.025320 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" event={"ID":"213e7818-aa1d-4020-9b98-fc9dc7ec8c48","Type":"ContainerStarted","Data":"f9369f40f3988bcf71447b0899ae31b716833e11403d999efa44e8072dc94994"} Sep 17 03:13:05.046628 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:05.044143 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n96sm" podStartSLOduration=3.271860782 podStartE2EDuration="25.044125441s" totalImagesPullingTime="21.772264659s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:05.043785402 +0000 UTC m=+25.577296103" watchObservedRunningTime="2026-09-17 03:13:05.044125441 +0000 UTC m=+25.577636140" Sep 17 03:13:05.891891 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:05.891860 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:13:05.892094 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:05.891860 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:13:05.892094 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:05.891989 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgwwg" podUID="eca0ae2b-bd17-447e-9784-04f94225f000" Sep 17 03:13:05.892094 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:05.892022 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:13:05.892221 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:05.892120 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m8pj" podUID="2580ca6b-3260-4448-a21c-9f9ee7e2e1b7" Sep 17 03:13:05.892221 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:05.892180 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfbnk" podUID="6c98ae40-3a0b-4d27-b060-510431eb9770" Sep 17 03:13:06.410236 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:06.410210 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f59hh" Sep 17 03:13:06.410834 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:06.410815 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f59hh" Sep 17 03:13:07.030280 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:07.030254 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f59hh" Sep 17 03:13:07.030793 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:07.030769 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f59hh" Sep 17 03:13:07.891962 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:07.891756 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:13:07.892383 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:07.891756 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:13:07.892383 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:07.891983 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgwwg" podUID="eca0ae2b-bd17-447e-9784-04f94225f000" Sep 17 03:13:07.892383 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:07.891777 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:13:07.892383 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:07.892064 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m8pj" podUID="2580ca6b-3260-4448-a21c-9f9ee7e2e1b7" Sep 17 03:13:07.892383 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:07.892118 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfbnk" podUID="6c98ae40-3a0b-4d27-b060-510431eb9770" Sep 17 03:13:08.034218 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:08.034188 2574 generic.go:356] "Generic (PLEG): container finished" podID="f26c059a-e57c-4f3f-bdaf-15df31142402" containerID="7d41954204f5558068925de17b848e9ce5b99acf87cefd0e4f876c5d728abb42" exitCode=0 Sep 17 03:13:08.034389 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:08.034272 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxr44" event={"ID":"f26c059a-e57c-4f3f-bdaf-15df31142402","Type":"ContainerDied","Data":"7d41954204f5558068925de17b848e9ce5b99acf87cefd0e4f876c5d728abb42"} Sep 17 03:13:08.038177 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:08.038156 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" event={"ID":"a07b8242-870d-4be1-827d-d5b5e41d45ec","Type":"ContainerStarted","Data":"36f523d9da56a2930e575b3263886fb0d9086afb05639d54e663c38c1982d25a"} Sep 17 03:13:09.040321 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:09.040285 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:13:09.041006 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:09.040825 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:13:09.041006 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:09.040895 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:13:09.058985 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:09.058960 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:13:09.062494 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:09.062309 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:13:09.087290 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:09.087252 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" podStartSLOduration=10.823538873 podStartE2EDuration="30.087238024s" totalImagesPullingTime="19.263699151s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:08.10184357 +0000 UTC m=+28.635354271" watchObservedRunningTime="2026-09-17 03:13:09.087238024 +0000 UTC m=+29.620748725" Sep 17 03:13:09.166162 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:09.166141 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bgwwg"] Sep 17 03:13:09.166266 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:09.166255 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:13:09.166370 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:09.166346 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgwwg" podUID="eca0ae2b-bd17-447e-9784-04f94225f000" Sep 17 03:13:09.169845 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:09.169818 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bfbnk"] Sep 17 03:13:09.170341 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:09.169878 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8m8pj"] Sep 17 03:13:09.170341 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:09.169958 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:13:09.170341 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:09.170034 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m8pj" podUID="2580ca6b-3260-4448-a21c-9f9ee7e2e1b7" Sep 17 03:13:09.170341 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:09.170091 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:13:09.170341 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:09.170182 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfbnk" podUID="6c98ae40-3a0b-4d27-b060-510431eb9770" Sep 17 03:13:10.044635 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:10.044602 2574 generic.go:356] "Generic (PLEG): container finished" podID="f26c059a-e57c-4f3f-bdaf-15df31142402" containerID="b748906ea9ab5ac5f7037f924daebb8fd6392cd8818e8a7f586665b97e014c95" exitCode=0 Sep 17 03:13:10.045037 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:10.044689 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxr44" event={"ID":"f26c059a-e57c-4f3f-bdaf-15df31142402","Type":"ContainerDied","Data":"b748906ea9ab5ac5f7037f924daebb8fd6392cd8818e8a7f586665b97e014c95"} Sep 17 03:13:10.892093 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:10.892017 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:13:10.892093 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:10.892048 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:13:10.892268 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:10.892130 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfbnk" podUID="6c98ae40-3a0b-4d27-b060-510431eb9770" Sep 17 03:13:10.892268 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:10.892201 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m8pj" podUID="2580ca6b-3260-4448-a21c-9f9ee7e2e1b7" Sep 17 03:13:10.892268 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:10.892225 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:13:10.892365 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:10.892337 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgwwg" podUID="eca0ae2b-bd17-447e-9784-04f94225f000" Sep 17 03:13:12.052929 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:12.052895 2574 generic.go:356] "Generic (PLEG): container finished" podID="f26c059a-e57c-4f3f-bdaf-15df31142402" containerID="c461f6750dd9b66e095cbdcc18f00841a24af3635981507f519afdd9ebe1decd" exitCode=0 Sep 17 03:13:12.053296 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:12.052947 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxr44" event={"ID":"f26c059a-e57c-4f3f-bdaf-15df31142402","Type":"ContainerDied","Data":"c461f6750dd9b66e095cbdcc18f00841a24af3635981507f519afdd9ebe1decd"} Sep 17 03:13:12.891852 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:12.891820 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:13:12.892135 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:12.891834 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:13:12.892135 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:12.891948 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfbnk" podUID="6c98ae40-3a0b-4d27-b060-510431eb9770" Sep 17 03:13:12.892135 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:12.891834 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:13:12.892135 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:12.892029 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m8pj" podUID="2580ca6b-3260-4448-a21c-9f9ee7e2e1b7" Sep 17 03:13:12.892135 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:12.892111 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgwwg" podUID="eca0ae2b-bd17-447e-9784-04f94225f000" Sep 17 03:13:13.647516 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:13.647474 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8fhq\" (UniqueName: \"kubernetes.io/projected/2580ca6b-3260-4448-a21c-9f9ee7e2e1b7-kube-api-access-k8fhq\") pod \"network-check-target-8m8pj\" (UID: \"2580ca6b-3260-4448-a21c-9f9ee7e2e1b7\") " pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:13:13.647516 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:13.647533 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs\") pod \"network-metrics-daemon-bgwwg\" (UID: \"eca0ae2b-bd17-447e-9784-04f94225f000\") " pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:13:13.648044 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:13.647584 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c98ae40-3a0b-4d27-b060-510431eb9770-original-pull-secret\") pod \"global-pull-secret-syncer-bfbnk\" (UID: \"6c98ae40-3a0b-4d27-b060-510431eb9770\") " pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:13:13.648044 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:13.647659 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:13:13.648044 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:13.647662 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:13:13.648044 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:13.647685 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:13:13.648044 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:13.647697 2574 projected.go:196] Error preparing data for projected volume kube-api-access-k8fhq for pod openshift-network-diagnostics/network-check-target-8m8pj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:13:13.648044 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:13.647721 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c98ae40-3a0b-4d27-b060-510431eb9770-original-pull-secret podName:6c98ae40-3a0b-4d27-b060-510431eb9770 nodeName:}" failed. No retries permitted until 2026-09-17 03:13:45.647703456 +0000 UTC m=+66.181214159 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c98ae40-3a0b-4d27-b060-510431eb9770-original-pull-secret") pod "global-pull-secret-syncer-bfbnk" (UID: "6c98ae40-3a0b-4d27-b060-510431eb9770") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:13:13.648044 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:13.647770 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:13:13.648044 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:13.647800 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs podName:eca0ae2b-bd17-447e-9784-04f94225f000 nodeName:}" failed. No retries permitted until 2026-09-17 03:13:45.647790821 +0000 UTC m=+66.181301516 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs") pod "network-metrics-daemon-bgwwg" (UID: "eca0ae2b-bd17-447e-9784-04f94225f000") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:13:13.648044 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:13.647833 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2580ca6b-3260-4448-a21c-9f9ee7e2e1b7-kube-api-access-k8fhq podName:2580ca6b-3260-4448-a21c-9f9ee7e2e1b7 nodeName:}" failed. No retries permitted until 2026-09-17 03:13:45.647824307 +0000 UTC m=+66.181334985 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8fhq" (UniqueName: "kubernetes.io/projected/2580ca6b-3260-4448-a21c-9f9ee7e2e1b7-kube-api-access-k8fhq") pod "network-check-target-8m8pj" (UID: "2580ca6b-3260-4448-a21c-9f9ee7e2e1b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:13:14.258394 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.258363 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-70.ec2.internal" event="NodeReady" Sep 17 03:13:14.258577 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.258538 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 03:13:14.293989 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.293952 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-767776f89d-rzc4t"] Sep 17 03:13:14.296103 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.295923 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:14.298723 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.298700 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 17 03:13:14.298941 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.298909 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 17 03:13:14.299035 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.299018 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xl2rt\"" Sep 17 03:13:14.299136 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.299113 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 17 03:13:14.309553 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.309529 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 17 03:13:14.310736 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.310713 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lczrd"] Sep 17 03:13:14.312754 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.312736 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-767776f89d-rzc4t"] Sep 17 03:13:14.312860 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.312769 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2c74k"] Sep 17 03:13:14.312919 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.312854 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lczrd" Sep 17 03:13:14.314807 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.314789 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2c74k" Sep 17 03:13:14.315598 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.315579 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lg7wr\"" Sep 17 03:13:14.315778 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.315760 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 03:13:14.316048 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.316031 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 03:13:14.317365 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.317347 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 03:13:14.317762 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.317744 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 03:13:14.317849 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.317819 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 03:13:14.318093 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.318077 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jwfhr\"" Sep 17 03:13:14.323587 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.323567 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lczrd"] Sep 17 03:13:14.324536 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.324518 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2c74k"] Sep 17 03:13:14.351952 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.351926 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-bound-sa-token\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:14.352096 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.351972 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7219af2d-7d54-49a4-9bbe-2356b96cec2d-image-registry-private-configuration\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:14.352096 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.352010 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-certificates\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:14.352096 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.352079 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7219af2d-7d54-49a4-9bbe-2356b96cec2d-ca-trust-extracted\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:14.352243 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.352122 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7219af2d-7d54-49a4-9bbe-2356b96cec2d-installation-pull-secrets\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:14.352243 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.352166 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:14.352243 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.352189 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7219af2d-7d54-49a4-9bbe-2356b96cec2d-trusted-ca\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:14.352337 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.352252 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmdbm\" (UniqueName: \"kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-kube-api-access-tmdbm\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:14.453359 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.453326 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls\") pod \"dns-default-lczrd\" (UID: \"f84f25fc-622c-4836-94b5-f48efb0d718a\") " pod="openshift-dns/dns-default-lczrd" Sep 17 03:13:14.453556 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.453377 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-certificates\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:14.453556 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.453401 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpwfs\" (UniqueName: \"kubernetes.io/projected/27fee724-3145-4db2-9b4e-083466ffab60-kube-api-access-jpwfs\") pod \"ingress-canary-2c74k\" (UID: \"27fee724-3145-4db2-9b4e-083466ffab60\") " pod="openshift-ingress-canary/ingress-canary-2c74k" Sep 17 03:13:14.453556 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.453540 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f84f25fc-622c-4836-94b5-f48efb0d718a-config-volume\") pod \"dns-default-lczrd\" (UID: \"f84f25fc-622c-4836-94b5-f48efb0d718a\") " pod="openshift-dns/dns-default-lczrd" Sep 17 03:13:14.453688 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.453570 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f84f25fc-622c-4836-94b5-f48efb0d718a-tmp-dir\") pod \"dns-default-lczrd\" (UID: \"f84f25fc-622c-4836-94b5-f48efb0d718a\") " pod="openshift-dns/dns-default-lczrd" Sep 17 03:13:14.453688 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.453609 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftkdq\" (UniqueName: \"kubernetes.io/projected/f84f25fc-622c-4836-94b5-f48efb0d718a-kube-api-access-ftkdq\") pod \"dns-default-lczrd\" (UID: \"f84f25fc-622c-4836-94b5-f48efb0d718a\") " pod="openshift-dns/dns-default-lczrd" Sep 17 03:13:14.453688 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.453655 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7219af2d-7d54-49a4-9bbe-2356b96cec2d-ca-trust-extracted\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:14.453688 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.453679 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7219af2d-7d54-49a4-9bbe-2356b96cec2d-installation-pull-secrets\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:14.453833 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.453706 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27fee724-3145-4db2-9b4e-083466ffab60-cert\") pod \"ingress-canary-2c74k\" (UID: \"27fee724-3145-4db2-9b4e-083466ffab60\") " pod="openshift-ingress-canary/ingress-canary-2c74k" Sep 17 03:13:14.453833 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.453725 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:14.453833 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.453743 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7219af2d-7d54-49a4-9bbe-2356b96cec2d-trusted-ca\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:14.453833 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.453782 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmdbm\" (UniqueName: \"kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-kube-api-access-tmdbm\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:14.453833 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.453808 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-bound-sa-token\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:14.454050 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.453849 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7219af2d-7d54-49a4-9bbe-2356b96cec2d-image-registry-private-configuration\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:14.454105 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.454044 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7219af2d-7d54-49a4-9bbe-2356b96cec2d-ca-trust-extracted\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:14.454105 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.454093 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-certificates\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:14.454215 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:14.454153 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:13:14.454215 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:14.454168 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-767776f89d-rzc4t: secret "image-registry-tls" not found Sep 17 03:13:14.454313 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:14.454223 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls podName:7219af2d-7d54-49a4-9bbe-2356b96cec2d nodeName:}" failed. No retries permitted until 2026-09-17 03:13:14.95420138 +0000 UTC m=+35.487712064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls") pod "image-registry-767776f89d-rzc4t" (UID: "7219af2d-7d54-49a4-9bbe-2356b96cec2d") : secret "image-registry-tls" not found Sep 17 03:13:14.455088 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.454978 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7219af2d-7d54-49a4-9bbe-2356b96cec2d-trusted-ca\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:14.457903 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.457885 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7219af2d-7d54-49a4-9bbe-2356b96cec2d-image-registry-private-configuration\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:14.457984 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.457887 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7219af2d-7d54-49a4-9bbe-2356b96cec2d-installation-pull-secrets\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:14.463232 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.463201 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmdbm\" (UniqueName: \"kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-kube-api-access-tmdbm\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:14.463313 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.463291 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-bound-sa-token\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:14.554534 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.554450 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls\") pod \"dns-default-lczrd\" (UID: \"f84f25fc-622c-4836-94b5-f48efb0d718a\") " pod="openshift-dns/dns-default-lczrd" Sep 17 03:13:14.554534 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.554496 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpwfs\" (UniqueName: \"kubernetes.io/projected/27fee724-3145-4db2-9b4e-083466ffab60-kube-api-access-jpwfs\") pod \"ingress-canary-2c74k\" (UID: \"27fee724-3145-4db2-9b4e-083466ffab60\") " pod="openshift-ingress-canary/ingress-canary-2c74k" Sep 17 03:13:14.554534 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.554519 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f84f25fc-622c-4836-94b5-f48efb0d718a-config-volume\") pod \"dns-default-lczrd\" (UID: \"f84f25fc-622c-4836-94b5-f48efb0d718a\") " pod="openshift-dns/dns-default-lczrd" Sep 17 03:13:14.554760 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.554542 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f84f25fc-622c-4836-94b5-f48efb0d718a-tmp-dir\") pod \"dns-default-lczrd\" (UID: \"f84f25fc-622c-4836-94b5-f48efb0d718a\") " pod="openshift-dns/dns-default-lczrd" Sep 17 03:13:14.554760 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.554566 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftkdq\" (UniqueName: \"kubernetes.io/projected/f84f25fc-622c-4836-94b5-f48efb0d718a-kube-api-access-ftkdq\") pod \"dns-default-lczrd\" (UID: \"f84f25fc-622c-4836-94b5-f48efb0d718a\") " pod="openshift-dns/dns-default-lczrd" Sep 17 03:13:14.554760 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.554593 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27fee724-3145-4db2-9b4e-083466ffab60-cert\") pod \"ingress-canary-2c74k\" (UID: \"27fee724-3145-4db2-9b4e-083466ffab60\") " pod="openshift-ingress-canary/ingress-canary-2c74k" Sep 17 03:13:14.554760 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:14.554630 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:13:14.554760 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:14.554704 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls podName:f84f25fc-622c-4836-94b5-f48efb0d718a nodeName:}" failed. No retries permitted until 2026-09-17 03:13:15.054681065 +0000 UTC m=+35.588191762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls") pod "dns-default-lczrd" (UID: "f84f25fc-622c-4836-94b5-f48efb0d718a") : secret "dns-default-metrics-tls" not found Sep 17 03:13:14.555387 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.555366 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f84f25fc-622c-4836-94b5-f48efb0d718a-config-volume\") pod \"dns-default-lczrd\" (UID: \"f84f25fc-622c-4836-94b5-f48efb0d718a\") " pod="openshift-dns/dns-default-lczrd" Sep 17 03:13:14.555560 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.555533 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f84f25fc-622c-4836-94b5-f48efb0d718a-tmp-dir\") pod \"dns-default-lczrd\" (UID: \"f84f25fc-622c-4836-94b5-f48efb0d718a\") " pod="openshift-dns/dns-default-lczrd" Sep 17 03:13:14.557400 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.557380 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27fee724-3145-4db2-9b4e-083466ffab60-cert\") pod \"ingress-canary-2c74k\" (UID: \"27fee724-3145-4db2-9b4e-083466ffab60\") " pod="openshift-ingress-canary/ingress-canary-2c74k" Sep 17 03:13:14.565122 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.565099 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftkdq\" (UniqueName: \"kubernetes.io/projected/f84f25fc-622c-4836-94b5-f48efb0d718a-kube-api-access-ftkdq\") pod \"dns-default-lczrd\" (UID: \"f84f25fc-622c-4836-94b5-f48efb0d718a\") " pod="openshift-dns/dns-default-lczrd" Sep 17 03:13:14.565208 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.565126 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpwfs\" (UniqueName: \"kubernetes.io/projected/27fee724-3145-4db2-9b4e-083466ffab60-kube-api-access-jpwfs\") pod \"ingress-canary-2c74k\" (UID: \"27fee724-3145-4db2-9b4e-083466ffab60\") " pod="openshift-ingress-canary/ingress-canary-2c74k" Sep 17 03:13:14.630349 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.630317 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2c74k" Sep 17 03:13:14.891809 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.891725 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:13:14.891809 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.891766 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:13:14.892295 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.891842 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:13:14.895776 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.895564 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ltdl9\"" Sep 17 03:13:14.895776 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.895583 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 03:13:14.895776 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.895643 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gbwtv\"" Sep 17 03:13:14.896677 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.896507 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 03:13:14.896677 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.896569 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 03:13:14.896677 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.896622 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 03:13:14.956982 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:14.956953 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:14.957130 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:14.957114 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:13:14.957193 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:14.957134 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-767776f89d-rzc4t: secret "image-registry-tls" not found Sep 17 03:13:14.957242 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:14.957214 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls podName:7219af2d-7d54-49a4-9bbe-2356b96cec2d nodeName:}" failed. No retries permitted until 2026-09-17 03:13:15.957191951 +0000 UTC m=+36.490702630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls") pod "image-registry-767776f89d-rzc4t" (UID: "7219af2d-7d54-49a4-9bbe-2356b96cec2d") : secret "image-registry-tls" not found Sep 17 03:13:15.057701 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:15.057665 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls\") pod \"dns-default-lczrd\" (UID: \"f84f25fc-622c-4836-94b5-f48efb0d718a\") " pod="openshift-dns/dns-default-lczrd" Sep 17 03:13:15.057874 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:15.057785 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:13:15.057874 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:15.057851 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls podName:f84f25fc-622c-4836-94b5-f48efb0d718a nodeName:}" failed. No retries permitted until 2026-09-17 03:13:16.057831831 +0000 UTC m=+36.591342528 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls") pod "dns-default-lczrd" (UID: "f84f25fc-622c-4836-94b5-f48efb0d718a") : secret "dns-default-metrics-tls" not found Sep 17 03:13:15.964178 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:15.964145 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:15.964570 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:15.964365 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:13:15.964570 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:15.964382 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-767776f89d-rzc4t: secret "image-registry-tls" not found Sep 17 03:13:15.964570 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:15.964466 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls podName:7219af2d-7d54-49a4-9bbe-2356b96cec2d nodeName:}" failed. No retries permitted until 2026-09-17 03:13:17.964449198 +0000 UTC m=+38.497959890 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls") pod "image-registry-767776f89d-rzc4t" (UID: "7219af2d-7d54-49a4-9bbe-2356b96cec2d") : secret "image-registry-tls" not found Sep 17 03:13:16.064823 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:16.064798 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls\") pod \"dns-default-lczrd\" (UID: \"f84f25fc-622c-4836-94b5-f48efb0d718a\") " pod="openshift-dns/dns-default-lczrd" Sep 17 03:13:16.064941 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:16.064923 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:13:16.064980 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:16.064973 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls podName:f84f25fc-622c-4836-94b5-f48efb0d718a nodeName:}" failed. No retries permitted until 2026-09-17 03:13:18.064958568 +0000 UTC m=+38.598469260 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls") pod "dns-default-lczrd" (UID: "f84f25fc-622c-4836-94b5-f48efb0d718a") : secret "dns-default-metrics-tls" not found Sep 17 03:13:16.231110 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:16.231053 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2c74k"] Sep 17 03:13:16.234629 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:13:16.234604 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27fee724_3145_4db2_9b4e_083466ffab60.slice/crio-ba5fe29c1137630d8359336a7cb535277af076190412905eb5a76e8480d6a6ec WatchSource:0}: Error finding container ba5fe29c1137630d8359336a7cb535277af076190412905eb5a76e8480d6a6ec: Status 404 returned error can't find the container with id ba5fe29c1137630d8359336a7cb535277af076190412905eb5a76e8480d6a6ec Sep 17 03:13:17.067049 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:17.067012 2574 generic.go:356] "Generic (PLEG): container finished" podID="f26c059a-e57c-4f3f-bdaf-15df31142402" containerID="4de3312a411e45961724effe6b73db2ae34d692ce9c3db55277204e036cdf0c4" exitCode=0 Sep 17 03:13:17.067841 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:17.067137 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxr44" event={"ID":"f26c059a-e57c-4f3f-bdaf-15df31142402","Type":"ContainerDied","Data":"4de3312a411e45961724effe6b73db2ae34d692ce9c3db55277204e036cdf0c4"} Sep 17 03:13:17.069114 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:17.069058 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2c74k" event={"ID":"27fee724-3145-4db2-9b4e-083466ffab60","Type":"ContainerStarted","Data":"ba5fe29c1137630d8359336a7cb535277af076190412905eb5a76e8480d6a6ec"} Sep 17 03:13:17.981871 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:17.981646 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:17.982066 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:17.981833 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:13:17.982066 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:17.981973 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-767776f89d-rzc4t: secret "image-registry-tls" not found Sep 17 03:13:17.982066 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:17.982052 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls podName:7219af2d-7d54-49a4-9bbe-2356b96cec2d nodeName:}" failed. No retries permitted until 2026-09-17 03:13:21.982029541 +0000 UTC m=+42.515540254 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls") pod "image-registry-767776f89d-rzc4t" (UID: "7219af2d-7d54-49a4-9bbe-2356b96cec2d") : secret "image-registry-tls" not found Sep 17 03:13:18.075274 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:18.075242 2574 generic.go:356] "Generic (PLEG): container finished" podID="f26c059a-e57c-4f3f-bdaf-15df31142402" containerID="ba8237b67d2e22157c01436daac357fc0a1c5dc2b9d5a27d71fe4ce567de64f1" exitCode=0 Sep 17 03:13:18.075695 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:18.075292 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxr44" event={"ID":"f26c059a-e57c-4f3f-bdaf-15df31142402","Type":"ContainerDied","Data":"ba8237b67d2e22157c01436daac357fc0a1c5dc2b9d5a27d71fe4ce567de64f1"} Sep 17 03:13:18.082931 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:18.082910 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls\") pod \"dns-default-lczrd\" (UID: \"f84f25fc-622c-4836-94b5-f48efb0d718a\") " pod="openshift-dns/dns-default-lczrd" Sep 17 03:13:18.083066 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:18.083018 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:13:18.083107 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:18.083075 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls podName:f84f25fc-622c-4836-94b5-f48efb0d718a nodeName:}" failed. No retries permitted until 2026-09-17 03:13:22.083059015 +0000 UTC m=+42.616569697 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls") pod "dns-default-lczrd" (UID: "f84f25fc-622c-4836-94b5-f48efb0d718a") : secret "dns-default-metrics-tls" not found Sep 17 03:13:19.081448 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:19.081348 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxr44" event={"ID":"f26c059a-e57c-4f3f-bdaf-15df31142402","Type":"ContainerStarted","Data":"b79a7615d697c1005198e0353925557352e58ee63b33d6a1de1b06b74faa74ff"} Sep 17 03:13:19.082817 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:19.082792 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2c74k" event={"ID":"27fee724-3145-4db2-9b4e-083466ffab60","Type":"ContainerStarted","Data":"2f7500f749b979d09eb6ad486347ce48b6590eb859b479c09d1cebe5fed9ee7c"} Sep 17 03:13:19.105700 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:19.105656 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hxr44" podStartSLOduration=8.455631606 podStartE2EDuration="39.105644817s" totalImagesPullingTime="30.650013211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:19.104141548 +0000 UTC m=+39.637652252" watchObservedRunningTime="2026-09-17 03:13:19.105644817 +0000 UTC m=+39.639155517" Sep 17 03:13:19.120632 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:19.120594 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2c74k" podStartSLOduration=2.670085999 podStartE2EDuration="5.120583265s" totalImagesPullingTime="2.450497266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:13:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:19.119906522 +0000 UTC m=+39.653417223" watchObservedRunningTime="2026-09-17 03:13:19.120583265 +0000 UTC m=+39.654093966" Sep 17 03:13:22.014907 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:22.014865 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:22.015376 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:22.015114 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:13:22.015376 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:22.015131 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-767776f89d-rzc4t: secret "image-registry-tls" not found Sep 17 03:13:22.015791 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:22.015754 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls podName:7219af2d-7d54-49a4-9bbe-2356b96cec2d nodeName:}" failed. No retries permitted until 2026-09-17 03:13:30.015191575 +0000 UTC m=+50.548702259 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls") pod "image-registry-767776f89d-rzc4t" (UID: "7219af2d-7d54-49a4-9bbe-2356b96cec2d") : secret "image-registry-tls" not found Sep 17 03:13:22.115813 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:22.115782 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls\") pod \"dns-default-lczrd\" (UID: \"f84f25fc-622c-4836-94b5-f48efb0d718a\") " pod="openshift-dns/dns-default-lczrd" Sep 17 03:13:22.115979 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:22.115873 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:13:22.115979 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:22.115943 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls podName:f84f25fc-622c-4836-94b5-f48efb0d718a nodeName:}" failed. No retries permitted until 2026-09-17 03:13:30.115927576 +0000 UTC m=+50.649438254 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls") pod "dns-default-lczrd" (UID: "f84f25fc-622c-4836-94b5-f48efb0d718a") : secret "dns-default-metrics-tls" not found Sep 17 03:13:30.068959 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:30.068916 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:30.069404 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:30.069065 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:13:30.069404 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:30.069078 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-767776f89d-rzc4t: secret "image-registry-tls" not found Sep 17 03:13:30.069404 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:30.069146 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls podName:7219af2d-7d54-49a4-9bbe-2356b96cec2d nodeName:}" failed. No retries permitted until 2026-09-17 03:13:46.069129038 +0000 UTC m=+66.602639722 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls") pod "image-registry-767776f89d-rzc4t" (UID: "7219af2d-7d54-49a4-9bbe-2356b96cec2d") : secret "image-registry-tls" not found Sep 17 03:13:30.170254 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:30.170221 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls\") pod \"dns-default-lczrd\" (UID: \"f84f25fc-622c-4836-94b5-f48efb0d718a\") " pod="openshift-dns/dns-default-lczrd" Sep 17 03:13:30.170436 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:30.170335 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:13:30.170436 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:30.170383 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls podName:f84f25fc-622c-4836-94b5-f48efb0d718a nodeName:}" failed. No retries permitted until 2026-09-17 03:13:46.170371453 +0000 UTC m=+66.703882132 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls") pod "dns-default-lczrd" (UID: "f84f25fc-622c-4836-94b5-f48efb0d718a") : secret "dns-default-metrics-tls" not found Sep 17 03:13:41.059177 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:41.059133 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tj7x2" Sep 17 03:13:45.676203 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:45.676162 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c98ae40-3a0b-4d27-b060-510431eb9770-original-pull-secret\") pod \"global-pull-secret-syncer-bfbnk\" (UID: \"6c98ae40-3a0b-4d27-b060-510431eb9770\") " pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:13:45.676780 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:45.676210 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8fhq\" (UniqueName: \"kubernetes.io/projected/2580ca6b-3260-4448-a21c-9f9ee7e2e1b7-kube-api-access-k8fhq\") pod \"network-check-target-8m8pj\" (UID: \"2580ca6b-3260-4448-a21c-9f9ee7e2e1b7\") " pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:13:45.676780 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:45.676341 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs\") pod \"network-metrics-daemon-bgwwg\" (UID: \"eca0ae2b-bd17-447e-9784-04f94225f000\") " pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:13:45.679360 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:45.679337 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 03:13:45.679414 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:45.679346 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 03:13:45.679414 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:45.679386 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 03:13:45.686696 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:45.686677 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 03:13:45.686804 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:45.686752 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs podName:eca0ae2b-bd17-447e-9784-04f94225f000 nodeName:}" failed. No retries permitted until 2026-09-17 03:14:49.686731664 +0000 UTC m=+130.220242364 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs") pod "network-metrics-daemon-bgwwg" (UID: "eca0ae2b-bd17-447e-9784-04f94225f000") : secret "metrics-daemon-secret" not found Sep 17 03:13:45.688911 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:45.688893 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 03:13:45.690018 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:45.689999 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c98ae40-3a0b-4d27-b060-510431eb9770-original-pull-secret\") pod \"global-pull-secret-syncer-bfbnk\" (UID: \"6c98ae40-3a0b-4d27-b060-510431eb9770\") " pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:13:45.699970 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:45.699949 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8fhq\" (UniqueName: \"kubernetes.io/projected/2580ca6b-3260-4448-a21c-9f9ee7e2e1b7-kube-api-access-k8fhq\") pod \"network-check-target-8m8pj\" (UID: \"2580ca6b-3260-4448-a21c-9f9ee7e2e1b7\") " pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:13:45.803193 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:45.803158 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfbnk" Sep 17 03:13:45.819342 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:45.819322 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gbwtv\"" Sep 17 03:13:45.826712 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:45.826695 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:13:46.079476 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:46.079383 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:13:46.079600 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:46.079529 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:13:46.079600 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:46.079547 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-767776f89d-rzc4t: secret "image-registry-tls" not found Sep 17 03:13:46.079600 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:46.079599 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls podName:7219af2d-7d54-49a4-9bbe-2356b96cec2d nodeName:}" failed. No retries permitted until 2026-09-17 03:14:18.079583787 +0000 UTC m=+98.613094466 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls") pod "image-registry-767776f89d-rzc4t" (UID: "7219af2d-7d54-49a4-9bbe-2356b96cec2d") : secret "image-registry-tls" not found Sep 17 03:13:46.093072 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:46.093049 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bfbnk"] Sep 17 03:13:46.096039 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:13:46.096019 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c98ae40_3a0b_4d27_b060_510431eb9770.slice/crio-f3adc50e6dc0dfff29d96ca68c5b4582a10fcb1d0cda3a6f51cc0954909baa1c WatchSource:0}: Error finding container f3adc50e6dc0dfff29d96ca68c5b4582a10fcb1d0cda3a6f51cc0954909baa1c: Status 404 returned error can't find the container with id f3adc50e6dc0dfff29d96ca68c5b4582a10fcb1d0cda3a6f51cc0954909baa1c Sep 17 03:13:46.116381 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:46.116359 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8m8pj"] Sep 17 03:13:46.119154 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:13:46.119123 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2580ca6b_3260_4448_a21c_9f9ee7e2e1b7.slice/crio-606b03a8037fe21c2ded1c9e324c191e340c283af25077721fab4419a94dfd9e WatchSource:0}: Error finding container 606b03a8037fe21c2ded1c9e324c191e340c283af25077721fab4419a94dfd9e: Status 404 returned error can't find the container with id 606b03a8037fe21c2ded1c9e324c191e340c283af25077721fab4419a94dfd9e Sep 17 03:13:46.145702 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:46.145672 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8m8pj" event={"ID":"2580ca6b-3260-4448-a21c-9f9ee7e2e1b7","Type":"ContainerStarted","Data":"606b03a8037fe21c2ded1c9e324c191e340c283af25077721fab4419a94dfd9e"} Sep 17 03:13:46.146647 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:46.146622 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bfbnk" event={"ID":"6c98ae40-3a0b-4d27-b060-510431eb9770","Type":"ContainerStarted","Data":"f3adc50e6dc0dfff29d96ca68c5b4582a10fcb1d0cda3a6f51cc0954909baa1c"} Sep 17 03:13:46.179965 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:46.179943 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls\") pod \"dns-default-lczrd\" (UID: \"f84f25fc-622c-4836-94b5-f48efb0d718a\") " pod="openshift-dns/dns-default-lczrd" Sep 17 03:13:46.180058 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:46.180047 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:13:46.180106 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:13:46.180098 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls podName:f84f25fc-622c-4836-94b5-f48efb0d718a nodeName:}" failed. No retries permitted until 2026-09-17 03:14:18.180085796 +0000 UTC m=+98.713596488 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls") pod "dns-default-lczrd" (UID: "f84f25fc-622c-4836-94b5-f48efb0d718a") : secret "dns-default-metrics-tls" not found Sep 17 03:13:51.161399 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:51.161364 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8m8pj" event={"ID":"2580ca6b-3260-4448-a21c-9f9ee7e2e1b7","Type":"ContainerStarted","Data":"4626f3c5669bbcad0ac7b84df2ce343cac47fbe93495c25638cba3efc135fc90"} Sep 17 03:13:51.161806 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:51.161480 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:13:51.163378 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:51.163351 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bfbnk" event={"ID":"6c98ae40-3a0b-4d27-b060-510431eb9770","Type":"ContainerStarted","Data":"41691e1995f2e75883bb8bbba561f6e9f0c6c357fd7e5744cb2e75120cb69b1a"} Sep 17 03:13:51.176536 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:51.176475 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8m8pj" podStartSLOduration=66.23640301 podStartE2EDuration="1m11.176458321s" totalImagesPullingTime="4.940055311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:51.175868504 +0000 UTC m=+71.709379205" watchObservedRunningTime="2026-09-17 03:13:51.176458321 +0000 UTC m=+71.709969022" Sep 17 03:13:51.189784 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:13:51.189657 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bfbnk" podStartSLOduration=66.223472849 podStartE2EDuration="1m11.189640625s" totalImagesPullingTime="4.966167776s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:51.189391507 +0000 UTC m=+71.722902223" watchObservedRunningTime="2026-09-17 03:13:51.189640625 +0000 UTC m=+71.723151326" Sep 17 03:14:18.102982 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:14:18.102865 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:14:18.103502 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:14:18.103018 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:14:18.103502 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:14:18.103037 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-767776f89d-rzc4t: secret "image-registry-tls" not found Sep 17 03:14:18.103502 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:14:18.103095 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls podName:7219af2d-7d54-49a4-9bbe-2356b96cec2d nodeName:}" failed. No retries permitted until 2026-09-17 03:15:22.103078265 +0000 UTC m=+162.636588943 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls") pod "image-registry-767776f89d-rzc4t" (UID: "7219af2d-7d54-49a4-9bbe-2356b96cec2d") : secret "image-registry-tls" not found Sep 17 03:14:18.203738 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:14:18.203702 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls\") pod \"dns-default-lczrd\" (UID: \"f84f25fc-622c-4836-94b5-f48efb0d718a\") " pod="openshift-dns/dns-default-lczrd" Sep 17 03:14:18.203897 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:14:18.203844 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:14:18.203958 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:14:18.203921 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls podName:f84f25fc-622c-4836-94b5-f48efb0d718a nodeName:}" failed. No retries permitted until 2026-09-17 03:15:22.203902845 +0000 UTC m=+162.737413538 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls") pod "dns-default-lczrd" (UID: "f84f25fc-622c-4836-94b5-f48efb0d718a") : secret "dns-default-metrics-tls" not found Sep 17 03:14:22.167839 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:14:22.167804 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8m8pj" Sep 17 03:14:49.713570 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:14:49.713533 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs\") pod \"network-metrics-daemon-bgwwg\" (UID: \"eca0ae2b-bd17-447e-9784-04f94225f000\") " pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:14:49.714025 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:14:49.713639 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 03:14:49.714025 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:14:49.713699 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs podName:eca0ae2b-bd17-447e-9784-04f94225f000 nodeName:}" failed. No retries permitted until 2026-09-17 03:16:51.713684857 +0000 UTC m=+252.247195536 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs") pod "network-metrics-daemon-bgwwg" (UID: "eca0ae2b-bd17-447e-9784-04f94225f000") : secret "metrics-daemon-secret" not found Sep 17 03:15:17.311113 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:15:17.311057 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-767776f89d-rzc4t" podUID="7219af2d-7d54-49a4-9bbe-2356b96cec2d" Sep 17 03:15:17.324278 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:15:17.324239 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lczrd" podUID="f84f25fc-622c-4836-94b5-f48efb0d718a" Sep 17 03:15:17.365572 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:15:17.365548 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:15:17.365697 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:15:17.365548 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lczrd" Sep 17 03:15:17.910387 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:15:17.910349 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bgwwg" podUID="eca0ae2b-bd17-447e-9784-04f94225f000" Sep 17 03:15:22.132561 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:15:22.132516 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:15:22.132950 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:15:22.132660 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:15:22.132950 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:15:22.132676 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-767776f89d-rzc4t: secret "image-registry-tls" not found Sep 17 03:15:22.132950 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:15:22.132743 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls podName:7219af2d-7d54-49a4-9bbe-2356b96cec2d nodeName:}" failed. No retries permitted until 2026-09-17 03:17:24.132724812 +0000 UTC m=+284.666235491 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls") pod "image-registry-767776f89d-rzc4t" (UID: "7219af2d-7d54-49a4-9bbe-2356b96cec2d") : secret "image-registry-tls" not found Sep 17 03:15:22.233574 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:15:22.233529 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls\") pod \"dns-default-lczrd\" (UID: \"f84f25fc-622c-4836-94b5-f48efb0d718a\") " pod="openshift-dns/dns-default-lczrd" Sep 17 03:15:22.233726 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:15:22.233663 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:15:22.233726 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:15:22.233716 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls podName:f84f25fc-622c-4836-94b5-f48efb0d718a nodeName:}" failed. No retries permitted until 2026-09-17 03:17:24.233703606 +0000 UTC m=+284.767214285 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls") pod "dns-default-lczrd" (UID: "f84f25fc-622c-4836-94b5-f48efb0d718a") : secret "dns-default-metrics-tls" not found Sep 17 03:15:28.891308 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:15:28.891255 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:16:51.738613 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:51.738579 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs\") pod \"network-metrics-daemon-bgwwg\" (UID: \"eca0ae2b-bd17-447e-9784-04f94225f000\") " pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:16:51.739068 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:16:51.738710 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 03:16:51.739068 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:16:51.738769 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs podName:eca0ae2b-bd17-447e-9784-04f94225f000 nodeName:}" failed. No retries permitted until 2026-09-17 03:18:53.738752138 +0000 UTC m=+374.272262818 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs") pod "network-metrics-daemon-bgwwg" (UID: "eca0ae2b-bd17-447e-9784-04f94225f000") : secret "metrics-daemon-secret" not found Sep 17 03:16:56.328228 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.328195 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-pm6n9"] Sep 17 03:16:56.330083 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.330059 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-w4xbj"] Sep 17 03:16:56.330198 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.330178 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-pm6n9" Sep 17 03:16:56.332000 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.331978 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-w4xbj" Sep 17 03:16:56.332123 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.331994 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-qt688"] Sep 17 03:16:56.333217 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.333199 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 17 03:16:56.333305 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.333286 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-82zrn\"" Sep 17 03:16:56.333463 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.333444 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 17 03:16:56.333700 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.333682 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 03:16:56.333800 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.333759 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5n64p"] Sep 17 03:16:56.333931 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.333913 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qt688" Sep 17 03:16:56.334714 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.334698 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 03:16:56.334807 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.334701 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:16:56.335042 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.335028 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 17 03:16:56.335737 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.335722 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jmmt9"] Sep 17 03:16:56.335820 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.335808 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5n64p" Sep 17 03:16:56.336225 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.336208 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-bxd7m\"" Sep 17 03:16:56.337621 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.337580 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jmmt9" Sep 17 03:16:56.339338 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.339319 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 17 03:16:56.339440 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.339355 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 03:16:56.339532 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.339516 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 17 03:16:56.339785 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.339771 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 17 03:16:56.339854 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.339798 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:16:56.339854 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.339823 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 03:16:56.340989 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.340971 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7ktz6\"" Sep 17 03:16:56.341204 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.341190 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xn2fs\"" Sep 17 03:16:56.341256 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.341217 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 17 03:16:56.342652 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.342632 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 17 03:16:56.342750 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.342648 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-pjzhb\"" Sep 17 03:16:56.342750 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.342635 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 17 03:16:56.342750 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.342632 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:16:56.342750 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.342677 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 17 03:16:56.342976 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.342961 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 17 03:16:56.344692 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.344676 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-w4xbj"] Sep 17 03:16:56.351595 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.351546 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-qt688"] Sep 17 03:16:56.352636 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.352581 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5n64p"] Sep 17 03:16:56.353660 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.353639 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jmmt9"] Sep 17 03:16:56.379405 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.379378 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-pm6n9"] Sep 17 03:16:56.472796 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.472762 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f265faf-76c7-473c-826a-00a566722ba8-service-ca-bundle\") pod \"insights-operator-5844b856db-pm6n9\" (UID: \"1f265faf-76c7-473c-826a-00a566722ba8\") " pod="openshift-insights/insights-operator-5844b856db-pm6n9" Sep 17 03:16:56.472796 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.472794 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5ec7bca-6b96-4f8c-865c-c863898cce51-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jmmt9\" (UID: \"e5ec7bca-6b96-4f8c-865c-c863898cce51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jmmt9" Sep 17 03:16:56.472975 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.472819 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnb9h\" (UniqueName: \"kubernetes.io/projected/1f265faf-76c7-473c-826a-00a566722ba8-kube-api-access-tnb9h\") pod \"insights-operator-5844b856db-pm6n9\" (UID: \"1f265faf-76c7-473c-826a-00a566722ba8\") " pod="openshift-insights/insights-operator-5844b856db-pm6n9" Sep 17 03:16:56.472975 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.472875 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4hlq\" (UniqueName: \"kubernetes.io/projected/6a49191e-8033-456b-8a50-12c79f3a1607-kube-api-access-k4hlq\") pod \"cluster-monitoring-operator-6cd954b897-qt688\" (UID: \"6a49191e-8033-456b-8a50-12c79f3a1607\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qt688" Sep 17 03:16:56.472975 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.472912 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98lhg\" (UniqueName: \"kubernetes.io/projected/18dc1401-1017-4bbb-bd80-2b11b7b5ab99-kube-api-access-98lhg\") pod \"cluster-samples-operator-86499c89c4-5n64p\" (UID: \"18dc1401-1017-4bbb-bd80-2b11b7b5ab99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5n64p" Sep 17 03:16:56.472975 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.472937 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz9j2\" (UniqueName: \"kubernetes.io/projected/e5ec7bca-6b96-4f8c-865c-c863898cce51-kube-api-access-bz9j2\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jmmt9\" (UID: \"e5ec7bca-6b96-4f8c-865c-c863898cce51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jmmt9" Sep 17 03:16:56.472975 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.472954 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f265faf-76c7-473c-826a-00a566722ba8-tmp\") pod \"insights-operator-5844b856db-pm6n9\" (UID: \"1f265faf-76c7-473c-826a-00a566722ba8\") " pod="openshift-insights/insights-operator-5844b856db-pm6n9" Sep 17 03:16:56.473136 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.473026 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1f265faf-76c7-473c-826a-00a566722ba8-snapshots\") pod \"insights-operator-5844b856db-pm6n9\" (UID: \"1f265faf-76c7-473c-826a-00a566722ba8\") " pod="openshift-insights/insights-operator-5844b856db-pm6n9" Sep 17 03:16:56.473136 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.473054 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1f265faf-76c7-473c-826a-00a566722ba8-serving-cert\") pod \"insights-operator-5844b856db-pm6n9\" (UID: \"1f265faf-76c7-473c-826a-00a566722ba8\") " pod="openshift-insights/insights-operator-5844b856db-pm6n9" Sep 17 03:16:56.473136 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.473078 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6a49191e-8033-456b-8a50-12c79f3a1607-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-qt688\" (UID: \"6a49191e-8033-456b-8a50-12c79f3a1607\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qt688" Sep 17 03:16:56.473136 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.473093 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5ec7bca-6b96-4f8c-865c-c863898cce51-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jmmt9\" (UID: \"e5ec7bca-6b96-4f8c-865c-c863898cce51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jmmt9" Sep 17 03:16:56.473136 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.473117 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a49191e-8033-456b-8a50-12c79f3a1607-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qt688\" (UID: \"6a49191e-8033-456b-8a50-12c79f3a1607\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qt688" Sep 17 03:16:56.473371 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.473145 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f265faf-76c7-473c-826a-00a566722ba8-trusted-ca-bundle\") pod \"insights-operator-5844b856db-pm6n9\" (UID: \"1f265faf-76c7-473c-826a-00a566722ba8\") " pod="openshift-insights/insights-operator-5844b856db-pm6n9" Sep 17 03:16:56.473371 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.473183 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64ng4\" (UniqueName: \"kubernetes.io/projected/95631d45-87be-4c97-ae51-944054d67784-kube-api-access-64ng4\") pod \"volume-data-source-validator-86695b7cc7-w4xbj\" (UID: \"95631d45-87be-4c97-ae51-944054d67784\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-w4xbj" Sep 17 03:16:56.473371 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.473203 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/18dc1401-1017-4bbb-bd80-2b11b7b5ab99-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-5n64p\" (UID: \"18dc1401-1017-4bbb-bd80-2b11b7b5ab99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5n64p" Sep 17 03:16:56.574246 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.574206 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98lhg\" (UniqueName: \"kubernetes.io/projected/18dc1401-1017-4bbb-bd80-2b11b7b5ab99-kube-api-access-98lhg\") pod \"cluster-samples-operator-86499c89c4-5n64p\" (UID: \"18dc1401-1017-4bbb-bd80-2b11b7b5ab99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5n64p" Sep 17 03:16:56.574246 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.574243 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz9j2\" (UniqueName: \"kubernetes.io/projected/e5ec7bca-6b96-4f8c-865c-c863898cce51-kube-api-access-bz9j2\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jmmt9\" (UID: \"e5ec7bca-6b96-4f8c-865c-c863898cce51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jmmt9" Sep 17 03:16:56.574515 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.574260 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f265faf-76c7-473c-826a-00a566722ba8-tmp\") pod \"insights-operator-5844b856db-pm6n9\" (UID: \"1f265faf-76c7-473c-826a-00a566722ba8\") " pod="openshift-insights/insights-operator-5844b856db-pm6n9" Sep 17 03:16:56.574515 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.574442 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1f265faf-76c7-473c-826a-00a566722ba8-snapshots\") pod \"insights-operator-5844b856db-pm6n9\" (UID: \"1f265faf-76c7-473c-826a-00a566722ba8\") " pod="openshift-insights/insights-operator-5844b856db-pm6n9" Sep 17 03:16:56.574515 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.574480 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1f265faf-76c7-473c-826a-00a566722ba8-serving-cert\") pod \"insights-operator-5844b856db-pm6n9\" (UID: \"1f265faf-76c7-473c-826a-00a566722ba8\") " pod="openshift-insights/insights-operator-5844b856db-pm6n9" Sep 17 03:16:56.574515 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.574507 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6a49191e-8033-456b-8a50-12c79f3a1607-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-qt688\" (UID: \"6a49191e-8033-456b-8a50-12c79f3a1607\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qt688" Sep 17 03:16:56.574712 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.574536 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5ec7bca-6b96-4f8c-865c-c863898cce51-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jmmt9\" (UID: \"e5ec7bca-6b96-4f8c-865c-c863898cce51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jmmt9" Sep 17 03:16:56.574712 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.574563 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a49191e-8033-456b-8a50-12c79f3a1607-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qt688\" (UID: \"6a49191e-8033-456b-8a50-12c79f3a1607\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qt688" Sep 17 03:16:56.574712 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.574591 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f265faf-76c7-473c-826a-00a566722ba8-trusted-ca-bundle\") pod \"insights-operator-5844b856db-pm6n9\" (UID: \"1f265faf-76c7-473c-826a-00a566722ba8\") " pod="openshift-insights/insights-operator-5844b856db-pm6n9" Sep 17 03:16:56.574712 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.574619 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64ng4\" (UniqueName: \"kubernetes.io/projected/95631d45-87be-4c97-ae51-944054d67784-kube-api-access-64ng4\") pod \"volume-data-source-validator-86695b7cc7-w4xbj\" (UID: \"95631d45-87be-4c97-ae51-944054d67784\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-w4xbj" Sep 17 03:16:56.574712 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.574645 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/18dc1401-1017-4bbb-bd80-2b11b7b5ab99-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-5n64p\" (UID: \"18dc1401-1017-4bbb-bd80-2b11b7b5ab99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5n64p" Sep 17 03:16:56.574712 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.574662 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f265faf-76c7-473c-826a-00a566722ba8-tmp\") pod \"insights-operator-5844b856db-pm6n9\" (UID: \"1f265faf-76c7-473c-826a-00a566722ba8\") " pod="openshift-insights/insights-operator-5844b856db-pm6n9" Sep 17 03:16:56.574712 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.574693 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f265faf-76c7-473c-826a-00a566722ba8-service-ca-bundle\") pod \"insights-operator-5844b856db-pm6n9\" (UID: \"1f265faf-76c7-473c-826a-00a566722ba8\") " pod="openshift-insights/insights-operator-5844b856db-pm6n9" Sep 17 03:16:56.575055 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.574717 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5ec7bca-6b96-4f8c-865c-c863898cce51-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jmmt9\" (UID: \"e5ec7bca-6b96-4f8c-865c-c863898cce51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jmmt9" Sep 17 03:16:56.575055 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.574762 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnb9h\" (UniqueName: \"kubernetes.io/projected/1f265faf-76c7-473c-826a-00a566722ba8-kube-api-access-tnb9h\") pod \"insights-operator-5844b856db-pm6n9\" (UID: \"1f265faf-76c7-473c-826a-00a566722ba8\") " pod="openshift-insights/insights-operator-5844b856db-pm6n9" Sep 17 03:16:56.575055 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.574804 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4hlq\" (UniqueName: \"kubernetes.io/projected/6a49191e-8033-456b-8a50-12c79f3a1607-kube-api-access-k4hlq\") pod \"cluster-monitoring-operator-6cd954b897-qt688\" (UID: \"6a49191e-8033-456b-8a50-12c79f3a1607\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qt688" Sep 17 03:16:56.575055 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.574997 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1f265faf-76c7-473c-826a-00a566722ba8-snapshots\") pod \"insights-operator-5844b856db-pm6n9\" (UID: \"1f265faf-76c7-473c-826a-00a566722ba8\") " pod="openshift-insights/insights-operator-5844b856db-pm6n9" Sep 17 03:16:56.575055 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:16:56.575045 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 03:16:56.575307 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.575121 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5ec7bca-6b96-4f8c-865c-c863898cce51-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jmmt9\" (UID: \"e5ec7bca-6b96-4f8c-865c-c863898cce51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jmmt9" Sep 17 03:16:56.575307 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:16:56.575189 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 03:16:56.575406 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.575303 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6a49191e-8033-456b-8a50-12c79f3a1607-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-qt688\" (UID: \"6a49191e-8033-456b-8a50-12c79f3a1607\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qt688" Sep 17 03:16:56.575612 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.575593 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f265faf-76c7-473c-826a-00a566722ba8-service-ca-bundle\") pod \"insights-operator-5844b856db-pm6n9\" (UID: \"1f265faf-76c7-473c-826a-00a566722ba8\") " pod="openshift-insights/insights-operator-5844b856db-pm6n9" Sep 17 03:16:56.575691 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:16:56.575670 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a49191e-8033-456b-8a50-12c79f3a1607-cluster-monitoring-operator-tls podName:6a49191e-8033-456b-8a50-12c79f3a1607 nodeName:}" failed. No retries permitted until 2026-09-17 03:16:57.075645559 +0000 UTC m=+257.609156252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a49191e-8033-456b-8a50-12c79f3a1607-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-qt688" (UID: "6a49191e-8033-456b-8a50-12c79f3a1607") : secret "cluster-monitoring-operator-tls" not found Sep 17 03:16:56.575745 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:16:56.575699 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18dc1401-1017-4bbb-bd80-2b11b7b5ab99-samples-operator-tls podName:18dc1401-1017-4bbb-bd80-2b11b7b5ab99 nodeName:}" failed. No retries permitted until 2026-09-17 03:16:57.075688398 +0000 UTC m=+257.609199077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/18dc1401-1017-4bbb-bd80-2b11b7b5ab99-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-5n64p" (UID: "18dc1401-1017-4bbb-bd80-2b11b7b5ab99") : secret "samples-operator-tls" not found Sep 17 03:16:56.575849 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.575818 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f265faf-76c7-473c-826a-00a566722ba8-trusted-ca-bundle\") pod \"insights-operator-5844b856db-pm6n9\" (UID: \"1f265faf-76c7-473c-826a-00a566722ba8\") " pod="openshift-insights/insights-operator-5844b856db-pm6n9" Sep 17 03:16:56.577293 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.577274 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1f265faf-76c7-473c-826a-00a566722ba8-serving-cert\") pod \"insights-operator-5844b856db-pm6n9\" (UID: \"1f265faf-76c7-473c-826a-00a566722ba8\") " pod="openshift-insights/insights-operator-5844b856db-pm6n9" Sep 17 03:16:56.577369 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.577277 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5ec7bca-6b96-4f8c-865c-c863898cce51-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jmmt9\" (UID: \"e5ec7bca-6b96-4f8c-865c-c863898cce51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jmmt9" Sep 17 03:16:56.584446 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.584357 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64ng4\" (UniqueName: \"kubernetes.io/projected/95631d45-87be-4c97-ae51-944054d67784-kube-api-access-64ng4\") pod \"volume-data-source-validator-86695b7cc7-w4xbj\" (UID: \"95631d45-87be-4c97-ae51-944054d67784\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-w4xbj" Sep 17 03:16:56.584646 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.584613 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz9j2\" (UniqueName: \"kubernetes.io/projected/e5ec7bca-6b96-4f8c-865c-c863898cce51-kube-api-access-bz9j2\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jmmt9\" (UID: \"e5ec7bca-6b96-4f8c-865c-c863898cce51\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jmmt9" Sep 17 03:16:56.584728 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.584707 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4hlq\" (UniqueName: \"kubernetes.io/projected/6a49191e-8033-456b-8a50-12c79f3a1607-kube-api-access-k4hlq\") pod \"cluster-monitoring-operator-6cd954b897-qt688\" (UID: \"6a49191e-8033-456b-8a50-12c79f3a1607\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qt688" Sep 17 03:16:56.584816 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.584802 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98lhg\" (UniqueName: \"kubernetes.io/projected/18dc1401-1017-4bbb-bd80-2b11b7b5ab99-kube-api-access-98lhg\") pod \"cluster-samples-operator-86499c89c4-5n64p\" (UID: \"18dc1401-1017-4bbb-bd80-2b11b7b5ab99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5n64p" Sep 17 03:16:56.584919 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.584905 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnb9h\" (UniqueName: \"kubernetes.io/projected/1f265faf-76c7-473c-826a-00a566722ba8-kube-api-access-tnb9h\") pod \"insights-operator-5844b856db-pm6n9\" (UID: \"1f265faf-76c7-473c-826a-00a566722ba8\") " pod="openshift-insights/insights-operator-5844b856db-pm6n9" Sep 17 03:16:56.641721 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.641696 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-pm6n9" Sep 17 03:16:56.649208 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.649187 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-w4xbj" Sep 17 03:16:56.668252 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.668224 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jmmt9" Sep 17 03:16:56.913263 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.913184 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-pm6n9"] Sep 17 03:16:56.917106 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:16:56.917081 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f265faf_76c7_473c_826a_00a566722ba8.slice/crio-d949da13a3e11c346821f32c7a37d159ec1e8fec09d7b8cf5c1cf08ad14ea52a WatchSource:0}: Error finding container d949da13a3e11c346821f32c7a37d159ec1e8fec09d7b8cf5c1cf08ad14ea52a: Status 404 returned error can't find the container with id d949da13a3e11c346821f32c7a37d159ec1e8fec09d7b8cf5c1cf08ad14ea52a Sep 17 03:16:56.933672 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.933652 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-w4xbj"] Sep 17 03:16:56.937482 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:16:56.937460 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95631d45_87be_4c97_ae51_944054d67784.slice/crio-a85391eca74b72d169dfc2527c3fc2a4f59fb6748c55f5f36c8f8abb872ce6ff WatchSource:0}: Error finding container a85391eca74b72d169dfc2527c3fc2a4f59fb6748c55f5f36c8f8abb872ce6ff: Status 404 returned error can't find the container with id a85391eca74b72d169dfc2527c3fc2a4f59fb6748c55f5f36c8f8abb872ce6ff Sep 17 03:16:56.956474 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:56.956452 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jmmt9"] Sep 17 03:16:56.958632 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:16:56.958613 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5ec7bca_6b96_4f8c_865c_c863898cce51.slice/crio-bc11664ac0886281d6a10254d2333ffac1e1cb3eb5cc4080610dd6f84d6a2145 WatchSource:0}: Error finding container bc11664ac0886281d6a10254d2333ffac1e1cb3eb5cc4080610dd6f84d6a2145: Status 404 returned error can't find the container with id bc11664ac0886281d6a10254d2333ffac1e1cb3eb5cc4080610dd6f84d6a2145 Sep 17 03:16:57.078145 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:57.078078 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/18dc1401-1017-4bbb-bd80-2b11b7b5ab99-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-5n64p\" (UID: \"18dc1401-1017-4bbb-bd80-2b11b7b5ab99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5n64p" Sep 17 03:16:57.078314 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:16:57.078250 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 03:16:57.078314 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:16:57.078307 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 03:16:57.078405 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:57.078253 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a49191e-8033-456b-8a50-12c79f3a1607-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qt688\" (UID: \"6a49191e-8033-456b-8a50-12c79f3a1607\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qt688" Sep 17 03:16:57.078405 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:16:57.078319 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18dc1401-1017-4bbb-bd80-2b11b7b5ab99-samples-operator-tls podName:18dc1401-1017-4bbb-bd80-2b11b7b5ab99 nodeName:}" failed. No retries permitted until 2026-09-17 03:16:58.078297146 +0000 UTC m=+258.611807832 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/18dc1401-1017-4bbb-bd80-2b11b7b5ab99-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-5n64p" (UID: "18dc1401-1017-4bbb-bd80-2b11b7b5ab99") : secret "samples-operator-tls" not found Sep 17 03:16:57.078405 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:16:57.078367 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a49191e-8033-456b-8a50-12c79f3a1607-cluster-monitoring-operator-tls podName:6a49191e-8033-456b-8a50-12c79f3a1607 nodeName:}" failed. No retries permitted until 2026-09-17 03:16:58.078337293 +0000 UTC m=+258.611847974 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a49191e-8033-456b-8a50-12c79f3a1607-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-qt688" (UID: "6a49191e-8033-456b-8a50-12c79f3a1607") : secret "cluster-monitoring-operator-tls" not found Sep 17 03:16:57.598473 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:57.598387 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jmmt9" event={"ID":"e5ec7bca-6b96-4f8c-865c-c863898cce51","Type":"ContainerStarted","Data":"bc11664ac0886281d6a10254d2333ffac1e1cb3eb5cc4080610dd6f84d6a2145"} Sep 17 03:16:57.599856 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:57.599818 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-w4xbj" event={"ID":"95631d45-87be-4c97-ae51-944054d67784","Type":"ContainerStarted","Data":"a85391eca74b72d169dfc2527c3fc2a4f59fb6748c55f5f36c8f8abb872ce6ff"} Sep 17 03:16:57.601159 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:57.601129 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-pm6n9" event={"ID":"1f265faf-76c7-473c-826a-00a566722ba8","Type":"ContainerStarted","Data":"d949da13a3e11c346821f32c7a37d159ec1e8fec09d7b8cf5c1cf08ad14ea52a"} Sep 17 03:16:58.088357 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:58.088319 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a49191e-8033-456b-8a50-12c79f3a1607-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qt688\" (UID: \"6a49191e-8033-456b-8a50-12c79f3a1607\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qt688" Sep 17 03:16:58.088576 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:58.088371 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/18dc1401-1017-4bbb-bd80-2b11b7b5ab99-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-5n64p\" (UID: \"18dc1401-1017-4bbb-bd80-2b11b7b5ab99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5n64p" Sep 17 03:16:58.088576 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:16:58.088515 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 03:16:58.088709 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:16:58.088583 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18dc1401-1017-4bbb-bd80-2b11b7b5ab99-samples-operator-tls podName:18dc1401-1017-4bbb-bd80-2b11b7b5ab99 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:00.088568278 +0000 UTC m=+260.622078962 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/18dc1401-1017-4bbb-bd80-2b11b7b5ab99-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-5n64p" (UID: "18dc1401-1017-4bbb-bd80-2b11b7b5ab99") : secret "samples-operator-tls" not found Sep 17 03:16:58.088709 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:16:58.088515 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 03:16:58.088709 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:16:58.088653 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a49191e-8033-456b-8a50-12c79f3a1607-cluster-monitoring-operator-tls podName:6a49191e-8033-456b-8a50-12c79f3a1607 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:00.088638392 +0000 UTC m=+260.622149083 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a49191e-8033-456b-8a50-12c79f3a1607-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-qt688" (UID: "6a49191e-8033-456b-8a50-12c79f3a1607") : secret "cluster-monitoring-operator-tls" not found Sep 17 03:16:59.608905 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:59.608798 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-w4xbj" event={"ID":"95631d45-87be-4c97-ae51-944054d67784","Type":"ContainerStarted","Data":"1b69b04fb4528cbddc2abcba54785a12e030d9236964c266d5c94af84420e19d"} Sep 17 03:16:59.610475 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:59.610443 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-pm6n9" event={"ID":"1f265faf-76c7-473c-826a-00a566722ba8","Type":"ContainerStarted","Data":"e66769bbfb3f1db316019e18f024c5bed5d7205a530e1bec6e47cc5b06ee74e9"} Sep 17 03:16:59.611968 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:59.611947 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jmmt9" event={"ID":"e5ec7bca-6b96-4f8c-865c-c863898cce51","Type":"ContainerStarted","Data":"7591d1e94197b482aae5c8c5868bc7e79cf7dbf0332931b817adb4316c074527"} Sep 17 03:16:59.625031 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:59.624994 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-w4xbj" podStartSLOduration=1.335324887 podStartE2EDuration="3.624980494s" totalImagesPullingTime="2.289655607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:16:59.624410305 +0000 UTC m=+260.157921006" watchObservedRunningTime="2026-09-17 03:16:59.624980494 +0000 UTC m=+260.158491192" Sep 17 03:16:59.640468 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:59.640403 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jmmt9" podStartSLOduration=1.367039407 podStartE2EDuration="3.640386161s" totalImagesPullingTime="2.273346754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:16:59.639308938 +0000 UTC m=+260.172819640" watchObservedRunningTime="2026-09-17 03:16:59.640386161 +0000 UTC m=+260.173896864" Sep 17 03:16:59.656820 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:16:59.656783 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-pm6n9" podStartSLOduration=1.3409826040000001 podStartE2EDuration="3.656770191s" totalImagesPullingTime="2.315787587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:16:59.656709342 +0000 UTC m=+260.190220039" watchObservedRunningTime="2026-09-17 03:16:59.656770191 +0000 UTC m=+260.190280892" Sep 17 03:17:00.104698 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:00.104659 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a49191e-8033-456b-8a50-12c79f3a1607-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qt688\" (UID: \"6a49191e-8033-456b-8a50-12c79f3a1607\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qt688" Sep 17 03:17:00.104698 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:00.104703 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/18dc1401-1017-4bbb-bd80-2b11b7b5ab99-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-5n64p\" (UID: \"18dc1401-1017-4bbb-bd80-2b11b7b5ab99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5n64p" Sep 17 03:17:00.104972 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:00.104814 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 03:17:00.104972 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:00.104816 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 03:17:00.104972 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:00.104891 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a49191e-8033-456b-8a50-12c79f3a1607-cluster-monitoring-operator-tls podName:6a49191e-8033-456b-8a50-12c79f3a1607 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:04.104870759 +0000 UTC m=+264.638381440 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a49191e-8033-456b-8a50-12c79f3a1607-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-qt688" (UID: "6a49191e-8033-456b-8a50-12c79f3a1607") : secret "cluster-monitoring-operator-tls" not found Sep 17 03:17:00.104972 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:00.104911 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18dc1401-1017-4bbb-bd80-2b11b7b5ab99-samples-operator-tls podName:18dc1401-1017-4bbb-bd80-2b11b7b5ab99 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:04.104902032 +0000 UTC m=+264.638412716 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/18dc1401-1017-4bbb-bd80-2b11b7b5ab99-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-5n64p" (UID: "18dc1401-1017-4bbb-bd80-2b11b7b5ab99") : secret "samples-operator-tls" not found Sep 17 03:17:00.617622 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:00.617593 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-hx5b6"] Sep 17 03:17:00.619758 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:00.619735 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hx5b6" Sep 17 03:17:00.622550 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:00.622526 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-9sdbj\"" Sep 17 03:17:00.622648 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:00.622527 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 17 03:17:00.623738 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:00.623726 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 17 03:17:00.630077 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:00.630055 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-hx5b6"] Sep 17 03:17:00.710963 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:00.710914 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94vlz\" (UniqueName: \"kubernetes.io/projected/60572324-d861-4d96-91e5-2168038ab007-kube-api-access-94vlz\") pod \"migrator-8b4d697c5-hx5b6\" (UID: \"60572324-d861-4d96-91e5-2168038ab007\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hx5b6" Sep 17 03:17:00.812200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:00.812163 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94vlz\" (UniqueName: \"kubernetes.io/projected/60572324-d861-4d96-91e5-2168038ab007-kube-api-access-94vlz\") pod \"migrator-8b4d697c5-hx5b6\" (UID: \"60572324-d861-4d96-91e5-2168038ab007\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hx5b6" Sep 17 03:17:00.820462 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:00.820411 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94vlz\" (UniqueName: \"kubernetes.io/projected/60572324-d861-4d96-91e5-2168038ab007-kube-api-access-94vlz\") pod \"migrator-8b4d697c5-hx5b6\" (UID: \"60572324-d861-4d96-91e5-2168038ab007\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hx5b6" Sep 17 03:17:00.892754 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:00.892683 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-44fwj"] Sep 17 03:17:00.894765 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:00.894738 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:00.897409 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:00.897384 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 03:17:00.897587 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:00.897472 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 03:17:00.897587 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:00.897482 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v629g\"" Sep 17 03:17:00.908000 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:00.907975 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-44fwj"] Sep 17 03:17:00.928197 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:00.928124 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hx5b6" Sep 17 03:17:01.014355 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:01.014325 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/16e98aad-d258-4cbb-af74-d1465d0daebc-data-volume\") pod \"insights-runtime-extractor-44fwj\" (UID: \"16e98aad-d258-4cbb-af74-d1465d0daebc\") " pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:01.014535 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:01.014359 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-594zx\" (UniqueName: \"kubernetes.io/projected/16e98aad-d258-4cbb-af74-d1465d0daebc-kube-api-access-594zx\") pod \"insights-runtime-extractor-44fwj\" (UID: \"16e98aad-d258-4cbb-af74-d1465d0daebc\") " pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:01.014535 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:01.014460 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/16e98aad-d258-4cbb-af74-d1465d0daebc-crio-socket\") pod \"insights-runtime-extractor-44fwj\" (UID: \"16e98aad-d258-4cbb-af74-d1465d0daebc\") " pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:01.014535 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:01.014501 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16e98aad-d258-4cbb-af74-d1465d0daebc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44fwj\" (UID: \"16e98aad-d258-4cbb-af74-d1465d0daebc\") " pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:01.014660 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:01.014558 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16e98aad-d258-4cbb-af74-d1465d0daebc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44fwj\" (UID: \"16e98aad-d258-4cbb-af74-d1465d0daebc\") " pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:01.115727 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:01.115687 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/16e98aad-d258-4cbb-af74-d1465d0daebc-data-volume\") pod \"insights-runtime-extractor-44fwj\" (UID: \"16e98aad-d258-4cbb-af74-d1465d0daebc\") " pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:01.115727 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:01.115728 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-594zx\" (UniqueName: \"kubernetes.io/projected/16e98aad-d258-4cbb-af74-d1465d0daebc-kube-api-access-594zx\") pod \"insights-runtime-extractor-44fwj\" (UID: \"16e98aad-d258-4cbb-af74-d1465d0daebc\") " pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:01.115961 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:01.115773 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/16e98aad-d258-4cbb-af74-d1465d0daebc-crio-socket\") pod \"insights-runtime-extractor-44fwj\" (UID: \"16e98aad-d258-4cbb-af74-d1465d0daebc\") " pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:01.115961 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:01.115797 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16e98aad-d258-4cbb-af74-d1465d0daebc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44fwj\" (UID: \"16e98aad-d258-4cbb-af74-d1465d0daebc\") " pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:01.115961 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:01.115823 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16e98aad-d258-4cbb-af74-d1465d0daebc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44fwj\" (UID: \"16e98aad-d258-4cbb-af74-d1465d0daebc\") " pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:01.115961 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:01.115894 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/16e98aad-d258-4cbb-af74-d1465d0daebc-crio-socket\") pod \"insights-runtime-extractor-44fwj\" (UID: \"16e98aad-d258-4cbb-af74-d1465d0daebc\") " pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:01.115961 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:01.115920 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 03:17:01.115961 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:01.115946 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:17:01.116194 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:01.116009 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16e98aad-d258-4cbb-af74-d1465d0daebc-kube-rbac-proxy-cm podName:16e98aad-d258-4cbb-af74-d1465d0daebc nodeName:}" failed. No retries permitted until 2026-09-17 03:17:01.615989134 +0000 UTC m=+262.149499819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/16e98aad-d258-4cbb-af74-d1465d0daebc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-44fwj" (UID: "16e98aad-d258-4cbb-af74-d1465d0daebc") : configmap "kube-rbac-proxy" not found Sep 17 03:17:01.116194 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:01.116029 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16e98aad-d258-4cbb-af74-d1465d0daebc-insights-runtime-extractor-tls podName:16e98aad-d258-4cbb-af74-d1465d0daebc nodeName:}" failed. No retries permitted until 2026-09-17 03:17:01.616018911 +0000 UTC m=+262.149529597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/16e98aad-d258-4cbb-af74-d1465d0daebc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-44fwj" (UID: "16e98aad-d258-4cbb-af74-d1465d0daebc") : secret "insights-runtime-extractor-tls" not found Sep 17 03:17:01.116194 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:01.116027 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/16e98aad-d258-4cbb-af74-d1465d0daebc-data-volume\") pod \"insights-runtime-extractor-44fwj\" (UID: \"16e98aad-d258-4cbb-af74-d1465d0daebc\") " pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:01.127683 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:01.127662 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-594zx\" (UniqueName: \"kubernetes.io/projected/16e98aad-d258-4cbb-af74-d1465d0daebc-kube-api-access-594zx\") pod \"insights-runtime-extractor-44fwj\" (UID: \"16e98aad-d258-4cbb-af74-d1465d0daebc\") " pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:01.194079 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:01.194052 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-hx5b6"] Sep 17 03:17:01.197014 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:17:01.196987 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60572324_d861_4d96_91e5_2168038ab007.slice/crio-93e388670f4efce379e0db0e2fbbf4327a43935148767d303345a235b1c8acd0 WatchSource:0}: Error finding container 93e388670f4efce379e0db0e2fbbf4327a43935148767d303345a235b1c8acd0: Status 404 returned error can't find the container with id 93e388670f4efce379e0db0e2fbbf4327a43935148767d303345a235b1c8acd0 Sep 17 03:17:01.618373 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:01.618291 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16e98aad-d258-4cbb-af74-d1465d0daebc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44fwj\" (UID: \"16e98aad-d258-4cbb-af74-d1465d0daebc\") " pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:01.618373 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:01.618333 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16e98aad-d258-4cbb-af74-d1465d0daebc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44fwj\" (UID: \"16e98aad-d258-4cbb-af74-d1465d0daebc\") " pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:01.618832 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:01.618436 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 03:17:01.618832 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:01.618475 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:17:01.618832 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:01.618495 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16e98aad-d258-4cbb-af74-d1465d0daebc-kube-rbac-proxy-cm podName:16e98aad-d258-4cbb-af74-d1465d0daebc nodeName:}" failed. No retries permitted until 2026-09-17 03:17:02.618477396 +0000 UTC m=+263.151988094 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/16e98aad-d258-4cbb-af74-d1465d0daebc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-44fwj" (UID: "16e98aad-d258-4cbb-af74-d1465d0daebc") : configmap "kube-rbac-proxy" not found Sep 17 03:17:01.618832 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:01.618535 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16e98aad-d258-4cbb-af74-d1465d0daebc-insights-runtime-extractor-tls podName:16e98aad-d258-4cbb-af74-d1465d0daebc nodeName:}" failed. No retries permitted until 2026-09-17 03:17:02.618516606 +0000 UTC m=+263.152027291 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/16e98aad-d258-4cbb-af74-d1465d0daebc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-44fwj" (UID: "16e98aad-d258-4cbb-af74-d1465d0daebc") : secret "insights-runtime-extractor-tls" not found Sep 17 03:17:01.619001 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:01.618983 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hx5b6" event={"ID":"60572324-d861-4d96-91e5-2168038ab007","Type":"ContainerStarted","Data":"93e388670f4efce379e0db0e2fbbf4327a43935148767d303345a235b1c8acd0"} Sep 17 03:17:02.624307 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:02.624218 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hx5b6" event={"ID":"60572324-d861-4d96-91e5-2168038ab007","Type":"ContainerStarted","Data":"31d2e80c13301e910baa13f5eb886e323ae7a83bb368101389a1d20c9323d92b"} Sep 17 03:17:02.624307 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:02.624269 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hx5b6" event={"ID":"60572324-d861-4d96-91e5-2168038ab007","Type":"ContainerStarted","Data":"941a1821cdf9defa4704121e6ebcd903fe643817e7c102c96683710d08ca2459"} Sep 17 03:17:02.627783 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:02.627765 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16e98aad-d258-4cbb-af74-d1465d0daebc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44fwj\" (UID: \"16e98aad-d258-4cbb-af74-d1465d0daebc\") " pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:02.627839 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:02.627797 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16e98aad-d258-4cbb-af74-d1465d0daebc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44fwj\" (UID: \"16e98aad-d258-4cbb-af74-d1465d0daebc\") " pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:02.627931 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:02.627916 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:17:02.627964 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:02.627949 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 03:17:02.627994 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:02.627976 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16e98aad-d258-4cbb-af74-d1465d0daebc-insights-runtime-extractor-tls podName:16e98aad-d258-4cbb-af74-d1465d0daebc nodeName:}" failed. No retries permitted until 2026-09-17 03:17:04.627959883 +0000 UTC m=+265.161470568 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/16e98aad-d258-4cbb-af74-d1465d0daebc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-44fwj" (UID: "16e98aad-d258-4cbb-af74-d1465d0daebc") : secret "insights-runtime-extractor-tls" not found Sep 17 03:17:02.628033 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:02.627997 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16e98aad-d258-4cbb-af74-d1465d0daebc-kube-rbac-proxy-cm podName:16e98aad-d258-4cbb-af74-d1465d0daebc nodeName:}" failed. No retries permitted until 2026-09-17 03:17:04.627983239 +0000 UTC m=+265.161493936 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/16e98aad-d258-4cbb-af74-d1465d0daebc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-44fwj" (UID: "16e98aad-d258-4cbb-af74-d1465d0daebc") : configmap "kube-rbac-proxy" not found Sep 17 03:17:02.641180 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:02.641136 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hx5b6" podStartSLOduration=1.521430176 podStartE2EDuration="2.641121597s" totalImagesPullingTime="1.119691421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:02.640457773 +0000 UTC m=+263.173968477" watchObservedRunningTime="2026-09-17 03:17:02.641121597 +0000 UTC m=+263.174632298" Sep 17 03:17:03.470721 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:03.470694 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-246d2_72dfc96b-596c-4f3f-93f7-7a323067dae4/dns-node-resolver/0.log" Sep 17 03:17:04.140254 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:04.140207 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a49191e-8033-456b-8a50-12c79f3a1607-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qt688\" (UID: \"6a49191e-8033-456b-8a50-12c79f3a1607\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qt688" Sep 17 03:17:04.140254 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:04.140254 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/18dc1401-1017-4bbb-bd80-2b11b7b5ab99-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-5n64p\" (UID: \"18dc1401-1017-4bbb-bd80-2b11b7b5ab99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5n64p" Sep 17 03:17:04.140689 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:04.140353 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 03:17:04.140689 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:04.140354 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 03:17:04.140689 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:04.140409 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a49191e-8033-456b-8a50-12c79f3a1607-cluster-monitoring-operator-tls podName:6a49191e-8033-456b-8a50-12c79f3a1607 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:12.140394226 +0000 UTC m=+272.673904929 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a49191e-8033-456b-8a50-12c79f3a1607-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-qt688" (UID: "6a49191e-8033-456b-8a50-12c79f3a1607") : secret "cluster-monitoring-operator-tls" not found Sep 17 03:17:04.140689 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:04.140443 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18dc1401-1017-4bbb-bd80-2b11b7b5ab99-samples-operator-tls podName:18dc1401-1017-4bbb-bd80-2b11b7b5ab99 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:12.140416717 +0000 UTC m=+272.673927396 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/18dc1401-1017-4bbb-bd80-2b11b7b5ab99-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-5n64p" (UID: "18dc1401-1017-4bbb-bd80-2b11b7b5ab99") : secret "samples-operator-tls" not found Sep 17 03:17:04.470226 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:04.470200 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2dr88_ade8d91a-ea36-43e4-8754-afea35aaaeed/node-ca/0.log" Sep 17 03:17:04.644785 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:04.644750 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16e98aad-d258-4cbb-af74-d1465d0daebc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44fwj\" (UID: \"16e98aad-d258-4cbb-af74-d1465d0daebc\") " pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:04.644968 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:04.644791 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16e98aad-d258-4cbb-af74-d1465d0daebc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44fwj\" (UID: \"16e98aad-d258-4cbb-af74-d1465d0daebc\") " pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:04.644968 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:04.644872 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 03:17:04.644968 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:04.644891 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:17:04.644968 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:04.644935 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16e98aad-d258-4cbb-af74-d1465d0daebc-kube-rbac-proxy-cm podName:16e98aad-d258-4cbb-af74-d1465d0daebc nodeName:}" failed. No retries permitted until 2026-09-17 03:17:08.644916965 +0000 UTC m=+269.178427651 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/16e98aad-d258-4cbb-af74-d1465d0daebc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-44fwj" (UID: "16e98aad-d258-4cbb-af74-d1465d0daebc") : configmap "kube-rbac-proxy" not found Sep 17 03:17:04.644968 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:04.644951 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16e98aad-d258-4cbb-af74-d1465d0daebc-insights-runtime-extractor-tls podName:16e98aad-d258-4cbb-af74-d1465d0daebc nodeName:}" failed. No retries permitted until 2026-09-17 03:17:08.644943147 +0000 UTC m=+269.178453832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/16e98aad-d258-4cbb-af74-d1465d0daebc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-44fwj" (UID: "16e98aad-d258-4cbb-af74-d1465d0daebc") : secret "insights-runtime-extractor-tls" not found Sep 17 03:17:05.269736 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:05.269709 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2c74k_27fee724-3145-4db2-9b4e-083466ffab60/serve-healthcheck-canary/0.log" Sep 17 03:17:05.870545 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:05.870513 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-hx5b6_60572324-d861-4d96-91e5-2168038ab007/migrator/0.log" Sep 17 03:17:06.074971 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:06.074941 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-hx5b6_60572324-d861-4d96-91e5-2168038ab007/graceful-termination/0.log" Sep 17 03:17:06.271059 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:06.271039 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-jmmt9_e5ec7bca-6b96-4f8c-865c-c863898cce51/kube-storage-version-migrator-operator/0.log" Sep 17 03:17:08.675548 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:08.675513 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16e98aad-d258-4cbb-af74-d1465d0daebc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44fwj\" (UID: \"16e98aad-d258-4cbb-af74-d1465d0daebc\") " pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:08.675548 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:08.675552 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16e98aad-d258-4cbb-af74-d1465d0daebc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44fwj\" (UID: \"16e98aad-d258-4cbb-af74-d1465d0daebc\") " pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:08.675962 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:08.675659 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:17:08.675962 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:08.675681 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 03:17:08.675962 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:08.675720 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16e98aad-d258-4cbb-af74-d1465d0daebc-insights-runtime-extractor-tls podName:16e98aad-d258-4cbb-af74-d1465d0daebc nodeName:}" failed. No retries permitted until 2026-09-17 03:17:16.675704469 +0000 UTC m=+277.209215147 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/16e98aad-d258-4cbb-af74-d1465d0daebc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-44fwj" (UID: "16e98aad-d258-4cbb-af74-d1465d0daebc") : secret "insights-runtime-extractor-tls" not found Sep 17 03:17:08.675962 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:08.675733 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16e98aad-d258-4cbb-af74-d1465d0daebc-kube-rbac-proxy-cm podName:16e98aad-d258-4cbb-af74-d1465d0daebc nodeName:}" failed. No retries permitted until 2026-09-17 03:17:16.675727323 +0000 UTC m=+277.209238002 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/16e98aad-d258-4cbb-af74-d1465d0daebc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-44fwj" (UID: "16e98aad-d258-4cbb-af74-d1465d0daebc") : configmap "kube-rbac-proxy" not found Sep 17 03:17:12.202609 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:12.202574 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a49191e-8033-456b-8a50-12c79f3a1607-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qt688\" (UID: \"6a49191e-8033-456b-8a50-12c79f3a1607\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qt688" Sep 17 03:17:12.202609 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:12.202614 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/18dc1401-1017-4bbb-bd80-2b11b7b5ab99-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-5n64p\" (UID: \"18dc1401-1017-4bbb-bd80-2b11b7b5ab99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5n64p" Sep 17 03:17:12.205151 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:12.205129 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/18dc1401-1017-4bbb-bd80-2b11b7b5ab99-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-5n64p\" (UID: \"18dc1401-1017-4bbb-bd80-2b11b7b5ab99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5n64p" Sep 17 03:17:12.205263 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:12.205129 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a49191e-8033-456b-8a50-12c79f3a1607-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qt688\" (UID: \"6a49191e-8033-456b-8a50-12c79f3a1607\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qt688" Sep 17 03:17:12.256763 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:12.256735 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qt688" Sep 17 03:17:12.263546 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:12.263528 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5n64p" Sep 17 03:17:12.530988 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:12.530906 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-qt688"] Sep 17 03:17:12.534107 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:17:12.534080 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a49191e_8033_456b_8a50_12c79f3a1607.slice/crio-3b0ec44c9670832c33c77bdca2454380b21574a3ebe4d32a138ab5d4b93c7c22 WatchSource:0}: Error finding container 3b0ec44c9670832c33c77bdca2454380b21574a3ebe4d32a138ab5d4b93c7c22: Status 404 returned error can't find the container with id 3b0ec44c9670832c33c77bdca2454380b21574a3ebe4d32a138ab5d4b93c7c22 Sep 17 03:17:12.538307 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:12.538281 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5n64p"] Sep 17 03:17:12.657460 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:12.657409 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5n64p" event={"ID":"18dc1401-1017-4bbb-bd80-2b11b7b5ab99","Type":"ContainerStarted","Data":"b1203f6deddb087f8992a5090d83574edf94d5ea6af16c1ed55a60fcc4809a12"} Sep 17 03:17:12.658502 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:12.658478 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qt688" event={"ID":"6a49191e-8033-456b-8a50-12c79f3a1607","Type":"ContainerStarted","Data":"3b0ec44c9670832c33c77bdca2454380b21574a3ebe4d32a138ab5d4b93c7c22"} Sep 17 03:17:15.669480 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:15.669414 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5n64p" event={"ID":"18dc1401-1017-4bbb-bd80-2b11b7b5ab99","Type":"ContainerStarted","Data":"40be1e9cc25ee8148097ce29a3aa36648f2c155d7b6f7054a22b0b3ddf59f020"} Sep 17 03:17:15.669918 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:15.669502 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5n64p" event={"ID":"18dc1401-1017-4bbb-bd80-2b11b7b5ab99","Type":"ContainerStarted","Data":"e061ee565f1b00816c3feb672ab5d18ddee30c4bb58c2dcc20471343f55a4377"} Sep 17 03:17:15.670851 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:15.670833 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qt688" event={"ID":"6a49191e-8033-456b-8a50-12c79f3a1607","Type":"ContainerStarted","Data":"543ba4879fbda484dba8f633bee118fb1fa0e90a48e4fbbdfe5ddc0fb4f8aec2"} Sep 17 03:17:15.686195 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:15.686152 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5n64p" podStartSLOduration=17.528766384 podStartE2EDuration="19.686138566s" totalImagesPullingTime="2.157372182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:15.684868508 +0000 UTC m=+276.218379220" watchObservedRunningTime="2026-09-17 03:17:15.686138566 +0000 UTC m=+276.219649260" Sep 17 03:17:15.702746 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:15.702684 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qt688" podStartSLOduration=17.510812799 podStartE2EDuration="19.702668476s" totalImagesPullingTime="2.191855677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:15.701502693 +0000 UTC m=+276.235013399" watchObservedRunningTime="2026-09-17 03:17:15.702668476 +0000 UTC m=+276.236179177" Sep 17 03:17:16.742361 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:16.742307 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16e98aad-d258-4cbb-af74-d1465d0daebc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44fwj\" (UID: \"16e98aad-d258-4cbb-af74-d1465d0daebc\") " pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:16.742361 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:16.742370 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16e98aad-d258-4cbb-af74-d1465d0daebc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44fwj\" (UID: \"16e98aad-d258-4cbb-af74-d1465d0daebc\") " pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:16.743051 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:16.743031 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16e98aad-d258-4cbb-af74-d1465d0daebc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44fwj\" (UID: \"16e98aad-d258-4cbb-af74-d1465d0daebc\") " pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:16.744749 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:16.744732 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16e98aad-d258-4cbb-af74-d1465d0daebc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44fwj\" (UID: \"16e98aad-d258-4cbb-af74-d1465d0daebc\") " pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:16.803596 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:16.803571 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-44fwj" Sep 17 03:17:17.071263 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:17.071153 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-44fwj"] Sep 17 03:17:17.073563 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:17:17.073539 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16e98aad_d258_4cbb_af74_d1465d0daebc.slice/crio-bf1b093c6553ba2b606e1ade071ef2d14abc58a17ce8364c0fa82d0c3a0a36d3 WatchSource:0}: Error finding container bf1b093c6553ba2b606e1ade071ef2d14abc58a17ce8364c0fa82d0c3a0a36d3: Status 404 returned error can't find the container with id bf1b093c6553ba2b606e1ade071ef2d14abc58a17ce8364c0fa82d0c3a0a36d3 Sep 17 03:17:17.678375 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:17.678341 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44fwj" event={"ID":"16e98aad-d258-4cbb-af74-d1465d0daebc","Type":"ContainerStarted","Data":"6e4bb339c5f901f318af75cad01206d9f0922c1acbbae7d7f2edd452a0a2bd65"} Sep 17 03:17:17.678540 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:17.678394 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44fwj" event={"ID":"16e98aad-d258-4cbb-af74-d1465d0daebc","Type":"ContainerStarted","Data":"bf1b093c6553ba2b606e1ade071ef2d14abc58a17ce8364c0fa82d0c3a0a36d3"} Sep 17 03:17:18.683687 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:18.683652 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44fwj" event={"ID":"16e98aad-d258-4cbb-af74-d1465d0daebc","Type":"ContainerStarted","Data":"a1a8f120474f72c4584dbeee493310105dd1377ec430cd969cf041a2374955be"} Sep 17 03:17:20.366650 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:20.366595 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lczrd" podUID="f84f25fc-622c-4836-94b5-f48efb0d718a" Sep 17 03:17:20.366650 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:20.366595 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-767776f89d-rzc4t" podUID="7219af2d-7d54-49a4-9bbe-2356b96cec2d" Sep 17 03:17:20.691889 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:20.691857 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:17:20.691889 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:20.691862 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44fwj" event={"ID":"16e98aad-d258-4cbb-af74-d1465d0daebc","Type":"ContainerStarted","Data":"0cd5f306b1cdcac2620ab5663bb1665935ed0c3363125f0c91ab132aa8d4040e"} Sep 17 03:17:20.692111 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:20.692010 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lczrd" Sep 17 03:17:20.709623 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:20.709580 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-44fwj" podStartSLOduration=18.165282747 podStartE2EDuration="20.709566361s" totalImagesPullingTime="2.544283614s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:17:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:20.708762318 +0000 UTC m=+281.242273020" watchObservedRunningTime="2026-09-17 03:17:20.709566361 +0000 UTC m=+281.243077061" Sep 17 03:17:24.194207 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:24.194173 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:17:24.196705 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:24.196684 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls\") pod \"image-registry-767776f89d-rzc4t\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:17:24.295291 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:24.295253 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls\") pod \"dns-default-lczrd\" (UID: \"f84f25fc-622c-4836-94b5-f48efb0d718a\") " pod="openshift-dns/dns-default-lczrd" Sep 17 03:17:24.295753 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:24.295731 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xl2rt\"" Sep 17 03:17:24.297849 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:24.297829 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f84f25fc-622c-4836-94b5-f48efb0d718a-metrics-tls\") pod \"dns-default-lczrd\" (UID: \"f84f25fc-622c-4836-94b5-f48efb0d718a\") " pod="openshift-dns/dns-default-lczrd" Sep 17 03:17:24.304028 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:24.304009 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:17:24.582788 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:24.582713 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-767776f89d-rzc4t"] Sep 17 03:17:24.585986 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:17:24.585945 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7219af2d_7d54_49a4_9bbe_2356b96cec2d.slice/crio-afd56d79595742be5349e3c175109d9f035ede5ea669470e5bd28cf4c1b017ba WatchSource:0}: Error finding container afd56d79595742be5349e3c175109d9f035ede5ea669470e5bd28cf4c1b017ba: Status 404 returned error can't find the container with id afd56d79595742be5349e3c175109d9f035ede5ea669470e5bd28cf4c1b017ba Sep 17 03:17:24.595193 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:24.595172 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lg7wr\"" Sep 17 03:17:24.603513 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:24.603493 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lczrd" Sep 17 03:17:24.672108 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:24.672079 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-h9jxt"] Sep 17 03:17:24.675489 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:24.675466 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-h9jxt" Sep 17 03:17:24.678479 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:24.678458 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 17 03:17:24.678589 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:24.678458 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-72c2s\"" Sep 17 03:17:24.682739 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:24.682719 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-h9jxt"] Sep 17 03:17:24.705602 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:24.705553 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-767776f89d-rzc4t" event={"ID":"7219af2d-7d54-49a4-9bbe-2356b96cec2d","Type":"ContainerStarted","Data":"16429b40d097b9e189208dbbb8edc5962a66ce8c3c78129926a961e0ab943e4b"} Sep 17 03:17:24.705602 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:24.705597 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-767776f89d-rzc4t" event={"ID":"7219af2d-7d54-49a4-9bbe-2356b96cec2d","Type":"ContainerStarted","Data":"afd56d79595742be5349e3c175109d9f035ede5ea669470e5bd28cf4c1b017ba"} Sep 17 03:17:24.705783 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:24.705702 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:17:24.733779 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:24.733734 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-767776f89d-rzc4t" podStartSLOduration=284.733719312 podStartE2EDuration="4m44.733719312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:12:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:24.732702151 +0000 UTC m=+285.266212857" watchObservedRunningTime="2026-09-17 03:17:24.733719312 +0000 UTC m=+285.267230012" Sep 17 03:17:24.799771 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:24.799728 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e42d69b7-e153-459d-846a-36e750873c01-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-h9jxt\" (UID: \"e42d69b7-e153-459d-846a-36e750873c01\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-h9jxt" Sep 17 03:17:24.878341 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:24.878264 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lczrd"] Sep 17 03:17:24.881815 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:17:24.881790 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf84f25fc_622c_4836_94b5_f48efb0d718a.slice/crio-a386954cb57b441b168bbe71cc00db468ea29bf0bcabd1120b4f957f5d08208b WatchSource:0}: Error finding container a386954cb57b441b168bbe71cc00db468ea29bf0bcabd1120b4f957f5d08208b: Status 404 returned error can't find the container with id a386954cb57b441b168bbe71cc00db468ea29bf0bcabd1120b4f957f5d08208b Sep 17 03:17:24.900933 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:24.900901 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e42d69b7-e153-459d-846a-36e750873c01-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-h9jxt\" (UID: \"e42d69b7-e153-459d-846a-36e750873c01\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-h9jxt" Sep 17 03:17:24.903361 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:24.903341 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e42d69b7-e153-459d-846a-36e750873c01-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-h9jxt\" (UID: \"e42d69b7-e153-459d-846a-36e750873c01\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-h9jxt" Sep 17 03:17:24.985588 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:24.985559 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-h9jxt" Sep 17 03:17:25.257241 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:25.257213 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-h9jxt"] Sep 17 03:17:25.259850 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:17:25.259824 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode42d69b7_e153_459d_846a_36e750873c01.slice/crio-f7989fd1d0cfbedcbccc8fede25dfd1dd8163fdcd25673afbe5ec166c9b7b469 WatchSource:0}: Error finding container f7989fd1d0cfbedcbccc8fede25dfd1dd8163fdcd25673afbe5ec166c9b7b469: Status 404 returned error can't find the container with id f7989fd1d0cfbedcbccc8fede25dfd1dd8163fdcd25673afbe5ec166c9b7b469 Sep 17 03:17:25.710740 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:25.710708 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-h9jxt" event={"ID":"e42d69b7-e153-459d-846a-36e750873c01","Type":"ContainerStarted","Data":"f7989fd1d0cfbedcbccc8fede25dfd1dd8163fdcd25673afbe5ec166c9b7b469"} Sep 17 03:17:25.712055 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:25.712022 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lczrd" event={"ID":"f84f25fc-622c-4836-94b5-f48efb0d718a","Type":"ContainerStarted","Data":"a386954cb57b441b168bbe71cc00db468ea29bf0bcabd1120b4f957f5d08208b"} Sep 17 03:17:27.721543 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:27.721503 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-h9jxt" event={"ID":"e42d69b7-e153-459d-846a-36e750873c01","Type":"ContainerStarted","Data":"d1b575fcddbb8f3684a3e9884824fa1889f9fe9492aa4e0240b75e235a2beafa"} Sep 17 03:17:27.722001 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:27.721661 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-h9jxt" Sep 17 03:17:27.723360 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:27.723331 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lczrd" event={"ID":"f84f25fc-622c-4836-94b5-f48efb0d718a","Type":"ContainerStarted","Data":"eabfa89512f38958c8f2adfe7a82d7aa8e9a41b250c27911c4ba269cbf5e61f6"} Sep 17 03:17:27.723493 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:27.723386 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lczrd" Sep 17 03:17:27.723493 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:27.723406 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lczrd" event={"ID":"f84f25fc-622c-4836-94b5-f48efb0d718a","Type":"ContainerStarted","Data":"1c9aa08ac48dfc5dda815971bd118173d98ce3525da6ee1cb39fda36ef03727f"} Sep 17 03:17:27.726609 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:27.726586 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-h9jxt" Sep 17 03:17:27.737288 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:27.737250 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-h9jxt" podStartSLOduration=1.973408 podStartE2EDuration="3.73723753s" totalImagesPullingTime="1.76382953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:27.736129667 +0000 UTC m=+288.269640370" watchObservedRunningTime="2026-09-17 03:17:27.73723753 +0000 UTC m=+288.270748228" Sep 17 03:17:27.771836 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:27.771790 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lczrd" podStartSLOduration=251.624972893 podStartE2EDuration="4m13.771775753s" totalImagesPullingTime="2.14680286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:13:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:27.771299003 +0000 UTC m=+288.304809704" watchObservedRunningTime="2026-09-17 03:17:27.771775753 +0000 UTC m=+288.305286454" Sep 17 03:17:28.288235 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:28.288199 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-6wtgw"] Sep 17 03:17:28.291539 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:28.291523 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-6wtgw" Sep 17 03:17:28.295487 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:28.295468 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 17 03:17:28.295598 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:28.295496 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 17 03:17:28.295598 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:28.295523 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 03:17:28.295598 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:28.295581 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-c7z6b\"" Sep 17 03:17:28.302251 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:28.302234 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-6wtgw"] Sep 17 03:17:28.328239 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:28.328216 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/057639b4-1a97-4fad-865a-728a69b70606-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-6wtgw\" (UID: \"057639b4-1a97-4fad-865a-728a69b70606\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-6wtgw" Sep 17 03:17:28.328366 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:28.328244 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/057639b4-1a97-4fad-865a-728a69b70606-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-6wtgw\" (UID: \"057639b4-1a97-4fad-865a-728a69b70606\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-6wtgw" Sep 17 03:17:28.328366 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:28.328278 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvpr7\" (UniqueName: \"kubernetes.io/projected/057639b4-1a97-4fad-865a-728a69b70606-kube-api-access-rvpr7\") pod \"prometheus-operator-68bcd7f987-6wtgw\" (UID: \"057639b4-1a97-4fad-865a-728a69b70606\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-6wtgw" Sep 17 03:17:28.328366 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:28.328331 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/057639b4-1a97-4fad-865a-728a69b70606-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-6wtgw\" (UID: \"057639b4-1a97-4fad-865a-728a69b70606\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-6wtgw" Sep 17 03:17:28.429496 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:28.429470 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/057639b4-1a97-4fad-865a-728a69b70606-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-6wtgw\" (UID: \"057639b4-1a97-4fad-865a-728a69b70606\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-6wtgw" Sep 17 03:17:28.429665 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:28.429524 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/057639b4-1a97-4fad-865a-728a69b70606-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-6wtgw\" (UID: \"057639b4-1a97-4fad-865a-728a69b70606\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-6wtgw" Sep 17 03:17:28.429665 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:28.429543 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/057639b4-1a97-4fad-865a-728a69b70606-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-6wtgw\" (UID: \"057639b4-1a97-4fad-865a-728a69b70606\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-6wtgw" Sep 17 03:17:28.429665 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:28.429571 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvpr7\" (UniqueName: \"kubernetes.io/projected/057639b4-1a97-4fad-865a-728a69b70606-kube-api-access-rvpr7\") pod \"prometheus-operator-68bcd7f987-6wtgw\" (UID: \"057639b4-1a97-4fad-865a-728a69b70606\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-6wtgw" Sep 17 03:17:28.429665 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:28.429629 2574 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 17 03:17:28.429881 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:28.429687 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/057639b4-1a97-4fad-865a-728a69b70606-prometheus-operator-tls podName:057639b4-1a97-4fad-865a-728a69b70606 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:28.929673553 +0000 UTC m=+289.463184233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/057639b4-1a97-4fad-865a-728a69b70606-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-6wtgw" (UID: "057639b4-1a97-4fad-865a-728a69b70606") : secret "prometheus-operator-tls" not found Sep 17 03:17:28.430199 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:28.430177 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/057639b4-1a97-4fad-865a-728a69b70606-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-6wtgw\" (UID: \"057639b4-1a97-4fad-865a-728a69b70606\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-6wtgw" Sep 17 03:17:28.432007 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:28.431991 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/057639b4-1a97-4fad-865a-728a69b70606-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-6wtgw\" (UID: \"057639b4-1a97-4fad-865a-728a69b70606\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-6wtgw" Sep 17 03:17:28.438537 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:28.438520 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvpr7\" (UniqueName: \"kubernetes.io/projected/057639b4-1a97-4fad-865a-728a69b70606-kube-api-access-rvpr7\") pod \"prometheus-operator-68bcd7f987-6wtgw\" (UID: \"057639b4-1a97-4fad-865a-728a69b70606\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-6wtgw" Sep 17 03:17:28.933414 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:28.933379 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/057639b4-1a97-4fad-865a-728a69b70606-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-6wtgw\" (UID: \"057639b4-1a97-4fad-865a-728a69b70606\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-6wtgw" Sep 17 03:17:28.935875 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:28.935850 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/057639b4-1a97-4fad-865a-728a69b70606-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-6wtgw\" (UID: \"057639b4-1a97-4fad-865a-728a69b70606\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-6wtgw" Sep 17 03:17:29.199938 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:29.199855 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-6wtgw" Sep 17 03:17:29.468393 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:29.468302 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-6wtgw"] Sep 17 03:17:29.472076 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:17:29.472052 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod057639b4_1a97_4fad_865a_728a69b70606.slice/crio-c3cdf25f77f3879f703f6d212d9af520a6cad5a3a0efcd8dc77a322dd4caf2fd WatchSource:0}: Error finding container c3cdf25f77f3879f703f6d212d9af520a6cad5a3a0efcd8dc77a322dd4caf2fd: Status 404 returned error can't find the container with id c3cdf25f77f3879f703f6d212d9af520a6cad5a3a0efcd8dc77a322dd4caf2fd Sep 17 03:17:29.732912 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:29.732824 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-6wtgw" event={"ID":"057639b4-1a97-4fad-865a-728a69b70606","Type":"ContainerStarted","Data":"c3cdf25f77f3879f703f6d212d9af520a6cad5a3a0efcd8dc77a322dd4caf2fd"} Sep 17 03:17:31.741774 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:31.741735 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-6wtgw" event={"ID":"057639b4-1a97-4fad-865a-728a69b70606","Type":"ContainerStarted","Data":"8517e1243a035eee42a6e1c415ceeebc748e811ae1856f71a7a15a43feb2bc36"} Sep 17 03:17:31.742213 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:31.741787 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-6wtgw" event={"ID":"057639b4-1a97-4fad-865a-728a69b70606","Type":"ContainerStarted","Data":"81f6670ee1ca438012fd29c7e68a11dae552d7cda259281d35cb01f9f6ef3787"} Sep 17 03:17:31.762532 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:31.762485 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-6wtgw" podStartSLOduration=2.096537291 podStartE2EDuration="3.762470959s" totalImagesPullingTime="1.665933668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:17:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:31.76220914 +0000 UTC m=+292.295719842" watchObservedRunningTime="2026-09-17 03:17:31.762470959 +0000 UTC m=+292.295981660" Sep 17 03:17:31.891848 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:31.891807 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bgwwg" podUID="eca0ae2b-bd17-447e-9784-04f94225f000" Sep 17 03:17:33.664520 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.664486 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tlvff"] Sep 17 03:17:33.715061 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.715022 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn"] Sep 17 03:17:33.715213 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.715174 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.717966 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.717942 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 03:17:33.718114 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.717976 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 03:17:33.718260 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.718242 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 03:17:33.718355 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.718310 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qmnn9\"" Sep 17 03:17:33.750174 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.750151 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn"] Sep 17 03:17:33.750278 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.750243 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn" Sep 17 03:17:33.753586 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.753554 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 17 03:17:33.753705 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.753564 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 17 03:17:33.753705 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.753607 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-fwt4h\"" Sep 17 03:17:33.753705 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.753656 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 17 03:17:33.767285 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.767256 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4bd85564-5557-4611-920f-3c976561c254-node-exporter-tls\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.767384 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.767290 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bd85564-5557-4611-920f-3c976561c254-metrics-client-ca\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.767384 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.767307 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4bd85564-5557-4611-920f-3c976561c254-node-exporter-wtmp\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.767471 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.767394 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4bd85564-5557-4611-920f-3c976561c254-node-exporter-accelerators-collector-config\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.767471 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.767461 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bd85564-5557-4611-920f-3c976561c254-sys\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.767531 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.767480 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4bd85564-5557-4611-920f-3c976561c254-root\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.767531 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.767493 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4bd85564-5557-4611-920f-3c976561c254-node-exporter-textfile\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.767531 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.767515 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnzcp\" (UniqueName: \"kubernetes.io/projected/4bd85564-5557-4611-920f-3c976561c254-kube-api-access-dnzcp\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.767619 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.767551 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bd85564-5557-4611-920f-3c976561c254-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.868780 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.868752 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4bd85564-5557-4611-920f-3c976561c254-node-exporter-accelerators-collector-config\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.868917 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.868786 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e1408bb-202b-42b1-af12-3f412454408c-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-b6mwn\" (UID: \"9e1408bb-202b-42b1-af12-3f412454408c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn" Sep 17 03:17:33.868917 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.868805 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e1408bb-202b-42b1-af12-3f412454408c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-b6mwn\" (UID: \"9e1408bb-202b-42b1-af12-3f412454408c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn" Sep 17 03:17:33.868989 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.868922 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bd85564-5557-4611-920f-3c976561c254-sys\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.868989 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.868959 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4bd85564-5557-4611-920f-3c976561c254-root\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.868989 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.868978 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4bd85564-5557-4611-920f-3c976561c254-node-exporter-textfile\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.869082 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.869005 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9e1408bb-202b-42b1-af12-3f412454408c-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-b6mwn\" (UID: \"9e1408bb-202b-42b1-af12-3f412454408c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn" Sep 17 03:17:33.869082 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.869010 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bd85564-5557-4611-920f-3c976561c254-sys\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.869082 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.869013 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4bd85564-5557-4611-920f-3c976561c254-root\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.869082 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.869029 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnzcp\" (UniqueName: \"kubernetes.io/projected/4bd85564-5557-4611-920f-3c976561c254-kube-api-access-dnzcp\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.869082 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.869055 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9e1408bb-202b-42b1-af12-3f412454408c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-b6mwn\" (UID: \"9e1408bb-202b-42b1-af12-3f412454408c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn" Sep 17 03:17:33.869082 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.869080 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk7wx\" (UniqueName: \"kubernetes.io/projected/9e1408bb-202b-42b1-af12-3f412454408c-kube-api-access-lk7wx\") pod \"kube-state-metrics-59fbdd77d-b6mwn\" (UID: \"9e1408bb-202b-42b1-af12-3f412454408c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn" Sep 17 03:17:33.869330 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.869125 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bd85564-5557-4611-920f-3c976561c254-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.869330 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.869156 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e1408bb-202b-42b1-af12-3f412454408c-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-b6mwn\" (UID: \"9e1408bb-202b-42b1-af12-3f412454408c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn" Sep 17 03:17:33.869330 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.869184 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4bd85564-5557-4611-920f-3c976561c254-node-exporter-tls\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.869330 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.869227 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bd85564-5557-4611-920f-3c976561c254-metrics-client-ca\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.869330 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.869257 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4bd85564-5557-4611-920f-3c976561c254-node-exporter-wtmp\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.869330 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:33.869272 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 17 03:17:33.869330 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.869303 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4bd85564-5557-4611-920f-3c976561c254-node-exporter-textfile\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.869330 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:17:33.869322 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd85564-5557-4611-920f-3c976561c254-node-exporter-tls podName:4bd85564-5557-4611-920f-3c976561c254 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:34.369306303 +0000 UTC m=+294.902816982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4bd85564-5557-4611-920f-3c976561c254-node-exporter-tls") pod "node-exporter-tlvff" (UID: "4bd85564-5557-4611-920f-3c976561c254") : secret "node-exporter-tls" not found Sep 17 03:17:33.869710 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.869413 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4bd85564-5557-4611-920f-3c976561c254-node-exporter-wtmp\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.869710 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.869498 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4bd85564-5557-4611-920f-3c976561c254-node-exporter-accelerators-collector-config\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.869796 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.869726 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bd85564-5557-4611-920f-3c976561c254-metrics-client-ca\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.871729 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.871706 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bd85564-5557-4611-920f-3c976561c254-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.879285 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.879254 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnzcp\" (UniqueName: \"kubernetes.io/projected/4bd85564-5557-4611-920f-3c976561c254-kube-api-access-dnzcp\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:33.970693 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.970660 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9e1408bb-202b-42b1-af12-3f412454408c-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-b6mwn\" (UID: \"9e1408bb-202b-42b1-af12-3f412454408c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn" Sep 17 03:17:33.970864 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.970704 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9e1408bb-202b-42b1-af12-3f412454408c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-b6mwn\" (UID: \"9e1408bb-202b-42b1-af12-3f412454408c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn" Sep 17 03:17:33.970864 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.970729 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk7wx\" (UniqueName: \"kubernetes.io/projected/9e1408bb-202b-42b1-af12-3f412454408c-kube-api-access-lk7wx\") pod \"kube-state-metrics-59fbdd77d-b6mwn\" (UID: \"9e1408bb-202b-42b1-af12-3f412454408c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn" Sep 17 03:17:33.970864 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.970783 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e1408bb-202b-42b1-af12-3f412454408c-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-b6mwn\" (UID: \"9e1408bb-202b-42b1-af12-3f412454408c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn" Sep 17 03:17:33.970864 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.970855 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e1408bb-202b-42b1-af12-3f412454408c-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-b6mwn\" (UID: \"9e1408bb-202b-42b1-af12-3f412454408c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn" Sep 17 03:17:33.971025 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.970884 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e1408bb-202b-42b1-af12-3f412454408c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-b6mwn\" (UID: \"9e1408bb-202b-42b1-af12-3f412454408c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn" Sep 17 03:17:33.971107 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.971088 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9e1408bb-202b-42b1-af12-3f412454408c-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-b6mwn\" (UID: \"9e1408bb-202b-42b1-af12-3f412454408c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn" Sep 17 03:17:33.971582 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.971510 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9e1408bb-202b-42b1-af12-3f412454408c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-b6mwn\" (UID: \"9e1408bb-202b-42b1-af12-3f412454408c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn" Sep 17 03:17:33.971582 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.971562 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e1408bb-202b-42b1-af12-3f412454408c-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-b6mwn\" (UID: \"9e1408bb-202b-42b1-af12-3f412454408c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn" Sep 17 03:17:33.973334 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.973312 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e1408bb-202b-42b1-af12-3f412454408c-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-b6mwn\" (UID: \"9e1408bb-202b-42b1-af12-3f412454408c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn" Sep 17 03:17:33.973416 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.973350 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e1408bb-202b-42b1-af12-3f412454408c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-b6mwn\" (UID: \"9e1408bb-202b-42b1-af12-3f412454408c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn" Sep 17 03:17:33.981467 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:33.981440 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk7wx\" (UniqueName: \"kubernetes.io/projected/9e1408bb-202b-42b1-af12-3f412454408c-kube-api-access-lk7wx\") pod \"kube-state-metrics-59fbdd77d-b6mwn\" (UID: \"9e1408bb-202b-42b1-af12-3f412454408c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn" Sep 17 03:17:34.062366 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.062336 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn" Sep 17 03:17:34.374706 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.374636 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4bd85564-5557-4611-920f-3c976561c254-node-exporter-tls\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:34.377013 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.376986 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4bd85564-5557-4611-920f-3c976561c254-node-exporter-tls\") pod \"node-exporter-tlvff\" (UID: \"4bd85564-5557-4611-920f-3c976561c254\") " pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:34.382050 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.381925 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn"] Sep 17 03:17:34.384619 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:17:34.384597 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e1408bb_202b_42b1_af12_3f412454408c.slice/crio-96f5ae82cc093a4147cfc36653dbff1c2785bc93e6fe34352f550b6a61697002 WatchSource:0}: Error finding container 96f5ae82cc093a4147cfc36653dbff1c2785bc93e6fe34352f550b6a61697002: Status 404 returned error can't find the container with id 96f5ae82cc093a4147cfc36653dbff1c2785bc93e6fe34352f550b6a61697002 Sep 17 03:17:34.624216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.624188 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tlvff" Sep 17 03:17:34.689051 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:17:34.689023 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bd85564_5557_4611_920f_3c976561c254.slice/crio-6e219ee16ac80c11c32a17f5a1fcc998e63156c9c2b8cbbd1d5e3e9361f76d04 WatchSource:0}: Error finding container 6e219ee16ac80c11c32a17f5a1fcc998e63156c9c2b8cbbd1d5e3e9361f76d04: Status 404 returned error can't find the container with id 6e219ee16ac80c11c32a17f5a1fcc998e63156c9c2b8cbbd1d5e3e9361f76d04 Sep 17 03:17:34.704323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.703992 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 03:17:34.755926 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.755869 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tlvff" event={"ID":"4bd85564-5557-4611-920f-3c976561c254","Type":"ContainerStarted","Data":"6e219ee16ac80c11c32a17f5a1fcc998e63156c9c2b8cbbd1d5e3e9361f76d04"} Sep 17 03:17:34.755926 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.755925 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn" event={"ID":"9e1408bb-202b-42b1-af12-3f412454408c","Type":"ContainerStarted","Data":"96f5ae82cc093a4147cfc36653dbff1c2785bc93e6fe34352f550b6a61697002"} Sep 17 03:17:34.756125 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.755955 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 03:17:34.756168 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.756124 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.758828 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.758809 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 17 03:17:34.759046 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.759020 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 17 03:17:34.759162 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.759122 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 17 03:17:34.759162 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.759131 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 17 03:17:34.759162 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.759147 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 17 03:17:34.759319 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.759148 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 17 03:17:34.759319 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.759240 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 17 03:17:34.759319 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.759308 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 17 03:17:34.759592 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.759576 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dmdt9\"" Sep 17 03:17:34.759635 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.759588 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 17 03:17:34.878849 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.878820 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.878849 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.878853 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f6aa682-febf-4318-9224-98ab9162922a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.879053 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.878869 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f6aa682-febf-4318-9224-98ab9162922a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.879053 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.878886 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-web-config\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.879053 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.879032 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.879158 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.879074 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.879158 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.879103 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f6aa682-febf-4318-9224-98ab9162922a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.879158 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.879129 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.879271 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.879189 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f6aa682-febf-4318-9224-98ab9162922a-config-out\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.879271 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.879215 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzvth\" (UniqueName: \"kubernetes.io/projected/6f6aa682-febf-4318-9224-98ab9162922a-kube-api-access-jzvth\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.879271 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.879248 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.879439 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.879335 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-config-volume\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.879439 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.879380 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f6aa682-febf-4318-9224-98ab9162922a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.980660 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.980579 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f6aa682-febf-4318-9224-98ab9162922a-config-out\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.980660 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.980616 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzvth\" (UniqueName: \"kubernetes.io/projected/6f6aa682-febf-4318-9224-98ab9162922a-kube-api-access-jzvth\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.980660 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.980645 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.981394 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.980683 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-config-volume\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.981394 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.980708 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f6aa682-febf-4318-9224-98ab9162922a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.981394 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.980736 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.981394 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.980765 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f6aa682-febf-4318-9224-98ab9162922a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.981394 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.980789 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f6aa682-febf-4318-9224-98ab9162922a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.981394 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.980814 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-web-config\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.981394 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.980866 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.981394 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.980893 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.981394 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.980914 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f6aa682-febf-4318-9224-98ab9162922a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.981394 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.980935 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.981394 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.981082 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f6aa682-febf-4318-9224-98ab9162922a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.982172 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.982147 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f6aa682-febf-4318-9224-98ab9162922a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.984019 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.983927 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.984335 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.984172 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f6aa682-febf-4318-9224-98ab9162922a-config-out\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.984335 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.984258 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f6aa682-febf-4318-9224-98ab9162922a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.984610 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.984570 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f6aa682-febf-4318-9224-98ab9162922a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.984749 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.984728 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-web-config\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.984835 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.984815 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-config-volume\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.984957 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.984940 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.985146 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.985130 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.985493 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.985476 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.987045 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.987023 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:34.996925 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:34.996904 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzvth\" (UniqueName: \"kubernetes.io/projected/6f6aa682-febf-4318-9224-98ab9162922a-kube-api-access-jzvth\") pod \"alertmanager-main-0\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:35.067223 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:35.067191 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:17:35.397914 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:35.397808 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 03:17:35.399199 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:17:35.399169 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f6aa682_febf_4318_9224_98ab9162922a.slice/crio-7b5af6c1f7c28f12ba3eeee63d8ae52502c04ec64b9cf61fc02d52d1969337d8 WatchSource:0}: Error finding container 7b5af6c1f7c28f12ba3eeee63d8ae52502c04ec64b9cf61fc02d52d1969337d8: Status 404 returned error can't find the container with id 7b5af6c1f7c28f12ba3eeee63d8ae52502c04ec64b9cf61fc02d52d1969337d8 Sep 17 03:17:35.759054 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:35.759015 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f6aa682-febf-4318-9224-98ab9162922a","Type":"ContainerStarted","Data":"7b5af6c1f7c28f12ba3eeee63d8ae52502c04ec64b9cf61fc02d52d1969337d8"} Sep 17 03:17:36.766038 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:36.765999 2574 generic.go:356] "Generic (PLEG): container finished" podID="4bd85564-5557-4611-920f-3c976561c254" containerID="92760b7eccf4dba07ffd60b91959bd4c8cbee881a9ee8fc59e32fcf1d30718b3" exitCode=0 Sep 17 03:17:36.766504 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:36.766367 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tlvff" event={"ID":"4bd85564-5557-4611-920f-3c976561c254","Type":"ContainerDied","Data":"92760b7eccf4dba07ffd60b91959bd4c8cbee881a9ee8fc59e32fcf1d30718b3"} Sep 17 03:17:36.773436 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:36.773401 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn" event={"ID":"9e1408bb-202b-42b1-af12-3f412454408c","Type":"ContainerStarted","Data":"87df695811451582e6aa4740019fe317fcd4904ba3edf41f5773ce934fc9b153"} Sep 17 03:17:36.773546 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:36.773495 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn" event={"ID":"9e1408bb-202b-42b1-af12-3f412454408c","Type":"ContainerStarted","Data":"09a53f19335eced40f912518b4a0fc6f5115c25ec28fd4ec54296ed44e3920da"} Sep 17 03:17:36.773546 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:36.773514 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn" event={"ID":"9e1408bb-202b-42b1-af12-3f412454408c","Type":"ContainerStarted","Data":"aac730f541128d437ac226b68863ba1e0c623265a7a315e48d2b378c1f895c6a"} Sep 17 03:17:36.806065 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:36.806016 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-b6mwn" podStartSLOduration=1.878913411 podStartE2EDuration="3.805996663s" totalImagesPullingTime="1.927083252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:17:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:36.8050879 +0000 UTC m=+297.338598632" watchObservedRunningTime="2026-09-17 03:17:36.805996663 +0000 UTC m=+297.339507365" Sep 17 03:17:37.729561 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:37.729532 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lczrd" Sep 17 03:17:37.782766 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:37.782732 2574 generic.go:356] "Generic (PLEG): container finished" podID="6f6aa682-febf-4318-9224-98ab9162922a" containerID="dbc65afe1390b2701016e5c35248b291f943521a156b3510445d483dd0fab97c" exitCode=0 Sep 17 03:17:37.783161 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:37.782849 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f6aa682-febf-4318-9224-98ab9162922a","Type":"ContainerDied","Data":"dbc65afe1390b2701016e5c35248b291f943521a156b3510445d483dd0fab97c"} Sep 17 03:17:37.785191 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:37.785166 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tlvff" event={"ID":"4bd85564-5557-4611-920f-3c976561c254","Type":"ContainerStarted","Data":"6a1d04cdd7d68dbebbd1b802e662d70af2a776e2fe150dbf3a50201da8cb6006"} Sep 17 03:17:37.785298 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:37.785225 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tlvff" event={"ID":"4bd85564-5557-4611-920f-3c976561c254","Type":"ContainerStarted","Data":"41d41849146be212834b70b69c496aadb1a43097818324bb9736b497dad479c4"} Sep 17 03:17:37.826918 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:37.826862 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tlvff" podStartSLOduration=3.119626974 podStartE2EDuration="4.826841343s" totalImagesPullingTime="1.62087265s" totalInitContainerRuntime="86.341719ms" isStatefulPod=true podCreationTimestamp="2026-09-17 03:17:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:37.824790978 +0000 UTC m=+298.358301683" watchObservedRunningTime="2026-09-17 03:17:37.826841343 +0000 UTC m=+298.360352045" Sep 17 03:17:37.946313 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:37.946280 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-cb94b6879-t2nfj"] Sep 17 03:17:37.948773 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:37.948754 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:17:37.951483 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:37.951463 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 17 03:17:37.951855 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:37.951829 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ndwv9\"" Sep 17 03:17:37.952049 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:37.952035 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 03:17:37.952368 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:37.952353 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dvmas4fono2r3\"" Sep 17 03:17:37.952521 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:37.952500 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 17 03:17:37.952569 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:37.952549 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 17 03:17:37.960174 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:37.960151 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-cb94b6879-t2nfj"] Sep 17 03:17:38.010835 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:38.010758 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cc1b2bfd-1808-4d04-8005-3409f176650e-secret-metrics-server-client-certs\") pod \"metrics-server-cb94b6879-t2nfj\" (UID: \"cc1b2bfd-1808-4d04-8005-3409f176650e\") " pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:17:38.010835 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:38.010792 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc1b2bfd-1808-4d04-8005-3409f176650e-client-ca-bundle\") pod \"metrics-server-cb94b6879-t2nfj\" (UID: \"cc1b2bfd-1808-4d04-8005-3409f176650e\") " pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:17:38.010990 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:38.010871 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cc1b2bfd-1808-4d04-8005-3409f176650e-secret-metrics-server-tls\") pod \"metrics-server-cb94b6879-t2nfj\" (UID: \"cc1b2bfd-1808-4d04-8005-3409f176650e\") " pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:17:38.010990 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:38.010904 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w5mn\" (UniqueName: \"kubernetes.io/projected/cc1b2bfd-1808-4d04-8005-3409f176650e-kube-api-access-8w5mn\") pod \"metrics-server-cb94b6879-t2nfj\" (UID: \"cc1b2bfd-1808-4d04-8005-3409f176650e\") " pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:17:38.010990 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:38.010932 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc1b2bfd-1808-4d04-8005-3409f176650e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-cb94b6879-t2nfj\" (UID: \"cc1b2bfd-1808-4d04-8005-3409f176650e\") " pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:17:38.010990 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:38.010985 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cc1b2bfd-1808-4d04-8005-3409f176650e-audit-log\") pod \"metrics-server-cb94b6879-t2nfj\" (UID: \"cc1b2bfd-1808-4d04-8005-3409f176650e\") " pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:17:38.011133 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:38.011008 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cc1b2bfd-1808-4d04-8005-3409f176650e-metrics-server-audit-profiles\") pod \"metrics-server-cb94b6879-t2nfj\" (UID: \"cc1b2bfd-1808-4d04-8005-3409f176650e\") " pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:17:38.112313 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:38.112274 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cc1b2bfd-1808-4d04-8005-3409f176650e-secret-metrics-server-tls\") pod \"metrics-server-cb94b6879-t2nfj\" (UID: \"cc1b2bfd-1808-4d04-8005-3409f176650e\") " pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:17:38.112313 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:38.112318 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w5mn\" (UniqueName: \"kubernetes.io/projected/cc1b2bfd-1808-4d04-8005-3409f176650e-kube-api-access-8w5mn\") pod \"metrics-server-cb94b6879-t2nfj\" (UID: \"cc1b2bfd-1808-4d04-8005-3409f176650e\") " pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:17:38.112551 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:38.112346 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc1b2bfd-1808-4d04-8005-3409f176650e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-cb94b6879-t2nfj\" (UID: \"cc1b2bfd-1808-4d04-8005-3409f176650e\") " pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:17:38.112551 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:38.112378 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cc1b2bfd-1808-4d04-8005-3409f176650e-audit-log\") pod \"metrics-server-cb94b6879-t2nfj\" (UID: \"cc1b2bfd-1808-4d04-8005-3409f176650e\") " pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:17:38.112551 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:38.112394 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cc1b2bfd-1808-4d04-8005-3409f176650e-metrics-server-audit-profiles\") pod \"metrics-server-cb94b6879-t2nfj\" (UID: \"cc1b2bfd-1808-4d04-8005-3409f176650e\") " pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:17:38.112551 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:38.112530 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cc1b2bfd-1808-4d04-8005-3409f176650e-secret-metrics-server-client-certs\") pod \"metrics-server-cb94b6879-t2nfj\" (UID: \"cc1b2bfd-1808-4d04-8005-3409f176650e\") " pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:17:38.112750 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:38.112565 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc1b2bfd-1808-4d04-8005-3409f176650e-client-ca-bundle\") pod \"metrics-server-cb94b6879-t2nfj\" (UID: \"cc1b2bfd-1808-4d04-8005-3409f176650e\") " pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:17:38.112802 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:38.112763 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cc1b2bfd-1808-4d04-8005-3409f176650e-audit-log\") pod \"metrics-server-cb94b6879-t2nfj\" (UID: \"cc1b2bfd-1808-4d04-8005-3409f176650e\") " pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:17:38.113160 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:38.113132 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc1b2bfd-1808-4d04-8005-3409f176650e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-cb94b6879-t2nfj\" (UID: \"cc1b2bfd-1808-4d04-8005-3409f176650e\") " pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:17:38.113370 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:38.113351 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cc1b2bfd-1808-4d04-8005-3409f176650e-metrics-server-audit-profiles\") pod \"metrics-server-cb94b6879-t2nfj\" (UID: \"cc1b2bfd-1808-4d04-8005-3409f176650e\") " pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:17:38.114953 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:38.114924 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cc1b2bfd-1808-4d04-8005-3409f176650e-secret-metrics-server-tls\") pod \"metrics-server-cb94b6879-t2nfj\" (UID: \"cc1b2bfd-1808-4d04-8005-3409f176650e\") " pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:17:38.115032 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:38.114966 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc1b2bfd-1808-4d04-8005-3409f176650e-client-ca-bundle\") pod \"metrics-server-cb94b6879-t2nfj\" (UID: \"cc1b2bfd-1808-4d04-8005-3409f176650e\") " pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:17:38.115142 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:38.115123 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cc1b2bfd-1808-4d04-8005-3409f176650e-secret-metrics-server-client-certs\") pod \"metrics-server-cb94b6879-t2nfj\" (UID: \"cc1b2bfd-1808-4d04-8005-3409f176650e\") " pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:17:38.120823 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:38.120805 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w5mn\" (UniqueName: \"kubernetes.io/projected/cc1b2bfd-1808-4d04-8005-3409f176650e-kube-api-access-8w5mn\") pod \"metrics-server-cb94b6879-t2nfj\" (UID: \"cc1b2bfd-1808-4d04-8005-3409f176650e\") " pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:17:38.260684 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:38.260648 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:17:38.531159 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:38.531082 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-cb94b6879-t2nfj"] Sep 17 03:17:38.533814 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:17:38.533786 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc1b2bfd_1808_4d04_8005_3409f176650e.slice/crio-9b3624cf6efabb782da01f052eb65ef2db10cc5cb316c5e6f86c3885973a6421 WatchSource:0}: Error finding container 9b3624cf6efabb782da01f052eb65ef2db10cc5cb316c5e6f86c3885973a6421: Status 404 returned error can't find the container with id 9b3624cf6efabb782da01f052eb65ef2db10cc5cb316c5e6f86c3885973a6421 Sep 17 03:17:38.790543 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:38.790461 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" event={"ID":"cc1b2bfd-1808-4d04-8005-3409f176650e","Type":"ContainerStarted","Data":"9b3624cf6efabb782da01f052eb65ef2db10cc5cb316c5e6f86c3885973a6421"} Sep 17 03:17:39.799061 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.798917 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f6aa682-febf-4318-9224-98ab9162922a","Type":"ContainerStarted","Data":"1dfb8f35601ac7ed4a745fb855d722e6a3e6516d001f9aef5c1f0cef27e5b67a"} Sep 17 03:17:39.799061 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.799018 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f6aa682-febf-4318-9224-98ab9162922a","Type":"ContainerStarted","Data":"10c1a1dc3eee51cc2273eac8bd60bbee69db4397ec7df526f9a560607cf11622"} Sep 17 03:17:39.799061 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.799059 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f6aa682-febf-4318-9224-98ab9162922a","Type":"ContainerStarted","Data":"36531bed5010aa0e056d25d74e0c50f64c1df04bbe4575de76f8b449d4c06ade"} Sep 17 03:17:39.799658 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.799085 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f6aa682-febf-4318-9224-98ab9162922a","Type":"ContainerStarted","Data":"11a820345b308bb60679c0f00828c0397201a35efa1682b7b68968328e572eca"} Sep 17 03:17:39.871323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.871124 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:17:39.876267 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.875102 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:39.878083 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.878058 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 03:17:39.878435 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.878398 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 03:17:39.878516 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.878464 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 03:17:39.878821 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.878794 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 03:17:39.880927 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.880568 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 03:17:39.880927 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.880582 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 03:17:39.880927 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.880594 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 03:17:39.880927 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.880788 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 03:17:39.880927 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.880824 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bcfng\"" Sep 17 03:17:39.880927 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.880853 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 03:17:39.881344 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.881073 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 03:17:39.881344 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.881162 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 03:17:39.881344 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.881269 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 03:17:39.881546 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.881450 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 03:17:39.881546 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.881494 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e1v2qojptulh5\"" Sep 17 03:17:39.883132 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.882967 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 03:17:39.891586 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.891566 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:17:39.930000 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.929973 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:39.930000 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.930004 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:39.930209 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.930030 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:39.930209 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.930074 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:39.930209 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.930145 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:39.930346 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.930213 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/541c6991-1c9f-4303-bce6-f78c3bf79859-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:39.930346 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.930238 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:39.930346 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.930262 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:39.930346 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.930293 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:39.930346 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.930313 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-config\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:39.930346 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.930339 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:39.930636 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.930363 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6zwd\" (UniqueName: \"kubernetes.io/projected/541c6991-1c9f-4303-bce6-f78c3bf79859-kube-api-access-w6zwd\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:39.930636 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.930387 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:39.930636 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.930471 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-web-config\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:39.930636 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.930496 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/541c6991-1c9f-4303-bce6-f78c3bf79859-config-out\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:39.930636 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.930517 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:39.930636 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.930582 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:39.930636 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.930617 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:39.930870 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.930664 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:39.930870 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:39.930710 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.032069 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.031581 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-web-config\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.032069 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.031650 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/541c6991-1c9f-4303-bce6-f78c3bf79859-config-out\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.032069 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.031744 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.032069 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.031795 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.032069 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.031831 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.032069 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.031865 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.032069 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.031896 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.032069 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.031941 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.032069 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.031973 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.032069 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.032008 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.032069 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.032048 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.032069 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.032083 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.032753 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.032157 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/541c6991-1c9f-4303-bce6-f78c3bf79859-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.032753 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.032187 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.032753 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.032216 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.032753 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.032258 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.032753 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.032293 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-config\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.032753 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.032328 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.032753 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.032362 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6zwd\" (UniqueName: \"kubernetes.io/projected/541c6991-1c9f-4303-bce6-f78c3bf79859-kube-api-access-w6zwd\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.032753 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.032398 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.035714 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.035688 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.036300 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.036219 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.039151 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.036883 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.039151 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.037396 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.040065 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.040036 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.040168 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.040117 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.041342 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.040852 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.041342 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.041292 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-web-config\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.041731 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.041705 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.042293 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.042270 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.042472 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.042372 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.042585 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.042477 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.043928 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.043903 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/541c6991-1c9f-4303-bce6-f78c3bf79859-config-out\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.044234 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.044209 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.044893 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.044871 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.045200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.045176 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-config\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.045294 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.045225 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/541c6991-1c9f-4303-bce6-f78c3bf79859-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.045294 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.045229 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.046259 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.046238 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.054126 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.054098 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6zwd\" (UniqueName: \"kubernetes.io/projected/541c6991-1c9f-4303-bce6-f78c3bf79859-kube-api-access-w6zwd\") pod \"prometheus-k8s-0\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.190995 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.190965 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:40.260784 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.260761 2574 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 03:17:40.504214 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.504189 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:17:40.506462 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:17:40.506406 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod541c6991_1c9f_4303_bce6_f78c3bf79859.slice/crio-83efcb2025f9d2b9386b3f45c1873080d100a2718cdcd06f4561927e2283c436 WatchSource:0}: Error finding container 83efcb2025f9d2b9386b3f45c1873080d100a2718cdcd06f4561927e2283c436: Status 404 returned error can't find the container with id 83efcb2025f9d2b9386b3f45c1873080d100a2718cdcd06f4561927e2283c436 Sep 17 03:17:40.804244 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.804140 2574 generic.go:356] "Generic (PLEG): container finished" podID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerID="d861ceaf57ab486ab016ff8c00538f35b84a8fddcf09a186114e1774085ddac1" exitCode=0 Sep 17 03:17:40.804244 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.804229 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"541c6991-1c9f-4303-bce6-f78c3bf79859","Type":"ContainerDied","Data":"d861ceaf57ab486ab016ff8c00538f35b84a8fddcf09a186114e1774085ddac1"} Sep 17 03:17:40.804740 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.804286 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"541c6991-1c9f-4303-bce6-f78c3bf79859","Type":"ContainerStarted","Data":"83efcb2025f9d2b9386b3f45c1873080d100a2718cdcd06f4561927e2283c436"} Sep 17 03:17:40.807984 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.807960 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f6aa682-febf-4318-9224-98ab9162922a","Type":"ContainerStarted","Data":"e5fe32b823f6b65c486047ce296bc47b4cab0d008d595ebb64d910d7c2528729"} Sep 17 03:17:40.809557 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.809530 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" event={"ID":"cc1b2bfd-1808-4d04-8005-3409f176650e","Type":"ContainerStarted","Data":"f88e0388fd66a3369c33f362d9bfba4b621b3521793c04b50f9c82447c63dae7"} Sep 17 03:17:40.853164 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:40.853118 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" podStartSLOduration=2.176375533 podStartE2EDuration="3.853103436s" totalImagesPullingTime="1.676727903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:40.852133849 +0000 UTC m=+301.385644739" watchObservedRunningTime="2026-09-17 03:17:40.853103436 +0000 UTC m=+301.386614137" Sep 17 03:17:41.817792 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:41.817758 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f6aa682-febf-4318-9224-98ab9162922a","Type":"ContainerStarted","Data":"4d39075f2d0a8fc8e3ce5ea82ee00a71ccaf4ef52671e4d9e99e997e7e44b39c"} Sep 17 03:17:41.844338 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:41.844285 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.5699106130000002 podStartE2EDuration="7.844263798s" totalImagesPullingTime="4.255141588s" totalInitContainerRuntime="19.211597ms" isStatefulPod=false podCreationTimestamp="2026-09-17 03:17:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:41.842736393 +0000 UTC m=+302.376247107" watchObservedRunningTime="2026-09-17 03:17:41.844263798 +0000 UTC m=+302.377774500" Sep 17 03:17:42.892068 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:42.892028 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:17:44.310227 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:44.310186 2574 patch_prober.go:28] interesting pod/image-registry-767776f89d-rzc4t container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 17 03:17:44.310735 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:44.310257 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-767776f89d-rzc4t" podUID="7219af2d-7d54-49a4-9bbe-2356b96cec2d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 03:17:44.835396 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:44.835353 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"541c6991-1c9f-4303-bce6-f78c3bf79859","Type":"ContainerStarted","Data":"1f6abd4e86338b77c791d3e8931a651108479496c814fe897790b90b7e5d1b37"} Sep 17 03:17:44.836972 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:44.836952 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 03:17:45.717839 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:45.717812 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:17:45.842105 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:45.842069 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"541c6991-1c9f-4303-bce6-f78c3bf79859","Type":"ContainerStarted","Data":"1993ea681619691e18b95d958c87dd194b9459f41e1dfaaaa9e242b436f85e11"} Sep 17 03:17:46.850104 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:46.850063 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"541c6991-1c9f-4303-bce6-f78c3bf79859","Type":"ContainerStarted","Data":"8513572ab1eca1f239aa6b88a019330c0d290820fb9859e11e0f59b4acb6968d"} Sep 17 03:17:46.850506 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:46.850185 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"541c6991-1c9f-4303-bce6-f78c3bf79859","Type":"ContainerStarted","Data":"6b8fe3d6fe3c26e5012728f91a5898c4d5ee1607d07897d9c1aa856f3427b04c"} Sep 17 03:17:46.850506 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:46.850219 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"541c6991-1c9f-4303-bce6-f78c3bf79859","Type":"ContainerStarted","Data":"7c928049ad19bccb2ab94e0b28eeb085d5af69d952ef3c21425ebac9be216bcb"} Sep 17 03:17:46.850506 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:46.850249 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"541c6991-1c9f-4303-bce6-f78c3bf79859","Type":"ContainerStarted","Data":"f2dd77b5944dd8d7e31d829f015b9b6ca63fa24061b3b05c3b5bd8107c96db6a"} Sep 17 03:17:46.881293 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:46.881241 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.274426924 podStartE2EDuration="7.88122452s" totalImagesPullingTime="5.586358345s" totalInitContainerRuntime="20.439251ms" isStatefulPod=false podCreationTimestamp="2026-09-17 03:17:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:46.879989689 +0000 UTC m=+307.413500418" watchObservedRunningTime="2026-09-17 03:17:46.88122452 +0000 UTC m=+307.414735221" Sep 17 03:17:46.955207 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:46.955174 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-767776f89d-rzc4t"] Sep 17 03:17:50.191507 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:50.191476 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:17:58.261652 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:58.261615 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:17:58.262101 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:17:58.261675 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:18:11.975070 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:11.975031 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-767776f89d-rzc4t" podUID="7219af2d-7d54-49a4-9bbe-2356b96cec2d" containerName="registry" containerID="cri-o://16429b40d097b9e189208dbbb8edc5962a66ce8c3c78129926a961e0ab943e4b" gracePeriod=30 Sep 17 03:18:12.204019 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.203994 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:18:12.319701 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.319615 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7219af2d-7d54-49a4-9bbe-2356b96cec2d-trusted-ca\") pod \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " Sep 17 03:18:12.319701 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.319683 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7219af2d-7d54-49a4-9bbe-2356b96cec2d-image-registry-private-configuration\") pod \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " Sep 17 03:18:12.319918 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.319796 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7219af2d-7d54-49a4-9bbe-2356b96cec2d-ca-trust-extracted\") pod \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " Sep 17 03:18:12.319918 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.319841 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmdbm\" (UniqueName: \"kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-kube-api-access-tmdbm\") pod \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " Sep 17 03:18:12.319918 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.319876 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-certificates\") pod \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " Sep 17 03:18:12.319918 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.319901 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls\") pod \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " Sep 17 03:18:12.320122 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.319944 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7219af2d-7d54-49a4-9bbe-2356b96cec2d-installation-pull-secrets\") pod \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " Sep 17 03:18:12.320122 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.319997 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-bound-sa-token\") pod \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\" (UID: \"7219af2d-7d54-49a4-9bbe-2356b96cec2d\") " Sep 17 03:18:12.320313 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.320278 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7219af2d-7d54-49a4-9bbe-2356b96cec2d" (UID: "7219af2d-7d54-49a4-9bbe-2356b96cec2d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:18:12.320456 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.320412 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7219af2d-7d54-49a4-9bbe-2356b96cec2d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7219af2d-7d54-49a4-9bbe-2356b96cec2d" (UID: "7219af2d-7d54-49a4-9bbe-2356b96cec2d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:18:12.322497 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.322469 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-kube-api-access-tmdbm" (OuterVolumeSpecName: "kube-api-access-tmdbm") pod "7219af2d-7d54-49a4-9bbe-2356b96cec2d" (UID: "7219af2d-7d54-49a4-9bbe-2356b96cec2d"). InnerVolumeSpecName "kube-api-access-tmdbm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:18:12.322737 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.322716 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7219af2d-7d54-49a4-9bbe-2356b96cec2d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7219af2d-7d54-49a4-9bbe-2356b96cec2d" (UID: "7219af2d-7d54-49a4-9bbe-2356b96cec2d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:18:12.322805 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.322762 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7219af2d-7d54-49a4-9bbe-2356b96cec2d" (UID: "7219af2d-7d54-49a4-9bbe-2356b96cec2d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:18:12.322999 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.322981 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7219af2d-7d54-49a4-9bbe-2356b96cec2d" (UID: "7219af2d-7d54-49a4-9bbe-2356b96cec2d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:18:12.323079 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.323054 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7219af2d-7d54-49a4-9bbe-2356b96cec2d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7219af2d-7d54-49a4-9bbe-2356b96cec2d" (UID: "7219af2d-7d54-49a4-9bbe-2356b96cec2d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:18:12.328602 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.328577 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7219af2d-7d54-49a4-9bbe-2356b96cec2d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7219af2d-7d54-49a4-9bbe-2356b96cec2d" (UID: "7219af2d-7d54-49a4-9bbe-2356b96cec2d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:18:12.421553 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.421519 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-bound-sa-token\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:12.421553 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.421548 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7219af2d-7d54-49a4-9bbe-2356b96cec2d-trusted-ca\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:12.421553 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.421557 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7219af2d-7d54-49a4-9bbe-2356b96cec2d-image-registry-private-configuration\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:12.421780 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.421567 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7219af2d-7d54-49a4-9bbe-2356b96cec2d-ca-trust-extracted\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:12.421780 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.421578 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmdbm\" (UniqueName: \"kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-kube-api-access-tmdbm\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:12.421780 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.421587 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-certificates\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:12.421780 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.421594 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7219af2d-7d54-49a4-9bbe-2356b96cec2d-registry-tls\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:12.421780 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.421602 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7219af2d-7d54-49a4-9bbe-2356b96cec2d-installation-pull-secrets\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:12.950633 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.950598 2574 generic.go:356] "Generic (PLEG): container finished" podID="7219af2d-7d54-49a4-9bbe-2356b96cec2d" containerID="16429b40d097b9e189208dbbb8edc5962a66ce8c3c78129926a961e0ab943e4b" exitCode=0 Sep 17 03:18:12.950805 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.950657 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-767776f89d-rzc4t" Sep 17 03:18:12.950805 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.950692 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-767776f89d-rzc4t" event={"ID":"7219af2d-7d54-49a4-9bbe-2356b96cec2d","Type":"ContainerDied","Data":"16429b40d097b9e189208dbbb8edc5962a66ce8c3c78129926a961e0ab943e4b"} Sep 17 03:18:12.950805 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.950745 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-767776f89d-rzc4t" event={"ID":"7219af2d-7d54-49a4-9bbe-2356b96cec2d","Type":"ContainerDied","Data":"afd56d79595742be5349e3c175109d9f035ede5ea669470e5bd28cf4c1b017ba"} Sep 17 03:18:12.950805 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.950765 2574 scope.go:117] "RemoveContainer" containerID="16429b40d097b9e189208dbbb8edc5962a66ce8c3c78129926a961e0ab943e4b" Sep 17 03:18:12.959731 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.959713 2574 scope.go:117] "RemoveContainer" containerID="16429b40d097b9e189208dbbb8edc5962a66ce8c3c78129926a961e0ab943e4b" Sep 17 03:18:12.960012 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:18:12.959996 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16429b40d097b9e189208dbbb8edc5962a66ce8c3c78129926a961e0ab943e4b\": container with ID starting with 16429b40d097b9e189208dbbb8edc5962a66ce8c3c78129926a961e0ab943e4b not found: ID does not exist" containerID="16429b40d097b9e189208dbbb8edc5962a66ce8c3c78129926a961e0ab943e4b" Sep 17 03:18:12.960067 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.960021 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16429b40d097b9e189208dbbb8edc5962a66ce8c3c78129926a961e0ab943e4b"} err="failed to get container status \"16429b40d097b9e189208dbbb8edc5962a66ce8c3c78129926a961e0ab943e4b\": rpc error: code = NotFound desc = could not find container \"16429b40d097b9e189208dbbb8edc5962a66ce8c3c78129926a961e0ab943e4b\": container with ID starting with 16429b40d097b9e189208dbbb8edc5962a66ce8c3c78129926a961e0ab943e4b not found: ID does not exist" Sep 17 03:18:12.972660 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.972635 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-767776f89d-rzc4t"] Sep 17 03:18:12.976035 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:12.976015 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-767776f89d-rzc4t"] Sep 17 03:18:13.896884 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:13.896848 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7219af2d-7d54-49a4-9bbe-2356b96cec2d" path="/var/lib/kubelet/pods/7219af2d-7d54-49a4-9bbe-2356b96cec2d/volumes" Sep 17 03:18:18.265983 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:18.265955 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:18:18.274305 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:18.274278 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-cb94b6879-t2nfj" Sep 17 03:18:20.983406 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:20.983365 2574 generic.go:356] "Generic (PLEG): container finished" podID="e5ec7bca-6b96-4f8c-865c-c863898cce51" containerID="7591d1e94197b482aae5c8c5868bc7e79cf7dbf0332931b817adb4316c074527" exitCode=0 Sep 17 03:18:20.983944 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:20.983456 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jmmt9" event={"ID":"e5ec7bca-6b96-4f8c-865c-c863898cce51","Type":"ContainerDied","Data":"7591d1e94197b482aae5c8c5868bc7e79cf7dbf0332931b817adb4316c074527"} Sep 17 03:18:20.983944 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:20.983871 2574 scope.go:117] "RemoveContainer" containerID="7591d1e94197b482aae5c8c5868bc7e79cf7dbf0332931b817adb4316c074527" Sep 17 03:18:21.988989 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:21.988951 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jmmt9" event={"ID":"e5ec7bca-6b96-4f8c-865c-c863898cce51","Type":"ContainerStarted","Data":"102dfc55dd62a8c44ff8482dd5f31ad5d388eb2dd602ec28759d99fcadc7a9cf"} Sep 17 03:18:30.019620 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:30.019589 2574 generic.go:356] "Generic (PLEG): container finished" podID="1f265faf-76c7-473c-826a-00a566722ba8" containerID="e66769bbfb3f1db316019e18f024c5bed5d7205a530e1bec6e47cc5b06ee74e9" exitCode=0 Sep 17 03:18:30.020060 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:30.019661 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-pm6n9" event={"ID":"1f265faf-76c7-473c-826a-00a566722ba8","Type":"ContainerDied","Data":"e66769bbfb3f1db316019e18f024c5bed5d7205a530e1bec6e47cc5b06ee74e9"} Sep 17 03:18:30.020120 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:30.020107 2574 scope.go:117] "RemoveContainer" containerID="e66769bbfb3f1db316019e18f024c5bed5d7205a530e1bec6e47cc5b06ee74e9" Sep 17 03:18:31.025866 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:31.025776 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-pm6n9" event={"ID":"1f265faf-76c7-473c-826a-00a566722ba8","Type":"ContainerStarted","Data":"820989e9c4298637a4e93f7093daa577bfe6088bf4953e2d988f70fbb9b79fb3"} Sep 17 03:18:40.191713 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:40.191685 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:18:40.211297 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:40.211271 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:18:41.078652 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:41.078624 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:18:53.799142 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:53.799093 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs\") pod \"network-metrics-daemon-bgwwg\" (UID: \"eca0ae2b-bd17-447e-9784-04f94225f000\") " pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:18:53.801790 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:53.801765 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca0ae2b-bd17-447e-9784-04f94225f000-metrics-certs\") pod \"network-metrics-daemon-bgwwg\" (UID: \"eca0ae2b-bd17-447e-9784-04f94225f000\") " pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:18:53.913802 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:53.913766 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 03:18:53.914070 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:53.914033 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="alertmanager" containerID="cri-o://11a820345b308bb60679c0f00828c0397201a35efa1682b7b68968328e572eca" gracePeriod=120 Sep 17 03:18:53.914140 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:53.914091 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="kube-rbac-proxy-metric" containerID="cri-o://e5fe32b823f6b65c486047ce296bc47b4cab0d008d595ebb64d910d7c2528729" gracePeriod=120 Sep 17 03:18:53.914140 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:53.914117 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="kube-rbac-proxy" containerID="cri-o://1dfb8f35601ac7ed4a745fb855d722e6a3e6516d001f9aef5c1f0cef27e5b67a" gracePeriod=120 Sep 17 03:18:53.914140 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:53.914132 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="config-reloader" containerID="cri-o://36531bed5010aa0e056d25d74e0c50f64c1df04bbe4575de76f8b449d4c06ade" gracePeriod=120 Sep 17 03:18:53.914276 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:53.914109 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="kube-rbac-proxy-web" containerID="cri-o://10c1a1dc3eee51cc2273eac8bd60bbee69db4397ec7df526f9a560607cf11622" gracePeriod=120 Sep 17 03:18:53.914276 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:53.914188 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="prom-label-proxy" containerID="cri-o://4d39075f2d0a8fc8e3ce5ea82ee00a71ccaf4ef52671e4d9e99e997e7e44b39c" gracePeriod=120 Sep 17 03:18:53.995808 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:53.995778 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ltdl9\"" Sep 17 03:18:54.004097 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:54.004075 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgwwg" Sep 17 03:18:54.119387 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:54.119355 2574 generic.go:356] "Generic (PLEG): container finished" podID="6f6aa682-febf-4318-9224-98ab9162922a" containerID="4d39075f2d0a8fc8e3ce5ea82ee00a71ccaf4ef52671e4d9e99e997e7e44b39c" exitCode=0 Sep 17 03:18:54.119387 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:54.119380 2574 generic.go:356] "Generic (PLEG): container finished" podID="6f6aa682-febf-4318-9224-98ab9162922a" containerID="e5fe32b823f6b65c486047ce296bc47b4cab0d008d595ebb64d910d7c2528729" exitCode=0 Sep 17 03:18:54.119387 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:54.119386 2574 generic.go:356] "Generic (PLEG): container finished" podID="6f6aa682-febf-4318-9224-98ab9162922a" containerID="1dfb8f35601ac7ed4a745fb855d722e6a3e6516d001f9aef5c1f0cef27e5b67a" exitCode=0 Sep 17 03:18:54.119387 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:54.119392 2574 generic.go:356] "Generic (PLEG): container finished" podID="6f6aa682-febf-4318-9224-98ab9162922a" containerID="36531bed5010aa0e056d25d74e0c50f64c1df04bbe4575de76f8b449d4c06ade" exitCode=0 Sep 17 03:18:54.119387 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:54.119396 2574 generic.go:356] "Generic (PLEG): container finished" podID="6f6aa682-febf-4318-9224-98ab9162922a" containerID="11a820345b308bb60679c0f00828c0397201a35efa1682b7b68968328e572eca" exitCode=0 Sep 17 03:18:54.119781 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:54.119453 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f6aa682-febf-4318-9224-98ab9162922a","Type":"ContainerDied","Data":"4d39075f2d0a8fc8e3ce5ea82ee00a71ccaf4ef52671e4d9e99e997e7e44b39c"} Sep 17 03:18:54.119781 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:54.119563 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f6aa682-febf-4318-9224-98ab9162922a","Type":"ContainerDied","Data":"e5fe32b823f6b65c486047ce296bc47b4cab0d008d595ebb64d910d7c2528729"} Sep 17 03:18:54.119781 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:54.119605 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f6aa682-febf-4318-9224-98ab9162922a","Type":"ContainerDied","Data":"1dfb8f35601ac7ed4a745fb855d722e6a3e6516d001f9aef5c1f0cef27e5b67a"} Sep 17 03:18:54.119781 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:54.119646 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f6aa682-febf-4318-9224-98ab9162922a","Type":"ContainerDied","Data":"36531bed5010aa0e056d25d74e0c50f64c1df04bbe4575de76f8b449d4c06ade"} Sep 17 03:18:54.119781 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:54.119687 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f6aa682-febf-4318-9224-98ab9162922a","Type":"ContainerDied","Data":"11a820345b308bb60679c0f00828c0397201a35efa1682b7b68968328e572eca"} Sep 17 03:18:54.276222 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:54.276199 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bgwwg"] Sep 17 03:18:54.278555 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:18:54.278527 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeca0ae2b_bd17_447e_9784_04f94225f000.slice/crio-ee4df3ed40ca0df8d1d13744dbe1897afc4fe0310dc43886dd6f56c2a2ebec7c WatchSource:0}: Error finding container ee4df3ed40ca0df8d1d13744dbe1897afc4fe0310dc43886dd6f56c2a2ebec7c: Status 404 returned error can't find the container with id ee4df3ed40ca0df8d1d13744dbe1897afc4fe0310dc43886dd6f56c2a2ebec7c Sep 17 03:18:55.125921 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.125893 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bgwwg" event={"ID":"eca0ae2b-bd17-447e-9784-04f94225f000","Type":"ContainerStarted","Data":"ee4df3ed40ca0df8d1d13744dbe1897afc4fe0310dc43886dd6f56c2a2ebec7c"} Sep 17 03:18:55.475985 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.475957 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:55.615874 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.615789 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzvth\" (UniqueName: \"kubernetes.io/projected/6f6aa682-febf-4318-9224-98ab9162922a-kube-api-access-jzvth\") pod \"6f6aa682-febf-4318-9224-98ab9162922a\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " Sep 17 03:18:55.615874 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.615834 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-secret-alertmanager-main-tls\") pod \"6f6aa682-febf-4318-9224-98ab9162922a\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " Sep 17 03:18:55.615874 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.615861 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"6f6aa682-febf-4318-9224-98ab9162922a\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " Sep 17 03:18:55.616149 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.615888 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f6aa682-febf-4318-9224-98ab9162922a-alertmanager-main-db\") pod \"6f6aa682-febf-4318-9224-98ab9162922a\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " Sep 17 03:18:55.616149 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.615919 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-config-volume\") pod \"6f6aa682-febf-4318-9224-98ab9162922a\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " Sep 17 03:18:55.616149 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.615977 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-cluster-tls-config\") pod \"6f6aa682-febf-4318-9224-98ab9162922a\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " Sep 17 03:18:55.616149 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.616013 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-secret-alertmanager-kube-rbac-proxy\") pod \"6f6aa682-febf-4318-9224-98ab9162922a\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " Sep 17 03:18:55.616149 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.616035 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f6aa682-febf-4318-9224-98ab9162922a-config-out\") pod \"6f6aa682-febf-4318-9224-98ab9162922a\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " Sep 17 03:18:55.616149 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.616060 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f6aa682-febf-4318-9224-98ab9162922a-metrics-client-ca\") pod \"6f6aa682-febf-4318-9224-98ab9162922a\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " Sep 17 03:18:55.616149 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.616090 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-secret-alertmanager-kube-rbac-proxy-web\") pod \"6f6aa682-febf-4318-9224-98ab9162922a\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " Sep 17 03:18:55.616149 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.616129 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-web-config\") pod \"6f6aa682-febf-4318-9224-98ab9162922a\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " Sep 17 03:18:55.616546 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.616154 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f6aa682-febf-4318-9224-98ab9162922a-alertmanager-trusted-ca-bundle\") pod \"6f6aa682-febf-4318-9224-98ab9162922a\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " Sep 17 03:18:55.616546 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.616178 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f6aa682-febf-4318-9224-98ab9162922a-tls-assets\") pod \"6f6aa682-febf-4318-9224-98ab9162922a\" (UID: \"6f6aa682-febf-4318-9224-98ab9162922a\") " Sep 17 03:18:55.616797 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.616770 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f6aa682-febf-4318-9224-98ab9162922a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "6f6aa682-febf-4318-9224-98ab9162922a" (UID: "6f6aa682-febf-4318-9224-98ab9162922a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:18:55.617414 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.617381 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f6aa682-febf-4318-9224-98ab9162922a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "6f6aa682-febf-4318-9224-98ab9162922a" (UID: "6f6aa682-febf-4318-9224-98ab9162922a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:18:55.617630 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.617572 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f6aa682-febf-4318-9224-98ab9162922a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "6f6aa682-febf-4318-9224-98ab9162922a" (UID: "6f6aa682-febf-4318-9224-98ab9162922a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:18:55.619035 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.619008 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f6aa682-febf-4318-9224-98ab9162922a-config-out" (OuterVolumeSpecName: "config-out") pod "6f6aa682-febf-4318-9224-98ab9162922a" (UID: "6f6aa682-febf-4318-9224-98ab9162922a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:18:55.619144 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.619082 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f6aa682-febf-4318-9224-98ab9162922a-kube-api-access-jzvth" (OuterVolumeSpecName: "kube-api-access-jzvth") pod "6f6aa682-febf-4318-9224-98ab9162922a" (UID: "6f6aa682-febf-4318-9224-98ab9162922a"). InnerVolumeSpecName "kube-api-access-jzvth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:18:55.619323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.619297 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "6f6aa682-febf-4318-9224-98ab9162922a" (UID: "6f6aa682-febf-4318-9224-98ab9162922a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:18:55.619753 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.619735 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "6f6aa682-febf-4318-9224-98ab9162922a" (UID: "6f6aa682-febf-4318-9224-98ab9162922a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:18:55.619905 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.619883 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f6aa682-febf-4318-9224-98ab9162922a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6f6aa682-febf-4318-9224-98ab9162922a" (UID: "6f6aa682-febf-4318-9224-98ab9162922a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:18:55.620160 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.620127 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-config-volume" (OuterVolumeSpecName: "config-volume") pod "6f6aa682-febf-4318-9224-98ab9162922a" (UID: "6f6aa682-febf-4318-9224-98ab9162922a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:18:55.620233 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.620180 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "6f6aa682-febf-4318-9224-98ab9162922a" (UID: "6f6aa682-febf-4318-9224-98ab9162922a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:18:55.620809 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.620786 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "6f6aa682-febf-4318-9224-98ab9162922a" (UID: "6f6aa682-febf-4318-9224-98ab9162922a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:18:55.623971 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.623948 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "6f6aa682-febf-4318-9224-98ab9162922a" (UID: "6f6aa682-febf-4318-9224-98ab9162922a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:18:55.630125 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.630106 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-web-config" (OuterVolumeSpecName: "web-config") pod "6f6aa682-febf-4318-9224-98ab9162922a" (UID: "6f6aa682-febf-4318-9224-98ab9162922a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:18:55.717164 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.717129 2574 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-cluster-tls-config\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:55.717164 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.717158 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:55.717358 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.717172 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f6aa682-febf-4318-9224-98ab9162922a-config-out\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:55.717358 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.717185 2574 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f6aa682-febf-4318-9224-98ab9162922a-metrics-client-ca\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:55.717358 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.717197 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:55.717358 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.717208 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-web-config\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:55.717358 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.717219 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f6aa682-febf-4318-9224-98ab9162922a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:55.717358 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.717231 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f6aa682-febf-4318-9224-98ab9162922a-tls-assets\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:55.717358 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.717241 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzvth\" (UniqueName: \"kubernetes.io/projected/6f6aa682-febf-4318-9224-98ab9162922a-kube-api-access-jzvth\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:55.717358 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.717251 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-secret-alertmanager-main-tls\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:55.717358 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.717263 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:55.717358 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.717276 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f6aa682-febf-4318-9224-98ab9162922a-alertmanager-main-db\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:55.717358 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:55.717288 2574 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f6aa682-febf-4318-9224-98ab9162922a-config-volume\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:56.135488 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.135460 2574 generic.go:356] "Generic (PLEG): container finished" podID="6f6aa682-febf-4318-9224-98ab9162922a" containerID="10c1a1dc3eee51cc2273eac8bd60bbee69db4397ec7df526f9a560607cf11622" exitCode=0 Sep 17 03:18:56.135923 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.135531 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f6aa682-febf-4318-9224-98ab9162922a","Type":"ContainerDied","Data":"10c1a1dc3eee51cc2273eac8bd60bbee69db4397ec7df526f9a560607cf11622"} Sep 17 03:18:56.135923 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.135584 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.135923 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.135625 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f6aa682-febf-4318-9224-98ab9162922a","Type":"ContainerDied","Data":"7b5af6c1f7c28f12ba3eeee63d8ae52502c04ec64b9cf61fc02d52d1969337d8"} Sep 17 03:18:56.135923 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.135647 2574 scope.go:117] "RemoveContainer" containerID="4d39075f2d0a8fc8e3ce5ea82ee00a71ccaf4ef52671e4d9e99e997e7e44b39c" Sep 17 03:18:56.137575 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.137540 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bgwwg" event={"ID":"eca0ae2b-bd17-447e-9784-04f94225f000","Type":"ContainerStarted","Data":"e1d8511e0be1595b01bc1d739d6ac4fd7a6f476c963ef279ae960a3bc1d0ab67"} Sep 17 03:18:56.137675 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.137641 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bgwwg" event={"ID":"eca0ae2b-bd17-447e-9784-04f94225f000","Type":"ContainerStarted","Data":"0a32c0d55ff54617f1b219f8ebd4adf2de6a5965042138a574051239128c7bd2"} Sep 17 03:18:56.143593 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.143578 2574 scope.go:117] "RemoveContainer" containerID="e5fe32b823f6b65c486047ce296bc47b4cab0d008d595ebb64d910d7c2528729" Sep 17 03:18:56.150291 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.150273 2574 scope.go:117] "RemoveContainer" containerID="1dfb8f35601ac7ed4a745fb855d722e6a3e6516d001f9aef5c1f0cef27e5b67a" Sep 17 03:18:56.156919 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.156904 2574 scope.go:117] "RemoveContainer" containerID="10c1a1dc3eee51cc2273eac8bd60bbee69db4397ec7df526f9a560607cf11622" Sep 17 03:18:56.159308 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.159275 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bgwwg" podStartSLOduration=375.088966133 podStartE2EDuration="6m16.159262604s" totalImagesPullingTime="1.070296471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:18:56.158499201 +0000 UTC m=+376.692009922" watchObservedRunningTime="2026-09-17 03:18:56.159262604 +0000 UTC m=+376.692773374" Sep 17 03:18:56.163758 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.163740 2574 scope.go:117] "RemoveContainer" containerID="36531bed5010aa0e056d25d74e0c50f64c1df04bbe4575de76f8b449d4c06ade" Sep 17 03:18:56.170499 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.170470 2574 scope.go:117] "RemoveContainer" containerID="11a820345b308bb60679c0f00828c0397201a35efa1682b7b68968328e572eca" Sep 17 03:18:56.174277 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.174252 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 03:18:56.179389 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.179370 2574 scope.go:117] "RemoveContainer" containerID="dbc65afe1390b2701016e5c35248b291f943521a156b3510445d483dd0fab97c" Sep 17 03:18:56.180090 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.180071 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 03:18:56.186669 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.186650 2574 scope.go:117] "RemoveContainer" containerID="4d39075f2d0a8fc8e3ce5ea82ee00a71ccaf4ef52671e4d9e99e997e7e44b39c" Sep 17 03:18:56.186933 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:18:56.186915 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d39075f2d0a8fc8e3ce5ea82ee00a71ccaf4ef52671e4d9e99e997e7e44b39c\": container with ID starting with 4d39075f2d0a8fc8e3ce5ea82ee00a71ccaf4ef52671e4d9e99e997e7e44b39c not found: ID does not exist" containerID="4d39075f2d0a8fc8e3ce5ea82ee00a71ccaf4ef52671e4d9e99e997e7e44b39c" Sep 17 03:18:56.186982 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.186945 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d39075f2d0a8fc8e3ce5ea82ee00a71ccaf4ef52671e4d9e99e997e7e44b39c"} err="failed to get container status \"4d39075f2d0a8fc8e3ce5ea82ee00a71ccaf4ef52671e4d9e99e997e7e44b39c\": rpc error: code = NotFound desc = could not find container \"4d39075f2d0a8fc8e3ce5ea82ee00a71ccaf4ef52671e4d9e99e997e7e44b39c\": container with ID starting with 4d39075f2d0a8fc8e3ce5ea82ee00a71ccaf4ef52671e4d9e99e997e7e44b39c not found: ID does not exist" Sep 17 03:18:56.186982 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.186963 2574 scope.go:117] "RemoveContainer" containerID="e5fe32b823f6b65c486047ce296bc47b4cab0d008d595ebb64d910d7c2528729" Sep 17 03:18:56.187219 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:18:56.187203 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5fe32b823f6b65c486047ce296bc47b4cab0d008d595ebb64d910d7c2528729\": container with ID starting with e5fe32b823f6b65c486047ce296bc47b4cab0d008d595ebb64d910d7c2528729 not found: ID does not exist" containerID="e5fe32b823f6b65c486047ce296bc47b4cab0d008d595ebb64d910d7c2528729" Sep 17 03:18:56.187260 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.187225 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5fe32b823f6b65c486047ce296bc47b4cab0d008d595ebb64d910d7c2528729"} err="failed to get container status \"e5fe32b823f6b65c486047ce296bc47b4cab0d008d595ebb64d910d7c2528729\": rpc error: code = NotFound desc = could not find container \"e5fe32b823f6b65c486047ce296bc47b4cab0d008d595ebb64d910d7c2528729\": container with ID starting with e5fe32b823f6b65c486047ce296bc47b4cab0d008d595ebb64d910d7c2528729 not found: ID does not exist" Sep 17 03:18:56.187260 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.187240 2574 scope.go:117] "RemoveContainer" containerID="1dfb8f35601ac7ed4a745fb855d722e6a3e6516d001f9aef5c1f0cef27e5b67a" Sep 17 03:18:56.187487 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:18:56.187471 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dfb8f35601ac7ed4a745fb855d722e6a3e6516d001f9aef5c1f0cef27e5b67a\": container with ID starting with 1dfb8f35601ac7ed4a745fb855d722e6a3e6516d001f9aef5c1f0cef27e5b67a not found: ID does not exist" containerID="1dfb8f35601ac7ed4a745fb855d722e6a3e6516d001f9aef5c1f0cef27e5b67a" Sep 17 03:18:56.187534 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.187492 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dfb8f35601ac7ed4a745fb855d722e6a3e6516d001f9aef5c1f0cef27e5b67a"} err="failed to get container status \"1dfb8f35601ac7ed4a745fb855d722e6a3e6516d001f9aef5c1f0cef27e5b67a\": rpc error: code = NotFound desc = could not find container \"1dfb8f35601ac7ed4a745fb855d722e6a3e6516d001f9aef5c1f0cef27e5b67a\": container with ID starting with 1dfb8f35601ac7ed4a745fb855d722e6a3e6516d001f9aef5c1f0cef27e5b67a not found: ID does not exist" Sep 17 03:18:56.187534 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.187505 2574 scope.go:117] "RemoveContainer" containerID="10c1a1dc3eee51cc2273eac8bd60bbee69db4397ec7df526f9a560607cf11622" Sep 17 03:18:56.187735 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:18:56.187720 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10c1a1dc3eee51cc2273eac8bd60bbee69db4397ec7df526f9a560607cf11622\": container with ID starting with 10c1a1dc3eee51cc2273eac8bd60bbee69db4397ec7df526f9a560607cf11622 not found: ID does not exist" containerID="10c1a1dc3eee51cc2273eac8bd60bbee69db4397ec7df526f9a560607cf11622" Sep 17 03:18:56.187776 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.187737 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10c1a1dc3eee51cc2273eac8bd60bbee69db4397ec7df526f9a560607cf11622"} err="failed to get container status \"10c1a1dc3eee51cc2273eac8bd60bbee69db4397ec7df526f9a560607cf11622\": rpc error: code = NotFound desc = could not find container \"10c1a1dc3eee51cc2273eac8bd60bbee69db4397ec7df526f9a560607cf11622\": container with ID starting with 10c1a1dc3eee51cc2273eac8bd60bbee69db4397ec7df526f9a560607cf11622 not found: ID does not exist" Sep 17 03:18:56.187776 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.187754 2574 scope.go:117] "RemoveContainer" containerID="36531bed5010aa0e056d25d74e0c50f64c1df04bbe4575de76f8b449d4c06ade" Sep 17 03:18:56.187974 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:18:56.187958 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36531bed5010aa0e056d25d74e0c50f64c1df04bbe4575de76f8b449d4c06ade\": container with ID starting with 36531bed5010aa0e056d25d74e0c50f64c1df04bbe4575de76f8b449d4c06ade not found: ID does not exist" containerID="36531bed5010aa0e056d25d74e0c50f64c1df04bbe4575de76f8b449d4c06ade" Sep 17 03:18:56.188015 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.187979 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36531bed5010aa0e056d25d74e0c50f64c1df04bbe4575de76f8b449d4c06ade"} err="failed to get container status \"36531bed5010aa0e056d25d74e0c50f64c1df04bbe4575de76f8b449d4c06ade\": rpc error: code = NotFound desc = could not find container \"36531bed5010aa0e056d25d74e0c50f64c1df04bbe4575de76f8b449d4c06ade\": container with ID starting with 36531bed5010aa0e056d25d74e0c50f64c1df04bbe4575de76f8b449d4c06ade not found: ID does not exist" Sep 17 03:18:56.188015 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.187993 2574 scope.go:117] "RemoveContainer" containerID="11a820345b308bb60679c0f00828c0397201a35efa1682b7b68968328e572eca" Sep 17 03:18:56.188195 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:18:56.188181 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11a820345b308bb60679c0f00828c0397201a35efa1682b7b68968328e572eca\": container with ID starting with 11a820345b308bb60679c0f00828c0397201a35efa1682b7b68968328e572eca not found: ID does not exist" containerID="11a820345b308bb60679c0f00828c0397201a35efa1682b7b68968328e572eca" Sep 17 03:18:56.188229 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.188198 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11a820345b308bb60679c0f00828c0397201a35efa1682b7b68968328e572eca"} err="failed to get container status \"11a820345b308bb60679c0f00828c0397201a35efa1682b7b68968328e572eca\": rpc error: code = NotFound desc = could not find container \"11a820345b308bb60679c0f00828c0397201a35efa1682b7b68968328e572eca\": container with ID starting with 11a820345b308bb60679c0f00828c0397201a35efa1682b7b68968328e572eca not found: ID does not exist" Sep 17 03:18:56.188229 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.188223 2574 scope.go:117] "RemoveContainer" containerID="dbc65afe1390b2701016e5c35248b291f943521a156b3510445d483dd0fab97c" Sep 17 03:18:56.188484 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:18:56.188467 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbc65afe1390b2701016e5c35248b291f943521a156b3510445d483dd0fab97c\": container with ID starting with dbc65afe1390b2701016e5c35248b291f943521a156b3510445d483dd0fab97c not found: ID does not exist" containerID="dbc65afe1390b2701016e5c35248b291f943521a156b3510445d483dd0fab97c" Sep 17 03:18:56.188529 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.188489 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbc65afe1390b2701016e5c35248b291f943521a156b3510445d483dd0fab97c"} err="failed to get container status \"dbc65afe1390b2701016e5c35248b291f943521a156b3510445d483dd0fab97c\": rpc error: code = NotFound desc = could not find container \"dbc65afe1390b2701016e5c35248b291f943521a156b3510445d483dd0fab97c\": container with ID starting with dbc65afe1390b2701016e5c35248b291f943521a156b3510445d483dd0fab97c not found: ID does not exist" Sep 17 03:18:56.203007 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.202981 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 03:18:56.203268 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.203254 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="init-config-reloader" Sep 17 03:18:56.203304 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.203271 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="init-config-reloader" Sep 17 03:18:56.203304 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.203282 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="config-reloader" Sep 17 03:18:56.203304 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.203288 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="config-reloader" Sep 17 03:18:56.203304 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.203294 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="kube-rbac-proxy-web" Sep 17 03:18:56.203304 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.203300 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="kube-rbac-proxy-web" Sep 17 03:18:56.203304 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.203305 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="kube-rbac-proxy" Sep 17 03:18:56.203509 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.203311 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="kube-rbac-proxy" Sep 17 03:18:56.203509 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.203322 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="kube-rbac-proxy-metric" Sep 17 03:18:56.203509 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.203327 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="kube-rbac-proxy-metric" Sep 17 03:18:56.203509 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.203335 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7219af2d-7d54-49a4-9bbe-2356b96cec2d" containerName="registry" Sep 17 03:18:56.203509 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.203340 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7219af2d-7d54-49a4-9bbe-2356b96cec2d" containerName="registry" Sep 17 03:18:56.203509 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.203350 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="prom-label-proxy" Sep 17 03:18:56.203509 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.203355 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="prom-label-proxy" Sep 17 03:18:56.203509 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.203361 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="alertmanager" Sep 17 03:18:56.203509 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.203365 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="alertmanager" Sep 17 03:18:56.203509 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.203409 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="prom-label-proxy" Sep 17 03:18:56.203509 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.203415 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="kube-rbac-proxy" Sep 17 03:18:56.203509 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.203445 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="alertmanager" Sep 17 03:18:56.203509 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.203452 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="config-reloader" Sep 17 03:18:56.203509 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.203458 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7219af2d-7d54-49a4-9bbe-2356b96cec2d" containerName="registry" Sep 17 03:18:56.203509 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.203463 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="kube-rbac-proxy-metric" Sep 17 03:18:56.203509 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.203469 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f6aa682-febf-4318-9224-98ab9162922a" containerName="kube-rbac-proxy-web" Sep 17 03:18:56.212128 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.212106 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.214894 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.214869 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 17 03:18:56.214991 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.214900 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dmdt9\"" Sep 17 03:18:56.214991 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.214919 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 17 03:18:56.214991 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.214874 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 17 03:18:56.214991 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.214881 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 17 03:18:56.215192 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.214881 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 17 03:18:56.215192 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.215167 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 17 03:18:56.215278 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.215262 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 17 03:18:56.215333 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.215318 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 17 03:18:56.221478 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.221459 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 17 03:18:56.222628 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.222607 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 03:18:56.323022 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.322987 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a053e20-c783-428b-80e0-cd339520a88d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.323174 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.323040 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a053e20-c783-428b-80e0-cd339520a88d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.323174 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.323107 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a053e20-c783-428b-80e0-cd339520a88d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.323174 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.323136 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a053e20-c783-428b-80e0-cd339520a88d-config-out\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.323174 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.323165 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a053e20-c783-428b-80e0-cd339520a88d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.323303 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.323192 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a053e20-c783-428b-80e0-cd339520a88d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.323303 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.323213 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a053e20-c783-428b-80e0-cd339520a88d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.323303 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.323244 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a053e20-c783-428b-80e0-cd339520a88d-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.323303 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.323267 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f894w\" (UniqueName: \"kubernetes.io/projected/0a053e20-c783-428b-80e0-cd339520a88d-kube-api-access-f894w\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.323448 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.323304 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a053e20-c783-428b-80e0-cd339520a88d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.323448 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.323342 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a053e20-c783-428b-80e0-cd339520a88d-web-config\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.323448 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.323369 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a053e20-c783-428b-80e0-cd339520a88d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.323448 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.323394 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a053e20-c783-428b-80e0-cd339520a88d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.423955 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.423885 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a053e20-c783-428b-80e0-cd339520a88d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.423955 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.423917 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a053e20-c783-428b-80e0-cd339520a88d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.423955 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.423938 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a053e20-c783-428b-80e0-cd339520a88d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.424130 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.424068 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a053e20-c783-428b-80e0-cd339520a88d-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.424130 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.424097 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f894w\" (UniqueName: \"kubernetes.io/projected/0a053e20-c783-428b-80e0-cd339520a88d-kube-api-access-f894w\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.424130 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.424120 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a053e20-c783-428b-80e0-cd339520a88d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.424313 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.424157 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a053e20-c783-428b-80e0-cd339520a88d-web-config\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.424507 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.424412 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a053e20-c783-428b-80e0-cd339520a88d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.424507 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.424498 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a053e20-c783-428b-80e0-cd339520a88d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.424679 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.424541 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a053e20-c783-428b-80e0-cd339520a88d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.424679 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.424586 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a053e20-c783-428b-80e0-cd339520a88d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.424679 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.424626 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a053e20-c783-428b-80e0-cd339520a88d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.424679 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.424653 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a053e20-c783-428b-80e0-cd339520a88d-config-out\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.425156 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.424923 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a053e20-c783-428b-80e0-cd339520a88d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.425719 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.425694 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a053e20-c783-428b-80e0-cd339520a88d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.427139 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.427115 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a053e20-c783-428b-80e0-cd339520a88d-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.427293 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.427268 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a053e20-c783-428b-80e0-cd339520a88d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.427368 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.427275 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a053e20-c783-428b-80e0-cd339520a88d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.427368 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.427347 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a053e20-c783-428b-80e0-cd339520a88d-web-config\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.427514 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.427362 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a053e20-c783-428b-80e0-cd339520a88d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.427565 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.427528 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a053e20-c783-428b-80e0-cd339520a88d-config-out\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.427899 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.427877 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a053e20-c783-428b-80e0-cd339520a88d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.428105 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.428089 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a053e20-c783-428b-80e0-cd339520a88d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.428462 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.428415 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a053e20-c783-428b-80e0-cd339520a88d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.429300 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.429280 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a053e20-c783-428b-80e0-cd339520a88d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.432966 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.432949 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f894w\" (UniqueName: \"kubernetes.io/projected/0a053e20-c783-428b-80e0-cd339520a88d-kube-api-access-f894w\") pod \"alertmanager-main-0\" (UID: \"0a053e20-c783-428b-80e0-cd339520a88d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.522966 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.522936 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 03:18:56.804300 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:56.804127 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 03:18:56.806887 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:18:56.806864 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a053e20_c783_428b_80e0_cd339520a88d.slice/crio-4b450e3f6043aa6839e70209521dc9853c8a305c5022bfea4faac87978f4d3bd WatchSource:0}: Error finding container 4b450e3f6043aa6839e70209521dc9853c8a305c5022bfea4faac87978f4d3bd: Status 404 returned error can't find the container with id 4b450e3f6043aa6839e70209521dc9853c8a305c5022bfea4faac87978f4d3bd Sep 17 03:18:57.144649 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:57.144566 2574 generic.go:356] "Generic (PLEG): container finished" podID="0a053e20-c783-428b-80e0-cd339520a88d" containerID="d2c150f5cb091627900f81ca0e405331d63db8ef78a8019ecba1d7eebc102c3f" exitCode=0 Sep 17 03:18:57.145046 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:57.144646 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a053e20-c783-428b-80e0-cd339520a88d","Type":"ContainerDied","Data":"d2c150f5cb091627900f81ca0e405331d63db8ef78a8019ecba1d7eebc102c3f"} Sep 17 03:18:57.145046 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:57.144709 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a053e20-c783-428b-80e0-cd339520a88d","Type":"ContainerStarted","Data":"4b450e3f6043aa6839e70209521dc9853c8a305c5022bfea4faac87978f4d3bd"} Sep 17 03:18:57.896641 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:57.896610 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f6aa682-febf-4318-9224-98ab9162922a" path="/var/lib/kubelet/pods/6f6aa682-febf-4318-9224-98ab9162922a/volumes" Sep 17 03:18:58.153328 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:58.153237 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a053e20-c783-428b-80e0-cd339520a88d","Type":"ContainerStarted","Data":"7d730d6b4b40f7883fc23687f34ec14d88065deae64a1ed8957baec226d87794"} Sep 17 03:18:58.153328 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:58.153310 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a053e20-c783-428b-80e0-cd339520a88d","Type":"ContainerStarted","Data":"075e32fee81e7017a8a07d21b5c1be5a4f823b66b306362658055f8c4ac51788"} Sep 17 03:18:58.153867 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:58.153349 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a053e20-c783-428b-80e0-cd339520a88d","Type":"ContainerStarted","Data":"1d7457f57a2e6339c12a7be8d5daa98b6589a8fabe29e21990cdfcf2ab5c8430"} Sep 17 03:18:58.153867 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:58.153386 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a053e20-c783-428b-80e0-cd339520a88d","Type":"ContainerStarted","Data":"ca50375f40b948f65e6db7483f7df8e77af7a121a84552b877bd6172221e8e76"} Sep 17 03:18:58.153867 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:58.153451 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a053e20-c783-428b-80e0-cd339520a88d","Type":"ContainerStarted","Data":"8335c0c58f8f005bdcb57d3e98f90f537c51540a82a642304228b7ebbd2d1f9a"} Sep 17 03:18:58.153867 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:58.153496 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a053e20-c783-428b-80e0-cd339520a88d","Type":"ContainerStarted","Data":"775f89e64beb5ac780aea3e29600a34f7ff111cc3ec7bf9ce33fdb7e4197c9f1"} Sep 17 03:18:58.182284 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:58.182233 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.16363458 podStartE2EDuration="2.182215515s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.580935ms" isStatefulPod=false podCreationTimestamp="2026-09-17 03:18:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:18:58.181319468 +0000 UTC m=+378.714830169" watchObservedRunningTime="2026-09-17 03:18:58.182215515 +0000 UTC m=+378.715726212" Sep 17 03:18:58.294737 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:58.294703 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:18:58.295070 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:58.295019 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="prometheus" containerID="cri-o://1f6abd4e86338b77c791d3e8931a651108479496c814fe897790b90b7e5d1b37" gracePeriod=600 Sep 17 03:18:58.295151 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:58.295046 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="kube-rbac-proxy" containerID="cri-o://6b8fe3d6fe3c26e5012728f91a5898c4d5ee1607d07897d9c1aa856f3427b04c" gracePeriod=600 Sep 17 03:18:58.295151 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:58.295100 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="config-reloader" containerID="cri-o://1993ea681619691e18b95d958c87dd194b9459f41e1dfaaaa9e242b436f85e11" gracePeriod=600 Sep 17 03:18:58.295151 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:58.295123 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="kube-rbac-proxy-web" containerID="cri-o://7c928049ad19bccb2ab94e0b28eeb085d5af69d952ef3c21425ebac9be216bcb" gracePeriod=600 Sep 17 03:18:58.295308 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:58.295110 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8513572ab1eca1f239aa6b88a019330c0d290820fb9859e11e0f59b4acb6968d" gracePeriod=600 Sep 17 03:18:58.295308 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:58.295046 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="thanos-sidecar" containerID="cri-o://f2dd77b5944dd8d7e31d829f015b9b6ca63fa24061b3b05c3b5bd8107c96db6a" gracePeriod=600 Sep 17 03:18:59.160323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.160234 2574 generic.go:356] "Generic (PLEG): container finished" podID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerID="8513572ab1eca1f239aa6b88a019330c0d290820fb9859e11e0f59b4acb6968d" exitCode=0 Sep 17 03:18:59.160323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.160258 2574 generic.go:356] "Generic (PLEG): container finished" podID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerID="6b8fe3d6fe3c26e5012728f91a5898c4d5ee1607d07897d9c1aa856f3427b04c" exitCode=0 Sep 17 03:18:59.160323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.160267 2574 generic.go:356] "Generic (PLEG): container finished" podID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerID="f2dd77b5944dd8d7e31d829f015b9b6ca63fa24061b3b05c3b5bd8107c96db6a" exitCode=0 Sep 17 03:18:59.160323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.160272 2574 generic.go:356] "Generic (PLEG): container finished" podID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerID="1993ea681619691e18b95d958c87dd194b9459f41e1dfaaaa9e242b436f85e11" exitCode=0 Sep 17 03:18:59.160323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.160278 2574 generic.go:356] "Generic (PLEG): container finished" podID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerID="1f6abd4e86338b77c791d3e8931a651108479496c814fe897790b90b7e5d1b37" exitCode=0 Sep 17 03:18:59.160323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.160305 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"541c6991-1c9f-4303-bce6-f78c3bf79859","Type":"ContainerDied","Data":"8513572ab1eca1f239aa6b88a019330c0d290820fb9859e11e0f59b4acb6968d"} Sep 17 03:18:59.160832 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.160374 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"541c6991-1c9f-4303-bce6-f78c3bf79859","Type":"ContainerDied","Data":"6b8fe3d6fe3c26e5012728f91a5898c4d5ee1607d07897d9c1aa856f3427b04c"} Sep 17 03:18:59.160832 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.160402 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"541c6991-1c9f-4303-bce6-f78c3bf79859","Type":"ContainerDied","Data":"f2dd77b5944dd8d7e31d829f015b9b6ca63fa24061b3b05c3b5bd8107c96db6a"} Sep 17 03:18:59.160832 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.160445 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"541c6991-1c9f-4303-bce6-f78c3bf79859","Type":"ContainerDied","Data":"1993ea681619691e18b95d958c87dd194b9459f41e1dfaaaa9e242b436f85e11"} Sep 17 03:18:59.160832 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.160471 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"541c6991-1c9f-4303-bce6-f78c3bf79859","Type":"ContainerDied","Data":"1f6abd4e86338b77c791d3e8931a651108479496c814fe897790b90b7e5d1b37"} Sep 17 03:18:59.533555 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.533531 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:18:59.654116 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.654081 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-metrics-client-certs\") pod \"541c6991-1c9f-4303-bce6-f78c3bf79859\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " Sep 17 03:18:59.654116 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.654113 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-configmap-serving-certs-ca-bundle\") pod \"541c6991-1c9f-4303-bce6-f78c3bf79859\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " Sep 17 03:18:59.654360 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.654128 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-grpc-tls\") pod \"541c6991-1c9f-4303-bce6-f78c3bf79859\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " Sep 17 03:18:59.654360 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.654148 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-prometheus-k8s-tls\") pod \"541c6991-1c9f-4303-bce6-f78c3bf79859\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " Sep 17 03:18:59.654360 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.654167 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"541c6991-1c9f-4303-bce6-f78c3bf79859\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " Sep 17 03:18:59.654360 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.654192 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-thanos-prometheus-http-client-file\") pod \"541c6991-1c9f-4303-bce6-f78c3bf79859\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " Sep 17 03:18:59.654360 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.654228 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-k8s-rulefiles-2\") pod \"541c6991-1c9f-4303-bce6-f78c3bf79859\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " Sep 17 03:18:59.654360 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.654251 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-configmap-kubelet-serving-ca-bundle\") pod \"541c6991-1c9f-4303-bce6-f78c3bf79859\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " Sep 17 03:18:59.654360 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.654284 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-kube-rbac-proxy\") pod \"541c6991-1c9f-4303-bce6-f78c3bf79859\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " Sep 17 03:18:59.654360 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.654308 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-web-config\") pod \"541c6991-1c9f-4303-bce6-f78c3bf79859\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " Sep 17 03:18:59.654360 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.654332 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/541c6991-1c9f-4303-bce6-f78c3bf79859-config-out\") pod \"541c6991-1c9f-4303-bce6-f78c3bf79859\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " Sep 17 03:18:59.654360 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.654356 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-config\") pod \"541c6991-1c9f-4303-bce6-f78c3bf79859\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " Sep 17 03:18:59.654912 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.654381 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-k8s-db\") pod \"541c6991-1c9f-4303-bce6-f78c3bf79859\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " Sep 17 03:18:59.654912 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.654409 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-k8s-rulefiles-0\") pod \"541c6991-1c9f-4303-bce6-f78c3bf79859\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " Sep 17 03:18:59.654912 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.654482 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-configmap-metrics-client-ca\") pod \"541c6991-1c9f-4303-bce6-f78c3bf79859\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " Sep 17 03:18:59.654912 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.654542 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-k8s-rulefiles-1\") pod \"541c6991-1c9f-4303-bce6-f78c3bf79859\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " Sep 17 03:18:59.654912 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.654580 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-trusted-ca-bundle\") pod \"541c6991-1c9f-4303-bce6-f78c3bf79859\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " Sep 17 03:18:59.654912 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.654605 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/541c6991-1c9f-4303-bce6-f78c3bf79859-tls-assets\") pod \"541c6991-1c9f-4303-bce6-f78c3bf79859\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " Sep 17 03:18:59.654912 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.654637 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6zwd\" (UniqueName: \"kubernetes.io/projected/541c6991-1c9f-4303-bce6-f78c3bf79859-kube-api-access-w6zwd\") pod \"541c6991-1c9f-4303-bce6-f78c3bf79859\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " Sep 17 03:18:59.654912 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.654665 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"541c6991-1c9f-4303-bce6-f78c3bf79859\" (UID: \"541c6991-1c9f-4303-bce6-f78c3bf79859\") " Sep 17 03:18:59.655557 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.654593 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "541c6991-1c9f-4303-bce6-f78c3bf79859" (UID: "541c6991-1c9f-4303-bce6-f78c3bf79859"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:18:59.655557 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.655007 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "541c6991-1c9f-4303-bce6-f78c3bf79859" (UID: "541c6991-1c9f-4303-bce6-f78c3bf79859"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:18:59.655969 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.655155 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "541c6991-1c9f-4303-bce6-f78c3bf79859" (UID: "541c6991-1c9f-4303-bce6-f78c3bf79859"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:18:59.656308 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.656285 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "541c6991-1c9f-4303-bce6-f78c3bf79859" (UID: "541c6991-1c9f-4303-bce6-f78c3bf79859"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:18:59.656623 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.656599 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "541c6991-1c9f-4303-bce6-f78c3bf79859" (UID: "541c6991-1c9f-4303-bce6-f78c3bf79859"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:18:59.657939 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.657908 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "541c6991-1c9f-4303-bce6-f78c3bf79859" (UID: "541c6991-1c9f-4303-bce6-f78c3bf79859"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:18:59.658104 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.658077 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "541c6991-1c9f-4303-bce6-f78c3bf79859" (UID: "541c6991-1c9f-4303-bce6-f78c3bf79859"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:18:59.658184 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.658167 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "541c6991-1c9f-4303-bce6-f78c3bf79859" (UID: "541c6991-1c9f-4303-bce6-f78c3bf79859"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:18:59.658247 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.658177 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "541c6991-1c9f-4303-bce6-f78c3bf79859" (UID: "541c6991-1c9f-4303-bce6-f78c3bf79859"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:18:59.658667 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.658635 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "541c6991-1c9f-4303-bce6-f78c3bf79859" (UID: "541c6991-1c9f-4303-bce6-f78c3bf79859"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:18:59.659236 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.659205 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "541c6991-1c9f-4303-bce6-f78c3bf79859" (UID: "541c6991-1c9f-4303-bce6-f78c3bf79859"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:18:59.659326 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.659270 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "541c6991-1c9f-4303-bce6-f78c3bf79859" (UID: "541c6991-1c9f-4303-bce6-f78c3bf79859"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:18:59.659545 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.659482 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "541c6991-1c9f-4303-bce6-f78c3bf79859" (UID: "541c6991-1c9f-4303-bce6-f78c3bf79859"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:18:59.659545 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.659493 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/541c6991-1c9f-4303-bce6-f78c3bf79859-kube-api-access-w6zwd" (OuterVolumeSpecName: "kube-api-access-w6zwd") pod "541c6991-1c9f-4303-bce6-f78c3bf79859" (UID: "541c6991-1c9f-4303-bce6-f78c3bf79859"). InnerVolumeSpecName "kube-api-access-w6zwd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:18:59.659545 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.659514 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/541c6991-1c9f-4303-bce6-f78c3bf79859-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "541c6991-1c9f-4303-bce6-f78c3bf79859" (UID: "541c6991-1c9f-4303-bce6-f78c3bf79859"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:18:59.659742 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.659698 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/541c6991-1c9f-4303-bce6-f78c3bf79859-config-out" (OuterVolumeSpecName: "config-out") pod "541c6991-1c9f-4303-bce6-f78c3bf79859" (UID: "541c6991-1c9f-4303-bce6-f78c3bf79859"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:18:59.659742 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.659707 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "541c6991-1c9f-4303-bce6-f78c3bf79859" (UID: "541c6991-1c9f-4303-bce6-f78c3bf79859"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:18:59.660032 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.660004 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "541c6991-1c9f-4303-bce6-f78c3bf79859" (UID: "541c6991-1c9f-4303-bce6-f78c3bf79859"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:18:59.660878 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.660859 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-config" (OuterVolumeSpecName: "config") pod "541c6991-1c9f-4303-bce6-f78c3bf79859" (UID: "541c6991-1c9f-4303-bce6-f78c3bf79859"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:18:59.669991 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.669972 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-web-config" (OuterVolumeSpecName: "web-config") pod "541c6991-1c9f-4303-bce6-f78c3bf79859" (UID: "541c6991-1c9f-4303-bce6-f78c3bf79859"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:18:59.755833 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.755795 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-configmap-metrics-client-ca\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:59.755833 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.755831 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:59.755833 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.755841 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:59.756037 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.755851 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/541c6991-1c9f-4303-bce6-f78c3bf79859-tls-assets\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:59.756037 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.755859 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6zwd\" (UniqueName: \"kubernetes.io/projected/541c6991-1c9f-4303-bce6-f78c3bf79859-kube-api-access-w6zwd\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:59.756037 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.755868 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:59.756037 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.755876 2574 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-metrics-client-certs\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:59.756037 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.755884 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:59.756037 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.755893 2574 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-grpc-tls\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:59.756037 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.755900 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:59.756037 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.755909 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:59.756037 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.755917 2574 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:59.756037 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.755926 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:59.756037 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.755933 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:59.756037 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.755941 2574 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-secret-kube-rbac-proxy\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:59.756037 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.755950 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-web-config\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:59.756037 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.755960 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/541c6991-1c9f-4303-bce6-f78c3bf79859-config-out\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:59.756037 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.755967 2574 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/541c6991-1c9f-4303-bce6-f78c3bf79859-config\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:59.756037 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.755974 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-k8s-db\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:18:59.756037 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:18:59.755982 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/541c6991-1c9f-4303-bce6-f78c3bf79859-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:19:00.168149 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.168109 2574 generic.go:356] "Generic (PLEG): container finished" podID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerID="7c928049ad19bccb2ab94e0b28eeb085d5af69d952ef3c21425ebac9be216bcb" exitCode=0 Sep 17 03:19:00.168577 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.168183 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.168577 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.168199 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"541c6991-1c9f-4303-bce6-f78c3bf79859","Type":"ContainerDied","Data":"7c928049ad19bccb2ab94e0b28eeb085d5af69d952ef3c21425ebac9be216bcb"} Sep 17 03:19:00.168577 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.168264 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"541c6991-1c9f-4303-bce6-f78c3bf79859","Type":"ContainerDied","Data":"83efcb2025f9d2b9386b3f45c1873080d100a2718cdcd06f4561927e2283c436"} Sep 17 03:19:00.168577 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.168297 2574 scope.go:117] "RemoveContainer" containerID="8513572ab1eca1f239aa6b88a019330c0d290820fb9859e11e0f59b4acb6968d" Sep 17 03:19:00.176790 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.176774 2574 scope.go:117] "RemoveContainer" containerID="6b8fe3d6fe3c26e5012728f91a5898c4d5ee1607d07897d9c1aa856f3427b04c" Sep 17 03:19:00.183731 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.183715 2574 scope.go:117] "RemoveContainer" containerID="7c928049ad19bccb2ab94e0b28eeb085d5af69d952ef3c21425ebac9be216bcb" Sep 17 03:19:00.191405 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.191384 2574 scope.go:117] "RemoveContainer" containerID="f2dd77b5944dd8d7e31d829f015b9b6ca63fa24061b3b05c3b5bd8107c96db6a" Sep 17 03:19:00.191710 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.191688 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:19:00.194886 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.194866 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:19:00.198766 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.198748 2574 scope.go:117] "RemoveContainer" containerID="1993ea681619691e18b95d958c87dd194b9459f41e1dfaaaa9e242b436f85e11" Sep 17 03:19:00.205482 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.205464 2574 scope.go:117] "RemoveContainer" containerID="1f6abd4e86338b77c791d3e8931a651108479496c814fe897790b90b7e5d1b37" Sep 17 03:19:00.212927 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.212912 2574 scope.go:117] "RemoveContainer" containerID="d861ceaf57ab486ab016ff8c00538f35b84a8fddcf09a186114e1774085ddac1" Sep 17 03:19:00.218052 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.218028 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:19:00.218316 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.218301 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="config-reloader" Sep 17 03:19:00.218316 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.218314 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="config-reloader" Sep 17 03:19:00.218473 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.218324 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="thanos-sidecar" Sep 17 03:19:00.218473 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.218329 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="thanos-sidecar" Sep 17 03:19:00.218473 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.218340 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="kube-rbac-proxy-thanos" Sep 17 03:19:00.218473 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.218346 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="kube-rbac-proxy-thanos" Sep 17 03:19:00.218473 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.218353 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="prometheus" Sep 17 03:19:00.218473 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.218360 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="prometheus" Sep 17 03:19:00.218473 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.218365 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="kube-rbac-proxy-web" Sep 17 03:19:00.218473 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.218371 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="kube-rbac-proxy-web" Sep 17 03:19:00.218473 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.218384 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="init-config-reloader" Sep 17 03:19:00.218473 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.218388 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="init-config-reloader" Sep 17 03:19:00.218473 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.218395 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="kube-rbac-proxy" Sep 17 03:19:00.218473 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.218400 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="kube-rbac-proxy" Sep 17 03:19:00.218473 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.218464 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="kube-rbac-proxy-thanos" Sep 17 03:19:00.218473 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.218473 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="config-reloader" Sep 17 03:19:00.218473 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.218479 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="kube-rbac-proxy-web" Sep 17 03:19:00.218473 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.218484 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="kube-rbac-proxy" Sep 17 03:19:00.219242 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.218490 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="prometheus" Sep 17 03:19:00.219242 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.218495 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" containerName="thanos-sidecar" Sep 17 03:19:00.220786 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.220771 2574 scope.go:117] "RemoveContainer" containerID="8513572ab1eca1f239aa6b88a019330c0d290820fb9859e11e0f59b4acb6968d" Sep 17 03:19:00.221095 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:19:00.221075 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8513572ab1eca1f239aa6b88a019330c0d290820fb9859e11e0f59b4acb6968d\": container with ID starting with 8513572ab1eca1f239aa6b88a019330c0d290820fb9859e11e0f59b4acb6968d not found: ID does not exist" containerID="8513572ab1eca1f239aa6b88a019330c0d290820fb9859e11e0f59b4acb6968d" Sep 17 03:19:00.221152 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.221107 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8513572ab1eca1f239aa6b88a019330c0d290820fb9859e11e0f59b4acb6968d"} err="failed to get container status \"8513572ab1eca1f239aa6b88a019330c0d290820fb9859e11e0f59b4acb6968d\": rpc error: code = NotFound desc = could not find container \"8513572ab1eca1f239aa6b88a019330c0d290820fb9859e11e0f59b4acb6968d\": container with ID starting with 8513572ab1eca1f239aa6b88a019330c0d290820fb9859e11e0f59b4acb6968d not found: ID does not exist" Sep 17 03:19:00.221152 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.221125 2574 scope.go:117] "RemoveContainer" containerID="6b8fe3d6fe3c26e5012728f91a5898c4d5ee1607d07897d9c1aa856f3427b04c" Sep 17 03:19:00.221389 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:19:00.221372 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b8fe3d6fe3c26e5012728f91a5898c4d5ee1607d07897d9c1aa856f3427b04c\": container with ID starting with 6b8fe3d6fe3c26e5012728f91a5898c4d5ee1607d07897d9c1aa856f3427b04c not found: ID does not exist" containerID="6b8fe3d6fe3c26e5012728f91a5898c4d5ee1607d07897d9c1aa856f3427b04c" Sep 17 03:19:00.221462 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.221394 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b8fe3d6fe3c26e5012728f91a5898c4d5ee1607d07897d9c1aa856f3427b04c"} err="failed to get container status \"6b8fe3d6fe3c26e5012728f91a5898c4d5ee1607d07897d9c1aa856f3427b04c\": rpc error: code = NotFound desc = could not find container \"6b8fe3d6fe3c26e5012728f91a5898c4d5ee1607d07897d9c1aa856f3427b04c\": container with ID starting with 6b8fe3d6fe3c26e5012728f91a5898c4d5ee1607d07897d9c1aa856f3427b04c not found: ID does not exist" Sep 17 03:19:00.221462 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.221410 2574 scope.go:117] "RemoveContainer" containerID="7c928049ad19bccb2ab94e0b28eeb085d5af69d952ef3c21425ebac9be216bcb" Sep 17 03:19:00.221753 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:19:00.221733 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c928049ad19bccb2ab94e0b28eeb085d5af69d952ef3c21425ebac9be216bcb\": container with ID starting with 7c928049ad19bccb2ab94e0b28eeb085d5af69d952ef3c21425ebac9be216bcb not found: ID does not exist" containerID="7c928049ad19bccb2ab94e0b28eeb085d5af69d952ef3c21425ebac9be216bcb" Sep 17 03:19:00.221832 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.221755 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c928049ad19bccb2ab94e0b28eeb085d5af69d952ef3c21425ebac9be216bcb"} err="failed to get container status \"7c928049ad19bccb2ab94e0b28eeb085d5af69d952ef3c21425ebac9be216bcb\": rpc error: code = NotFound desc = could not find container \"7c928049ad19bccb2ab94e0b28eeb085d5af69d952ef3c21425ebac9be216bcb\": container with ID starting with 7c928049ad19bccb2ab94e0b28eeb085d5af69d952ef3c21425ebac9be216bcb not found: ID does not exist" Sep 17 03:19:00.221832 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.221770 2574 scope.go:117] "RemoveContainer" containerID="f2dd77b5944dd8d7e31d829f015b9b6ca63fa24061b3b05c3b5bd8107c96db6a" Sep 17 03:19:00.222018 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:19:00.221999 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2dd77b5944dd8d7e31d829f015b9b6ca63fa24061b3b05c3b5bd8107c96db6a\": container with ID starting with f2dd77b5944dd8d7e31d829f015b9b6ca63fa24061b3b05c3b5bd8107c96db6a not found: ID does not exist" containerID="f2dd77b5944dd8d7e31d829f015b9b6ca63fa24061b3b05c3b5bd8107c96db6a" Sep 17 03:19:00.222112 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.222018 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2dd77b5944dd8d7e31d829f015b9b6ca63fa24061b3b05c3b5bd8107c96db6a"} err="failed to get container status \"f2dd77b5944dd8d7e31d829f015b9b6ca63fa24061b3b05c3b5bd8107c96db6a\": rpc error: code = NotFound desc = could not find container \"f2dd77b5944dd8d7e31d829f015b9b6ca63fa24061b3b05c3b5bd8107c96db6a\": container with ID starting with f2dd77b5944dd8d7e31d829f015b9b6ca63fa24061b3b05c3b5bd8107c96db6a not found: ID does not exist" Sep 17 03:19:00.222112 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.222032 2574 scope.go:117] "RemoveContainer" containerID="1993ea681619691e18b95d958c87dd194b9459f41e1dfaaaa9e242b436f85e11" Sep 17 03:19:00.222275 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:19:00.222256 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1993ea681619691e18b95d958c87dd194b9459f41e1dfaaaa9e242b436f85e11\": container with ID starting with 1993ea681619691e18b95d958c87dd194b9459f41e1dfaaaa9e242b436f85e11 not found: ID does not exist" containerID="1993ea681619691e18b95d958c87dd194b9459f41e1dfaaaa9e242b436f85e11" Sep 17 03:19:00.222339 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.222281 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1993ea681619691e18b95d958c87dd194b9459f41e1dfaaaa9e242b436f85e11"} err="failed to get container status \"1993ea681619691e18b95d958c87dd194b9459f41e1dfaaaa9e242b436f85e11\": rpc error: code = NotFound desc = could not find container \"1993ea681619691e18b95d958c87dd194b9459f41e1dfaaaa9e242b436f85e11\": container with ID starting with 1993ea681619691e18b95d958c87dd194b9459f41e1dfaaaa9e242b436f85e11 not found: ID does not exist" Sep 17 03:19:00.222339 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.222295 2574 scope.go:117] "RemoveContainer" containerID="1f6abd4e86338b77c791d3e8931a651108479496c814fe897790b90b7e5d1b37" Sep 17 03:19:00.222468 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.222446 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.222604 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:19:00.222586 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f6abd4e86338b77c791d3e8931a651108479496c814fe897790b90b7e5d1b37\": container with ID starting with 1f6abd4e86338b77c791d3e8931a651108479496c814fe897790b90b7e5d1b37 not found: ID does not exist" containerID="1f6abd4e86338b77c791d3e8931a651108479496c814fe897790b90b7e5d1b37" Sep 17 03:19:00.222657 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.222612 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f6abd4e86338b77c791d3e8931a651108479496c814fe897790b90b7e5d1b37"} err="failed to get container status \"1f6abd4e86338b77c791d3e8931a651108479496c814fe897790b90b7e5d1b37\": rpc error: code = NotFound desc = could not find container \"1f6abd4e86338b77c791d3e8931a651108479496c814fe897790b90b7e5d1b37\": container with ID starting with 1f6abd4e86338b77c791d3e8931a651108479496c814fe897790b90b7e5d1b37 not found: ID does not exist" Sep 17 03:19:00.222657 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.222630 2574 scope.go:117] "RemoveContainer" containerID="d861ceaf57ab486ab016ff8c00538f35b84a8fddcf09a186114e1774085ddac1" Sep 17 03:19:00.223234 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:19:00.223216 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d861ceaf57ab486ab016ff8c00538f35b84a8fddcf09a186114e1774085ddac1\": container with ID starting with d861ceaf57ab486ab016ff8c00538f35b84a8fddcf09a186114e1774085ddac1 not found: ID does not exist" containerID="d861ceaf57ab486ab016ff8c00538f35b84a8fddcf09a186114e1774085ddac1" Sep 17 03:19:00.223305 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.223239 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d861ceaf57ab486ab016ff8c00538f35b84a8fddcf09a186114e1774085ddac1"} err="failed to get container status \"d861ceaf57ab486ab016ff8c00538f35b84a8fddcf09a186114e1774085ddac1\": rpc error: code = NotFound desc = could not find container \"d861ceaf57ab486ab016ff8c00538f35b84a8fddcf09a186114e1774085ddac1\": container with ID starting with d861ceaf57ab486ab016ff8c00538f35b84a8fddcf09a186114e1774085ddac1 not found: ID does not exist" Sep 17 03:19:00.225204 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.225186 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 03:19:00.225301 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.225214 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 03:19:00.225301 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.225189 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 03:19:00.225301 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.225189 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 03:19:00.225540 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.225525 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 03:19:00.225782 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.225764 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 03:19:00.225893 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.225878 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bcfng\"" Sep 17 03:19:00.226111 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.226096 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 03:19:00.226160 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.226104 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 03:19:00.226480 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.226462 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 03:19:00.227405 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.227384 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 03:19:00.227538 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.227385 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 03:19:00.227607 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.227391 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 03:19:00.227668 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.227551 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e1v2qojptulh5\"" Sep 17 03:19:00.229253 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.229234 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 03:19:00.231267 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.231248 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 03:19:00.238211 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.238192 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:19:00.360646 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.360609 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.360646 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.360649 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1716308a-fa75-40c7-b3dc-fdd199525f0b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.360646 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.360667 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.360898 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.360688 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.360898 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.360715 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1716308a-fa75-40c7-b3dc-fdd199525f0b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.360898 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.360806 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.360898 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.360841 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1716308a-fa75-40c7-b3dc-fdd199525f0b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.360898 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.360857 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1716308a-fa75-40c7-b3dc-fdd199525f0b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.360898 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.360875 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1716308a-fa75-40c7-b3dc-fdd199525f0b-config-out\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.360898 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.360892 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1716308a-fa75-40c7-b3dc-fdd199525f0b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.361154 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.360920 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1716308a-fa75-40c7-b3dc-fdd199525f0b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.361154 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.360938 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-web-config\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.361154 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.360952 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1716308a-fa75-40c7-b3dc-fdd199525f0b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.361154 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.360974 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.361154 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.360989 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n965w\" (UniqueName: \"kubernetes.io/projected/1716308a-fa75-40c7-b3dc-fdd199525f0b-kube-api-access-n965w\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.361154 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.361021 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1716308a-fa75-40c7-b3dc-fdd199525f0b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.361154 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.361063 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1716308a-fa75-40c7-b3dc-fdd199525f0b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.361154 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.361080 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-config\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.361154 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.361095 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.361154 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.361111 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.462304 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.462274 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.462455 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.462311 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1716308a-fa75-40c7-b3dc-fdd199525f0b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.462455 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.462327 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1716308a-fa75-40c7-b3dc-fdd199525f0b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.462455 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.462343 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1716308a-fa75-40c7-b3dc-fdd199525f0b-config-out\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.462455 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.462359 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1716308a-fa75-40c7-b3dc-fdd199525f0b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.462455 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.462390 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1716308a-fa75-40c7-b3dc-fdd199525f0b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.462455 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.462417 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-web-config\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.462735 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.462469 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1716308a-fa75-40c7-b3dc-fdd199525f0b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.462735 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.462490 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.462735 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.462510 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n965w\" (UniqueName: \"kubernetes.io/projected/1716308a-fa75-40c7-b3dc-fdd199525f0b-kube-api-access-n965w\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.462735 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.462533 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1716308a-fa75-40c7-b3dc-fdd199525f0b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.462735 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.462588 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1716308a-fa75-40c7-b3dc-fdd199525f0b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.462735 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.462617 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-config\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.462735 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.462642 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.462735 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.462665 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.462735 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.462704 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.462735 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.462728 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1716308a-fa75-40c7-b3dc-fdd199525f0b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.463192 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.462751 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.463192 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.462776 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1716308a-fa75-40c7-b3dc-fdd199525f0b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.463192 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.462785 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.463192 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.462826 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1716308a-fa75-40c7-b3dc-fdd199525f0b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.463192 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.463146 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1716308a-fa75-40c7-b3dc-fdd199525f0b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.463458 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.463278 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1716308a-fa75-40c7-b3dc-fdd199525f0b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.463687 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.463661 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1716308a-fa75-40c7-b3dc-fdd199525f0b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.464499 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.464476 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1716308a-fa75-40c7-b3dc-fdd199525f0b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.465410 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.465382 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1716308a-fa75-40c7-b3dc-fdd199525f0b-config-out\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.466081 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.466052 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.466174 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.466088 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1716308a-fa75-40c7-b3dc-fdd199525f0b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.466928 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.466730 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1716308a-fa75-40c7-b3dc-fdd199525f0b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.466928 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.466877 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.467440 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.467348 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1716308a-fa75-40c7-b3dc-fdd199525f0b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.467631 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.467555 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.468077 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.468051 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-config\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.468172 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.468117 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1716308a-fa75-40c7-b3dc-fdd199525f0b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.468369 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.468347 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.468580 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.468561 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.468712 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.468698 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.468752 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.468713 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.469191 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.469171 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1716308a-fa75-40c7-b3dc-fdd199525f0b-web-config\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.471834 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.471813 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n965w\" (UniqueName: \"kubernetes.io/projected/1716308a-fa75-40c7-b3dc-fdd199525f0b-kube-api-access-n965w\") pod \"prometheus-k8s-0\" (UID: \"1716308a-fa75-40c7-b3dc-fdd199525f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.532146 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.532101 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:19:00.818606 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:00.818581 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:19:00.819865 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:19:00.819838 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1716308a_fa75_40c7_b3dc_fdd199525f0b.slice/crio-71a34dc567a11efc2838ec77a2f82a080350fd7518a3f5099fdca502514b2fff WatchSource:0}: Error finding container 71a34dc567a11efc2838ec77a2f82a080350fd7518a3f5099fdca502514b2fff: Status 404 returned error can't find the container with id 71a34dc567a11efc2838ec77a2f82a080350fd7518a3f5099fdca502514b2fff Sep 17 03:19:01.173987 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:01.173898 2574 generic.go:356] "Generic (PLEG): container finished" podID="1716308a-fa75-40c7-b3dc-fdd199525f0b" containerID="8e73f6fe615f760c73a64e9ee6d6500784ab045b531c3a683f60124ca1b689f5" exitCode=0 Sep 17 03:19:01.174383 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:01.173982 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1716308a-fa75-40c7-b3dc-fdd199525f0b","Type":"ContainerDied","Data":"8e73f6fe615f760c73a64e9ee6d6500784ab045b531c3a683f60124ca1b689f5"} Sep 17 03:19:01.174383 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:01.174046 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1716308a-fa75-40c7-b3dc-fdd199525f0b","Type":"ContainerStarted","Data":"71a34dc567a11efc2838ec77a2f82a080350fd7518a3f5099fdca502514b2fff"} Sep 17 03:19:01.897144 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:01.897064 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="541c6991-1c9f-4303-bce6-f78c3bf79859" path="/var/lib/kubelet/pods/541c6991-1c9f-4303-bce6-f78c3bf79859/volumes" Sep 17 03:19:02.183028 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:02.182999 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1716308a-fa75-40c7-b3dc-fdd199525f0b","Type":"ContainerStarted","Data":"c4a53a03a9e0938a146796ff1e8abb8d324c6612bbcbb48b136a13cca8b050f7"} Sep 17 03:19:02.183447 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:02.183055 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1716308a-fa75-40c7-b3dc-fdd199525f0b","Type":"ContainerStarted","Data":"c91a2b719448d66fbbf068338c65226b9c3af9d1229cff8e66bcd7440be140c8"} Sep 17 03:19:02.183447 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:02.183080 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1716308a-fa75-40c7-b3dc-fdd199525f0b","Type":"ContainerStarted","Data":"b93b7a21b00675e56ac4c756c5f93fe1ac8d917816fd199c0571e497726ffc9b"} Sep 17 03:19:02.183447 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:02.183104 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1716308a-fa75-40c7-b3dc-fdd199525f0b","Type":"ContainerStarted","Data":"5b6cf1fb89a718b450087712d40c1316cd01f9c471120c7caa28633a3a3e97d8"} Sep 17 03:19:02.183447 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:02.183127 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1716308a-fa75-40c7-b3dc-fdd199525f0b","Type":"ContainerStarted","Data":"90dcfcb6ce211c491f4ed76247e5a806cd615120ca98fc77bfe87c8585662424"} Sep 17 03:19:02.183447 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:02.183151 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1716308a-fa75-40c7-b3dc-fdd199525f0b","Type":"ContainerStarted","Data":"429fa86e9dc6b56d2b97bd2d814ad89561fd0732dd35276d0101f3f718751b46"} Sep 17 03:19:02.229438 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:02.229365 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.210991766 podStartE2EDuration="2.229349527s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.357761ms" isStatefulPod=false podCreationTimestamp="2026-09-17 03:19:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:19:02.228140717 +0000 UTC m=+382.761651441" watchObservedRunningTime="2026-09-17 03:19:02.229349527 +0000 UTC m=+382.762860227" Sep 17 03:19:05.532283 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:19:05.532251 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:20:00.532615 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:20:00.532573 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:20:00.548622 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:20:00.548597 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:20:01.434313 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:20:01.434279 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:21:59.241818 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:21:59.241787 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-vvlvj"] Sep 17 03:21:59.244744 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:21:59.244729 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-vvlvj" Sep 17 03:21:59.247646 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:21:59.247626 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 17 03:21:59.247759 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:21:59.247654 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 17 03:21:59.248979 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:21:59.248961 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-tzf2g\"" Sep 17 03:21:59.254575 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:21:59.254555 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-vvlvj"] Sep 17 03:21:59.337999 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:21:59.337968 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06e302ba-cf87-4205-80b2-179fb24f38b8-bound-sa-token\") pod \"cert-manager-55b4d954d5-vvlvj\" (UID: \"06e302ba-cf87-4205-80b2-179fb24f38b8\") " pod="cert-manager/cert-manager-55b4d954d5-vvlvj" Sep 17 03:21:59.338138 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:21:59.338006 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k742\" (UniqueName: \"kubernetes.io/projected/06e302ba-cf87-4205-80b2-179fb24f38b8-kube-api-access-8k742\") pod \"cert-manager-55b4d954d5-vvlvj\" (UID: \"06e302ba-cf87-4205-80b2-179fb24f38b8\") " pod="cert-manager/cert-manager-55b4d954d5-vvlvj" Sep 17 03:21:59.438736 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:21:59.438701 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06e302ba-cf87-4205-80b2-179fb24f38b8-bound-sa-token\") pod \"cert-manager-55b4d954d5-vvlvj\" (UID: \"06e302ba-cf87-4205-80b2-179fb24f38b8\") " pod="cert-manager/cert-manager-55b4d954d5-vvlvj" Sep 17 03:21:59.438876 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:21:59.438741 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k742\" (UniqueName: \"kubernetes.io/projected/06e302ba-cf87-4205-80b2-179fb24f38b8-kube-api-access-8k742\") pod \"cert-manager-55b4d954d5-vvlvj\" (UID: \"06e302ba-cf87-4205-80b2-179fb24f38b8\") " pod="cert-manager/cert-manager-55b4d954d5-vvlvj" Sep 17 03:21:59.447249 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:21:59.447221 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06e302ba-cf87-4205-80b2-179fb24f38b8-bound-sa-token\") pod \"cert-manager-55b4d954d5-vvlvj\" (UID: \"06e302ba-cf87-4205-80b2-179fb24f38b8\") " pod="cert-manager/cert-manager-55b4d954d5-vvlvj" Sep 17 03:21:59.447364 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:21:59.447348 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k742\" (UniqueName: \"kubernetes.io/projected/06e302ba-cf87-4205-80b2-179fb24f38b8-kube-api-access-8k742\") pod \"cert-manager-55b4d954d5-vvlvj\" (UID: \"06e302ba-cf87-4205-80b2-179fb24f38b8\") " pod="cert-manager/cert-manager-55b4d954d5-vvlvj" Sep 17 03:21:59.568605 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:21:59.568529 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-vvlvj" Sep 17 03:21:59.840595 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:21:59.840571 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-vvlvj"] Sep 17 03:21:59.842701 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:21:59.842674 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06e302ba_cf87_4205_80b2_179fb24f38b8.slice/crio-e4b5a1313b3b5495f2478461612d6b2565145502e86ad43029b9787ff23b62c9 WatchSource:0}: Error finding container e4b5a1313b3b5495f2478461612d6b2565145502e86ad43029b9787ff23b62c9: Status 404 returned error can't find the container with id e4b5a1313b3b5495f2478461612d6b2565145502e86ad43029b9787ff23b62c9 Sep 17 03:21:59.895793 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:21:59.895765 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-vvlvj" event={"ID":"06e302ba-cf87-4205-80b2-179fb24f38b8","Type":"ContainerStarted","Data":"e4b5a1313b3b5495f2478461612d6b2565145502e86ad43029b9787ff23b62c9"} Sep 17 03:22:02.907716 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:02.907682 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-vvlvj" event={"ID":"06e302ba-cf87-4205-80b2-179fb24f38b8","Type":"ContainerStarted","Data":"5b59c60c087d9c15804cf38de994231769991e6e7991fb2c6fa23b0dd788a0bc"} Sep 17 03:22:02.923772 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:02.923728 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-vvlvj" podStartSLOduration=0.947764061 podStartE2EDuration="3.923712328s" totalImagesPullingTime="2.975948267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:21:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:22:02.922453886 +0000 UTC m=+563.455964588" watchObservedRunningTime="2026-09-17 03:22:02.923712328 +0000 UTC m=+563.457223029" Sep 17 03:22:28.601480 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:28.601448 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx"] Sep 17 03:22:28.604928 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:28.604913 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx" Sep 17 03:22:28.607975 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:28.607947 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 17 03:22:28.607975 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:28.607962 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jkzz5\"" Sep 17 03:22:28.608121 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:28.607983 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 17 03:22:28.608121 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:28.607962 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 17 03:22:28.608121 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:28.608083 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 17 03:22:28.617718 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:28.617698 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx"] Sep 17 03:22:28.687224 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:28.687194 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e277ce9b-e98d-4927-b229-480ded52caf4-manifests\") pod \"opendatahub-operator-controller-manager-6b9b769b77-nqnbx\" (UID: \"e277ce9b-e98d-4927-b229-480ded52caf4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx" Sep 17 03:22:28.687376 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:28.687235 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e277ce9b-e98d-4927-b229-480ded52caf4-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b9b769b77-nqnbx\" (UID: \"e277ce9b-e98d-4927-b229-480ded52caf4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx" Sep 17 03:22:28.687376 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:28.687272 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e277ce9b-e98d-4927-b229-480ded52caf4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b9b769b77-nqnbx\" (UID: \"e277ce9b-e98d-4927-b229-480ded52caf4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx" Sep 17 03:22:28.687376 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:28.687293 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgps9\" (UniqueName: \"kubernetes.io/projected/e277ce9b-e98d-4927-b229-480ded52caf4-kube-api-access-sgps9\") pod \"opendatahub-operator-controller-manager-6b9b769b77-nqnbx\" (UID: \"e277ce9b-e98d-4927-b229-480ded52caf4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx" Sep 17 03:22:28.687376 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:28.687319 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e277ce9b-e98d-4927-b229-480ded52caf4-tmp\") pod \"opendatahub-operator-controller-manager-6b9b769b77-nqnbx\" (UID: \"e277ce9b-e98d-4927-b229-480ded52caf4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx" Sep 17 03:22:28.787975 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:28.787945 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e277ce9b-e98d-4927-b229-480ded52caf4-manifests\") pod \"opendatahub-operator-controller-manager-6b9b769b77-nqnbx\" (UID: \"e277ce9b-e98d-4927-b229-480ded52caf4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx" Sep 17 03:22:28.788121 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:28.787983 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e277ce9b-e98d-4927-b229-480ded52caf4-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b9b769b77-nqnbx\" (UID: \"e277ce9b-e98d-4927-b229-480ded52caf4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx" Sep 17 03:22:28.788121 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:28.788008 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e277ce9b-e98d-4927-b229-480ded52caf4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b9b769b77-nqnbx\" (UID: \"e277ce9b-e98d-4927-b229-480ded52caf4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx" Sep 17 03:22:28.788121 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:28.788032 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgps9\" (UniqueName: \"kubernetes.io/projected/e277ce9b-e98d-4927-b229-480ded52caf4-kube-api-access-sgps9\") pod \"opendatahub-operator-controller-manager-6b9b769b77-nqnbx\" (UID: \"e277ce9b-e98d-4927-b229-480ded52caf4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx" Sep 17 03:22:28.788121 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:28.788074 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e277ce9b-e98d-4927-b229-480ded52caf4-tmp\") pod \"opendatahub-operator-controller-manager-6b9b769b77-nqnbx\" (UID: \"e277ce9b-e98d-4927-b229-480ded52caf4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx" Sep 17 03:22:28.788449 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:28.788393 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e277ce9b-e98d-4927-b229-480ded52caf4-manifests\") pod \"opendatahub-operator-controller-manager-6b9b769b77-nqnbx\" (UID: \"e277ce9b-e98d-4927-b229-480ded52caf4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx" Sep 17 03:22:28.790474 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:28.790448 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e277ce9b-e98d-4927-b229-480ded52caf4-tmp\") pod \"opendatahub-operator-controller-manager-6b9b769b77-nqnbx\" (UID: \"e277ce9b-e98d-4927-b229-480ded52caf4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx" Sep 17 03:22:28.790669 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:28.790649 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e277ce9b-e98d-4927-b229-480ded52caf4-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b9b769b77-nqnbx\" (UID: \"e277ce9b-e98d-4927-b229-480ded52caf4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx" Sep 17 03:22:28.790754 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:28.790732 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e277ce9b-e98d-4927-b229-480ded52caf4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b9b769b77-nqnbx\" (UID: \"e277ce9b-e98d-4927-b229-480ded52caf4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx" Sep 17 03:22:28.798019 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:28.797998 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgps9\" (UniqueName: \"kubernetes.io/projected/e277ce9b-e98d-4927-b229-480ded52caf4-kube-api-access-sgps9\") pod \"opendatahub-operator-controller-manager-6b9b769b77-nqnbx\" (UID: \"e277ce9b-e98d-4927-b229-480ded52caf4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx" Sep 17 03:22:28.914966 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:28.914892 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx" Sep 17 03:22:29.192780 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:29.192757 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx"] Sep 17 03:22:29.195364 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:22:29.195338 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode277ce9b_e98d_4927_b229_480ded52caf4.slice/crio-76366bba88fbc73cd9940fcd6a2b2fd0792d140f6c2a2742f53fbc3af543165a WatchSource:0}: Error finding container 76366bba88fbc73cd9940fcd6a2b2fd0792d140f6c2a2742f53fbc3af543165a: Status 404 returned error can't find the container with id 76366bba88fbc73cd9940fcd6a2b2fd0792d140f6c2a2742f53fbc3af543165a Sep 17 03:22:30.017369 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:30.017331 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx" event={"ID":"e277ce9b-e98d-4927-b229-480ded52caf4","Type":"ContainerStarted","Data":"76366bba88fbc73cd9940fcd6a2b2fd0792d140f6c2a2742f53fbc3af543165a"} Sep 17 03:22:33.033348 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:33.033315 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx" event={"ID":"e277ce9b-e98d-4927-b229-480ded52caf4","Type":"ContainerStarted","Data":"d5ad115a44f093f470ed7f2bbec5e9d2a56a94c520c9cc7e0ad6fec2d9274574"} Sep 17 03:22:34.039518 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:34.039453 2574 generic.go:356] "Generic (PLEG): container finished" podID="e277ce9b-e98d-4927-b229-480ded52caf4" containerID="d5ad115a44f093f470ed7f2bbec5e9d2a56a94c520c9cc7e0ad6fec2d9274574" exitCode=0 Sep 17 03:22:34.039518 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:34.039506 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx" event={"ID":"e277ce9b-e98d-4927-b229-480ded52caf4","Type":"ContainerDied","Data":"d5ad115a44f093f470ed7f2bbec5e9d2a56a94c520c9cc7e0ad6fec2d9274574"} Sep 17 03:22:35.045162 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:35.045124 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx" event={"ID":"e277ce9b-e98d-4927-b229-480ded52caf4","Type":"ContainerStarted","Data":"d6faed60ba3a774a9e70781a28806d1d164ae8b76b62b84f5d2a5ac1cde13493"} Sep 17 03:22:35.045565 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:35.045208 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx" Sep 17 03:22:35.068873 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:35.068830 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx" podStartSLOduration=2.298687904 podStartE2EDuration="7.068813894s" totalImagesPullingTime="3.756290598s" totalInitContainerRuntime="1.013835392s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:22:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:22:35.066396572 +0000 UTC m=+595.599907274" watchObservedRunningTime="2026-09-17 03:22:35.068813894 +0000 UTC m=+595.602324666" Sep 17 03:22:46.051585 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:46.051552 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-nqnbx" Sep 17 03:22:46.326979 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:46.326902 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-dd99db947-n6j75"] Sep 17 03:22:46.329955 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:46.329936 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-dd99db947-n6j75" Sep 17 03:22:46.333087 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:46.333066 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 17 03:22:46.333087 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:46.333081 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 17 03:22:46.333310 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:46.333107 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rdcwp\"" Sep 17 03:22:46.333310 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:46.333131 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:22:46.333310 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:46.333132 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 17 03:22:46.333310 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:46.333066 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 17 03:22:46.339878 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:46.339859 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-dd99db947-n6j75"] Sep 17 03:22:46.437143 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:46.437111 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c7469c8-6425-417a-932a-11eb1bc7e2ec-cert\") pod \"lws-controller-manager-dd99db947-n6j75\" (UID: \"6c7469c8-6425-417a-932a-11eb1bc7e2ec\") " pod="openshift-lws-operator/lws-controller-manager-dd99db947-n6j75" Sep 17 03:22:46.437316 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:46.437148 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6c7469c8-6425-417a-932a-11eb1bc7e2ec-manager-config\") pod \"lws-controller-manager-dd99db947-n6j75\" (UID: \"6c7469c8-6425-417a-932a-11eb1bc7e2ec\") " pod="openshift-lws-operator/lws-controller-manager-dd99db947-n6j75" Sep 17 03:22:46.437316 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:46.437216 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcwhf\" (UniqueName: \"kubernetes.io/projected/6c7469c8-6425-417a-932a-11eb1bc7e2ec-kube-api-access-gcwhf\") pod \"lws-controller-manager-dd99db947-n6j75\" (UID: \"6c7469c8-6425-417a-932a-11eb1bc7e2ec\") " pod="openshift-lws-operator/lws-controller-manager-dd99db947-n6j75" Sep 17 03:22:46.437404 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:46.437327 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c7469c8-6425-417a-932a-11eb1bc7e2ec-metrics-cert\") pod \"lws-controller-manager-dd99db947-n6j75\" (UID: \"6c7469c8-6425-417a-932a-11eb1bc7e2ec\") " pod="openshift-lws-operator/lws-controller-manager-dd99db947-n6j75" Sep 17 03:22:46.538228 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:46.538181 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c7469c8-6425-417a-932a-11eb1bc7e2ec-cert\") pod \"lws-controller-manager-dd99db947-n6j75\" (UID: \"6c7469c8-6425-417a-932a-11eb1bc7e2ec\") " pod="openshift-lws-operator/lws-controller-manager-dd99db947-n6j75" Sep 17 03:22:46.538228 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:46.538235 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6c7469c8-6425-417a-932a-11eb1bc7e2ec-manager-config\") pod \"lws-controller-manager-dd99db947-n6j75\" (UID: \"6c7469c8-6425-417a-932a-11eb1bc7e2ec\") " pod="openshift-lws-operator/lws-controller-manager-dd99db947-n6j75" Sep 17 03:22:46.538455 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:46.538272 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcwhf\" (UniqueName: \"kubernetes.io/projected/6c7469c8-6425-417a-932a-11eb1bc7e2ec-kube-api-access-gcwhf\") pod \"lws-controller-manager-dd99db947-n6j75\" (UID: \"6c7469c8-6425-417a-932a-11eb1bc7e2ec\") " pod="openshift-lws-operator/lws-controller-manager-dd99db947-n6j75" Sep 17 03:22:46.538455 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:46.538359 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c7469c8-6425-417a-932a-11eb1bc7e2ec-metrics-cert\") pod \"lws-controller-manager-dd99db947-n6j75\" (UID: \"6c7469c8-6425-417a-932a-11eb1bc7e2ec\") " pod="openshift-lws-operator/lws-controller-manager-dd99db947-n6j75" Sep 17 03:22:46.538932 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:46.538913 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6c7469c8-6425-417a-932a-11eb1bc7e2ec-manager-config\") pod \"lws-controller-manager-dd99db947-n6j75\" (UID: \"6c7469c8-6425-417a-932a-11eb1bc7e2ec\") " pod="openshift-lws-operator/lws-controller-manager-dd99db947-n6j75" Sep 17 03:22:46.540875 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:46.540859 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c7469c8-6425-417a-932a-11eb1bc7e2ec-cert\") pod \"lws-controller-manager-dd99db947-n6j75\" (UID: \"6c7469c8-6425-417a-932a-11eb1bc7e2ec\") " pod="openshift-lws-operator/lws-controller-manager-dd99db947-n6j75" Sep 17 03:22:46.540923 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:46.540902 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c7469c8-6425-417a-932a-11eb1bc7e2ec-metrics-cert\") pod \"lws-controller-manager-dd99db947-n6j75\" (UID: \"6c7469c8-6425-417a-932a-11eb1bc7e2ec\") " pod="openshift-lws-operator/lws-controller-manager-dd99db947-n6j75" Sep 17 03:22:46.546606 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:46.546584 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcwhf\" (UniqueName: \"kubernetes.io/projected/6c7469c8-6425-417a-932a-11eb1bc7e2ec-kube-api-access-gcwhf\") pod \"lws-controller-manager-dd99db947-n6j75\" (UID: \"6c7469c8-6425-417a-932a-11eb1bc7e2ec\") " pod="openshift-lws-operator/lws-controller-manager-dd99db947-n6j75" Sep 17 03:22:46.639331 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:46.639239 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-dd99db947-n6j75" Sep 17 03:22:46.921091 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:46.921066 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-dd99db947-n6j75"] Sep 17 03:22:46.923703 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:22:46.923676 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c7469c8_6425_417a_932a_11eb1bc7e2ec.slice/crio-834031184d9c3afa17a2edd01508c0e27e1c2e80a7adc22bf8dfeb03f3c039c6 WatchSource:0}: Error finding container 834031184d9c3afa17a2edd01508c0e27e1c2e80a7adc22bf8dfeb03f3c039c6: Status 404 returned error can't find the container with id 834031184d9c3afa17a2edd01508c0e27e1c2e80a7adc22bf8dfeb03f3c039c6 Sep 17 03:22:46.925766 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:46.925752 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 03:22:47.104840 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:47.104804 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-dd99db947-n6j75" event={"ID":"6c7469c8-6425-417a-932a-11eb1bc7e2ec","Type":"ContainerStarted","Data":"834031184d9c3afa17a2edd01508c0e27e1c2e80a7adc22bf8dfeb03f3c039c6"} Sep 17 03:22:49.433682 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:49.433651 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b76b6489b-zw7c9"] Sep 17 03:22:49.436965 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:49.436944 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b76b6489b-zw7c9" Sep 17 03:22:49.439763 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:49.439741 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 17 03:22:49.439868 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:49.439742 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 17 03:22:49.441036 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:49.440941 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 17 03:22:49.441036 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:49.440964 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vglhj\"" Sep 17 03:22:49.441036 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:49.441005 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 17 03:22:49.446997 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:49.446975 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b76b6489b-zw7c9"] Sep 17 03:22:49.565818 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:49.565744 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe7d032d-46c3-43ca-a6a8-9c6ece9b74d2-tmp\") pod \"kube-auth-proxy-5b76b6489b-zw7c9\" (UID: \"fe7d032d-46c3-43ca-a6a8-9c6ece9b74d2\") " pod="openshift-ingress/kube-auth-proxy-5b76b6489b-zw7c9" Sep 17 03:22:49.565818 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:49.565807 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kjdz\" (UniqueName: \"kubernetes.io/projected/fe7d032d-46c3-43ca-a6a8-9c6ece9b74d2-kube-api-access-9kjdz\") pod \"kube-auth-proxy-5b76b6489b-zw7c9\" (UID: \"fe7d032d-46c3-43ca-a6a8-9c6ece9b74d2\") " pod="openshift-ingress/kube-auth-proxy-5b76b6489b-zw7c9" Sep 17 03:22:49.565983 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:49.565852 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe7d032d-46c3-43ca-a6a8-9c6ece9b74d2-tls-certs\") pod \"kube-auth-proxy-5b76b6489b-zw7c9\" (UID: \"fe7d032d-46c3-43ca-a6a8-9c6ece9b74d2\") " pod="openshift-ingress/kube-auth-proxy-5b76b6489b-zw7c9" Sep 17 03:22:49.667094 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:49.667063 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe7d032d-46c3-43ca-a6a8-9c6ece9b74d2-tls-certs\") pod \"kube-auth-proxy-5b76b6489b-zw7c9\" (UID: \"fe7d032d-46c3-43ca-a6a8-9c6ece9b74d2\") " pod="openshift-ingress/kube-auth-proxy-5b76b6489b-zw7c9" Sep 17 03:22:49.667246 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:49.667111 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe7d032d-46c3-43ca-a6a8-9c6ece9b74d2-tmp\") pod \"kube-auth-proxy-5b76b6489b-zw7c9\" (UID: \"fe7d032d-46c3-43ca-a6a8-9c6ece9b74d2\") " pod="openshift-ingress/kube-auth-proxy-5b76b6489b-zw7c9" Sep 17 03:22:49.667246 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:49.667158 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kjdz\" (UniqueName: \"kubernetes.io/projected/fe7d032d-46c3-43ca-a6a8-9c6ece9b74d2-kube-api-access-9kjdz\") pod \"kube-auth-proxy-5b76b6489b-zw7c9\" (UID: \"fe7d032d-46c3-43ca-a6a8-9c6ece9b74d2\") " pod="openshift-ingress/kube-auth-proxy-5b76b6489b-zw7c9" Sep 17 03:22:49.669643 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:49.669616 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe7d032d-46c3-43ca-a6a8-9c6ece9b74d2-tmp\") pod \"kube-auth-proxy-5b76b6489b-zw7c9\" (UID: \"fe7d032d-46c3-43ca-a6a8-9c6ece9b74d2\") " pod="openshift-ingress/kube-auth-proxy-5b76b6489b-zw7c9" Sep 17 03:22:49.669844 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:49.669828 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe7d032d-46c3-43ca-a6a8-9c6ece9b74d2-tls-certs\") pod \"kube-auth-proxy-5b76b6489b-zw7c9\" (UID: \"fe7d032d-46c3-43ca-a6a8-9c6ece9b74d2\") " pod="openshift-ingress/kube-auth-proxy-5b76b6489b-zw7c9" Sep 17 03:22:49.675731 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:49.675712 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kjdz\" (UniqueName: \"kubernetes.io/projected/fe7d032d-46c3-43ca-a6a8-9c6ece9b74d2-kube-api-access-9kjdz\") pod \"kube-auth-proxy-5b76b6489b-zw7c9\" (UID: \"fe7d032d-46c3-43ca-a6a8-9c6ece9b74d2\") " pod="openshift-ingress/kube-auth-proxy-5b76b6489b-zw7c9" Sep 17 03:22:49.747385 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:49.747359 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b76b6489b-zw7c9" Sep 17 03:22:50.019869 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:50.019648 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b76b6489b-zw7c9"] Sep 17 03:22:50.022407 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:22:50.022377 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe7d032d_46c3_43ca_a6a8_9c6ece9b74d2.slice/crio-5a585a21fafae7081141f54ee05753c95a672f7728e23989afb9d266e5daeaf2 WatchSource:0}: Error finding container 5a585a21fafae7081141f54ee05753c95a672f7728e23989afb9d266e5daeaf2: Status 404 returned error can't find the container with id 5a585a21fafae7081141f54ee05753c95a672f7728e23989afb9d266e5daeaf2 Sep 17 03:22:50.120756 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:50.120720 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-dd99db947-n6j75" event={"ID":"6c7469c8-6425-417a-932a-11eb1bc7e2ec","Type":"ContainerStarted","Data":"06e456ea0b202995bfcf31c59da7b56a7a05b550945ba1d46c7dce96324b0f4d"} Sep 17 03:22:50.120965 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:50.120831 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-dd99db947-n6j75" Sep 17 03:22:50.121964 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:50.121944 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b76b6489b-zw7c9" event={"ID":"fe7d032d-46c3-43ca-a6a8-9c6ece9b74d2","Type":"ContainerStarted","Data":"5a585a21fafae7081141f54ee05753c95a672f7728e23989afb9d266e5daeaf2"} Sep 17 03:22:50.151319 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:50.151266 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-dd99db947-n6j75" podStartSLOduration=1.835406841 podStartE2EDuration="4.151250798s" totalImagesPullingTime="2.315843957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:22:50.148720384 +0000 UTC m=+610.682231084" watchObservedRunningTime="2026-09-17 03:22:50.151250798 +0000 UTC m=+610.684761499" Sep 17 03:22:53.139262 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:53.139170 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b76b6489b-zw7c9" event={"ID":"fe7d032d-46c3-43ca-a6a8-9c6ece9b74d2","Type":"ContainerStarted","Data":"aab252b0053eb6325f96abe13c209149de9b14ab621a2201e22a75dac6be116e"} Sep 17 03:22:53.158307 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:22:53.158246 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b76b6489b-zw7c9" podStartSLOduration=1.303147493 podStartE2EDuration="4.158229653s" totalImagesPullingTime="2.85508216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:22:53.156964933 +0000 UTC m=+613.690475634" watchObservedRunningTime="2026-09-17 03:22:53.158229653 +0000 UTC m=+613.691740354" Sep 17 03:23:01.129981 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:23:01.129904 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-dd99db947-n6j75" Sep 17 03:24:25.881256 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:25.881214 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-n77pb"] Sep 17 03:24:25.884757 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:25.884736 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-n77pb" Sep 17 03:24:25.887738 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:25.887714 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 17 03:24:25.887820 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:25.887758 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-zc79k\"" Sep 17 03:24:25.889021 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:25.889008 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 17 03:24:25.905015 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:25.904992 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-n77pb"] Sep 17 03:24:26.025926 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:26.025896 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6zg8\" (UniqueName: \"kubernetes.io/projected/2c29998a-70b7-4ab6-819b-5ecb84060458-kube-api-access-z6zg8\") pod \"authorino-operator-76b478bd78-n77pb\" (UID: \"2c29998a-70b7-4ab6-819b-5ecb84060458\") " pod="kuadrant-system/authorino-operator-76b478bd78-n77pb" Sep 17 03:24:26.126586 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:26.126557 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6zg8\" (UniqueName: \"kubernetes.io/projected/2c29998a-70b7-4ab6-819b-5ecb84060458-kube-api-access-z6zg8\") pod \"authorino-operator-76b478bd78-n77pb\" (UID: \"2c29998a-70b7-4ab6-819b-5ecb84060458\") " pod="kuadrant-system/authorino-operator-76b478bd78-n77pb" Sep 17 03:24:26.140660 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:26.140611 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6zg8\" (UniqueName: \"kubernetes.io/projected/2c29998a-70b7-4ab6-819b-5ecb84060458-kube-api-access-z6zg8\") pod \"authorino-operator-76b478bd78-n77pb\" (UID: \"2c29998a-70b7-4ab6-819b-5ecb84060458\") " pod="kuadrant-system/authorino-operator-76b478bd78-n77pb" Sep 17 03:24:26.195540 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:26.195507 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-n77pb" Sep 17 03:24:26.469363 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:26.469298 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-n77pb"] Sep 17 03:24:26.473616 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:24:26.473576 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c29998a_70b7_4ab6_819b_5ecb84060458.slice/crio-8160d2c8810c28d3a754c462fb1b862ffdc5c7036d7404a2240f79506dc35ea4 WatchSource:0}: Error finding container 8160d2c8810c28d3a754c462fb1b862ffdc5c7036d7404a2240f79506dc35ea4: Status 404 returned error can't find the container with id 8160d2c8810c28d3a754c462fb1b862ffdc5c7036d7404a2240f79506dc35ea4 Sep 17 03:24:26.552645 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:26.552610 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-n77pb" event={"ID":"2c29998a-70b7-4ab6-819b-5ecb84060458","Type":"ContainerStarted","Data":"8160d2c8810c28d3a754c462fb1b862ffdc5c7036d7404a2240f79506dc35ea4"} Sep 17 03:24:29.568355 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:29.568318 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-n77pb" event={"ID":"2c29998a-70b7-4ab6-819b-5ecb84060458","Type":"ContainerStarted","Data":"97d647ae0244bda86cf799e3e4d8b215b65457ca7e5fd4a43c1001e5da5ae3d8"} Sep 17 03:24:29.568782 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:29.568465 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-n77pb" Sep 17 03:24:29.585896 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:29.585852 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-n77pb" podStartSLOduration=2.228116033 podStartE2EDuration="4.585837249s" totalImagesPullingTime="2.357721216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:24:29.584249843 +0000 UTC m=+710.117760544" watchObservedRunningTime="2026-09-17 03:24:29.585837249 +0000 UTC m=+710.119347950" Sep 17 03:24:40.576603 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:40.576532 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-n77pb" Sep 17 03:24:41.737763 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:41.737716 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2fdkz"] Sep 17 03:24:41.741315 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:41.741294 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2fdkz" Sep 17 03:24:41.744006 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:41.743981 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-k4b22\"" Sep 17 03:24:41.754252 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:41.754227 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2fdkz"] Sep 17 03:24:41.765069 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:41.765048 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c42de0b-75a5-49ec-95e9-3a43abf4f64d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-2fdkz\" (UID: \"1c42de0b-75a5-49ec-95e9-3a43abf4f64d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2fdkz" Sep 17 03:24:41.765174 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:41.765079 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn94w\" (UniqueName: \"kubernetes.io/projected/1c42de0b-75a5-49ec-95e9-3a43abf4f64d-kube-api-access-xn94w\") pod \"kuadrant-operator-controller-manager-5f685c496f-2fdkz\" (UID: \"1c42de0b-75a5-49ec-95e9-3a43abf4f64d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2fdkz" Sep 17 03:24:41.865709 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:41.865674 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c42de0b-75a5-49ec-95e9-3a43abf4f64d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-2fdkz\" (UID: \"1c42de0b-75a5-49ec-95e9-3a43abf4f64d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2fdkz" Sep 17 03:24:41.865709 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:41.865709 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn94w\" (UniqueName: \"kubernetes.io/projected/1c42de0b-75a5-49ec-95e9-3a43abf4f64d-kube-api-access-xn94w\") pod \"kuadrant-operator-controller-manager-5f685c496f-2fdkz\" (UID: \"1c42de0b-75a5-49ec-95e9-3a43abf4f64d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2fdkz" Sep 17 03:24:41.866061 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:41.866040 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c42de0b-75a5-49ec-95e9-3a43abf4f64d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-2fdkz\" (UID: \"1c42de0b-75a5-49ec-95e9-3a43abf4f64d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2fdkz" Sep 17 03:24:41.895935 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:41.895910 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn94w\" (UniqueName: \"kubernetes.io/projected/1c42de0b-75a5-49ec-95e9-3a43abf4f64d-kube-api-access-xn94w\") pod \"kuadrant-operator-controller-manager-5f685c496f-2fdkz\" (UID: \"1c42de0b-75a5-49ec-95e9-3a43abf4f64d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2fdkz" Sep 17 03:24:42.052041 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:42.051952 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2fdkz" Sep 17 03:24:42.341405 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:42.341378 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2fdkz"] Sep 17 03:24:42.342919 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:24:42.342888 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c42de0b_75a5_49ec_95e9_3a43abf4f64d.slice/crio-83d84aaae5fae4ba3c866928c5426d727274ac17902f160a2cc3039cec57339c WatchSource:0}: Error finding container 83d84aaae5fae4ba3c866928c5426d727274ac17902f160a2cc3039cec57339c: Status 404 returned error can't find the container with id 83d84aaae5fae4ba3c866928c5426d727274ac17902f160a2cc3039cec57339c Sep 17 03:24:42.636086 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:42.636005 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2fdkz" event={"ID":"1c42de0b-75a5-49ec-95e9-3a43abf4f64d","Type":"ContainerStarted","Data":"83d84aaae5fae4ba3c866928c5426d727274ac17902f160a2cc3039cec57339c"} Sep 17 03:24:46.659514 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:46.659478 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2fdkz" event={"ID":"1c42de0b-75a5-49ec-95e9-3a43abf4f64d","Type":"ContainerStarted","Data":"d2bf28395858877b23eef263ec9761152171ec69cb37734273f227be54dca10a"} Sep 17 03:24:46.659990 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:46.659552 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2fdkz" Sep 17 03:24:57.666952 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:57.666924 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2fdkz" Sep 17 03:24:57.691996 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:24:57.691946 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2fdkz" podStartSLOduration=12.919325062 podStartE2EDuration="16.691932736s" totalImagesPullingTime="3.772607674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:24:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:24:46.682036428 +0000 UTC m=+727.215547131" watchObservedRunningTime="2026-09-17 03:24:57.691932736 +0000 UTC m=+738.225443438" Sep 17 03:25:09.839693 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:09.839658 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2fdkz"] Sep 17 03:25:09.840041 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:09.839848 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2fdkz" podUID="1c42de0b-75a5-49ec-95e9-3a43abf4f64d" containerName="manager" containerID="cri-o://d2bf28395858877b23eef263ec9761152171ec69cb37734273f227be54dca10a" gracePeriod=10 Sep 17 03:25:10.083055 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:10.083032 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2fdkz" Sep 17 03:25:10.223940 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:10.223907 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xn94w\" (UniqueName: \"kubernetes.io/projected/1c42de0b-75a5-49ec-95e9-3a43abf4f64d-kube-api-access-xn94w\") pod \"1c42de0b-75a5-49ec-95e9-3a43abf4f64d\" (UID: \"1c42de0b-75a5-49ec-95e9-3a43abf4f64d\") " Sep 17 03:25:10.224117 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:10.223951 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c42de0b-75a5-49ec-95e9-3a43abf4f64d-extensions-socket-volume\") pod \"1c42de0b-75a5-49ec-95e9-3a43abf4f64d\" (UID: \"1c42de0b-75a5-49ec-95e9-3a43abf4f64d\") " Sep 17 03:25:10.224407 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:10.224385 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c42de0b-75a5-49ec-95e9-3a43abf4f64d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1c42de0b-75a5-49ec-95e9-3a43abf4f64d" (UID: "1c42de0b-75a5-49ec-95e9-3a43abf4f64d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:25:10.226304 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:10.226277 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c42de0b-75a5-49ec-95e9-3a43abf4f64d-kube-api-access-xn94w" (OuterVolumeSpecName: "kube-api-access-xn94w") pod "1c42de0b-75a5-49ec-95e9-3a43abf4f64d" (UID: "1c42de0b-75a5-49ec-95e9-3a43abf4f64d"). InnerVolumeSpecName "kube-api-access-xn94w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:25:10.324776 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:10.324744 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xn94w\" (UniqueName: \"kubernetes.io/projected/1c42de0b-75a5-49ec-95e9-3a43abf4f64d-kube-api-access-xn94w\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:25:10.324776 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:10.324770 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c42de0b-75a5-49ec-95e9-3a43abf4f64d-extensions-socket-volume\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:25:10.773000 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:10.772967 2574 generic.go:356] "Generic (PLEG): container finished" podID="1c42de0b-75a5-49ec-95e9-3a43abf4f64d" containerID="d2bf28395858877b23eef263ec9761152171ec69cb37734273f227be54dca10a" exitCode=0 Sep 17 03:25:10.773208 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:10.773009 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2fdkz" Sep 17 03:25:10.773208 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:10.773036 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2fdkz" event={"ID":"1c42de0b-75a5-49ec-95e9-3a43abf4f64d","Type":"ContainerDied","Data":"d2bf28395858877b23eef263ec9761152171ec69cb37734273f227be54dca10a"} Sep 17 03:25:10.773208 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:10.773099 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2fdkz" event={"ID":"1c42de0b-75a5-49ec-95e9-3a43abf4f64d","Type":"ContainerDied","Data":"83d84aaae5fae4ba3c866928c5426d727274ac17902f160a2cc3039cec57339c"} Sep 17 03:25:10.773208 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:10.773130 2574 scope.go:117] "RemoveContainer" containerID="d2bf28395858877b23eef263ec9761152171ec69cb37734273f227be54dca10a" Sep 17 03:25:10.782020 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:10.782005 2574 scope.go:117] "RemoveContainer" containerID="d2bf28395858877b23eef263ec9761152171ec69cb37734273f227be54dca10a" Sep 17 03:25:10.782289 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:25:10.782268 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2bf28395858877b23eef263ec9761152171ec69cb37734273f227be54dca10a\": container with ID starting with d2bf28395858877b23eef263ec9761152171ec69cb37734273f227be54dca10a not found: ID does not exist" containerID="d2bf28395858877b23eef263ec9761152171ec69cb37734273f227be54dca10a" Sep 17 03:25:10.782336 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:10.782290 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2bf28395858877b23eef263ec9761152171ec69cb37734273f227be54dca10a"} err="failed to get container status \"d2bf28395858877b23eef263ec9761152171ec69cb37734273f227be54dca10a\": rpc error: code = NotFound desc = could not find container \"d2bf28395858877b23eef263ec9761152171ec69cb37734273f227be54dca10a\": container with ID starting with d2bf28395858877b23eef263ec9761152171ec69cb37734273f227be54dca10a not found: ID does not exist" Sep 17 03:25:10.804069 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:10.804038 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2fdkz"] Sep 17 03:25:10.808025 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:10.807999 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-2fdkz"] Sep 17 03:25:11.899976 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:11.899944 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c42de0b-75a5-49ec-95e9-3a43abf4f64d" path="/var/lib/kubelet/pods/1c42de0b-75a5-49ec-95e9-3a43abf4f64d/volumes" Sep 17 03:25:28.093054 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.093022 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-92pgf"] Sep 17 03:25:28.093452 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.093349 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c42de0b-75a5-49ec-95e9-3a43abf4f64d" containerName="manager" Sep 17 03:25:28.093452 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.093359 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c42de0b-75a5-49ec-95e9-3a43abf4f64d" containerName="manager" Sep 17 03:25:28.093452 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.093447 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c42de0b-75a5-49ec-95e9-3a43abf4f64d" containerName="manager" Sep 17 03:25:28.096276 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.096261 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-92pgf" Sep 17 03:25:28.099154 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.099134 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9thlg\"" Sep 17 03:25:28.099271 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.099138 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 17 03:25:28.104803 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.104781 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-92pgf"] Sep 17 03:25:28.135511 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.135473 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-92pgf"] Sep 17 03:25:28.178311 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.178281 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b0f91f11-d888-4bf3-9b6f-25e1c284ba19-config-file\") pod \"limitador-limitador-84994f7ffc-92pgf\" (UID: \"b0f91f11-d888-4bf3-9b6f-25e1c284ba19\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-92pgf" Sep 17 03:25:28.178461 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.178380 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28h8n\" (UniqueName: \"kubernetes.io/projected/b0f91f11-d888-4bf3-9b6f-25e1c284ba19-kube-api-access-28h8n\") pod \"limitador-limitador-84994f7ffc-92pgf\" (UID: \"b0f91f11-d888-4bf3-9b6f-25e1c284ba19\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-92pgf" Sep 17 03:25:28.279263 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.279230 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b0f91f11-d888-4bf3-9b6f-25e1c284ba19-config-file\") pod \"limitador-limitador-84994f7ffc-92pgf\" (UID: \"b0f91f11-d888-4bf3-9b6f-25e1c284ba19\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-92pgf" Sep 17 03:25:28.279412 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.279315 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28h8n\" (UniqueName: \"kubernetes.io/projected/b0f91f11-d888-4bf3-9b6f-25e1c284ba19-kube-api-access-28h8n\") pod \"limitador-limitador-84994f7ffc-92pgf\" (UID: \"b0f91f11-d888-4bf3-9b6f-25e1c284ba19\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-92pgf" Sep 17 03:25:28.279820 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.279801 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b0f91f11-d888-4bf3-9b6f-25e1c284ba19-config-file\") pod \"limitador-limitador-84994f7ffc-92pgf\" (UID: \"b0f91f11-d888-4bf3-9b6f-25e1c284ba19\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-92pgf" Sep 17 03:25:28.288501 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.288482 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28h8n\" (UniqueName: \"kubernetes.io/projected/b0f91f11-d888-4bf3-9b6f-25e1c284ba19-kube-api-access-28h8n\") pod \"limitador-limitador-84994f7ffc-92pgf\" (UID: \"b0f91f11-d888-4bf3-9b6f-25e1c284ba19\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-92pgf" Sep 17 03:25:28.405465 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.405367 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-9g2k5"] Sep 17 03:25:28.407976 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.407955 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-9g2k5" Sep 17 03:25:28.408054 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.407979 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-92pgf" Sep 17 03:25:28.410750 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.410731 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lhlnk\"" Sep 17 03:25:28.415741 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.415718 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-9g2k5"] Sep 17 03:25:28.481762 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.481733 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqhss\" (UniqueName: \"kubernetes.io/projected/e16a48f9-1b7d-4027-b59c-2c0b627e3bb9-kube-api-access-cqhss\") pod \"authorino-7bcfd8f9cd-9g2k5\" (UID: \"e16a48f9-1b7d-4027-b59c-2c0b627e3bb9\") " pod="kuadrant-system/authorino-7bcfd8f9cd-9g2k5" Sep 17 03:25:28.583124 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.583091 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqhss\" (UniqueName: \"kubernetes.io/projected/e16a48f9-1b7d-4027-b59c-2c0b627e3bb9-kube-api-access-cqhss\") pod \"authorino-7bcfd8f9cd-9g2k5\" (UID: \"e16a48f9-1b7d-4027-b59c-2c0b627e3bb9\") " pod="kuadrant-system/authorino-7bcfd8f9cd-9g2k5" Sep 17 03:25:28.591306 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.591277 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqhss\" (UniqueName: \"kubernetes.io/projected/e16a48f9-1b7d-4027-b59c-2c0b627e3bb9-kube-api-access-cqhss\") pod \"authorino-7bcfd8f9cd-9g2k5\" (UID: \"e16a48f9-1b7d-4027-b59c-2c0b627e3bb9\") " pod="kuadrant-system/authorino-7bcfd8f9cd-9g2k5" Sep 17 03:25:28.681388 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.681363 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-92pgf"] Sep 17 03:25:28.684115 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:25:28.684091 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0f91f11_d888_4bf3_9b6f_25e1c284ba19.slice/crio-052f5141e0ebd20ddbbec06d34718a659679203ae9bad5cad3db3f74e7d53a2d WatchSource:0}: Error finding container 052f5141e0ebd20ddbbec06d34718a659679203ae9bad5cad3db3f74e7d53a2d: Status 404 returned error can't find the container with id 052f5141e0ebd20ddbbec06d34718a659679203ae9bad5cad3db3f74e7d53a2d Sep 17 03:25:28.731916 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.731893 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-9g2k5" Sep 17 03:25:28.858308 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:28.858274 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-92pgf" event={"ID":"b0f91f11-d888-4bf3-9b6f-25e1c284ba19","Type":"ContainerStarted","Data":"052f5141e0ebd20ddbbec06d34718a659679203ae9bad5cad3db3f74e7d53a2d"} Sep 17 03:25:29.001739 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:29.001715 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-9g2k5"] Sep 17 03:25:29.004083 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:25:29.004058 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode16a48f9_1b7d_4027_b59c_2c0b627e3bb9.slice/crio-425c0d3968549d9b925a1a2a8f356492445ba464f943eb668fc52a84f3a144ed WatchSource:0}: Error finding container 425c0d3968549d9b925a1a2a8f356492445ba464f943eb668fc52a84f3a144ed: Status 404 returned error can't find the container with id 425c0d3968549d9b925a1a2a8f356492445ba464f943eb668fc52a84f3a144ed Sep 17 03:25:29.864376 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:29.864285 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-92pgf" event={"ID":"b0f91f11-d888-4bf3-9b6f-25e1c284ba19","Type":"ContainerStarted","Data":"e0af60864c4000db47f3b92729e68962e85f5e2fb0f9b33e318369b5677c6592"} Sep 17 03:25:29.864376 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:29.864338 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-92pgf" Sep 17 03:25:29.865486 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:29.865460 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-9g2k5" event={"ID":"e16a48f9-1b7d-4027-b59c-2c0b627e3bb9","Type":"ContainerStarted","Data":"425c0d3968549d9b925a1a2a8f356492445ba464f943eb668fc52a84f3a144ed"} Sep 17 03:25:29.881740 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:29.881692 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-92pgf" podStartSLOduration=0.973374434 podStartE2EDuration="1.881677575s" totalImagesPullingTime="908.303141ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:25:29.881317751 +0000 UTC m=+770.414828455" watchObservedRunningTime="2026-09-17 03:25:29.881677575 +0000 UTC m=+770.415188286" Sep 17 03:25:31.726437 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:31.726385 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-9g2k5"] Sep 17 03:25:31.877314 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:31.877276 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-9g2k5" event={"ID":"e16a48f9-1b7d-4027-b59c-2c0b627e3bb9","Type":"ContainerStarted","Data":"303749401a7e2e8d9078abb8b451fecfe0eae4873c4338ad7f3917993abc2fb3"} Sep 17 03:25:31.891688 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:31.891633 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-9g2k5" podStartSLOduration=1.582762214 podStartE2EDuration="3.891615815s" totalImagesPullingTime="2.308853601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:25:31.891211593 +0000 UTC m=+772.424722295" watchObservedRunningTime="2026-09-17 03:25:31.891615815 +0000 UTC m=+772.425126518" Sep 17 03:25:32.887460 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:32.883372 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-9g2k5" podUID="e16a48f9-1b7d-4027-b59c-2c0b627e3bb9" containerName="authorino" containerID="cri-o://303749401a7e2e8d9078abb8b451fecfe0eae4873c4338ad7f3917993abc2fb3" gracePeriod=30 Sep 17 03:25:33.130088 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:33.130065 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-9g2k5" Sep 17 03:25:33.225937 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:33.225911 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqhss\" (UniqueName: \"kubernetes.io/projected/e16a48f9-1b7d-4027-b59c-2c0b627e3bb9-kube-api-access-cqhss\") pod \"e16a48f9-1b7d-4027-b59c-2c0b627e3bb9\" (UID: \"e16a48f9-1b7d-4027-b59c-2c0b627e3bb9\") " Sep 17 03:25:33.228042 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:33.228019 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e16a48f9-1b7d-4027-b59c-2c0b627e3bb9-kube-api-access-cqhss" (OuterVolumeSpecName: "kube-api-access-cqhss") pod "e16a48f9-1b7d-4027-b59c-2c0b627e3bb9" (UID: "e16a48f9-1b7d-4027-b59c-2c0b627e3bb9"). InnerVolumeSpecName "kube-api-access-cqhss". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:25:33.326920 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:33.326884 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqhss\" (UniqueName: \"kubernetes.io/projected/e16a48f9-1b7d-4027-b59c-2c0b627e3bb9-kube-api-access-cqhss\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:25:33.889299 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:33.889262 2574 generic.go:356] "Generic (PLEG): container finished" podID="e16a48f9-1b7d-4027-b59c-2c0b627e3bb9" containerID="303749401a7e2e8d9078abb8b451fecfe0eae4873c4338ad7f3917993abc2fb3" exitCode=0 Sep 17 03:25:33.889771 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:33.889315 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-9g2k5" Sep 17 03:25:33.889771 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:33.889339 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-9g2k5" event={"ID":"e16a48f9-1b7d-4027-b59c-2c0b627e3bb9","Type":"ContainerDied","Data":"303749401a7e2e8d9078abb8b451fecfe0eae4873c4338ad7f3917993abc2fb3"} Sep 17 03:25:33.889771 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:33.889381 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-9g2k5" event={"ID":"e16a48f9-1b7d-4027-b59c-2c0b627e3bb9","Type":"ContainerDied","Data":"425c0d3968549d9b925a1a2a8f356492445ba464f943eb668fc52a84f3a144ed"} Sep 17 03:25:33.889771 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:33.889397 2574 scope.go:117] "RemoveContainer" containerID="303749401a7e2e8d9078abb8b451fecfe0eae4873c4338ad7f3917993abc2fb3" Sep 17 03:25:33.898349 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:33.898334 2574 scope.go:117] "RemoveContainer" containerID="303749401a7e2e8d9078abb8b451fecfe0eae4873c4338ad7f3917993abc2fb3" Sep 17 03:25:33.898632 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:25:33.898611 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"303749401a7e2e8d9078abb8b451fecfe0eae4873c4338ad7f3917993abc2fb3\": container with ID starting with 303749401a7e2e8d9078abb8b451fecfe0eae4873c4338ad7f3917993abc2fb3 not found: ID does not exist" containerID="303749401a7e2e8d9078abb8b451fecfe0eae4873c4338ad7f3917993abc2fb3" Sep 17 03:25:33.898721 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:33.898639 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"303749401a7e2e8d9078abb8b451fecfe0eae4873c4338ad7f3917993abc2fb3"} err="failed to get container status \"303749401a7e2e8d9078abb8b451fecfe0eae4873c4338ad7f3917993abc2fb3\": rpc error: code = NotFound desc = could not find container \"303749401a7e2e8d9078abb8b451fecfe0eae4873c4338ad7f3917993abc2fb3\": container with ID starting with 303749401a7e2e8d9078abb8b451fecfe0eae4873c4338ad7f3917993abc2fb3 not found: ID does not exist" Sep 17 03:25:33.911731 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:33.911708 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-9g2k5"] Sep 17 03:25:33.918061 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:33.918039 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-9g2k5"] Sep 17 03:25:35.897589 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:35.897555 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e16a48f9-1b7d-4027-b59c-2c0b627e3bb9" path="/var/lib/kubelet/pods/e16a48f9-1b7d-4027-b59c-2c0b627e3bb9/volumes" Sep 17 03:25:40.873145 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:40.873108 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-92pgf" Sep 17 03:25:56.721077 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:56.721038 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-gm2q9"] Sep 17 03:25:56.721602 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:56.721413 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e16a48f9-1b7d-4027-b59c-2c0b627e3bb9" containerName="authorino" Sep 17 03:25:56.721602 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:56.721442 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e16a48f9-1b7d-4027-b59c-2c0b627e3bb9" containerName="authorino" Sep 17 03:25:56.721602 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:56.721531 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e16a48f9-1b7d-4027-b59c-2c0b627e3bb9" containerName="authorino" Sep 17 03:25:56.724113 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:56.724096 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-gm2q9" Sep 17 03:25:56.726692 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:56.726669 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lhlnk\"" Sep 17 03:25:56.731134 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:56.731106 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-gm2q9"] Sep 17 03:25:56.731743 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:56.731562 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k5vh\" (UniqueName: \"kubernetes.io/projected/1e975fd3-2eb6-4be6-8b56-93a8c0b8303c-kube-api-access-7k5vh\") pod \"authorino-557f876f69-gm2q9\" (UID: \"1e975fd3-2eb6-4be6-8b56-93a8c0b8303c\") " pod="kuadrant-system/authorino-557f876f69-gm2q9" Sep 17 03:25:56.832806 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:56.832773 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k5vh\" (UniqueName: \"kubernetes.io/projected/1e975fd3-2eb6-4be6-8b56-93a8c0b8303c-kube-api-access-7k5vh\") pod \"authorino-557f876f69-gm2q9\" (UID: \"1e975fd3-2eb6-4be6-8b56-93a8c0b8303c\") " pod="kuadrant-system/authorino-557f876f69-gm2q9" Sep 17 03:25:56.841447 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:56.841407 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k5vh\" (UniqueName: \"kubernetes.io/projected/1e975fd3-2eb6-4be6-8b56-93a8c0b8303c-kube-api-access-7k5vh\") pod \"authorino-557f876f69-gm2q9\" (UID: \"1e975fd3-2eb6-4be6-8b56-93a8c0b8303c\") " pod="kuadrant-system/authorino-557f876f69-gm2q9" Sep 17 03:25:56.859619 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:56.859587 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-gm2q9"] Sep 17 03:25:56.859847 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:56.859835 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-gm2q9" Sep 17 03:25:56.886061 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:56.886031 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-9gjqd"] Sep 17 03:25:56.888707 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:56.888682 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-9gjqd" Sep 17 03:25:56.891319 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:56.891289 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 17 03:25:56.898644 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:56.898505 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-9gjqd"] Sep 17 03:25:56.967369 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:56.967337 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-9gjqd"] Sep 17 03:25:56.967662 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:25:56.967640 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-67tbc tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-9gjqd" podUID="062e16cf-fc95-4a2a-b209-3f2001c50792" Sep 17 03:25:56.989951 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:56.989880 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-9gjqd" Sep 17 03:25:56.995991 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:56.995969 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-9gjqd" Sep 17 03:25:57.036062 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:57.036034 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/062e16cf-fc95-4a2a-b209-3f2001c50792-tls-cert\") pod \"authorino-6d4dfc649f-9gjqd\" (UID: \"062e16cf-fc95-4a2a-b209-3f2001c50792\") " pod="kuadrant-system/authorino-6d4dfc649f-9gjqd" Sep 17 03:25:57.036211 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:57.036065 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67tbc\" (UniqueName: \"kubernetes.io/projected/062e16cf-fc95-4a2a-b209-3f2001c50792-kube-api-access-67tbc\") pod \"authorino-6d4dfc649f-9gjqd\" (UID: \"062e16cf-fc95-4a2a-b209-3f2001c50792\") " pod="kuadrant-system/authorino-6d4dfc649f-9gjqd" Sep 17 03:25:57.137279 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:57.137242 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/062e16cf-fc95-4a2a-b209-3f2001c50792-tls-cert\") pod \"authorino-6d4dfc649f-9gjqd\" (UID: \"062e16cf-fc95-4a2a-b209-3f2001c50792\") " pod="kuadrant-system/authorino-6d4dfc649f-9gjqd" Sep 17 03:25:57.137486 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:57.137296 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67tbc\" (UniqueName: \"kubernetes.io/projected/062e16cf-fc95-4a2a-b209-3f2001c50792-kube-api-access-67tbc\") pod \"authorino-6d4dfc649f-9gjqd\" (UID: \"062e16cf-fc95-4a2a-b209-3f2001c50792\") " pod="kuadrant-system/authorino-6d4dfc649f-9gjqd" Sep 17 03:25:57.138946 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:57.138918 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-gm2q9"] Sep 17 03:25:57.140401 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:57.140379 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/062e16cf-fc95-4a2a-b209-3f2001c50792-tls-cert\") pod \"authorino-6d4dfc649f-9gjqd\" (UID: \"062e16cf-fc95-4a2a-b209-3f2001c50792\") " pod="kuadrant-system/authorino-6d4dfc649f-9gjqd" Sep 17 03:25:57.141690 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:25:57.141669 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e975fd3_2eb6_4be6_8b56_93a8c0b8303c.slice/crio-dbfdc196b2fd425f5dc3b554e684820295cf41a72e4ee3d65cbee7df03b56dff WatchSource:0}: Error finding container dbfdc196b2fd425f5dc3b554e684820295cf41a72e4ee3d65cbee7df03b56dff: Status 404 returned error can't find the container with id dbfdc196b2fd425f5dc3b554e684820295cf41a72e4ee3d65cbee7df03b56dff Sep 17 03:25:57.145360 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:57.145336 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67tbc\" (UniqueName: \"kubernetes.io/projected/062e16cf-fc95-4a2a-b209-3f2001c50792-kube-api-access-67tbc\") pod \"authorino-6d4dfc649f-9gjqd\" (UID: \"062e16cf-fc95-4a2a-b209-3f2001c50792\") " pod="kuadrant-system/authorino-6d4dfc649f-9gjqd" Sep 17 03:25:57.238555 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:57.238513 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/062e16cf-fc95-4a2a-b209-3f2001c50792-tls-cert\") pod \"062e16cf-fc95-4a2a-b209-3f2001c50792\" (UID: \"062e16cf-fc95-4a2a-b209-3f2001c50792\") " Sep 17 03:25:57.238726 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:57.238571 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67tbc\" (UniqueName: \"kubernetes.io/projected/062e16cf-fc95-4a2a-b209-3f2001c50792-kube-api-access-67tbc\") pod \"062e16cf-fc95-4a2a-b209-3f2001c50792\" (UID: \"062e16cf-fc95-4a2a-b209-3f2001c50792\") " Sep 17 03:25:57.240880 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:57.240819 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/062e16cf-fc95-4a2a-b209-3f2001c50792-kube-api-access-67tbc" (OuterVolumeSpecName: "kube-api-access-67tbc") pod "062e16cf-fc95-4a2a-b209-3f2001c50792" (UID: "062e16cf-fc95-4a2a-b209-3f2001c50792"). InnerVolumeSpecName "kube-api-access-67tbc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:25:57.240964 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:57.240887 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/062e16cf-fc95-4a2a-b209-3f2001c50792-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "062e16cf-fc95-4a2a-b209-3f2001c50792" (UID: "062e16cf-fc95-4a2a-b209-3f2001c50792"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:25:57.339983 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:57.339944 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67tbc\" (UniqueName: \"kubernetes.io/projected/062e16cf-fc95-4a2a-b209-3f2001c50792-kube-api-access-67tbc\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:25:57.339983 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:57.339973 2574 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/062e16cf-fc95-4a2a-b209-3f2001c50792-tls-cert\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:25:57.996959 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:57.996928 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-9gjqd" Sep 17 03:25:57.997374 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:57.996957 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-557f876f69-gm2q9" podUID="1e975fd3-2eb6-4be6-8b56-93a8c0b8303c" containerName="authorino" containerID="cri-o://7a2fe5ca4e9123bb3d36ca2c3d0d43df8b041c76452fa244f554425f34d0e628" gracePeriod=30 Sep 17 03:25:57.997374 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:57.996929 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-gm2q9" event={"ID":"1e975fd3-2eb6-4be6-8b56-93a8c0b8303c","Type":"ContainerStarted","Data":"7a2fe5ca4e9123bb3d36ca2c3d0d43df8b041c76452fa244f554425f34d0e628"} Sep 17 03:25:57.997374 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:57.997051 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-gm2q9" event={"ID":"1e975fd3-2eb6-4be6-8b56-93a8c0b8303c","Type":"ContainerStarted","Data":"dbfdc196b2fd425f5dc3b554e684820295cf41a72e4ee3d65cbee7df03b56dff"} Sep 17 03:25:58.012247 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:58.012200 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-557f876f69-gm2q9" podStartSLOduration=1.483781091 podStartE2EDuration="2.012183524s" totalImagesPullingTime="528.402433ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:25:58.011395994 +0000 UTC m=+798.544906696" watchObservedRunningTime="2026-09-17 03:25:58.012183524 +0000 UTC m=+798.545694256" Sep 17 03:25:58.036802 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:58.036755 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-9gjqd"] Sep 17 03:25:58.042096 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:58.042064 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-9gjqd"] Sep 17 03:25:58.250487 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:58.250398 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-gm2q9" Sep 17 03:25:58.347766 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:58.347714 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7k5vh\" (UniqueName: \"kubernetes.io/projected/1e975fd3-2eb6-4be6-8b56-93a8c0b8303c-kube-api-access-7k5vh\") pod \"1e975fd3-2eb6-4be6-8b56-93a8c0b8303c\" (UID: \"1e975fd3-2eb6-4be6-8b56-93a8c0b8303c\") " Sep 17 03:25:58.349945 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:58.349915 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e975fd3-2eb6-4be6-8b56-93a8c0b8303c-kube-api-access-7k5vh" (OuterVolumeSpecName: "kube-api-access-7k5vh") pod "1e975fd3-2eb6-4be6-8b56-93a8c0b8303c" (UID: "1e975fd3-2eb6-4be6-8b56-93a8c0b8303c"). InnerVolumeSpecName "kube-api-access-7k5vh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:25:58.449256 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:58.449216 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7k5vh\" (UniqueName: \"kubernetes.io/projected/1e975fd3-2eb6-4be6-8b56-93a8c0b8303c-kube-api-access-7k5vh\") on node \"ip-10-0-131-70.ec2.internal\" DevicePath \"\"" Sep 17 03:25:59.003751 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:59.003716 2574 generic.go:356] "Generic (PLEG): container finished" podID="1e975fd3-2eb6-4be6-8b56-93a8c0b8303c" containerID="7a2fe5ca4e9123bb3d36ca2c3d0d43df8b041c76452fa244f554425f34d0e628" exitCode=0 Sep 17 03:25:59.004148 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:59.003763 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-gm2q9" Sep 17 03:25:59.004148 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:59.003784 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-gm2q9" event={"ID":"1e975fd3-2eb6-4be6-8b56-93a8c0b8303c","Type":"ContainerDied","Data":"7a2fe5ca4e9123bb3d36ca2c3d0d43df8b041c76452fa244f554425f34d0e628"} Sep 17 03:25:59.004148 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:59.003816 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-gm2q9" event={"ID":"1e975fd3-2eb6-4be6-8b56-93a8c0b8303c","Type":"ContainerDied","Data":"dbfdc196b2fd425f5dc3b554e684820295cf41a72e4ee3d65cbee7df03b56dff"} Sep 17 03:25:59.004148 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:59.003832 2574 scope.go:117] "RemoveContainer" containerID="7a2fe5ca4e9123bb3d36ca2c3d0d43df8b041c76452fa244f554425f34d0e628" Sep 17 03:25:59.012717 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:59.012695 2574 scope.go:117] "RemoveContainer" containerID="7a2fe5ca4e9123bb3d36ca2c3d0d43df8b041c76452fa244f554425f34d0e628" Sep 17 03:25:59.013056 ip-10-0-131-70 kubenswrapper[2574]: E0917 03:25:59.013037 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a2fe5ca4e9123bb3d36ca2c3d0d43df8b041c76452fa244f554425f34d0e628\": container with ID starting with 7a2fe5ca4e9123bb3d36ca2c3d0d43df8b041c76452fa244f554425f34d0e628 not found: ID does not exist" containerID="7a2fe5ca4e9123bb3d36ca2c3d0d43df8b041c76452fa244f554425f34d0e628" Sep 17 03:25:59.013106 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:59.013066 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a2fe5ca4e9123bb3d36ca2c3d0d43df8b041c76452fa244f554425f34d0e628"} err="failed to get container status \"7a2fe5ca4e9123bb3d36ca2c3d0d43df8b041c76452fa244f554425f34d0e628\": rpc error: code = NotFound desc = could not find container \"7a2fe5ca4e9123bb3d36ca2c3d0d43df8b041c76452fa244f554425f34d0e628\": container with ID starting with 7a2fe5ca4e9123bb3d36ca2c3d0d43df8b041c76452fa244f554425f34d0e628 not found: ID does not exist" Sep 17 03:25:59.024233 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:59.024199 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-gm2q9"] Sep 17 03:25:59.026160 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:59.026133 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-gm2q9"] Sep 17 03:25:59.897901 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:59.897856 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="062e16cf-fc95-4a2a-b209-3f2001c50792" path="/var/lib/kubelet/pods/062e16cf-fc95-4a2a-b209-3f2001c50792/volumes" Sep 17 03:25:59.898162 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:25:59.898144 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e975fd3-2eb6-4be6-8b56-93a8c0b8303c" path="/var/lib/kubelet/pods/1e975fd3-2eb6-4be6-8b56-93a8c0b8303c/volumes" Sep 17 03:26:40.835809 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:26:40.835778 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-92pgf"] Sep 17 03:27:21.729238 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:21.729202 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-92pgf"] Sep 17 03:27:26.237020 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:26.236986 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-92pgf"] Sep 17 03:27:45.624543 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:45.624508 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-92pgf"] Sep 17 03:27:59.637466 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.637416 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4"] Sep 17 03:27:59.638913 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.637936 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e975fd3-2eb6-4be6-8b56-93a8c0b8303c" containerName="authorino" Sep 17 03:27:59.638913 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.637952 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e975fd3-2eb6-4be6-8b56-93a8c0b8303c" containerName="authorino" Sep 17 03:27:59.638913 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.638031 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e975fd3-2eb6-4be6-8b56-93a8c0b8303c" containerName="authorino" Sep 17 03:27:59.639931 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.639912 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" Sep 17 03:27:59.644355 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.644331 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tvzh7\"" Sep 17 03:27:59.644488 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.644352 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Sep 17 03:27:59.644488 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.644338 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 17 03:27:59.644488 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.644383 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 17 03:27:59.649169 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.649142 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4"] Sep 17 03:27:59.698877 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.698845 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ddb80cc-5ef8-4c27-8bf3-04fb088d9668-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-smfc4\" (UID: \"8ddb80cc-5ef8-4c27-8bf3-04fb088d9668\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" Sep 17 03:27:59.699083 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.698893 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55699\" (UniqueName: \"kubernetes.io/projected/8ddb80cc-5ef8-4c27-8bf3-04fb088d9668-kube-api-access-55699\") pod \"e2e-trlp-test-simulated-kserve-598466548d-smfc4\" (UID: \"8ddb80cc-5ef8-4c27-8bf3-04fb088d9668\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" Sep 17 03:27:59.699083 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.698989 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ddb80cc-5ef8-4c27-8bf3-04fb088d9668-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-smfc4\" (UID: \"8ddb80cc-5ef8-4c27-8bf3-04fb088d9668\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" Sep 17 03:27:59.699083 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.699020 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ddb80cc-5ef8-4c27-8bf3-04fb088d9668-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-smfc4\" (UID: \"8ddb80cc-5ef8-4c27-8bf3-04fb088d9668\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" Sep 17 03:27:59.699228 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.699086 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ddb80cc-5ef8-4c27-8bf3-04fb088d9668-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-smfc4\" (UID: \"8ddb80cc-5ef8-4c27-8bf3-04fb088d9668\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" Sep 17 03:27:59.699228 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.699123 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ddb80cc-5ef8-4c27-8bf3-04fb088d9668-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-smfc4\" (UID: \"8ddb80cc-5ef8-4c27-8bf3-04fb088d9668\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" Sep 17 03:27:59.799854 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.799807 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ddb80cc-5ef8-4c27-8bf3-04fb088d9668-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-smfc4\" (UID: \"8ddb80cc-5ef8-4c27-8bf3-04fb088d9668\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" Sep 17 03:27:59.800067 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.799865 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ddb80cc-5ef8-4c27-8bf3-04fb088d9668-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-smfc4\" (UID: \"8ddb80cc-5ef8-4c27-8bf3-04fb088d9668\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" Sep 17 03:27:59.800067 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.799892 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ddb80cc-5ef8-4c27-8bf3-04fb088d9668-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-smfc4\" (UID: \"8ddb80cc-5ef8-4c27-8bf3-04fb088d9668\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" Sep 17 03:27:59.800067 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.799935 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55699\" (UniqueName: \"kubernetes.io/projected/8ddb80cc-5ef8-4c27-8bf3-04fb088d9668-kube-api-access-55699\") pod \"e2e-trlp-test-simulated-kserve-598466548d-smfc4\" (UID: \"8ddb80cc-5ef8-4c27-8bf3-04fb088d9668\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" Sep 17 03:27:59.800067 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.800006 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ddb80cc-5ef8-4c27-8bf3-04fb088d9668-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-smfc4\" (UID: \"8ddb80cc-5ef8-4c27-8bf3-04fb088d9668\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" Sep 17 03:27:59.800067 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.800027 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ddb80cc-5ef8-4c27-8bf3-04fb088d9668-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-smfc4\" (UID: \"8ddb80cc-5ef8-4c27-8bf3-04fb088d9668\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" Sep 17 03:27:59.800343 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.800313 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ddb80cc-5ef8-4c27-8bf3-04fb088d9668-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-smfc4\" (UID: \"8ddb80cc-5ef8-4c27-8bf3-04fb088d9668\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" Sep 17 03:27:59.800404 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.800367 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ddb80cc-5ef8-4c27-8bf3-04fb088d9668-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-smfc4\" (UID: \"8ddb80cc-5ef8-4c27-8bf3-04fb088d9668\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" Sep 17 03:27:59.800404 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.800377 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ddb80cc-5ef8-4c27-8bf3-04fb088d9668-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-smfc4\" (UID: \"8ddb80cc-5ef8-4c27-8bf3-04fb088d9668\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" Sep 17 03:27:59.802400 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.802371 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ddb80cc-5ef8-4c27-8bf3-04fb088d9668-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-smfc4\" (UID: \"8ddb80cc-5ef8-4c27-8bf3-04fb088d9668\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" Sep 17 03:27:59.802547 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.802529 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ddb80cc-5ef8-4c27-8bf3-04fb088d9668-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-smfc4\" (UID: \"8ddb80cc-5ef8-4c27-8bf3-04fb088d9668\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" Sep 17 03:27:59.808574 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.808556 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55699\" (UniqueName: \"kubernetes.io/projected/8ddb80cc-5ef8-4c27-8bf3-04fb088d9668-kube-api-access-55699\") pod \"e2e-trlp-test-simulated-kserve-598466548d-smfc4\" (UID: \"8ddb80cc-5ef8-4c27-8bf3-04fb088d9668\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" Sep 17 03:27:59.950789 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:27:59.950752 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" Sep 17 03:28:00.222141 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:00.222111 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4"] Sep 17 03:28:00.223548 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:28:00.223512 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ddb80cc_5ef8_4c27_8bf3_04fb088d9668.slice/crio-6576cc1dde76e4a7da31438f9dcd9dc5f4c0f08224ea69102f77d1bde908a6e9 WatchSource:0}: Error finding container 6576cc1dde76e4a7da31438f9dcd9dc5f4c0f08224ea69102f77d1bde908a6e9: Status 404 returned error can't find the container with id 6576cc1dde76e4a7da31438f9dcd9dc5f4c0f08224ea69102f77d1bde908a6e9 Sep 17 03:28:00.224890 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:00.224874 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 03:28:00.568885 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:00.568765 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" event={"ID":"8ddb80cc-5ef8-4c27-8bf3-04fb088d9668","Type":"ContainerStarted","Data":"6576cc1dde76e4a7da31438f9dcd9dc5f4c0f08224ea69102f77d1bde908a6e9"} Sep 17 03:28:01.027670 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:01.027620 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-92pgf"] Sep 17 03:28:01.575095 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:01.575064 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" event={"ID":"8ddb80cc-5ef8-4c27-8bf3-04fb088d9668","Type":"ContainerStarted","Data":"b9ae2d6cbd163fa007acd9ad0336de7f8420d03cafaebb66dca72a954422915c"} Sep 17 03:28:08.122191 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:08.122130 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" podStartSLOduration=8.126223717 podStartE2EDuration="9.122114119s" totalImagesPullingTime="995.890402ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:27:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:28:01.624985599 +0000 UTC m=+922.158496299" watchObservedRunningTime="2026-09-17 03:28:08.122114119 +0000 UTC m=+928.655624819" Sep 17 03:28:08.122600 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:08.122366 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp"] Sep 17 03:28:08.124923 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:08.124903 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" Sep 17 03:28:08.127632 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:08.127608 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 17 03:28:08.136041 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:08.136016 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp"] Sep 17 03:28:08.278413 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:08.278384 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b80a5c40-c8a8-4011-b0e3-233c0161f2fd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp\" (UID: \"b80a5c40-c8a8-4011-b0e3-233c0161f2fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" Sep 17 03:28:08.278624 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:08.278470 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b80a5c40-c8a8-4011-b0e3-233c0161f2fd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp\" (UID: \"b80a5c40-c8a8-4011-b0e3-233c0161f2fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" Sep 17 03:28:08.278624 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:08.278495 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b80a5c40-c8a8-4011-b0e3-233c0161f2fd-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp\" (UID: \"b80a5c40-c8a8-4011-b0e3-233c0161f2fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" Sep 17 03:28:08.278624 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:08.278514 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b80a5c40-c8a8-4011-b0e3-233c0161f2fd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp\" (UID: \"b80a5c40-c8a8-4011-b0e3-233c0161f2fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" Sep 17 03:28:08.278624 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:08.278541 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhf8b\" (UniqueName: \"kubernetes.io/projected/b80a5c40-c8a8-4011-b0e3-233c0161f2fd-kube-api-access-fhf8b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp\" (UID: \"b80a5c40-c8a8-4011-b0e3-233c0161f2fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" Sep 17 03:28:08.278624 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:08.278586 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b80a5c40-c8a8-4011-b0e3-233c0161f2fd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp\" (UID: \"b80a5c40-c8a8-4011-b0e3-233c0161f2fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" Sep 17 03:28:08.379376 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:08.379290 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b80a5c40-c8a8-4011-b0e3-233c0161f2fd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp\" (UID: \"b80a5c40-c8a8-4011-b0e3-233c0161f2fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" Sep 17 03:28:08.379376 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:08.379323 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b80a5c40-c8a8-4011-b0e3-233c0161f2fd-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp\" (UID: \"b80a5c40-c8a8-4011-b0e3-233c0161f2fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" Sep 17 03:28:08.379376 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:08.379343 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b80a5c40-c8a8-4011-b0e3-233c0161f2fd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp\" (UID: \"b80a5c40-c8a8-4011-b0e3-233c0161f2fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" Sep 17 03:28:08.379669 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:08.379401 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhf8b\" (UniqueName: \"kubernetes.io/projected/b80a5c40-c8a8-4011-b0e3-233c0161f2fd-kube-api-access-fhf8b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp\" (UID: \"b80a5c40-c8a8-4011-b0e3-233c0161f2fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" Sep 17 03:28:08.379669 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:08.379474 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b80a5c40-c8a8-4011-b0e3-233c0161f2fd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp\" (UID: \"b80a5c40-c8a8-4011-b0e3-233c0161f2fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" Sep 17 03:28:08.379669 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:08.379595 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b80a5c40-c8a8-4011-b0e3-233c0161f2fd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp\" (UID: \"b80a5c40-c8a8-4011-b0e3-233c0161f2fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" Sep 17 03:28:08.379820 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:08.379768 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b80a5c40-c8a8-4011-b0e3-233c0161f2fd-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp\" (UID: \"b80a5c40-c8a8-4011-b0e3-233c0161f2fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" Sep 17 03:28:08.379820 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:08.379781 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b80a5c40-c8a8-4011-b0e3-233c0161f2fd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp\" (UID: \"b80a5c40-c8a8-4011-b0e3-233c0161f2fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" Sep 17 03:28:08.379967 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:08.379949 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b80a5c40-c8a8-4011-b0e3-233c0161f2fd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp\" (UID: \"b80a5c40-c8a8-4011-b0e3-233c0161f2fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" Sep 17 03:28:08.381833 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:08.381808 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b80a5c40-c8a8-4011-b0e3-233c0161f2fd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp\" (UID: \"b80a5c40-c8a8-4011-b0e3-233c0161f2fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" Sep 17 03:28:08.382087 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:08.382070 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b80a5c40-c8a8-4011-b0e3-233c0161f2fd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp\" (UID: \"b80a5c40-c8a8-4011-b0e3-233c0161f2fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" Sep 17 03:28:08.386905 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:08.386881 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhf8b\" (UniqueName: \"kubernetes.io/projected/b80a5c40-c8a8-4011-b0e3-233c0161f2fd-kube-api-access-fhf8b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp\" (UID: \"b80a5c40-c8a8-4011-b0e3-233c0161f2fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" Sep 17 03:28:08.436438 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:08.436403 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" Sep 17 03:28:08.707610 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:08.707581 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp"] Sep 17 03:28:08.710143 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:28:08.710117 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb80a5c40_c8a8_4011_b0e3_233c0161f2fd.slice/crio-ee2056afa3feb37488589a6f6b0911b51b762d677bda446b0f74f77228298c0a WatchSource:0}: Error finding container ee2056afa3feb37488589a6f6b0911b51b762d677bda446b0f74f77228298c0a: Status 404 returned error can't find the container with id ee2056afa3feb37488589a6f6b0911b51b762d677bda446b0f74f77228298c0a Sep 17 03:28:09.612174 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:09.612140 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" event={"ID":"b80a5c40-c8a8-4011-b0e3-233c0161f2fd","Type":"ContainerStarted","Data":"6383d8938ce38ff1254ee470879dac8f920e9c6ef352396842b795b494a5711c"} Sep 17 03:28:09.612774 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:09.612190 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" event={"ID":"b80a5c40-c8a8-4011-b0e3-233c0161f2fd","Type":"ContainerStarted","Data":"ee2056afa3feb37488589a6f6b0911b51b762d677bda446b0f74f77228298c0a"} Sep 17 03:28:09.625059 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:09.625026 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-92pgf"] Sep 17 03:28:09.629943 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:09.629896 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" podStartSLOduration=1.4768974670000001 podStartE2EDuration="1.62987939s" totalImagesPullingTime="152.981923ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:28:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:28:09.629064705 +0000 UTC m=+930.162575407" watchObservedRunningTime="2026-09-17 03:28:09.62987939 +0000 UTC m=+930.163390100" Sep 17 03:28:09.951649 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:09.951618 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" Sep 17 03:28:09.951804 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:09.951668 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" Sep 17 03:28:09.963961 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:09.963935 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" Sep 17 03:28:10.629660 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:10.629632 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-smfc4" Sep 17 03:28:14.630147 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:14.630107 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-92pgf"] Sep 17 03:28:18.437210 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:18.437178 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" Sep 17 03:28:18.437672 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:18.437237 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" Sep 17 03:28:18.449615 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:18.449592 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" Sep 17 03:28:18.667194 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:18.667161 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltvhp" Sep 17 03:28:26.534977 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:26.534939 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k"] Sep 17 03:28:26.540573 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:26.540549 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" Sep 17 03:28:26.543563 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:26.543543 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Sep 17 03:28:26.548654 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:26.548634 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k"] Sep 17 03:28:26.633758 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:26.633722 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d924fdae-8291-483b-bbcb-f79922bca8b4-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-52c7k\" (UID: \"d924fdae-8291-483b-bbcb-f79922bca8b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" Sep 17 03:28:26.633758 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:26.633758 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d924fdae-8291-483b-bbcb-f79922bca8b4-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-52c7k\" (UID: \"d924fdae-8291-483b-bbcb-f79922bca8b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" Sep 17 03:28:26.633958 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:26.633791 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d924fdae-8291-483b-bbcb-f79922bca8b4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-52c7k\" (UID: \"d924fdae-8291-483b-bbcb-f79922bca8b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" Sep 17 03:28:26.633958 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:26.633809 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5fjd\" (UniqueName: \"kubernetes.io/projected/d924fdae-8291-483b-bbcb-f79922bca8b4-kube-api-access-b5fjd\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-52c7k\" (UID: \"d924fdae-8291-483b-bbcb-f79922bca8b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" Sep 17 03:28:26.633958 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:26.633836 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d924fdae-8291-483b-bbcb-f79922bca8b4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-52c7k\" (UID: \"d924fdae-8291-483b-bbcb-f79922bca8b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" Sep 17 03:28:26.633958 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:26.633889 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d924fdae-8291-483b-bbcb-f79922bca8b4-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-52c7k\" (UID: \"d924fdae-8291-483b-bbcb-f79922bca8b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" Sep 17 03:28:26.734956 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:26.734919 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5fjd\" (UniqueName: \"kubernetes.io/projected/d924fdae-8291-483b-bbcb-f79922bca8b4-kube-api-access-b5fjd\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-52c7k\" (UID: \"d924fdae-8291-483b-bbcb-f79922bca8b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" Sep 17 03:28:26.734956 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:26.734961 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d924fdae-8291-483b-bbcb-f79922bca8b4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-52c7k\" (UID: \"d924fdae-8291-483b-bbcb-f79922bca8b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" Sep 17 03:28:26.735246 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:26.735018 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d924fdae-8291-483b-bbcb-f79922bca8b4-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-52c7k\" (UID: \"d924fdae-8291-483b-bbcb-f79922bca8b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" Sep 17 03:28:26.735246 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:26.735106 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d924fdae-8291-483b-bbcb-f79922bca8b4-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-52c7k\" (UID: \"d924fdae-8291-483b-bbcb-f79922bca8b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" Sep 17 03:28:26.735246 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:26.735129 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d924fdae-8291-483b-bbcb-f79922bca8b4-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-52c7k\" (UID: \"d924fdae-8291-483b-bbcb-f79922bca8b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" Sep 17 03:28:26.735246 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:26.735169 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d924fdae-8291-483b-bbcb-f79922bca8b4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-52c7k\" (UID: \"d924fdae-8291-483b-bbcb-f79922bca8b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" Sep 17 03:28:26.735532 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:26.735511 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d924fdae-8291-483b-bbcb-f79922bca8b4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-52c7k\" (UID: \"d924fdae-8291-483b-bbcb-f79922bca8b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" Sep 17 03:28:26.735602 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:26.735581 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d924fdae-8291-483b-bbcb-f79922bca8b4-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-52c7k\" (UID: \"d924fdae-8291-483b-bbcb-f79922bca8b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" Sep 17 03:28:26.735665 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:26.735584 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d924fdae-8291-483b-bbcb-f79922bca8b4-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-52c7k\" (UID: \"d924fdae-8291-483b-bbcb-f79922bca8b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" Sep 17 03:28:26.737672 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:26.737651 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d924fdae-8291-483b-bbcb-f79922bca8b4-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-52c7k\" (UID: \"d924fdae-8291-483b-bbcb-f79922bca8b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" Sep 17 03:28:26.737851 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:26.737839 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d924fdae-8291-483b-bbcb-f79922bca8b4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-52c7k\" (UID: \"d924fdae-8291-483b-bbcb-f79922bca8b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" Sep 17 03:28:26.746207 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:26.746186 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5fjd\" (UniqueName: \"kubernetes.io/projected/d924fdae-8291-483b-bbcb-f79922bca8b4-kube-api-access-b5fjd\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-52c7k\" (UID: \"d924fdae-8291-483b-bbcb-f79922bca8b4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" Sep 17 03:28:26.851583 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:26.851506 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" Sep 17 03:28:27.124156 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:27.124129 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k"] Sep 17 03:28:27.125952 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:28:27.125925 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd924fdae_8291_483b_bbcb_f79922bca8b4.slice/crio-c79875bdb7655826473c2c23d34b329581785ff1cf3fda0dccdfcb991c086894 WatchSource:0}: Error finding container c79875bdb7655826473c2c23d34b329581785ff1cf3fda0dccdfcb991c086894: Status 404 returned error can't find the container with id c79875bdb7655826473c2c23d34b329581785ff1cf3fda0dccdfcb991c086894 Sep 17 03:28:27.699316 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:27.699282 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" event={"ID":"d924fdae-8291-483b-bbcb-f79922bca8b4","Type":"ContainerStarted","Data":"964a374c289846f322b5d2ef7f73c25ae6a8c65da760e9eade34575fe3a2eab9"} Sep 17 03:28:27.699316 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:27.699322 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" event={"ID":"d924fdae-8291-483b-bbcb-f79922bca8b4","Type":"ContainerStarted","Data":"c79875bdb7655826473c2c23d34b329581785ff1cf3fda0dccdfcb991c086894"} Sep 17 03:28:27.716923 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:27.716869 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" podStartSLOduration=1.5366311769999998 podStartE2EDuration="1.716852855s" totalImagesPullingTime="180.221678ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:28:27.716336796 +0000 UTC m=+948.249847499" watchObservedRunningTime="2026-09-17 03:28:27.716852855 +0000 UTC m=+948.250363556" Sep 17 03:28:28.827894 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:28.827857 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-92pgf"] Sep 17 03:28:36.852200 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:36.852161 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" Sep 17 03:28:36.852741 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:36.852251 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" Sep 17 03:28:36.864568 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:36.864547 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" Sep 17 03:28:37.756535 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:28:37.756497 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-52c7k" Sep 17 03:30:08.385435 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:30:08.385400 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7dcd5f9fcc-rtbxd"] Sep 17 03:30:08.388675 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:30:08.388654 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dcd5f9fcc-rtbxd" Sep 17 03:30:08.392539 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:30:08.392515 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 17 03:30:08.392539 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:30:08.392526 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lhlnk\"" Sep 17 03:30:08.396503 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:30:08.396104 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7dcd5f9fcc-rtbxd"] Sep 17 03:30:08.447018 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:30:08.446985 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eeb7beac-50cd-4e67-8b1b-f5e44b894a19-tls-cert\") pod \"authorino-7dcd5f9fcc-rtbxd\" (UID: \"eeb7beac-50cd-4e67-8b1b-f5e44b894a19\") " pod="kuadrant-system/authorino-7dcd5f9fcc-rtbxd" Sep 17 03:30:08.447179 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:30:08.447028 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppjjd\" (UniqueName: \"kubernetes.io/projected/eeb7beac-50cd-4e67-8b1b-f5e44b894a19-kube-api-access-ppjjd\") pod \"authorino-7dcd5f9fcc-rtbxd\" (UID: \"eeb7beac-50cd-4e67-8b1b-f5e44b894a19\") " pod="kuadrant-system/authorino-7dcd5f9fcc-rtbxd" Sep 17 03:30:08.548481 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:30:08.548441 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eeb7beac-50cd-4e67-8b1b-f5e44b894a19-tls-cert\") pod \"authorino-7dcd5f9fcc-rtbxd\" (UID: \"eeb7beac-50cd-4e67-8b1b-f5e44b894a19\") " pod="kuadrant-system/authorino-7dcd5f9fcc-rtbxd" Sep 17 03:30:08.548481 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:30:08.548490 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppjjd\" (UniqueName: \"kubernetes.io/projected/eeb7beac-50cd-4e67-8b1b-f5e44b894a19-kube-api-access-ppjjd\") pod \"authorino-7dcd5f9fcc-rtbxd\" (UID: \"eeb7beac-50cd-4e67-8b1b-f5e44b894a19\") " pod="kuadrant-system/authorino-7dcd5f9fcc-rtbxd" Sep 17 03:30:08.550995 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:30:08.550972 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eeb7beac-50cd-4e67-8b1b-f5e44b894a19-tls-cert\") pod \"authorino-7dcd5f9fcc-rtbxd\" (UID: \"eeb7beac-50cd-4e67-8b1b-f5e44b894a19\") " pod="kuadrant-system/authorino-7dcd5f9fcc-rtbxd" Sep 17 03:30:08.557374 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:30:08.557352 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppjjd\" (UniqueName: \"kubernetes.io/projected/eeb7beac-50cd-4e67-8b1b-f5e44b894a19-kube-api-access-ppjjd\") pod \"authorino-7dcd5f9fcc-rtbxd\" (UID: \"eeb7beac-50cd-4e67-8b1b-f5e44b894a19\") " pod="kuadrant-system/authorino-7dcd5f9fcc-rtbxd" Sep 17 03:30:08.699638 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:30:08.699609 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dcd5f9fcc-rtbxd" Sep 17 03:30:08.971123 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:30:08.971098 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7dcd5f9fcc-rtbxd"] Sep 17 03:30:08.973500 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:30:08.973468 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeeb7beac_50cd_4e67_8b1b_f5e44b894a19.slice/crio-2abbff669d2fdcf239d1f7d01b360535b421f117fef8323c268f757c57cb3277 WatchSource:0}: Error finding container 2abbff669d2fdcf239d1f7d01b360535b421f117fef8323c268f757c57cb3277: Status 404 returned error can't find the container with id 2abbff669d2fdcf239d1f7d01b360535b421f117fef8323c268f757c57cb3277 Sep 17 03:30:09.164987 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:30:09.164950 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dcd5f9fcc-rtbxd" event={"ID":"eeb7beac-50cd-4e67-8b1b-f5e44b894a19","Type":"ContainerStarted","Data":"2abbff669d2fdcf239d1f7d01b360535b421f117fef8323c268f757c57cb3277"} Sep 17 03:30:22.227398 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:30:22.227359 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dcd5f9fcc-rtbxd" event={"ID":"eeb7beac-50cd-4e67-8b1b-f5e44b894a19","Type":"ContainerStarted","Data":"63371afceae3780155746c7bf7b2801b299d4dec74c83bfc6cfa719ccd01a673"} Sep 17 03:30:22.245121 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:30:22.245050 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7dcd5f9fcc-rtbxd" podStartSLOduration=1.807964197 podStartE2EDuration="14.245031662s" totalImagesPullingTime="12.437067465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:30:22.243095416 +0000 UTC m=+1062.776606119" watchObservedRunningTime="2026-09-17 03:30:22.245031662 +0000 UTC m=+1062.778542364" Sep 17 03:31:22.184292 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:22.184260 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bfbnk_6c98ae40-3a0b-4d27-b060-510431eb9770/global-pull-secret-syncer/0.log" Sep 17 03:31:22.293477 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:22.293446 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f59hh_3043780c-edd9-40a8-bed5-a58f0265801e/konnectivity-agent/0.log" Sep 17 03:31:22.346487 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:22.346458 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-70.ec2.internal_21c858cc32c6191885a49e3c88c5f4d0/haproxy/0.log" Sep 17 03:31:26.479002 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:26.478971 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7dcd5f9fcc-rtbxd_eeb7beac-50cd-4e67-8b1b-f5e44b894a19/authorino/0.log" Sep 17 03:31:26.531094 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:26.531063 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-n77pb_2c29998a-70b7-4ab6-819b-5ecb84060458/manager/0.log" Sep 17 03:31:26.730974 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:26.730902 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-92pgf_b0f91f11-d888-4bf3-9b6f-25e1c284ba19/limitador/0.log" Sep 17 03:31:28.316168 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:28.316143 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a053e20-c783-428b-80e0-cd339520a88d/alertmanager/0.log" Sep 17 03:31:28.336675 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:28.336644 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a053e20-c783-428b-80e0-cd339520a88d/config-reloader/0.log" Sep 17 03:31:28.357876 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:28.357859 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a053e20-c783-428b-80e0-cd339520a88d/kube-rbac-proxy-web/0.log" Sep 17 03:31:28.378300 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:28.378277 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a053e20-c783-428b-80e0-cd339520a88d/kube-rbac-proxy/0.log" Sep 17 03:31:28.398160 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:28.398139 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a053e20-c783-428b-80e0-cd339520a88d/kube-rbac-proxy-metric/0.log" Sep 17 03:31:28.419566 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:28.419549 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a053e20-c783-428b-80e0-cd339520a88d/prom-label-proxy/0.log" Sep 17 03:31:28.450204 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:28.450184 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a053e20-c783-428b-80e0-cd339520a88d/init-config-reloader/0.log" Sep 17 03:31:28.485342 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:28.485320 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-qt688_6a49191e-8033-456b-8a50-12c79f3a1607/cluster-monitoring-operator/0.log" Sep 17 03:31:28.513363 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:28.513344 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-b6mwn_9e1408bb-202b-42b1-af12-3f412454408c/kube-state-metrics/0.log" Sep 17 03:31:28.532463 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:28.532439 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-b6mwn_9e1408bb-202b-42b1-af12-3f412454408c/kube-rbac-proxy-main/0.log" Sep 17 03:31:28.556854 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:28.556829 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-b6mwn_9e1408bb-202b-42b1-af12-3f412454408c/kube-rbac-proxy-self/0.log" Sep 17 03:31:28.582114 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:28.582034 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-cb94b6879-t2nfj_cc1b2bfd-1808-4d04-8005-3409f176650e/metrics-server/0.log" Sep 17 03:31:28.799105 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:28.799077 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tlvff_4bd85564-5557-4611-920f-3c976561c254/node-exporter/0.log" Sep 17 03:31:28.819598 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:28.819558 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tlvff_4bd85564-5557-4611-920f-3c976561c254/kube-rbac-proxy/0.log" Sep 17 03:31:28.839006 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:28.838948 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tlvff_4bd85564-5557-4611-920f-3c976561c254/init-textfile/0.log" Sep 17 03:31:28.966546 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:28.966519 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1716308a-fa75-40c7-b3dc-fdd199525f0b/prometheus/0.log" Sep 17 03:31:28.986040 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:28.986018 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1716308a-fa75-40c7-b3dc-fdd199525f0b/config-reloader/0.log" Sep 17 03:31:29.006853 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:29.006833 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1716308a-fa75-40c7-b3dc-fdd199525f0b/thanos-sidecar/0.log" Sep 17 03:31:29.026303 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:29.026289 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1716308a-fa75-40c7-b3dc-fdd199525f0b/kube-rbac-proxy-web/0.log" Sep 17 03:31:29.047266 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:29.047247 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1716308a-fa75-40c7-b3dc-fdd199525f0b/kube-rbac-proxy/0.log" Sep 17 03:31:29.069076 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:29.069057 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1716308a-fa75-40c7-b3dc-fdd199525f0b/kube-rbac-proxy-thanos/0.log" Sep 17 03:31:29.089542 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:29.089485 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1716308a-fa75-40c7-b3dc-fdd199525f0b/init-config-reloader/0.log" Sep 17 03:31:29.117517 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:29.117497 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-6wtgw_057639b4-1a97-4fad-865a-728a69b70606/prometheus-operator/0.log" Sep 17 03:31:29.135130 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:29.135110 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-6wtgw_057639b4-1a97-4fad-865a-728a69b70606/kube-rbac-proxy/0.log" Sep 17 03:31:29.158861 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:29.158831 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-h9jxt_e42d69b7-e153-459d-846a-36e750873c01/prometheus-operator-admission-webhook/0.log" Sep 17 03:31:33.057548 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:33.057520 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-w4xbj_95631d45-87be-4c97-ae51-944054d67784/volume-data-source-validator/0.log" Sep 17 03:31:33.269641 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:33.269607 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dnnlt/perf-node-gather-daemonset-llfw8"] Sep 17 03:31:33.273389 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:33.273369 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-llfw8" Sep 17 03:31:33.275950 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:33.275932 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dnnlt\"/\"openshift-service-ca.crt\"" Sep 17 03:31:33.276062 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:33.275933 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dnnlt\"/\"default-dockercfg-v2wjg\"" Sep 17 03:31:33.277259 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:33.277236 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dnnlt\"/\"kube-root-ca.crt\"" Sep 17 03:31:33.283021 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:33.283001 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dnnlt/perf-node-gather-daemonset-llfw8"] Sep 17 03:31:33.317589 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:33.317505 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0ed9b3a-3a7a-4e7d-abff-ef380235267a-lib-modules\") pod \"perf-node-gather-daemonset-llfw8\" (UID: \"a0ed9b3a-3a7a-4e7d-abff-ef380235267a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-llfw8" Sep 17 03:31:33.317589 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:33.317567 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a0ed9b3a-3a7a-4e7d-abff-ef380235267a-podres\") pod \"perf-node-gather-daemonset-llfw8\" (UID: \"a0ed9b3a-3a7a-4e7d-abff-ef380235267a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-llfw8" Sep 17 03:31:33.317773 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:33.317605 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0ed9b3a-3a7a-4e7d-abff-ef380235267a-sys\") pod \"perf-node-gather-daemonset-llfw8\" (UID: \"a0ed9b3a-3a7a-4e7d-abff-ef380235267a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-llfw8" Sep 17 03:31:33.317773 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:33.317648 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffqx2\" (UniqueName: \"kubernetes.io/projected/a0ed9b3a-3a7a-4e7d-abff-ef380235267a-kube-api-access-ffqx2\") pod \"perf-node-gather-daemonset-llfw8\" (UID: \"a0ed9b3a-3a7a-4e7d-abff-ef380235267a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-llfw8" Sep 17 03:31:33.317773 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:33.317670 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a0ed9b3a-3a7a-4e7d-abff-ef380235267a-proc\") pod \"perf-node-gather-daemonset-llfw8\" (UID: \"a0ed9b3a-3a7a-4e7d-abff-ef380235267a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-llfw8" Sep 17 03:31:33.418284 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:33.418247 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0ed9b3a-3a7a-4e7d-abff-ef380235267a-lib-modules\") pod \"perf-node-gather-daemonset-llfw8\" (UID: \"a0ed9b3a-3a7a-4e7d-abff-ef380235267a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-llfw8" Sep 17 03:31:33.418502 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:33.418310 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a0ed9b3a-3a7a-4e7d-abff-ef380235267a-podres\") pod \"perf-node-gather-daemonset-llfw8\" (UID: \"a0ed9b3a-3a7a-4e7d-abff-ef380235267a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-llfw8" Sep 17 03:31:33.418502 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:33.418364 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0ed9b3a-3a7a-4e7d-abff-ef380235267a-sys\") pod \"perf-node-gather-daemonset-llfw8\" (UID: \"a0ed9b3a-3a7a-4e7d-abff-ef380235267a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-llfw8" Sep 17 03:31:33.418502 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:33.418440 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0ed9b3a-3a7a-4e7d-abff-ef380235267a-lib-modules\") pod \"perf-node-gather-daemonset-llfw8\" (UID: \"a0ed9b3a-3a7a-4e7d-abff-ef380235267a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-llfw8" Sep 17 03:31:33.418502 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:33.418472 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0ed9b3a-3a7a-4e7d-abff-ef380235267a-sys\") pod \"perf-node-gather-daemonset-llfw8\" (UID: \"a0ed9b3a-3a7a-4e7d-abff-ef380235267a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-llfw8" Sep 17 03:31:33.418502 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:33.418449 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffqx2\" (UniqueName: \"kubernetes.io/projected/a0ed9b3a-3a7a-4e7d-abff-ef380235267a-kube-api-access-ffqx2\") pod \"perf-node-gather-daemonset-llfw8\" (UID: \"a0ed9b3a-3a7a-4e7d-abff-ef380235267a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-llfw8" Sep 17 03:31:33.418760 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:33.418522 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a0ed9b3a-3a7a-4e7d-abff-ef380235267a-proc\") pod \"perf-node-gather-daemonset-llfw8\" (UID: \"a0ed9b3a-3a7a-4e7d-abff-ef380235267a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-llfw8" Sep 17 03:31:33.418760 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:33.418446 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a0ed9b3a-3a7a-4e7d-abff-ef380235267a-podres\") pod \"perf-node-gather-daemonset-llfw8\" (UID: \"a0ed9b3a-3a7a-4e7d-abff-ef380235267a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-llfw8" Sep 17 03:31:33.418760 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:33.418614 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a0ed9b3a-3a7a-4e7d-abff-ef380235267a-proc\") pod \"perf-node-gather-daemonset-llfw8\" (UID: \"a0ed9b3a-3a7a-4e7d-abff-ef380235267a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-llfw8" Sep 17 03:31:33.427373 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:33.427351 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffqx2\" (UniqueName: \"kubernetes.io/projected/a0ed9b3a-3a7a-4e7d-abff-ef380235267a-kube-api-access-ffqx2\") pod \"perf-node-gather-daemonset-llfw8\" (UID: \"a0ed9b3a-3a7a-4e7d-abff-ef380235267a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-llfw8" Sep 17 03:31:33.583536 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:33.583458 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-llfw8" Sep 17 03:31:33.852021 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:33.851997 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dnnlt/perf-node-gather-daemonset-llfw8"] Sep 17 03:31:33.854379 ip-10-0-131-70 kubenswrapper[2574]: W0917 03:31:33.854355 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda0ed9b3a_3a7a_4e7d_abff_ef380235267a.slice/crio-8d875260bd403d3d143d0c4db27ecfa38a77ca4b8c339431456e95080416b75f WatchSource:0}: Error finding container 8d875260bd403d3d143d0c4db27ecfa38a77ca4b8c339431456e95080416b75f: Status 404 returned error can't find the container with id 8d875260bd403d3d143d0c4db27ecfa38a77ca4b8c339431456e95080416b75f Sep 17 03:31:34.356684 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:34.356653 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lczrd_f84f25fc-622c-4836-94b5-f48efb0d718a/dns/0.log" Sep 17 03:31:34.378355 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:34.378320 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lczrd_f84f25fc-622c-4836-94b5-f48efb0d718a/kube-rbac-proxy/0.log" Sep 17 03:31:34.400441 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:34.400398 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-246d2_72dfc96b-596c-4f3f-93f7-7a323067dae4/dns-node-resolver/0.log" Sep 17 03:31:34.569893 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:34.569855 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-llfw8" event={"ID":"a0ed9b3a-3a7a-4e7d-abff-ef380235267a","Type":"ContainerStarted","Data":"e24c7cb4d7a6d756a77799cf455373ade0e2221b50051ff4067f8d8c5fbd3c72"} Sep 17 03:31:34.570054 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:34.569901 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-llfw8" event={"ID":"a0ed9b3a-3a7a-4e7d-abff-ef380235267a","Type":"ContainerStarted","Data":"8d875260bd403d3d143d0c4db27ecfa38a77ca4b8c339431456e95080416b75f"} Sep 17 03:31:34.570054 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:34.569932 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-llfw8" Sep 17 03:31:34.587320 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:34.587276 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-llfw8" podStartSLOduration=1.587260951 podStartE2EDuration="1.587260951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:31:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:31:34.585408952 +0000 UTC m=+1135.118919655" watchObservedRunningTime="2026-09-17 03:31:34.587260951 +0000 UTC m=+1135.120771692" Sep 17 03:31:35.023253 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:35.023209 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2dr88_ade8d91a-ea36-43e4-8754-afea35aaaeed/node-ca/0.log" Sep 17 03:31:36.040944 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:36.040914 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b76b6489b-zw7c9_fe7d032d-46c3-43ca-a6a8-9c6ece9b74d2/kube-auth-proxy/0.log" Sep 17 03:31:36.746648 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:36.746612 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2c74k_27fee724-3145-4db2-9b4e-083466ffab60/serve-healthcheck-canary/0.log" Sep 17 03:31:37.222821 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:37.222790 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-pm6n9_1f265faf-76c7-473c-826a-00a566722ba8/insights-operator/1.log" Sep 17 03:31:37.223253 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:37.223131 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-pm6n9_1f265faf-76c7-473c-826a-00a566722ba8/insights-operator/0.log" Sep 17 03:31:37.246687 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:37.246666 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-44fwj_16e98aad-d258-4cbb-af74-d1465d0daebc/kube-rbac-proxy/0.log" Sep 17 03:31:37.266641 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:37.266622 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-44fwj_16e98aad-d258-4cbb-af74-d1465d0daebc/exporter/0.log" Sep 17 03:31:37.287278 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:37.287253 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-44fwj_16e98aad-d258-4cbb-af74-d1465d0daebc/extractor/0.log" Sep 17 03:31:39.767821 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:39.767792 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b9b769b77-nqnbx_e277ce9b-e98d-4927-b229-480ded52caf4/manager/0.log" Sep 17 03:31:39.789283 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:39.789257 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b9b769b77-nqnbx_e277ce9b-e98d-4927-b229-480ded52caf4/copy-manifests/0.log" Sep 17 03:31:40.583620 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:40.583587 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-llfw8" Sep 17 03:31:40.981445 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:40.981392 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-dd99db947-n6j75_6c7469c8-6425-417a-932a-11eb1bc7e2ec/manager/0.log" Sep 17 03:31:42.522776 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:42.522747 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b76b6489b-zw7c9_fe7d032d-46c3-43ca-a6a8-9c6ece9b74d2/kube-auth-proxy/0.log" Sep 17 03:31:43.860559 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:43.860457 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b76b6489b-zw7c9_fe7d032d-46c3-43ca-a6a8-9c6ece9b74d2/kube-auth-proxy/0.log" Sep 17 03:31:46.420930 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:46.420904 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-hx5b6_60572324-d861-4d96-91e5-2168038ab007/migrator/0.log" Sep 17 03:31:46.442113 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:46.442084 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-hx5b6_60572324-d861-4d96-91e5-2168038ab007/graceful-termination/0.log" Sep 17 03:31:46.805033 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:46.804999 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-jmmt9_e5ec7bca-6b96-4f8c-865c-c863898cce51/kube-storage-version-migrator-operator/1.log" Sep 17 03:31:46.806711 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:46.806668 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-jmmt9_e5ec7bca-6b96-4f8c-865c-c863898cce51/kube-storage-version-migrator-operator/0.log" Sep 17 03:31:47.793832 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:47.793800 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hxr44_f26c059a-e57c-4f3f-bdaf-15df31142402/kube-multus-additional-cni-plugins/0.log" Sep 17 03:31:47.813207 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:47.813175 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hxr44_f26c059a-e57c-4f3f-bdaf-15df31142402/egress-router-binary-copy/0.log" Sep 17 03:31:47.832323 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:47.832297 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hxr44_f26c059a-e57c-4f3f-bdaf-15df31142402/cni-plugins/0.log" Sep 17 03:31:47.854964 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:47.854938 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hxr44_f26c059a-e57c-4f3f-bdaf-15df31142402/bond-cni-plugin/0.log" Sep 17 03:31:47.874045 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:47.874022 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hxr44_f26c059a-e57c-4f3f-bdaf-15df31142402/routeoverride-cni/0.log" Sep 17 03:31:47.895210 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:47.895187 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hxr44_f26c059a-e57c-4f3f-bdaf-15df31142402/whereabouts-cni-bincopy/0.log" Sep 17 03:31:47.914968 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:47.914949 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hxr44_f26c059a-e57c-4f3f-bdaf-15df31142402/whereabouts-cni/0.log" Sep 17 03:31:48.236015 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:48.235984 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fxnnk_2e0230bb-9ec2-4733-a2ea-a51f9650184f/kube-multus/0.log" Sep 17 03:31:48.318193 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:48.318162 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bgwwg_eca0ae2b-bd17-447e-9784-04f94225f000/network-metrics-daemon/0.log" Sep 17 03:31:48.337238 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:48.337216 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bgwwg_eca0ae2b-bd17-447e-9784-04f94225f000/kube-rbac-proxy/0.log" Sep 17 03:31:49.584381 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:49.584353 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj7x2_a07b8242-870d-4be1-827d-d5b5e41d45ec/ovn-controller/0.log" Sep 17 03:31:49.601389 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:49.601368 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj7x2_a07b8242-870d-4be1-827d-d5b5e41d45ec/ovn-acl-logging/0.log" Sep 17 03:31:49.624591 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:49.624572 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj7x2_a07b8242-870d-4be1-827d-d5b5e41d45ec/kube-rbac-proxy-node/0.log" Sep 17 03:31:49.643456 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:49.643414 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj7x2_a07b8242-870d-4be1-827d-d5b5e41d45ec/kube-rbac-proxy-ovn-metrics/0.log" Sep 17 03:31:49.659255 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:49.659226 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj7x2_a07b8242-870d-4be1-827d-d5b5e41d45ec/northd/0.log" Sep 17 03:31:49.678216 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:49.678193 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj7x2_a07b8242-870d-4be1-827d-d5b5e41d45ec/nbdb/0.log" Sep 17 03:31:49.697480 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:49.697459 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj7x2_a07b8242-870d-4be1-827d-d5b5e41d45ec/sbdb/0.log" Sep 17 03:31:49.733972 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:49.733953 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tj7x2_a07b8242-870d-4be1-827d-d5b5e41d45ec/ovnkube-controller/0.log" Sep 17 03:31:50.824525 ip-10-0-131-70 kubenswrapper[2574]: I0917 03:31:50.824491 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-8m8pj_2580ca6b-3260-4448-a21c-9f9ee7e2e1b7/network-check-target-container/0.log"