Jun 15 01:36:07.546972 ip-10-0-132-124 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 15 01:36:07.546986 ip-10-0-132-124 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 15 01:36:07.546996 ip-10-0-132-124 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 15 01:36:07.547293 ip-10-0-132-124 systemd[1]: Failed to start Kubernetes Kubelet. Jun 15 01:36:17.734862 ip-10-0-132-124 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 15 01:36:17.734877 ip-10-0-132-124 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 5ac8454dd6b04ca3a8528244b7ff0fc3 -- Jun 15 01:38:41.538594 ip-10-0-132-124 systemd[1]: Starting Kubernetes Kubelet... Jun 15 01:38:41.891398 ip-10-0-132-124 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 01:38:41.891398 ip-10-0-132-124 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 15 01:38:41.891398 ip-10-0-132-124 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 01:38:41.891398 ip-10-0-132-124 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 15 01:38:41.892477 ip-10-0-132-124 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 01:38:41.893704 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.893625 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 15 01:38:41.899083 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899067 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 01:38:41.899083 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899082 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 01:38:41.899146 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899086 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 01:38:41.899146 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899089 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 01:38:41.899146 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899092 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 01:38:41.899146 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899094 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 01:38:41.899146 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899097 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 01:38:41.899146 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899100 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 01:38:41.899146 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899102 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 01:38:41.899146 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899105 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 01:38:41.899146 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899108 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 01:38:41.899146 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899110 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 01:38:41.899146 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899113 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 01:38:41.899146 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899116 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 01:38:41.899146 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899118 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 01:38:41.899146 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899121 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 01:38:41.899146 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899123 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 01:38:41.899146 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899126 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 01:38:41.899146 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899128 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 01:38:41.899146 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899131 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 01:38:41.899146 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899133 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 01:38:41.899618 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899148 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 01:38:41.899618 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899151 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 01:38:41.899618 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899154 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 01:38:41.899618 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899156 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 01:38:41.899618 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899159 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 01:38:41.899618 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899162 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 01:38:41.899618 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899164 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 01:38:41.899618 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899167 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 15 01:38:41.899618 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899177 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 01:38:41.899618 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899181 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 01:38:41.899618 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899183 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 01:38:41.899618 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899186 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 01:38:41.899618 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899189 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 01:38:41.899618 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899192 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 01:38:41.899618 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899194 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 01:38:41.899618 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899197 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 01:38:41.899618 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899199 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 01:38:41.899618 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899202 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 01:38:41.899618 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899204 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 01:38:41.899618 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899207 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 01:38:41.900102 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899209 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 01:38:41.900102 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899211 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 01:38:41.900102 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899214 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 01:38:41.900102 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899216 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 01:38:41.900102 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899219 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 01:38:41.900102 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899221 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 01:38:41.900102 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899224 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 01:38:41.900102 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899227 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 01:38:41.900102 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899229 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 01:38:41.900102 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899232 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 01:38:41.900102 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899234 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 01:38:41.900102 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899237 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 01:38:41.900102 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899239 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 01:38:41.900102 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899244 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 01:38:41.900102 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899247 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 01:38:41.900102 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899251 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 01:38:41.900102 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899254 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 01:38:41.900102 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899258 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 01:38:41.900102 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899260 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 01:38:41.900646 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899264 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 01:38:41.900646 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899268 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 01:38:41.900646 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899271 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 01:38:41.900646 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899274 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 01:38:41.900646 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899277 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 01:38:41.900646 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899280 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 01:38:41.900646 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899284 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 01:38:41.900646 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899286 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 01:38:41.900646 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899289 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 01:38:41.900646 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899291 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 01:38:41.900646 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899295 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 01:38:41.900646 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899299 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 01:38:41.900646 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899302 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 01:38:41.900646 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899304 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 01:38:41.900646 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899307 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 01:38:41.900646 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899314 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 01:38:41.900646 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899316 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 01:38:41.900646 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899318 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 01:38:41.900646 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899321 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 01:38:41.900646 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899324 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 01:38:41.901490 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899327 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 01:38:41.901490 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899329 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 01:38:41.901490 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899332 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 01:38:41.901490 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899347 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 01:38:41.901490 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899350 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 01:38:41.901490 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899352 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 01:38:41.901490 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899355 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 01:38:41.901490 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899358 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 01:38:41.901490 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899361 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 01:38:41.901490 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899364 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 01:38:41.901490 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899366 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 01:38:41.901490 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899369 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 01:38:41.901490 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899371 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 01:38:41.901490 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899374 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 01:38:41.901490 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899376 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 01:38:41.901490 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899379 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 01:38:41.901490 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899382 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 01:38:41.901490 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899384 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 01:38:41.901490 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.899387 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 01:38:41.901490 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900059 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 01:38:41.902007 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900065 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 01:38:41.902007 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900068 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 01:38:41.902007 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900072 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 01:38:41.902007 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900074 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 01:38:41.902007 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900077 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 01:38:41.902007 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900082 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 01:38:41.902007 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900086 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 01:38:41.902007 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900089 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 01:38:41.902007 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900092 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 01:38:41.902007 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900094 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 01:38:41.902007 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900097 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 01:38:41.902007 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900101 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 01:38:41.902007 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900104 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 01:38:41.902007 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900107 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 01:38:41.902007 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900110 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 01:38:41.902007 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900113 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 01:38:41.902007 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900116 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 01:38:41.902007 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900119 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 15 01:38:41.902007 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900121 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 01:38:41.902505 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900124 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 01:38:41.902505 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900127 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 01:38:41.902505 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900130 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 01:38:41.902505 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900132 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 01:38:41.902505 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900135 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 01:38:41.902505 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900137 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 01:38:41.902505 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900140 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 01:38:41.902505 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900142 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 01:38:41.902505 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900145 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 01:38:41.902505 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900147 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 01:38:41.902505 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900150 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 01:38:41.902505 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900152 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 01:38:41.902505 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900155 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 01:38:41.902505 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900157 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 01:38:41.902505 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900160 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 01:38:41.902505 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900162 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 01:38:41.902505 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900165 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 01:38:41.902505 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900169 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 01:38:41.902505 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900172 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 01:38:41.902505 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900175 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 01:38:41.902992 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900177 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 01:38:41.902992 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900180 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 01:38:41.902992 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900182 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 01:38:41.902992 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900185 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 01:38:41.902992 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900188 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 01:38:41.902992 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900190 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 01:38:41.902992 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900193 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 01:38:41.902992 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900195 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 01:38:41.902992 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900198 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 01:38:41.902992 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900200 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 01:38:41.902992 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900203 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 01:38:41.902992 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900205 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 01:38:41.902992 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900208 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 01:38:41.902992 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900210 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 01:38:41.902992 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900213 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 01:38:41.902992 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900216 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 01:38:41.902992 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900218 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 01:38:41.902992 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900221 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 01:38:41.902992 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900223 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 01:38:41.902992 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900226 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 01:38:41.903540 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900228 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 01:38:41.903540 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900231 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 01:38:41.903540 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900234 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 01:38:41.903540 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900236 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 01:38:41.903540 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900239 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 01:38:41.903540 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900241 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 01:38:41.903540 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900244 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 01:38:41.903540 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900246 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 01:38:41.903540 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900253 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 01:38:41.903540 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900256 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 01:38:41.903540 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900259 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 01:38:41.903540 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900261 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 01:38:41.903540 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900264 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 01:38:41.903540 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900266 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 01:38:41.903540 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900269 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 01:38:41.903540 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900272 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 01:38:41.903540 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900274 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 01:38:41.903540 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900277 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 01:38:41.903540 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900281 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 01:38:41.904001 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900285 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 01:38:41.904001 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900288 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 01:38:41.904001 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900291 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 01:38:41.904001 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900294 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 01:38:41.904001 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900297 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 01:38:41.904001 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900300 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 01:38:41.904001 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900303 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 01:38:41.904001 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900305 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 01:38:41.904001 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900309 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 01:38:41.904001 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900312 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 01:38:41.904001 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900314 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 01:38:41.904001 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900317 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 01:38:41.904001 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900320 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 01:38:41.904001 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900323 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 01:38:41.904001 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900325 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 01:38:41.904001 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900328 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 01:38:41.904001 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900331 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 01:38:41.904001 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900347 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 01:38:41.904001 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900350 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 01:38:41.904001 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.900353 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 01:38:41.904508 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902814 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 01:38:41.904508 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902824 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 01:38:41.904508 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902827 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 01:38:41.904508 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902830 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 01:38:41.904508 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902833 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 01:38:41.904508 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902836 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 01:38:41.904508 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902839 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 01:38:41.904508 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902842 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 01:38:41.904508 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902844 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 01:38:41.904508 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902847 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 01:38:41.904508 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902850 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 01:38:41.904508 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902852 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 01:38:41.904508 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902855 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 01:38:41.904508 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902857 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 01:38:41.904508 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902862 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 01:38:41.904508 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902865 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 01:38:41.904508 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902868 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 01:38:41.904508 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902871 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 01:38:41.904508 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902874 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 01:38:41.905000 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902876 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 01:38:41.905000 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902879 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 01:38:41.905000 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902882 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 01:38:41.905000 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902885 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 01:38:41.905000 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902888 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 01:38:41.905000 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902891 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 01:38:41.905000 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902893 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 01:38:41.905000 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902900 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 01:38:41.905000 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902902 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 01:38:41.905000 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902905 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 01:38:41.905000 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902907 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 01:38:41.905000 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902910 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 01:38:41.905000 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902913 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 01:38:41.905000 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902915 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 01:38:41.905000 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902921 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 01:38:41.905000 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902925 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 01:38:41.905000 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902928 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 01:38:41.905000 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902931 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 01:38:41.905000 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902934 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 01:38:41.905000 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902937 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 01:38:41.905497 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902940 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 01:38:41.905497 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902943 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 01:38:41.905497 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902946 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 01:38:41.905497 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902948 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 01:38:41.905497 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902951 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 01:38:41.905497 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902953 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 01:38:41.905497 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902956 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 01:38:41.905497 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902959 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 01:38:41.905497 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902962 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 01:38:41.905497 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902964 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 01:38:41.905497 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902967 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 01:38:41.905497 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902969 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 01:38:41.905497 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902972 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 01:38:41.905497 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902974 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 15 01:38:41.905497 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902977 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 01:38:41.905497 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902979 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 01:38:41.905497 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902982 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 01:38:41.905497 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902984 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 01:38:41.905497 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902987 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 01:38:41.905497 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902989 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 01:38:41.905976 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902993 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 01:38:41.905976 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902996 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 01:38:41.905976 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.902999 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 01:38:41.905976 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903002 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 01:38:41.905976 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903004 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 01:38:41.905976 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903007 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 01:38:41.905976 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903010 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 01:38:41.905976 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903013 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 01:38:41.905976 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903016 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 01:38:41.905976 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903018 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 01:38:41.905976 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903021 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 01:38:41.905976 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903024 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 01:38:41.905976 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903027 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 01:38:41.905976 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903030 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 01:38:41.905976 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903033 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 01:38:41.905976 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903035 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 01:38:41.905976 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903038 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 01:38:41.905976 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903040 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 01:38:41.905976 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903043 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 01:38:41.905976 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903045 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 01:38:41.906501 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903048 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 01:38:41.906501 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903050 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 01:38:41.906501 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903053 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 01:38:41.906501 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903056 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 01:38:41.906501 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903059 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 01:38:41.906501 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903061 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 01:38:41.906501 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903064 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 01:38:41.906501 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903066 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 01:38:41.906501 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903068 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 01:38:41.906501 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903071 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 01:38:41.906501 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903073 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 01:38:41.906501 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903076 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 01:38:41.906501 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903080 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 01:38:41.906501 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903083 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 01:38:41.906501 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903085 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 01:38:41.906501 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903088 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 01:38:41.906501 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903091 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 01:38:41.906501 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903093 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 01:38:41.906501 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903097 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 01:38:41.906501 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903100 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 01:38:41.906972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903180 2576 flags.go:64] FLAG: --address="0.0.0.0" Jun 15 01:38:41.906972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903187 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 15 01:38:41.906972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903194 2576 flags.go:64] FLAG: --anonymous-auth="true" Jun 15 01:38:41.906972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903199 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 15 01:38:41.906972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903203 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 15 01:38:41.906972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903206 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 15 01:38:41.906972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903210 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 15 01:38:41.906972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903215 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 15 01:38:41.906972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903218 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 15 01:38:41.906972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903221 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 15 01:38:41.906972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903225 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 15 01:38:41.906972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903228 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 15 01:38:41.906972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903231 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 15 01:38:41.906972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903234 2576 flags.go:64] FLAG: --cgroup-root="" Jun 15 01:38:41.906972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903236 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 15 01:38:41.906972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903239 2576 flags.go:64] FLAG: --client-ca-file="" Jun 15 01:38:41.906972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903243 2576 flags.go:64] FLAG: --cloud-provider="external" Jun 15 01:38:41.906972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903246 2576 flags.go:64] FLAG: --cluster-dns="[]" Jun 15 01:38:41.906972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903250 2576 flags.go:64] FLAG: --cluster-domain="" Jun 15 01:38:41.906972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903253 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 15 01:38:41.906972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903256 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 15 01:38:41.906972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903259 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 15 01:38:41.906972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903262 2576 flags.go:64] FLAG: --container-log-max-files="5" Jun 15 01:38:41.906972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903266 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 15 01:38:41.907566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903268 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 15 01:38:41.907566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903272 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 15 01:38:41.907566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903275 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 15 01:38:41.907566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903278 2576 flags.go:64] FLAG: --contention-profiling="false" Jun 15 01:38:41.907566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903281 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 15 01:38:41.907566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903284 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 15 01:38:41.907566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903287 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 15 01:38:41.907566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903290 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 15 01:38:41.907566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903298 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 15 01:38:41.907566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903302 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 15 01:38:41.907566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903304 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 15 01:38:41.907566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903307 2576 flags.go:64] FLAG: --enable-load-reader="false" Jun 15 01:38:41.907566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903310 2576 flags.go:64] FLAG: --enable-server="true" Jun 15 01:38:41.907566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903313 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 15 01:38:41.907566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903316 2576 flags.go:64] FLAG: --event-burst="100" Jun 15 01:38:41.907566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903319 2576 flags.go:64] FLAG: --event-qps="50" Jun 15 01:38:41.907566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903323 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 15 01:38:41.907566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903326 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 15 01:38:41.907566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903329 2576 flags.go:64] FLAG: --eviction-hard="" Jun 15 01:38:41.907566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903353 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 15 01:38:41.907566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903356 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 15 01:38:41.907566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903359 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 15 01:38:41.907566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903362 2576 flags.go:64] FLAG: --eviction-soft="" Jun 15 01:38:41.907566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903366 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 15 01:38:41.907566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903368 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 15 01:38:41.908169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903376 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 15 01:38:41.908169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903379 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jun 15 01:38:41.908169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903382 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 15 01:38:41.908169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903385 2576 flags.go:64] FLAG: --fail-swap-on="true" Jun 15 01:38:41.908169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903387 2576 flags.go:64] FLAG: --feature-gates="" Jun 15 01:38:41.908169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903395 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jun 15 01:38:41.908169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903398 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 15 01:38:41.908169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903401 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 15 01:38:41.908169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903404 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 15 01:38:41.908169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903407 2576 flags.go:64] FLAG: --healthz-port="10248" Jun 15 01:38:41.908169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903410 2576 flags.go:64] FLAG: --help="false" Jun 15 01:38:41.908169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903412 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-132-124.ec2.internal" Jun 15 01:38:41.908169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903415 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 15 01:38:41.908169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903419 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jun 15 01:38:41.908169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903422 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 15 01:38:41.908169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903425 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 15 01:38:41.908169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903429 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 15 01:38:41.908169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903432 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 15 01:38:41.908169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903435 2576 flags.go:64] FLAG: --image-service-endpoint="" Jun 15 01:38:41.908169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903437 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 15 01:38:41.908169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903440 2576 flags.go:64] FLAG: --kube-api-burst="100" Jun 15 01:38:41.908169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903443 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 15 01:38:41.908169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903446 2576 flags.go:64] FLAG: --kube-api-qps="50" Jun 15 01:38:41.908169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903449 2576 flags.go:64] FLAG: --kube-reserved="" Jun 15 01:38:41.908754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903452 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 15 01:38:41.908754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903454 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 15 01:38:41.908754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903457 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jun 15 01:38:41.908754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903460 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 15 01:38:41.908754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903463 2576 flags.go:64] FLAG: --lock-file="" Jun 15 01:38:41.908754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903465 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 15 01:38:41.908754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903468 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 15 01:38:41.908754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903471 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 15 01:38:41.908754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903476 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jun 15 01:38:41.908754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903480 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 15 01:38:41.908754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903482 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jun 15 01:38:41.908754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903485 2576 flags.go:64] FLAG: --logging-format="text" Jun 15 01:38:41.908754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903488 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 15 01:38:41.908754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903491 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 15 01:38:41.908754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903493 2576 flags.go:64] FLAG: --manifest-url="" Jun 15 01:38:41.908754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903498 2576 flags.go:64] FLAG: --manifest-url-header="" Jun 15 01:38:41.908754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903503 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 15 01:38:41.908754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903506 2576 flags.go:64] FLAG: --max-open-files="1000000" Jun 15 01:38:41.908754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903510 2576 flags.go:64] FLAG: --max-pods="110" Jun 15 01:38:41.908754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903513 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 15 01:38:41.908754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903516 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 15 01:38:41.908754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903519 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jun 15 01:38:41.908754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903522 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 15 01:38:41.908754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903525 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 15 01:38:41.908754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903527 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 15 01:38:41.909420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903530 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 15 01:38:41.909420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903537 2576 flags.go:64] FLAG: --node-status-max-images="50" Jun 15 01:38:41.909420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903540 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 15 01:38:41.909420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903543 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jun 15 01:38:41.909420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903546 2576 flags.go:64] FLAG: --pod-cidr="" Jun 15 01:38:41.909420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903550 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 15 01:38:41.909420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903555 2576 flags.go:64] FLAG: --pod-manifest-path="" Jun 15 01:38:41.909420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903558 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jun 15 01:38:41.909420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903561 2576 flags.go:64] FLAG: --pods-per-core="0" Jun 15 01:38:41.909420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903564 2576 flags.go:64] FLAG: --port="10250" Jun 15 01:38:41.909420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903567 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 15 01:38:41.909420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903569 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ad848c87c7b42f2b" Jun 15 01:38:41.909420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903572 2576 flags.go:64] FLAG: --qos-reserved="" Jun 15 01:38:41.909420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903575 2576 flags.go:64] FLAG: --read-only-port="10255" Jun 15 01:38:41.909420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903578 2576 flags.go:64] FLAG: --register-node="true" Jun 15 01:38:41.909420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903581 2576 flags.go:64] FLAG: --register-with-taints="" Jun 15 01:38:41.909420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903584 2576 flags.go:64] FLAG: --registry-burst="10" Jun 15 01:38:41.909420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903588 2576 flags.go:64] FLAG: --registry-qps="5" Jun 15 01:38:41.909420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903591 2576 flags.go:64] FLAG: --reserved-cpus="" Jun 15 01:38:41.909420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903593 2576 flags.go:64] FLAG: --reserved-memory="" Jun 15 01:38:41.909420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903597 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 15 01:38:41.909420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903600 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 15 01:38:41.909420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903603 2576 flags.go:64] FLAG: --rotate-certificates="false" Jun 15 01:38:41.909420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903607 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 15 01:38:41.909420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903610 2576 flags.go:64] FLAG: --runonce="false" Jun 15 01:38:41.910126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903613 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 15 01:38:41.910126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903616 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 15 01:38:41.910126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903619 2576 flags.go:64] FLAG: --seccomp-default="false" Jun 15 01:38:41.910126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903622 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 15 01:38:41.910126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903624 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 15 01:38:41.910126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903627 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 15 01:38:41.910126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903630 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 15 01:38:41.910126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903633 2576 flags.go:64] FLAG: --storage-driver-password="root" Jun 15 01:38:41.910126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903636 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jun 15 01:38:41.910126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903639 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jun 15 01:38:41.910126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903642 2576 flags.go:64] FLAG: --storage-driver-user="root" Jun 15 01:38:41.910126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903644 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 15 01:38:41.910126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903647 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 15 01:38:41.910126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903650 2576 flags.go:64] FLAG: --system-cgroups="" Jun 15 01:38:41.910126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903653 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 15 01:38:41.910126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903658 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 15 01:38:41.910126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903661 2576 flags.go:64] FLAG: --tls-cert-file="" Jun 15 01:38:41.910126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903664 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 15 01:38:41.910126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903667 2576 flags.go:64] FLAG: --tls-min-version="" Jun 15 01:38:41.910126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903670 2576 flags.go:64] FLAG: --tls-private-key-file="" Jun 15 01:38:41.910126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903673 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jun 15 01:38:41.910126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903676 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 15 01:38:41.910126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903679 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jun 15 01:38:41.910126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903682 2576 flags.go:64] FLAG: --v="2" Jun 15 01:38:41.910126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903685 2576 flags.go:64] FLAG: --version="false" Jun 15 01:38:41.910757 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903690 2576 flags.go:64] FLAG: --vmodule="" Jun 15 01:38:41.910757 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903693 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 15 01:38:41.910757 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.903696 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 15 01:38:41.910757 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903803 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 01:38:41.910757 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903807 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 01:38:41.910757 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903811 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 01:38:41.910757 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903814 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 01:38:41.910757 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903817 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 01:38:41.910757 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903819 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 01:38:41.910757 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903822 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 01:38:41.910757 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903825 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 01:38:41.910757 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903827 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 01:38:41.910757 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903830 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 01:38:41.910757 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903833 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 01:38:41.910757 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903835 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 01:38:41.910757 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903838 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 01:38:41.910757 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903840 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 01:38:41.910757 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903843 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 01:38:41.910757 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903847 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 01:38:41.910757 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903851 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 01:38:41.911248 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903854 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 01:38:41.911248 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903856 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 01:38:41.911248 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903859 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 01:38:41.911248 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903862 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 01:38:41.911248 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903865 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 01:38:41.911248 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903867 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 01:38:41.911248 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903870 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 01:38:41.911248 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903872 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 01:38:41.911248 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903875 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 01:38:41.911248 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903877 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 01:38:41.911248 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903880 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 01:38:41.911248 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903882 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 01:38:41.911248 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903885 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 01:38:41.911248 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903888 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 01:38:41.911248 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903891 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 01:38:41.911248 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903893 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 01:38:41.911248 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903896 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 01:38:41.911248 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903900 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 01:38:41.911248 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903903 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 01:38:41.911248 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903905 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 01:38:41.911760 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903908 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 01:38:41.911760 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903910 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 01:38:41.911760 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903913 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 01:38:41.911760 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903915 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 15 01:38:41.911760 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903918 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 01:38:41.911760 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903920 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 01:38:41.911760 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903923 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 01:38:41.911760 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903926 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 01:38:41.911760 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903928 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 01:38:41.911760 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903931 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 01:38:41.911760 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903933 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 01:38:41.911760 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903938 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 01:38:41.911760 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903941 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 01:38:41.911760 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903944 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 01:38:41.911760 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903947 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 01:38:41.911760 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903950 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 01:38:41.911760 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903954 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 01:38:41.911760 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903957 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 01:38:41.911760 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903959 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 01:38:41.912219 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903962 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 01:38:41.912219 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903965 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 01:38:41.912219 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903968 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 01:38:41.912219 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903970 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 01:38:41.912219 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903973 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 01:38:41.912219 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903976 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 01:38:41.912219 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903978 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 01:38:41.912219 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903981 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 01:38:41.912219 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903985 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 01:38:41.912219 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903988 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 01:38:41.912219 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903992 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 01:38:41.912219 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903995 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 01:38:41.912219 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.903997 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 01:38:41.912219 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904000 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 01:38:41.912219 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904002 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 01:38:41.912219 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904005 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 01:38:41.912219 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904008 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 01:38:41.912219 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904010 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 01:38:41.912219 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904013 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 01:38:41.912219 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904016 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 01:38:41.912716 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904018 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 01:38:41.912716 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904021 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 01:38:41.912716 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904023 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 01:38:41.912716 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904026 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 01:38:41.912716 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904028 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 01:38:41.912716 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904031 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 01:38:41.912716 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904033 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 01:38:41.912716 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904036 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 01:38:41.912716 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904039 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 01:38:41.912716 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904041 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 01:38:41.912716 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904044 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 01:38:41.912716 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904046 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 01:38:41.912716 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904049 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 01:38:41.912716 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904052 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 01:38:41.912716 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904054 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 01:38:41.912716 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904057 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 01:38:41.912716 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904059 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 01:38:41.912716 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904062 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 01:38:41.912716 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904064 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 01:38:41.912716 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904067 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 01:38:41.913188 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904071 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 01:38:41.913188 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904073 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 01:38:41.913188 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.904077 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 01:38:41.913188 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.904083 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 01:38:41.913188 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.910639 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 15 01:38:41.913188 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.910654 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 15 01:38:41.913188 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.910673 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 15 01:38:41.913188 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.910679 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 15 01:38:41.913188 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910735 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 01:38:41.913188 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910740 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 01:38:41.913188 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910743 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 01:38:41.913188 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910746 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 01:38:41.913188 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910749 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 01:38:41.913188 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910752 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 01:38:41.913188 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910755 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 01:38:41.913597 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910759 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 01:38:41.913597 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910762 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 01:38:41.913597 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910765 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 01:38:41.913597 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910768 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 01:38:41.913597 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910771 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 01:38:41.913597 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910775 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 01:38:41.913597 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910777 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 01:38:41.913597 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910780 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 01:38:41.913597 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910783 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 01:38:41.913597 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910785 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 01:38:41.913597 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910788 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 01:38:41.913597 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910791 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 01:38:41.913597 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910795 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 01:38:41.913597 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910798 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 01:38:41.913597 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910802 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 01:38:41.913597 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910805 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 01:38:41.913597 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910808 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 01:38:41.913597 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910810 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 01:38:41.913597 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910814 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 01:38:41.914056 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910816 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 01:38:41.914056 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910819 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 01:38:41.914056 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910822 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 01:38:41.914056 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910826 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 01:38:41.914056 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910829 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 01:38:41.914056 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910832 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 01:38:41.914056 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910834 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 01:38:41.914056 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910837 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 01:38:41.914056 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910839 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 01:38:41.914056 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910842 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 01:38:41.914056 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910844 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 01:38:41.914056 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910847 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 01:38:41.914056 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910849 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 01:38:41.914056 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910852 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 01:38:41.914056 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910855 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 01:38:41.914056 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910857 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 01:38:41.914056 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910860 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 01:38:41.914056 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910863 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 01:38:41.914056 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910865 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 01:38:41.914056 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910868 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 01:38:41.914558 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910870 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 01:38:41.914558 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910873 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 01:38:41.914558 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910875 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 01:38:41.914558 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910878 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 01:38:41.914558 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910880 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 01:38:41.914558 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910883 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 01:38:41.914558 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910885 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 01:38:41.914558 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910888 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 01:38:41.914558 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910890 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 01:38:41.914558 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910893 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 01:38:41.914558 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910895 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 01:38:41.914558 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910898 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 01:38:41.914558 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910900 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 01:38:41.914558 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910903 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 01:38:41.914558 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910905 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 01:38:41.914558 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910909 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 01:38:41.914558 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910913 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 01:38:41.914558 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910915 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 01:38:41.914558 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910918 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 01:38:41.914558 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910920 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 01:38:41.915039 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910923 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 01:38:41.915039 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910925 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 01:38:41.915039 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910928 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 01:38:41.915039 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910930 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 01:38:41.915039 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910933 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 01:38:41.915039 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910935 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 01:38:41.915039 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910938 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 01:38:41.915039 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910940 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 01:38:41.915039 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910943 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 01:38:41.915039 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910945 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 15 01:38:41.915039 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910949 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 01:38:41.915039 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910953 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 01:38:41.915039 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910955 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 01:38:41.915039 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910958 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 01:38:41.915039 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910960 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 01:38:41.915039 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910963 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 01:38:41.915039 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910965 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 01:38:41.915039 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910968 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 01:38:41.915039 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910970 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 01:38:41.915039 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910973 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 01:38:41.915629 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910976 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 01:38:41.915629 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910980 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 01:38:41.915629 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910983 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 01:38:41.915629 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910986 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 01:38:41.915629 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910989 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 01:38:41.915629 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910991 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 01:38:41.915629 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910994 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 01:38:41.915629 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.910997 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 01:38:41.915629 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911000 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 01:38:41.915629 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911005 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 01:38:41.915629 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911008 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 01:38:41.915629 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911010 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 01:38:41.915629 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911013 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 01:38:41.915629 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.911018 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 01:38:41.915968 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911124 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 01:38:41.915968 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911129 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 01:38:41.915968 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911132 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 01:38:41.915968 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911135 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 01:38:41.915968 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911138 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 01:38:41.915968 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911141 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 01:38:41.915968 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911145 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 01:38:41.915968 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911147 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 01:38:41.915968 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911150 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 01:38:41.915968 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911153 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 01:38:41.915968 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911156 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 01:38:41.915968 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911158 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 01:38:41.915968 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911161 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 01:38:41.915968 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911164 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 01:38:41.915968 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911167 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 01:38:41.915968 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911179 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 01:38:41.915968 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911184 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 01:38:41.915968 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911187 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 01:38:41.915968 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911191 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 01:38:41.916429 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911194 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 01:38:41.916429 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911197 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 01:38:41.916429 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911200 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 01:38:41.916429 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911203 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 01:38:41.916429 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911205 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 01:38:41.916429 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911208 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 01:38:41.916429 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911211 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 01:38:41.916429 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911213 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 01:38:41.916429 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911216 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 01:38:41.916429 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911222 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 01:38:41.916429 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911225 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 01:38:41.916429 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911228 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 01:38:41.916429 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911230 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 01:38:41.916429 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911233 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 15 01:38:41.916429 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911235 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 01:38:41.916429 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911238 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 01:38:41.916429 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911240 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 01:38:41.916429 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911243 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 01:38:41.916429 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911245 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 01:38:41.916429 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911248 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 01:38:41.916904 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911250 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 01:38:41.916904 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911253 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 01:38:41.916904 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911256 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 01:38:41.916904 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911259 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 01:38:41.916904 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911261 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 01:38:41.916904 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911264 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 01:38:41.916904 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911267 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 01:38:41.916904 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911270 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 01:38:41.916904 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911272 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 01:38:41.916904 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911275 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 01:38:41.916904 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911278 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 01:38:41.916904 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911280 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 01:38:41.916904 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911282 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 01:38:41.916904 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911285 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 01:38:41.916904 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911287 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 01:38:41.916904 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911290 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 01:38:41.916904 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911292 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 01:38:41.916904 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911294 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 01:38:41.916904 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911297 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 01:38:41.916904 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911300 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 01:38:41.917417 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911302 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 01:38:41.917417 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911305 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 01:38:41.917417 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911308 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 01:38:41.917417 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911310 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 01:38:41.917417 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911312 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 01:38:41.917417 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911315 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 01:38:41.917417 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911317 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 01:38:41.917417 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911320 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 01:38:41.917417 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911322 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 01:38:41.917417 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911325 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 01:38:41.917417 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911327 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 01:38:41.917417 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911330 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 01:38:41.917417 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911332 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 01:38:41.917417 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911351 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 01:38:41.917417 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911354 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 01:38:41.917417 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911357 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 01:38:41.917417 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911359 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 01:38:41.917417 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911362 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 01:38:41.917417 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911364 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 01:38:41.917861 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911367 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 01:38:41.917861 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911369 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 01:38:41.917861 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911372 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 01:38:41.917861 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911375 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 01:38:41.917861 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911377 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 01:38:41.917861 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911379 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 01:38:41.917861 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911382 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 01:38:41.917861 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911385 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 01:38:41.917861 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911388 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 01:38:41.917861 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911391 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 01:38:41.917861 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911394 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 01:38:41.917861 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911397 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 01:38:41.917861 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911400 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 01:38:41.917861 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911402 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 01:38:41.917861 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911405 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 01:38:41.917861 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911407 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 01:38:41.917861 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911410 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 01:38:41.917861 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911413 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 01:38:41.917861 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911415 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 01:38:41.917861 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911418 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 01:38:41.918332 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:41.911420 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 01:38:41.918332 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.911425 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 01:38:41.918332 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.911531 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jun 15 01:38:41.918332 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.913660 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 15 01:38:41.918332 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.914908 2576 server.go:1019] "Starting client certificate rotation" Jun 15 01:38:41.918332 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.915002 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 01:38:41.918332 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.915035 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 01:38:41.918332 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.917280 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 01:38:41.920137 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.920117 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 01:38:41.934690 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.934657 2576 log.go:25] "Validated CRI v1 runtime API" Jun 15 01:38:41.937707 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.937688 2576 log.go:25] "Validated CRI v1 image API" Jun 15 01:38:41.938520 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.938502 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 15 01:38:41.941513 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.941494 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 01:38:41.943446 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.943429 2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7ddc7064-be15-4275-baa3-888cc9419609:/dev/nvme0n1p4 fecfe7eb-4576-4893-99cc-d72e0e2235de:/dev/nvme0n1p3] Jun 15 01:38:41.943517 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.943445 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 15 01:38:41.949030 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.948924 2576 manager.go:216] Machine: {Timestamp:2026-06-15 01:38:41.947529878 +0000 UTC m=+0.306070269 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101555 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2595a858135ac2fe484b8f75ca56c3 SystemUUID:ec2595a8-5813-5ac2-fe48-4b8f75ca56c3 BootID:5ac8454d-d6b0-4ca3-a852-8244b7ff0fc3 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ae:1c:85:c2:57 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ae:1c:85:c2:57 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:a2:d8:ea:11:4b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 15 01:38:41.949030 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.949025 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 15 01:38:41.949137 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.949100 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 15 01:38:41.952192 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.952167 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 15 01:38:41.952326 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.952195 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-124.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 15 01:38:41.952828 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.952818 2576 topology_manager.go:138] "Creating topology manager with none policy" Jun 15 01:38:41.952862 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.952830 2576 container_manager_linux.go:309] "Creating device plugin manager" Jun 15 01:38:41.952862 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.952837 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 01:38:41.953463 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.953452 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 01:38:41.954551 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.954541 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 15 01:38:41.958069 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.958057 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 15 01:38:41.958180 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.958171 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 15 01:38:41.958218 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.958209 2576 kubelet.go:486] "Attempting to sync node with API server" Jun 15 01:38:41.958246 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.958230 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 15 01:38:41.958273 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.958253 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 15 01:38:41.958273 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.958268 2576 kubelet.go:398] "Adding apiserver pod source" Jun 15 01:38:41.958323 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.958280 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 15 01:38:41.958686 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.958674 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 01:38:41.958755 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.958692 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 01:38:41.961109 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.961093 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 15 01:38:41.962855 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.962842 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 15 01:38:41.962901 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.962872 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 15 01:38:41.963498 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.963483 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 15 01:38:41.963498 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.963499 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 15 01:38:41.963614 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.963505 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 15 01:38:41.963614 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.963512 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 15 01:38:41.963614 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.963520 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 15 01:38:41.963614 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.963526 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 15 01:38:41.963614 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.963534 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 15 01:38:41.963614 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.963538 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 15 01:38:41.963614 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.963545 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 15 01:38:41.963614 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.963550 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 15 01:38:41.963614 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.963570 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 15 01:38:41.963614 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.963579 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 15 01:38:41.964379 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.964368 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 15 01:38:41.964379 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.964379 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 15 01:38:41.966630 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.966611 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9np2z" Jun 15 01:38:41.967458 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.967446 2576 server.go:1268] "Started kubelet" Jun 15 01:38:41.967578 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.967532 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 15 01:38:41.967650 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.967517 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 15 01:38:41.967650 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.967615 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 15 01:38:41.967943 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.967920 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-124.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 15 01:38:41.968086 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:41.968063 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 15 01:38:41.968178 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:41.968086 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-124.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 15 01:38:41.968433 ip-10-0-132-124 systemd[1]: Started Kubernetes Kubelet. Jun 15 01:38:41.969374 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.969321 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 15 01:38:41.969737 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.969725 2576 server.go:310] "Adding debug handlers to kubelet server" Jun 15 01:38:41.973196 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.973171 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9np2z" Jun 15 01:38:41.976399 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:41.976377 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 15 01:38:41.976576 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:41.975678 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-124.ec2.internal.18b91d7666a8b68f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-124.ec2.internal,UID:ip-10-0-132-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-124.ec2.internal,},FirstTimestamp:2026-06-15 01:38:41.967421071 +0000 UTC m=+0.325961458,LastTimestamp:2026-06-15 01:38:41.967421071 +0000 UTC m=+0.325961458,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-124.ec2.internal,}" Jun 15 01:38:41.978884 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.978865 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 15 01:38:41.978942 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.978881 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 15 01:38:41.978995 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:41.978960 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-124.ec2.internal\" not found" Jun 15 01:38:41.979748 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.979728 2576 factory.go:55] Registering systemd factory Jun 15 01:38:41.979748 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.979750 2576 factory.go:223] Registration of the systemd container factory successfully Jun 15 01:38:41.980123 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.979973 2576 factory.go:153] Registering CRI-O factory Jun 15 01:38:41.980181 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.980126 2576 factory.go:223] Registration of the crio container factory successfully Jun 15 01:38:41.980181 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.980077 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 15 01:38:41.980181 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.980080 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 15 01:38:41.980307 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.980187 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 15 01:38:41.980307 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.980197 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 15 01:38:41.980307 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.980224 2576 factory.go:103] Registering Raw factory Jun 15 01:38:41.980307 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.980237 2576 manager.go:1196] Started watching for new ooms in manager Jun 15 01:38:41.980307 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.980269 2576 reconstruct.go:97] "Volume reconstruction finished" Jun 15 01:38:41.980307 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.980281 2576 reconciler.go:29] "Reconciler: start to sync state" Jun 15 01:38:41.980590 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.980579 2576 manager.go:349] Starting recovery of all containers Jun 15 01:38:41.980702 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:41.980683 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-124.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 15 01:38:41.980960 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:41.980928 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 15 01:38:41.991555 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.991444 2576 manager.go:354] Recovery completed Jun 15 01:38:41.995627 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.995615 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:38:41.998503 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.998487 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-124.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:38:41.998576 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.998518 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:38:41.998576 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.998530 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-124.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:38:41.999112 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.999096 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 15 01:38:41.999112 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.999112 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 15 01:38:41.999222 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.999106 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:38:41.999222 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.999133 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 15 01:38:41.999978 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.999962 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-124.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:38:42.000046 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:41.999995 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:38:42.000046 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.000012 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-124.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:38:42.001299 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.001286 2576 policy_none.go:49] "None policy: Start" Jun 15 01:38:42.001364 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.001305 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 15 01:38:42.001364 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.001322 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 15 01:38:42.003403 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.003387 2576 policy_none.go:47] "Start" Jun 15 01:38:42.043148 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.043121 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 15 01:38:42.058640 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.044189 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 15 01:38:42.058640 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.044235 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 15 01:38:42.058640 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.044260 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jun 15 01:38:42.058640 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:42.044300 2576 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 15 01:38:42.058640 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.045802 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 01:38:42.058640 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.045956 2576 manager.go:337] "Starting Device Plugin manager" Jun 15 01:38:42.058640 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:42.045986 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 15 01:38:42.058640 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.045999 2576 server.go:87] "Starting device plugin registration server" Jun 15 01:38:42.058640 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.046243 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 15 01:38:42.058640 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.046257 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 15 01:38:42.058640 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.046327 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 15 01:38:42.058640 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.046419 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 15 01:38:42.058640 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.046429 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 15 01:38:42.058640 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:42.046992 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 15 01:38:42.058640 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:42.047040 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-124.ec2.internal\" not found" Jun 15 01:38:42.144966 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.144901 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-124.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-124.ec2.internal"] Jun 15 01:38:42.145048 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.144978 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:38:42.145899 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.145882 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-124.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:38:42.145989 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.145918 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:38:42.145989 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.145934 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-124.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:38:42.146948 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.146935 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:38:42.147624 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.147606 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-124.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:38:42.147689 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.147639 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:38:42.147689 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.147654 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-124.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:38:42.147689 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.147685 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-124.ec2.internal" Jun 15 01:38:42.148185 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.148171 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:38:42.148304 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.148290 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-124.ec2.internal" Jun 15 01:38:42.148366 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.148319 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:38:42.148780 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.148759 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-124.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:38:42.148859 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.148787 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:38:42.148859 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.148798 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-124.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:38:42.148859 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.148763 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-124.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:38:42.148859 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.148854 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:38:42.149003 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.148864 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-124.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:38:42.150896 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.150881 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-124.ec2.internal" Jun 15 01:38:42.150988 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.150904 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:38:42.151533 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.151517 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-124.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:38:42.151601 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.151549 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:38:42.151601 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.151565 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-124.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:38:42.154563 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.154549 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-124.ec2.internal" Jun 15 01:38:42.154611 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:42.154567 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-124.ec2.internal\": node \"ip-10-0-132-124.ec2.internal\" not found" Jun 15 01:38:42.171429 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:42.171411 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-124.ec2.internal\" not found" Jun 15 01:38:42.171986 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:42.171970 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-124.ec2.internal\" not found" node="ip-10-0-132-124.ec2.internal" Jun 15 01:38:42.176425 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:42.176405 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-124.ec2.internal\" not found" node="ip-10-0-132-124.ec2.internal" Jun 15 01:38:42.181569 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.181552 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bf4310eb0511ab78d8a84f23e6330eb0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-124.ec2.internal\" (UID: \"bf4310eb0511ab78d8a84f23e6330eb0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-124.ec2.internal" Jun 15 01:38:42.181640 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.181577 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf4310eb0511ab78d8a84f23e6330eb0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-124.ec2.internal\" (UID: \"bf4310eb0511ab78d8a84f23e6330eb0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-124.ec2.internal" Jun 15 01:38:42.181640 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.181594 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fdbf0aa446b2930d878266db1bc6b1f0-config\") pod \"kube-apiserver-proxy-ip-10-0-132-124.ec2.internal\" (UID: \"fdbf0aa446b2930d878266db1bc6b1f0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-124.ec2.internal" Jun 15 01:38:42.272044 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:42.272024 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-124.ec2.internal\" not found" Jun 15 01:38:42.282360 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.282330 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bf4310eb0511ab78d8a84f23e6330eb0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-124.ec2.internal\" (UID: \"bf4310eb0511ab78d8a84f23e6330eb0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-124.ec2.internal" Jun 15 01:38:42.282406 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.282368 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf4310eb0511ab78d8a84f23e6330eb0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-124.ec2.internal\" (UID: \"bf4310eb0511ab78d8a84f23e6330eb0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-124.ec2.internal" Jun 15 01:38:42.282406 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.282384 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fdbf0aa446b2930d878266db1bc6b1f0-config\") pod \"kube-apiserver-proxy-ip-10-0-132-124.ec2.internal\" (UID: \"fdbf0aa446b2930d878266db1bc6b1f0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-124.ec2.internal" Jun 15 01:38:42.282482 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.282424 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf4310eb0511ab78d8a84f23e6330eb0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-124.ec2.internal\" (UID: \"bf4310eb0511ab78d8a84f23e6330eb0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-124.ec2.internal" Jun 15 01:38:42.282482 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.282426 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bf4310eb0511ab78d8a84f23e6330eb0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-124.ec2.internal\" (UID: \"bf4310eb0511ab78d8a84f23e6330eb0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-124.ec2.internal" Jun 15 01:38:42.282482 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.282454 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fdbf0aa446b2930d878266db1bc6b1f0-config\") pod \"kube-apiserver-proxy-ip-10-0-132-124.ec2.internal\" (UID: \"fdbf0aa446b2930d878266db1bc6b1f0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-124.ec2.internal" Jun 15 01:38:42.372992 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:42.372968 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-124.ec2.internal\" not found" Jun 15 01:38:42.473779 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:42.473722 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-124.ec2.internal\" not found" Jun 15 01:38:42.474817 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.474803 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-124.ec2.internal" Jun 15 01:38:42.479157 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.479142 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-124.ec2.internal" Jun 15 01:38:42.574414 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:42.574385 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-124.ec2.internal\" not found" Jun 15 01:38:42.674921 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:42.674898 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-124.ec2.internal\" not found" Jun 15 01:38:42.775469 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:42.775416 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-124.ec2.internal\" not found" Jun 15 01:38:42.875977 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:42.875948 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-124.ec2.internal\" not found" Jun 15 01:38:42.914499 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.914468 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 15 01:38:42.915164 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.914652 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 15 01:38:42.976704 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:42.976680 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-124.ec2.internal\" not found" Jun 15 01:38:42.979953 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.979907 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-14 01:33:41 +0000 UTC" deadline="2028-01-28 09:33:40.35510081 +0000 UTC" Jun 15 01:38:42.979953 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.979951 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14215h54m57.375153182s" Jun 15 01:38:42.980527 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:42.980503 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf4310eb0511ab78d8a84f23e6330eb0.slice/crio-7565936f8fa73fa4460491dc7eca73d85d01df70eec2d54777eaf4fda7b1415f WatchSource:0}: Error finding container 7565936f8fa73fa4460491dc7eca73d85d01df70eec2d54777eaf4fda7b1415f: Status 404 returned error can't find the container with id 7565936f8fa73fa4460491dc7eca73d85d01df70eec2d54777eaf4fda7b1415f Jun 15 01:38:42.980732 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:42.980715 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdbf0aa446b2930d878266db1bc6b1f0.slice/crio-6016f16033be01aa22546f3d412cfb310bfbe56f1a138acca5a629c302f3e23b WatchSource:0}: Error finding container 6016f16033be01aa22546f3d412cfb310bfbe56f1a138acca5a629c302f3e23b: Status 404 returned error can't find the container with id 6016f16033be01aa22546f3d412cfb310bfbe56f1a138acca5a629c302f3e23b Jun 15 01:38:42.987965 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:42.987942 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 01:38:43.026056 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.025968 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 01:38:43.048198 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.048140 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-124.ec2.internal" event={"ID":"fdbf0aa446b2930d878266db1bc6b1f0","Type":"ContainerStarted","Data":"6016f16033be01aa22546f3d412cfb310bfbe56f1a138acca5a629c302f3e23b"} Jun 15 01:38:43.049077 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.049056 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-124.ec2.internal" event={"ID":"bf4310eb0511ab78d8a84f23e6330eb0","Type":"ContainerStarted","Data":"7565936f8fa73fa4460491dc7eca73d85d01df70eec2d54777eaf4fda7b1415f"} Jun 15 01:38:43.080069 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.080051 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-124.ec2.internal" Jun 15 01:38:43.087176 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.087156 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 01:38:43.090452 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.090441 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-124.ec2.internal" Jun 15 01:38:43.100054 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.100035 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 01:38:43.257228 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.257210 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 01:38:43.370195 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.370170 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 01:38:43.915073 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.915038 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 01:38:43.959236 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.959207 2576 apiserver.go:52] "Watching apiserver" Jun 15 01:38:43.967134 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.967108 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 15 01:38:43.969879 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.969844 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-t9zjx","kube-system/kube-apiserver-proxy-ip-10-0-132-124.ec2.internal","openshift-dns/node-resolver-kqxqs","openshift-image-registry/node-ca-xqcdr","openshift-multus/multus-xngcq","openshift-network-operator/iptables-alerter-4sfxm","openshift-ovn-kubernetes/ovnkube-node-whwth","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl","openshift-cluster-node-tuning-operator/tuned-qprql","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-124.ec2.internal","openshift-multus/multus-additional-cni-plugins-7gxl6","openshift-multus/network-metrics-daemon-26h5n","openshift-network-diagnostics/network-check-target-lbh9n","kube-system/global-pull-secret-syncer-szg9h"] Jun 15 01:38:43.972461 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.972444 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:43.974662 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.974630 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:38:43.974751 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:43.974726 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbh9n" podUID="840c3654-07ac-4e2d-b17e-a21149308654" Jun 15 01:38:43.975051 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.975031 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 15 01:38:43.975146 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.975111 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 15 01:38:43.975264 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.975241 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7n9jc\"" Jun 15 01:38:43.975459 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.975437 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 15 01:38:43.975966 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.975944 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 15 01:38:43.976053 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.976001 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 15 01:38:43.976053 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.976015 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 15 01:38:43.976817 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.976795 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kqxqs" Jun 15 01:38:43.978961 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.978943 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 15 01:38:43.979057 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.979013 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 15 01:38:43.979057 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.979052 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xqcdr" Jun 15 01:38:43.979217 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.979178 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-s2wmb\"" Jun 15 01:38:43.979364 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.979327 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 15 01:38:43.981138 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.981117 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 15 01:38:43.981221 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.981192 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xngcq" Jun 15 01:38:43.981655 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.981632 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 15 01:38:43.981745 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.981700 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 15 01:38:43.981745 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.981710 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zmrk6\"" Jun 15 01:38:43.983437 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.983413 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 15 01:38:43.983528 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.983495 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-s5qk6\"" Jun 15 01:38:43.983591 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.983537 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 15 01:38:43.983591 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.983554 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 15 01:38:43.983688 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.983495 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 15 01:38:43.983861 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.983808 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4sfxm" Jun 15 01:38:43.986083 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.986066 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 15 01:38:43.986276 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.986225 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 15 01:38:43.986375 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.986307 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2ffzg\"" Jun 15 01:38:43.986375 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.986325 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 15 01:38:43.986486 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.986229 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:43.988653 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.988600 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 15 01:38:43.988653 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.988612 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 15 01:38:43.988888 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.988873 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t9zjx" Jun 15 01:38:43.989062 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.988876 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-grvm4\"" Jun 15 01:38:43.990624 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.990602 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 01:38:43.991219 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991199 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 15 01:38:43.991347 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-run-systemd\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:43.991423 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991364 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b842d4f5-5f7d-417a-9473-1271dc39b8eb-serviceca\") pod \"node-ca-xqcdr\" (UID: \"b842d4f5-5f7d-417a-9473-1271dc39b8eb\") " pod="openshift-image-registry/node-ca-xqcdr" Jun 15 01:38:43.991423 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991387 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-multus-cni-dir\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:43.991423 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991400 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:38:43.991423 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991417 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6060d82e-9d20-4244-b25e-ebbffe02c1aa-cni-binary-copy\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:43.991609 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991441 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-host-kubelet\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:43.991609 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991467 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-node-log\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:43.991609 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991489 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j9cj\" (UniqueName: \"kubernetes.io/projected/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-kube-api-access-8j9cj\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:43.991609 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991516 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqv4s\" (UniqueName: \"kubernetes.io/projected/840c3654-07ac-4e2d-b17e-a21149308654-kube-api-access-nqv4s\") pod \"network-check-target-lbh9n\" (UID: \"840c3654-07ac-4e2d-b17e-a21149308654\") " pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:38:43.991609 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-host-var-lib-cni-multus\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:43.991609 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991581 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-d2bkx\"" Jun 15 01:38:43.991609 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991593 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5hst\" (UniqueName: \"kubernetes.io/projected/6060d82e-9d20-4244-b25e-ebbffe02c1aa-kube-api-access-k5hst\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:43.991933 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991619 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 15 01:38:43.991933 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991616 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-etc-openvswitch\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:43.991933 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991672 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-host-run-k8s-cni-cncf-io\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:43.991933 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991696 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-host-var-lib-cni-bin\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:43.991933 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:43.991463 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szg9h" podUID="1113a386-54ff-45c9-88c7-0696fd879022" Jun 15 01:38:43.991933 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991742 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6060d82e-9d20-4244-b25e-ebbffe02c1aa-multus-daemon-config\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:43.991933 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991790 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-host-slash\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:43.991933 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991816 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-host-run-netns\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:43.991933 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991846 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-host-cni-bin\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:43.991933 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991871 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-ovnkube-config\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:43.991933 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991891 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-cnibin\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:43.991933 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991905 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-host-var-lib-kubelet\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:43.991933 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991924 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-systemd-units\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:43.992555 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991960 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-run-openvswitch\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:43.992555 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.991984 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-host-cni-netd\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:43.992555 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.992002 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11c51e69-484c-4efa-bebe-0eb0ccf33029-tmp-dir\") pod \"node-resolver-kqxqs\" (UID: \"11c51e69-484c-4efa-bebe-0eb0ccf33029\") " pod="openshift-dns/node-resolver-kqxqs" Jun 15 01:38:43.992555 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.992033 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-multus-socket-dir-parent\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:43.992555 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.992055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-host-run-multus-certs\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:43.992555 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.992069 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-etc-kubernetes\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:43.992555 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.992086 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-var-lib-openvswitch\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:43.992555 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.992109 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b842d4f5-5f7d-417a-9473-1271dc39b8eb-host\") pod \"node-ca-xqcdr\" (UID: \"b842d4f5-5f7d-417a-9473-1271dc39b8eb\") " pod="openshift-image-registry/node-ca-xqcdr" Jun 15 01:38:43.992555 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.992138 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq7rc\" (UniqueName: \"kubernetes.io/projected/b842d4f5-5f7d-417a-9473-1271dc39b8eb-kube-api-access-lq7rc\") pod \"node-ca-xqcdr\" (UID: \"b842d4f5-5f7d-417a-9473-1271dc39b8eb\") " pod="openshift-image-registry/node-ca-xqcdr" Jun 15 01:38:43.992555 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.992162 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-system-cni-dir\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:43.992555 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.992177 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-os-release\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:43.992555 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.992192 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-host-run-netns\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:43.992555 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.992214 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-multus-conf-dir\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:43.992555 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.992236 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:43.992555 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.992258 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-env-overrides\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:43.992555 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.992279 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-hostroot\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:43.992555 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.992302 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-host-run-ovn-kubernetes\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:43.993397 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.992328 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-ovn-node-metrics-cert\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:43.993397 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.992380 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ggkt\" (UniqueName: \"kubernetes.io/projected/11c51e69-484c-4efa-bebe-0eb0ccf33029-kube-api-access-9ggkt\") pod \"node-resolver-kqxqs\" (UID: \"11c51e69-484c-4efa-bebe-0eb0ccf33029\") " pod="openshift-dns/node-resolver-kqxqs" Jun 15 01:38:43.993397 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.992411 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-run-ovn\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:43.993397 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.992446 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-log-socket\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:43.993397 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.992483 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-ovnkube-script-lib\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:43.993397 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.992510 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/11c51e69-484c-4efa-bebe-0eb0ccf33029-hosts-file\") pod \"node-resolver-kqxqs\" (UID: \"11c51e69-484c-4efa-bebe-0eb0ccf33029\") " pod="openshift-dns/node-resolver-kqxqs" Jun 15 01:38:43.994225 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.994209 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" Jun 15 01:38:43.998459 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.998280 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fz84t\"" Jun 15 01:38:43.998459 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.998439 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 15 01:38:43.998599 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.998460 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 15 01:38:43.998696 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.998679 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 15 01:38:43.998779 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:43.998708 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.000895 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.000878 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 15 01:38:44.001115 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.001094 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t7cr5\"" Jun 15 01:38:44.001384 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.001365 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 15 01:38:44.001568 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.001552 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:38:44.001641 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:44.001620 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26h5n" podUID="2e027e5e-259c-4e7d-a90f-7dbf717f7701" Jun 15 01:38:44.010643 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.010622 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2jlwl" Jun 15 01:38:44.017533 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.017516 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2jlwl" Jun 15 01:38:44.081874 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.081848 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 15 01:38:44.092668 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.092640 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-etc-sysconfig\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.092668 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.092667 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2eaab3bc-5c5e-4538-9ece-1484335779c9-device-dir\") pod \"aws-ebs-csi-driver-node-cdtkl\" (UID: \"2eaab3bc-5c5e-4538-9ece-1484335779c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" Jun 15 01:38:44.092848 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.092691 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7c47a1e6-73c9-4bf5-ae77-06cb3d055991-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7gxl6\" (UID: \"7c47a1e6-73c9-4bf5-ae77-06cb3d055991\") " pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.092848 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.092744 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-host-var-lib-cni-multus\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.092848 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.092790 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-etc-openvswitch\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.092848 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.092819 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-run\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.092848 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.092826 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-host-var-lib-cni-multus\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.092848 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.092844 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2eaab3bc-5c5e-4538-9ece-1484335779c9-registration-dir\") pod \"aws-ebs-csi-driver-node-cdtkl\" (UID: \"2eaab3bc-5c5e-4538-9ece-1484335779c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" Jun 15 01:38:44.093117 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.092879 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5v7r\" (UniqueName: \"kubernetes.io/projected/2eaab3bc-5c5e-4538-9ece-1484335779c9-kube-api-access-x5v7r\") pod \"aws-ebs-csi-driver-node-cdtkl\" (UID: \"2eaab3bc-5c5e-4538-9ece-1484335779c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" Jun 15 01:38:44.093117 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.092902 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-etc-openvswitch\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.093117 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.092906 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c47a1e6-73c9-4bf5-ae77-06cb3d055991-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7gxl6\" (UID: \"7c47a1e6-73c9-4bf5-ae77-06cb3d055991\") " pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.093117 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.092934 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frpzh\" (UniqueName: \"kubernetes.io/projected/7c47a1e6-73c9-4bf5-ae77-06cb3d055991-kube-api-access-frpzh\") pod \"multus-additional-cni-plugins-7gxl6\" (UID: \"7c47a1e6-73c9-4bf5-ae77-06cb3d055991\") " pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.093117 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.092958 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-host-slash\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.093117 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.092974 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-host-run-netns\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.093117 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.092998 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs\") pod \"network-metrics-daemon-26h5n\" (UID: \"2e027e5e-259c-4e7d-a90f-7dbf717f7701\") " pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:38:44.093117 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093023 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/86bedf18-f8dd-48de-8aa0-bae474076aaf-agent-certs\") pod \"konnectivity-agent-t9zjx\" (UID: \"86bedf18-f8dd-48de-8aa0-bae474076aaf\") " pod="kube-system/konnectivity-agent-t9zjx" Jun 15 01:38:44.093117 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093032 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-host-run-netns\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.093117 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093052 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-host-slash\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.093117 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093059 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c47a1e6-73c9-4bf5-ae77-06cb3d055991-os-release\") pod \"multus-additional-cni-plugins-7gxl6\" (UID: \"7c47a1e6-73c9-4bf5-ae77-06cb3d055991\") " pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.093657 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093099 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-systemd-units\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.093657 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093165 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-systemd-units\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.093657 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-run-openvswitch\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.093657 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093231 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-host-cni-netd\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.093657 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093254 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-run-openvswitch\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.093657 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093302 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11c51e69-484c-4efa-bebe-0eb0ccf33029-tmp-dir\") pod \"node-resolver-kqxqs\" (UID: \"11c51e69-484c-4efa-bebe-0eb0ccf33029\") " pod="openshift-dns/node-resolver-kqxqs" Jun 15 01:38:44.093657 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093394 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-etc-sysctl-d\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.093657 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093421 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2eaab3bc-5c5e-4538-9ece-1484335779c9-socket-dir\") pod \"aws-ebs-csi-driver-node-cdtkl\" (UID: \"2eaab3bc-5c5e-4538-9ece-1484335779c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" Jun 15 01:38:44.093657 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093467 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c47a1e6-73c9-4bf5-ae77-06cb3d055991-system-cni-dir\") pod \"multus-additional-cni-plugins-7gxl6\" (UID: \"7c47a1e6-73c9-4bf5-ae77-06cb3d055991\") " pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.093657 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093493 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c47a1e6-73c9-4bf5-ae77-06cb3d055991-cni-binary-copy\") pod \"multus-additional-cni-plugins-7gxl6\" (UID: \"7c47a1e6-73c9-4bf5-ae77-06cb3d055991\") " pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.093657 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093519 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-multus-socket-dir-parent\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.093657 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093552 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-var-lib-openvswitch\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.093657 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093576 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1113a386-54ff-45c9-88c7-0696fd879022-original-pull-secret\") pod \"global-pull-secret-syncer-szg9h\" (UID: \"1113a386-54ff-45c9-88c7-0696fd879022\") " pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:38:44.093657 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093599 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b842d4f5-5f7d-417a-9473-1271dc39b8eb-host\") pod \"node-ca-xqcdr\" (UID: \"b842d4f5-5f7d-417a-9473-1271dc39b8eb\") " pod="openshift-image-registry/node-ca-xqcdr" Jun 15 01:38:44.093657 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093615 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11c51e69-484c-4efa-bebe-0eb0ccf33029-tmp-dir\") pod \"node-resolver-kqxqs\" (UID: \"11c51e69-484c-4efa-bebe-0eb0ccf33029\") " pod="openshift-dns/node-resolver-kqxqs" Jun 15 01:38:44.093657 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093622 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-system-cni-dir\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.093657 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093643 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-os-release\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.094425 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093704 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-var-lib-openvswitch\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.094425 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093712 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-system-cni-dir\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.094425 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093745 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-multus-socket-dir-parent\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.094425 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093748 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-host-run-netns\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.094425 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093773 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-multus-conf-dir\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.094425 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093800 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-host-cni-netd\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.094425 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093805 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b842d4f5-5f7d-417a-9473-1271dc39b8eb-host\") pod \"node-ca-xqcdr\" (UID: \"b842d4f5-5f7d-417a-9473-1271dc39b8eb\") " pod="openshift-image-registry/node-ca-xqcdr" Jun 15 01:38:44.094425 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093818 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ggkt\" (UniqueName: \"kubernetes.io/projected/11c51e69-484c-4efa-bebe-0eb0ccf33029-kube-api-access-9ggkt\") pod \"node-resolver-kqxqs\" (UID: \"11c51e69-484c-4efa-bebe-0eb0ccf33029\") " pod="openshift-dns/node-resolver-kqxqs" Jun 15 01:38:44.094425 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093839 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-host-run-netns\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.094425 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093828 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-multus-conf-dir\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.094425 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093854 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-etc-kubernetes\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.094425 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093854 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-os-release\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.094425 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093925 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0de16715-e524-4336-b795-5cb526c63bdc-host-slash\") pod \"iptables-alerter-4sfxm\" (UID: \"0de16715-e524-4336-b795-5cb526c63bdc\") " pod="openshift-network-operator/iptables-alerter-4sfxm" Jun 15 01:38:44.094425 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093957 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-host-run-ovn-kubernetes\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.094425 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.093995 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2eaab3bc-5c5e-4538-9ece-1484335779c9-sys-fs\") pod \"aws-ebs-csi-driver-node-cdtkl\" (UID: \"2eaab3bc-5c5e-4538-9ece-1484335779c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" Jun 15 01:38:44.094425 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094007 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-host-run-ovn-kubernetes\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.094425 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094025 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0de16715-e524-4336-b795-5cb526c63bdc-iptables-alerter-script\") pod \"iptables-alerter-4sfxm\" (UID: \"0de16715-e524-4336-b795-5cb526c63bdc\") " pod="openshift-network-operator/iptables-alerter-4sfxm" Jun 15 01:38:44.094425 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094053 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-log-socket\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.095167 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094078 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b842d4f5-5f7d-417a-9473-1271dc39b8eb-serviceca\") pod \"node-ca-xqcdr\" (UID: \"b842d4f5-5f7d-417a-9473-1271dc39b8eb\") " pod="openshift-image-registry/node-ca-xqcdr" Jun 15 01:38:44.095167 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094103 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-node-log\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.095167 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094127 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqv4s\" (UniqueName: \"kubernetes.io/projected/840c3654-07ac-4e2d-b17e-a21149308654-kube-api-access-nqv4s\") pod \"network-check-target-lbh9n\" (UID: \"840c3654-07ac-4e2d-b17e-a21149308654\") " pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:38:44.095167 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094129 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-log-socket\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.095167 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094149 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-etc-modprobe-d\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.095167 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094175 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-node-log\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.095167 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094288 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-lib-modules\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.095167 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094348 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-var-lib-kubelet\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.095167 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094376 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dttq\" (UniqueName: \"kubernetes.io/projected/0de16715-e524-4336-b795-5cb526c63bdc-kube-api-access-9dttq\") pod \"iptables-alerter-4sfxm\" (UID: \"0de16715-e524-4336-b795-5cb526c63bdc\") " pod="openshift-network-operator/iptables-alerter-4sfxm" Jun 15 01:38:44.095167 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094405 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5hst\" (UniqueName: \"kubernetes.io/projected/6060d82e-9d20-4244-b25e-ebbffe02c1aa-kube-api-access-k5hst\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.095167 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094440 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-etc-systemd\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.095167 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094467 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-sys\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.095167 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094480 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-host\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.095167 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094493 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ae81fe9-f019-4365-8c0c-2451927c6932-tmp\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.095167 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094512 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/86bedf18-f8dd-48de-8aa0-bae474076aaf-konnectivity-ca\") pod \"konnectivity-agent-t9zjx\" (UID: \"86bedf18-f8dd-48de-8aa0-bae474076aaf\") " pod="kube-system/konnectivity-agent-t9zjx" Jun 15 01:38:44.095167 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094533 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c47a1e6-73c9-4bf5-ae77-06cb3d055991-cnibin\") pod \"multus-additional-cni-plugins-7gxl6\" (UID: \"7c47a1e6-73c9-4bf5-ae77-06cb3d055991\") " pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.095167 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094561 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-host-run-k8s-cni-cncf-io\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.095910 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094586 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-host-var-lib-cni-bin\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.095910 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094609 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6060d82e-9d20-4244-b25e-ebbffe02c1aa-multus-daemon-config\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.095910 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094620 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b842d4f5-5f7d-417a-9473-1271dc39b8eb-serviceca\") pod \"node-ca-xqcdr\" (UID: \"b842d4f5-5f7d-417a-9473-1271dc39b8eb\") " pod="openshift-image-registry/node-ca-xqcdr" Jun 15 01:38:44.095910 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094633 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-host-cni-bin\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.095910 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094642 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-host-run-k8s-cni-cncf-io\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.095910 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094646 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-host-var-lib-cni-bin\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.095910 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094661 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-ovnkube-config\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.095910 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094695 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-host-cni-bin\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.095910 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094692 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2eaab3bc-5c5e-4538-9ece-1484335779c9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cdtkl\" (UID: \"2eaab3bc-5c5e-4538-9ece-1484335779c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" Jun 15 01:38:44.095910 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094737 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-cnibin\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.095910 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094760 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-host-var-lib-kubelet\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.095910 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5ae81fe9-f019-4365-8c0c-2451927c6932-etc-tuned\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.095910 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094835 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-host-var-lib-kubelet\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.095910 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094836 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2eaab3bc-5c5e-4538-9ece-1484335779c9-etc-selinux\") pod \"aws-ebs-csi-driver-node-cdtkl\" (UID: \"2eaab3bc-5c5e-4538-9ece-1484335779c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" Jun 15 01:38:44.095910 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-host-run-multus-certs\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.095910 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094901 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-etc-kubernetes\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.095910 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094931 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-cnibin\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.095910 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094944 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1113a386-54ff-45c9-88c7-0696fd879022-kubelet-config\") pod \"global-pull-secret-syncer-szg9h\" (UID: \"1113a386-54ff-45c9-88c7-0696fd879022\") " pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:38:44.096596 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094971 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq7rc\" (UniqueName: \"kubernetes.io/projected/b842d4f5-5f7d-417a-9473-1271dc39b8eb-kube-api-access-lq7rc\") pod \"node-ca-xqcdr\" (UID: \"b842d4f5-5f7d-417a-9473-1271dc39b8eb\") " pod="openshift-image-registry/node-ca-xqcdr" Jun 15 01:38:44.096596 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094963 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-host-run-multus-certs\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.096596 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094977 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-etc-kubernetes\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.096596 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.094996 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.096596 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095098 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-env-overrides\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.096596 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095121 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.096596 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095161 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msnl6\" (UniqueName: \"kubernetes.io/projected/2e027e5e-259c-4e7d-a90f-7dbf717f7701-kube-api-access-msnl6\") pod \"network-metrics-daemon-26h5n\" (UID: \"2e027e5e-259c-4e7d-a90f-7dbf717f7701\") " pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:38:44.096596 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095222 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6060d82e-9d20-4244-b25e-ebbffe02c1aa-multus-daemon-config\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.096596 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095230 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-ovnkube-config\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.096596 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095246 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psmgs\" (UniqueName: \"kubernetes.io/projected/5ae81fe9-f019-4365-8c0c-2451927c6932-kube-api-access-psmgs\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.096596 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095282 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-hostroot\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.096596 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095323 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-hostroot\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.096596 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095351 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-ovn-node-metrics-cert\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.096596 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-etc-sysctl-conf\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.096596 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7c47a1e6-73c9-4bf5-ae77-06cb3d055991-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7gxl6\" (UID: \"7c47a1e6-73c9-4bf5-ae77-06cb3d055991\") " pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.096596 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095427 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-run-ovn\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.096596 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095452 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-ovnkube-script-lib\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.097320 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095475 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/11c51e69-484c-4efa-bebe-0eb0ccf33029-hosts-file\") pod \"node-resolver-kqxqs\" (UID: \"11c51e69-484c-4efa-bebe-0eb0ccf33029\") " pod="openshift-dns/node-resolver-kqxqs" Jun 15 01:38:44.097320 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095499 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-run-ovn\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.097320 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095501 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1113a386-54ff-45c9-88c7-0696fd879022-dbus\") pod \"global-pull-secret-syncer-szg9h\" (UID: \"1113a386-54ff-45c9-88c7-0696fd879022\") " pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:38:44.097320 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095501 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-env-overrides\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.097320 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095555 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/11c51e69-484c-4efa-bebe-0eb0ccf33029-hosts-file\") pod \"node-resolver-kqxqs\" (UID: \"11c51e69-484c-4efa-bebe-0eb0ccf33029\") " pod="openshift-dns/node-resolver-kqxqs" Jun 15 01:38:44.097320 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095593 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-run-systemd\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.097320 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095624 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-multus-cni-dir\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.097320 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095633 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-run-systemd\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.097320 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095647 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6060d82e-9d20-4244-b25e-ebbffe02c1aa-cni-binary-copy\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.097320 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095670 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-host-kubelet\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.097320 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095719 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6060d82e-9d20-4244-b25e-ebbffe02c1aa-multus-cni-dir\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.097320 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095749 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-host-kubelet\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.097320 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095755 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 15 01:38:44.097320 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095784 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j9cj\" (UniqueName: \"kubernetes.io/projected/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-kube-api-access-8j9cj\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.097320 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.095962 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-ovnkube-script-lib\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.097320 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.096181 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6060d82e-9d20-4244-b25e-ebbffe02c1aa-cni-binary-copy\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.098991 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.098960 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-ovn-node-metrics-cert\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.099165 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:44.099147 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:38:44.099282 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:44.099175 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:38:44.099282 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:44.099189 2576 projected.go:196] Error preparing data for projected volume kube-api-access-nqv4s for pod openshift-network-diagnostics/network-check-target-lbh9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:44.099446 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:44.099290 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/840c3654-07ac-4e2d-b17e-a21149308654-kube-api-access-nqv4s podName:840c3654-07ac-4e2d-b17e-a21149308654 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:44.599269672 +0000 UTC m=+2.957810047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nqv4s" (UniqueName: "kubernetes.io/projected/840c3654-07ac-4e2d-b17e-a21149308654-kube-api-access-nqv4s") pod "network-check-target-lbh9n" (UID: "840c3654-07ac-4e2d-b17e-a21149308654") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:44.101425 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.101403 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ggkt\" (UniqueName: \"kubernetes.io/projected/11c51e69-484c-4efa-bebe-0eb0ccf33029-kube-api-access-9ggkt\") pod \"node-resolver-kqxqs\" (UID: \"11c51e69-484c-4efa-bebe-0eb0ccf33029\") " pod="openshift-dns/node-resolver-kqxqs" Jun 15 01:38:44.101737 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.101714 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5hst\" (UniqueName: \"kubernetes.io/projected/6060d82e-9d20-4244-b25e-ebbffe02c1aa-kube-api-access-k5hst\") pod \"multus-xngcq\" (UID: \"6060d82e-9d20-4244-b25e-ebbffe02c1aa\") " pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.102125 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.102103 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq7rc\" (UniqueName: \"kubernetes.io/projected/b842d4f5-5f7d-417a-9473-1271dc39b8eb-kube-api-access-lq7rc\") pod \"node-ca-xqcdr\" (UID: \"b842d4f5-5f7d-417a-9473-1271dc39b8eb\") " pod="openshift-image-registry/node-ca-xqcdr" Jun 15 01:38:44.103192 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.103163 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j9cj\" (UniqueName: \"kubernetes.io/projected/4081b3d4-8b74-4d97-b9d8-e4d131dd46df-kube-api-access-8j9cj\") pod \"ovnkube-node-whwth\" (UID: \"4081b3d4-8b74-4d97-b9d8-e4d131dd46df\") " pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.196381 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.196289 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2eaab3bc-5c5e-4538-9ece-1484335779c9-socket-dir\") pod \"aws-ebs-csi-driver-node-cdtkl\" (UID: \"2eaab3bc-5c5e-4538-9ece-1484335779c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" Jun 15 01:38:44.196381 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.196330 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c47a1e6-73c9-4bf5-ae77-06cb3d055991-system-cni-dir\") pod \"multus-additional-cni-plugins-7gxl6\" (UID: \"7c47a1e6-73c9-4bf5-ae77-06cb3d055991\") " pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.196562 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.196479 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c47a1e6-73c9-4bf5-ae77-06cb3d055991-system-cni-dir\") pod \"multus-additional-cni-plugins-7gxl6\" (UID: \"7c47a1e6-73c9-4bf5-ae77-06cb3d055991\") " pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.196562 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.196486 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2eaab3bc-5c5e-4538-9ece-1484335779c9-socket-dir\") pod \"aws-ebs-csi-driver-node-cdtkl\" (UID: \"2eaab3bc-5c5e-4538-9ece-1484335779c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" Jun 15 01:38:44.196562 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.196520 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c47a1e6-73c9-4bf5-ae77-06cb3d055991-cni-binary-copy\") pod \"multus-additional-cni-plugins-7gxl6\" (UID: \"7c47a1e6-73c9-4bf5-ae77-06cb3d055991\") " pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.196562 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.196544 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1113a386-54ff-45c9-88c7-0696fd879022-original-pull-secret\") pod \"global-pull-secret-syncer-szg9h\" (UID: \"1113a386-54ff-45c9-88c7-0696fd879022\") " pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:38:44.196562 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.196563 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-etc-kubernetes\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.196797 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.196581 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0de16715-e524-4336-b795-5cb526c63bdc-host-slash\") pod \"iptables-alerter-4sfxm\" (UID: \"0de16715-e524-4336-b795-5cb526c63bdc\") " pod="openshift-network-operator/iptables-alerter-4sfxm" Jun 15 01:38:44.196797 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.196637 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2eaab3bc-5c5e-4538-9ece-1484335779c9-sys-fs\") pod \"aws-ebs-csi-driver-node-cdtkl\" (UID: \"2eaab3bc-5c5e-4538-9ece-1484335779c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" Jun 15 01:38:44.196797 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.196664 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0de16715-e524-4336-b795-5cb526c63bdc-iptables-alerter-script\") pod \"iptables-alerter-4sfxm\" (UID: \"0de16715-e524-4336-b795-5cb526c63bdc\") " pod="openshift-network-operator/iptables-alerter-4sfxm" Jun 15 01:38:44.196797 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.196670 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0de16715-e524-4336-b795-5cb526c63bdc-host-slash\") pod \"iptables-alerter-4sfxm\" (UID: \"0de16715-e524-4336-b795-5cb526c63bdc\") " pod="openshift-network-operator/iptables-alerter-4sfxm" Jun 15 01:38:44.196797 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.196638 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-etc-kubernetes\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.196797 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.196707 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-etc-modprobe-d\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.196797 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.196732 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2eaab3bc-5c5e-4538-9ece-1484335779c9-sys-fs\") pod \"aws-ebs-csi-driver-node-cdtkl\" (UID: \"2eaab3bc-5c5e-4538-9ece-1484335779c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" Jun 15 01:38:44.196797 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.196734 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-lib-modules\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.196797 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.196769 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-var-lib-kubelet\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.196797 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.196790 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dttq\" (UniqueName: \"kubernetes.io/projected/0de16715-e524-4336-b795-5cb526c63bdc-kube-api-access-9dttq\") pod \"iptables-alerter-4sfxm\" (UID: \"0de16715-e524-4336-b795-5cb526c63bdc\") " pod="openshift-network-operator/iptables-alerter-4sfxm" Jun 15 01:38:44.197257 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.196812 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-etc-systemd\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.197257 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.196830 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-lib-modules\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.197257 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.196879 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-etc-systemd\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.197257 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.196951 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-etc-modprobe-d\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.197257 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.196989 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-var-lib-kubelet\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.197257 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.196833 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-sys\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.197257 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197093 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-host\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.197257 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197117 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ae81fe9-f019-4365-8c0c-2451927c6932-tmp\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.197257 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197143 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/86bedf18-f8dd-48de-8aa0-bae474076aaf-konnectivity-ca\") pod \"konnectivity-agent-t9zjx\" (UID: \"86bedf18-f8dd-48de-8aa0-bae474076aaf\") " pod="kube-system/konnectivity-agent-t9zjx" Jun 15 01:38:44.197257 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197170 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c47a1e6-73c9-4bf5-ae77-06cb3d055991-cnibin\") pod \"multus-additional-cni-plugins-7gxl6\" (UID: \"7c47a1e6-73c9-4bf5-ae77-06cb3d055991\") " pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.197257 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197176 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c47a1e6-73c9-4bf5-ae77-06cb3d055991-cni-binary-copy\") pod \"multus-additional-cni-plugins-7gxl6\" (UID: \"7c47a1e6-73c9-4bf5-ae77-06cb3d055991\") " pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.197257 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197201 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2eaab3bc-5c5e-4538-9ece-1484335779c9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cdtkl\" (UID: \"2eaab3bc-5c5e-4538-9ece-1484335779c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" Jun 15 01:38:44.197257 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197226 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5ae81fe9-f019-4365-8c0c-2451927c6932-etc-tuned\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.197257 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197250 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2eaab3bc-5c5e-4538-9ece-1484335779c9-etc-selinux\") pod \"aws-ebs-csi-driver-node-cdtkl\" (UID: \"2eaab3bc-5c5e-4538-9ece-1484335779c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" Jun 15 01:38:44.197975 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1113a386-54ff-45c9-88c7-0696fd879022-kubelet-config\") pod \"global-pull-secret-syncer-szg9h\" (UID: \"1113a386-54ff-45c9-88c7-0696fd879022\") " pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:38:44.197975 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197306 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msnl6\" (UniqueName: \"kubernetes.io/projected/2e027e5e-259c-4e7d-a90f-7dbf717f7701-kube-api-access-msnl6\") pod \"network-metrics-daemon-26h5n\" (UID: \"2e027e5e-259c-4e7d-a90f-7dbf717f7701\") " pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:38:44.197975 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197330 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psmgs\" (UniqueName: \"kubernetes.io/projected/5ae81fe9-f019-4365-8c0c-2451927c6932-kube-api-access-psmgs\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.197975 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197378 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-etc-sysctl-conf\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.197975 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197446 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7c47a1e6-73c9-4bf5-ae77-06cb3d055991-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7gxl6\" (UID: \"7c47a1e6-73c9-4bf5-ae77-06cb3d055991\") " pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.197975 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197478 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1113a386-54ff-45c9-88c7-0696fd879022-dbus\") pod \"global-pull-secret-syncer-szg9h\" (UID: \"1113a386-54ff-45c9-88c7-0696fd879022\") " pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:38:44.197975 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197509 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-etc-sysconfig\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.197975 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197532 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0de16715-e524-4336-b795-5cb526c63bdc-iptables-alerter-script\") pod \"iptables-alerter-4sfxm\" (UID: \"0de16715-e524-4336-b795-5cb526c63bdc\") " pod="openshift-network-operator/iptables-alerter-4sfxm" Jun 15 01:38:44.197975 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2eaab3bc-5c5e-4538-9ece-1484335779c9-device-dir\") pod \"aws-ebs-csi-driver-node-cdtkl\" (UID: \"2eaab3bc-5c5e-4538-9ece-1484335779c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" Jun 15 01:38:44.197975 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197579 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7c47a1e6-73c9-4bf5-ae77-06cb3d055991-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7gxl6\" (UID: \"7c47a1e6-73c9-4bf5-ae77-06cb3d055991\") " pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.197975 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197583 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2eaab3bc-5c5e-4538-9ece-1484335779c9-device-dir\") pod \"aws-ebs-csi-driver-node-cdtkl\" (UID: \"2eaab3bc-5c5e-4538-9ece-1484335779c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" Jun 15 01:38:44.197975 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197608 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-run\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.197975 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197628 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c47a1e6-73c9-4bf5-ae77-06cb3d055991-cnibin\") pod \"multus-additional-cni-plugins-7gxl6\" (UID: \"7c47a1e6-73c9-4bf5-ae77-06cb3d055991\") " pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.197975 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197631 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2eaab3bc-5c5e-4538-9ece-1484335779c9-registration-dir\") pod \"aws-ebs-csi-driver-node-cdtkl\" (UID: \"2eaab3bc-5c5e-4538-9ece-1484335779c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" Jun 15 01:38:44.197975 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197658 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5v7r\" (UniqueName: \"kubernetes.io/projected/2eaab3bc-5c5e-4538-9ece-1484335779c9-kube-api-access-x5v7r\") pod \"aws-ebs-csi-driver-node-cdtkl\" (UID: \"2eaab3bc-5c5e-4538-9ece-1484335779c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" Jun 15 01:38:44.197975 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197681 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c47a1e6-73c9-4bf5-ae77-06cb3d055991-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7gxl6\" (UID: \"7c47a1e6-73c9-4bf5-ae77-06cb3d055991\") " pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.198716 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frpzh\" (UniqueName: \"kubernetes.io/projected/7c47a1e6-73c9-4bf5-ae77-06cb3d055991-kube-api-access-frpzh\") pod \"multus-additional-cni-plugins-7gxl6\" (UID: \"7c47a1e6-73c9-4bf5-ae77-06cb3d055991\") " pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.198716 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197732 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs\") pod \"network-metrics-daemon-26h5n\" (UID: \"2e027e5e-259c-4e7d-a90f-7dbf717f7701\") " pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:38:44.198716 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197756 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/86bedf18-f8dd-48de-8aa0-bae474076aaf-agent-certs\") pod \"konnectivity-agent-t9zjx\" (UID: \"86bedf18-f8dd-48de-8aa0-bae474076aaf\") " pod="kube-system/konnectivity-agent-t9zjx" Jun 15 01:38:44.198716 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197770 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/86bedf18-f8dd-48de-8aa0-bae474076aaf-konnectivity-ca\") pod \"konnectivity-agent-t9zjx\" (UID: \"86bedf18-f8dd-48de-8aa0-bae474076aaf\") " pod="kube-system/konnectivity-agent-t9zjx" Jun 15 01:38:44.198716 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197781 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c47a1e6-73c9-4bf5-ae77-06cb3d055991-os-release\") pod \"multus-additional-cni-plugins-7gxl6\" (UID: \"7c47a1e6-73c9-4bf5-ae77-06cb3d055991\") " pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.198716 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197827 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-etc-sysctl-d\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.198716 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197835 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c47a1e6-73c9-4bf5-ae77-06cb3d055991-os-release\") pod \"multus-additional-cni-plugins-7gxl6\" (UID: \"7c47a1e6-73c9-4bf5-ae77-06cb3d055991\") " pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.198716 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197888 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2eaab3bc-5c5e-4538-9ece-1484335779c9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cdtkl\" (UID: \"2eaab3bc-5c5e-4538-9ece-1484335779c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" Jun 15 01:38:44.198716 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197917 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-host\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.198716 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:44.197253 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:44.198716 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:44.197952 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:44.198716 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.197994 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2eaab3bc-5c5e-4538-9ece-1484335779c9-registration-dir\") pod \"aws-ebs-csi-driver-node-cdtkl\" (UID: \"2eaab3bc-5c5e-4538-9ece-1484335779c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" Jun 15 01:38:44.198716 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.198038 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-sys\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.198716 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:44.198168 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs podName:2e027e5e-259c-4e7d-a90f-7dbf717f7701 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:44.698144084 +0000 UTC m=+3.056684481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs") pod "network-metrics-daemon-26h5n" (UID: "2e027e5e-259c-4e7d-a90f-7dbf717f7701") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:44.198716 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.198320 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1113a386-54ff-45c9-88c7-0696fd879022-kubelet-config\") pod \"global-pull-secret-syncer-szg9h\" (UID: \"1113a386-54ff-45c9-88c7-0696fd879022\") " pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:38:44.198716 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.198325 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-run\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.198716 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.198389 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2eaab3bc-5c5e-4538-9ece-1484335779c9-etc-selinux\") pod \"aws-ebs-csi-driver-node-cdtkl\" (UID: \"2eaab3bc-5c5e-4538-9ece-1484335779c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" Jun 15 01:38:44.198716 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.198437 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-etc-sysconfig\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.199464 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.198448 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1113a386-54ff-45c9-88c7-0696fd879022-dbus\") pod \"global-pull-secret-syncer-szg9h\" (UID: \"1113a386-54ff-45c9-88c7-0696fd879022\") " pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:38:44.199464 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.198542 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7c47a1e6-73c9-4bf5-ae77-06cb3d055991-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7gxl6\" (UID: \"7c47a1e6-73c9-4bf5-ae77-06cb3d055991\") " pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.199464 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.198548 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-etc-sysctl-conf\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.199464 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:44.198730 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1113a386-54ff-45c9-88c7-0696fd879022-original-pull-secret podName:1113a386-54ff-45c9-88c7-0696fd879022 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:44.698709644 +0000 UTC m=+3.057250026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1113a386-54ff-45c9-88c7-0696fd879022-original-pull-secret") pod "global-pull-secret-syncer-szg9h" (UID: "1113a386-54ff-45c9-88c7-0696fd879022") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:44.199464 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.198841 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5ae81fe9-f019-4365-8c0c-2451927c6932-etc-sysctl-d\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.199464 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.198848 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c47a1e6-73c9-4bf5-ae77-06cb3d055991-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7gxl6\" (UID: \"7c47a1e6-73c9-4bf5-ae77-06cb3d055991\") " pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.199464 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.198890 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7c47a1e6-73c9-4bf5-ae77-06cb3d055991-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7gxl6\" (UID: \"7c47a1e6-73c9-4bf5-ae77-06cb3d055991\") " pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.200426 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.200397 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5ae81fe9-f019-4365-8c0c-2451927c6932-etc-tuned\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.200740 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.200696 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/86bedf18-f8dd-48de-8aa0-bae474076aaf-agent-certs\") pod \"konnectivity-agent-t9zjx\" (UID: \"86bedf18-f8dd-48de-8aa0-bae474076aaf\") " pod="kube-system/konnectivity-agent-t9zjx" Jun 15 01:38:44.200863 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.200749 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ae81fe9-f019-4365-8c0c-2451927c6932-tmp\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.204896 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.204875 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dttq\" (UniqueName: \"kubernetes.io/projected/0de16715-e524-4336-b795-5cb526c63bdc-kube-api-access-9dttq\") pod \"iptables-alerter-4sfxm\" (UID: \"0de16715-e524-4336-b795-5cb526c63bdc\") " pod="openshift-network-operator/iptables-alerter-4sfxm" Jun 15 01:38:44.208368 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.208329 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frpzh\" (UniqueName: \"kubernetes.io/projected/7c47a1e6-73c9-4bf5-ae77-06cb3d055991-kube-api-access-frpzh\") pod \"multus-additional-cni-plugins-7gxl6\" (UID: \"7c47a1e6-73c9-4bf5-ae77-06cb3d055991\") " pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.208460 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.208398 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5v7r\" (UniqueName: \"kubernetes.io/projected/2eaab3bc-5c5e-4538-9ece-1484335779c9-kube-api-access-x5v7r\") pod \"aws-ebs-csi-driver-node-cdtkl\" (UID: \"2eaab3bc-5c5e-4538-9ece-1484335779c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" Jun 15 01:38:44.208716 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.208693 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msnl6\" (UniqueName: \"kubernetes.io/projected/2e027e5e-259c-4e7d-a90f-7dbf717f7701-kube-api-access-msnl6\") pod \"network-metrics-daemon-26h5n\" (UID: \"2e027e5e-259c-4e7d-a90f-7dbf717f7701\") " pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:38:44.208716 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.208706 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psmgs\" (UniqueName: \"kubernetes.io/projected/5ae81fe9-f019-4365-8c0c-2451927c6932-kube-api-access-psmgs\") pod \"tuned-qprql\" (UID: \"5ae81fe9-f019-4365-8c0c-2451927c6932\") " pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.283771 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.283741 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:38:44.291179 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.291150 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kqxqs" Jun 15 01:38:44.299639 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.299615 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xqcdr" Jun 15 01:38:44.306186 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.306167 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xngcq" Jun 15 01:38:44.314685 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.314668 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4sfxm" Jun 15 01:38:44.321243 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.321225 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qprql" Jun 15 01:38:44.326826 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.326808 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t9zjx" Jun 15 01:38:44.332432 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.332417 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" Jun 15 01:38:44.337912 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.337894 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7gxl6" Jun 15 01:38:44.600510 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.600433 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqv4s\" (UniqueName: \"kubernetes.io/projected/840c3654-07ac-4e2d-b17e-a21149308654-kube-api-access-nqv4s\") pod \"network-check-target-lbh9n\" (UID: \"840c3654-07ac-4e2d-b17e-a21149308654\") " pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:38:44.600651 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:44.600591 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:38:44.600651 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:44.600615 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:38:44.600651 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:44.600629 2576 projected.go:196] Error preparing data for projected volume kube-api-access-nqv4s for pod openshift-network-diagnostics/network-check-target-lbh9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:44.600773 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:44.600684 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/840c3654-07ac-4e2d-b17e-a21149308654-kube-api-access-nqv4s podName:840c3654-07ac-4e2d-b17e-a21149308654 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:45.600669981 +0000 UTC m=+3.959210355 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqv4s" (UniqueName: "kubernetes.io/projected/840c3654-07ac-4e2d-b17e-a21149308654-kube-api-access-nqv4s") pod "network-check-target-lbh9n" (UID: "840c3654-07ac-4e2d-b17e-a21149308654") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:44.700807 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.700774 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs\") pod \"network-metrics-daemon-26h5n\" (UID: \"2e027e5e-259c-4e7d-a90f-7dbf717f7701\") " pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:38:44.700967 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:44.700826 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1113a386-54ff-45c9-88c7-0696fd879022-original-pull-secret\") pod \"global-pull-secret-syncer-szg9h\" (UID: \"1113a386-54ff-45c9-88c7-0696fd879022\") " pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:38:44.700967 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:44.700887 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:44.700967 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:44.700937 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:44.700967 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:44.700950 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs podName:2e027e5e-259c-4e7d-a90f-7dbf717f7701 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:45.700933053 +0000 UTC m=+4.059473445 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs") pod "network-metrics-daemon-26h5n" (UID: "2e027e5e-259c-4e7d-a90f-7dbf717f7701") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:44.700967 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:44.700970 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1113a386-54ff-45c9-88c7-0696fd879022-original-pull-secret podName:1113a386-54ff-45c9-88c7-0696fd879022 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:45.700960567 +0000 UTC m=+4.059500955 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1113a386-54ff-45c9-88c7-0696fd879022-original-pull-secret") pod "global-pull-secret-syncer-szg9h" (UID: "1113a386-54ff-45c9-88c7-0696fd879022") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:44.819351 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:44.819118 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11c51e69_484c_4efa_bebe_0eb0ccf33029.slice/crio-464f402acef108eada335baf44c3bd1e45904cbef939215e851aa5f8c3309f1b WatchSource:0}: Error finding container 464f402acef108eada335baf44c3bd1e45904cbef939215e851aa5f8c3309f1b: Status 404 returned error can't find the container with id 464f402acef108eada335baf44c3bd1e45904cbef939215e851aa5f8c3309f1b Jun 15 01:38:44.838852 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:44.838802 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4081b3d4_8b74_4d97_b9d8_e4d131dd46df.slice/crio-240a6b4166bd3296c2832d55b46bee9da075b1afdd91fff9d4f668a26b855037 WatchSource:0}: Error finding container 240a6b4166bd3296c2832d55b46bee9da075b1afdd91fff9d4f668a26b855037: Status 404 returned error can't find the container with id 240a6b4166bd3296c2832d55b46bee9da075b1afdd91fff9d4f668a26b855037 Jun 15 01:38:44.840127 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:44.840102 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6060d82e_9d20_4244_b25e_ebbffe02c1aa.slice/crio-111b6e926b05382982aa706d948cfa1ba3b01b3823128abecba1c8a88f042ddd WatchSource:0}: Error finding container 111b6e926b05382982aa706d948cfa1ba3b01b3823128abecba1c8a88f042ddd: Status 404 returned error can't find the container with id 111b6e926b05382982aa706d948cfa1ba3b01b3823128abecba1c8a88f042ddd Jun 15 01:38:44.842396 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:44.842370 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ae81fe9_f019_4365_8c0c_2451927c6932.slice/crio-e059dee0b9fec42006e47509721afabe3f065fb471079f310d65599891d035c6 WatchSource:0}: Error finding container e059dee0b9fec42006e47509721afabe3f065fb471079f310d65599891d035c6: Status 404 returned error can't find the container with id e059dee0b9fec42006e47509721afabe3f065fb471079f310d65599891d035c6 Jun 15 01:38:44.847068 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:44.847044 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c47a1e6_73c9_4bf5_ae77_06cb3d055991.slice/crio-f867dadfe5119a8eced8bd4acfeb02e9260e82fad7a39b33ef13488e8d3ae277 WatchSource:0}: Error finding container f867dadfe5119a8eced8bd4acfeb02e9260e82fad7a39b33ef13488e8d3ae277: Status 404 returned error can't find the container with id f867dadfe5119a8eced8bd4acfeb02e9260e82fad7a39b33ef13488e8d3ae277 Jun 15 01:38:44.847896 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:44.847835 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eaab3bc_5c5e_4538_9ece_1484335779c9.slice/crio-9f7e04215ef7ac50d811742eb54c9228626d52963932fbb73706889797dc5ce8 WatchSource:0}: Error finding container 9f7e04215ef7ac50d811742eb54c9228626d52963932fbb73706889797dc5ce8: Status 404 returned error can't find the container with id 9f7e04215ef7ac50d811742eb54c9228626d52963932fbb73706889797dc5ce8 Jun 15 01:38:44.848908 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:44.848883 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0de16715_e524_4336_b795_5cb526c63bdc.slice/crio-37eec138ac66f6fdeb4ab29d63587aef2eb25e1621602f731d169df706874fb1 WatchSource:0}: Error finding container 37eec138ac66f6fdeb4ab29d63587aef2eb25e1621602f731d169df706874fb1: Status 404 returned error can't find the container with id 37eec138ac66f6fdeb4ab29d63587aef2eb25e1621602f731d169df706874fb1 Jun 15 01:38:44.850823 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:44.850685 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb842d4f5_5f7d_417a_9473_1271dc39b8eb.slice/crio-87cc86287086af913161743146486b6eae032e54c5e3b0c152c36aaa739eec90 WatchSource:0}: Error finding container 87cc86287086af913161743146486b6eae032e54c5e3b0c152c36aaa739eec90: Status 404 returned error can't find the container with id 87cc86287086af913161743146486b6eae032e54c5e3b0c152c36aaa739eec90 Jun 15 01:38:44.852222 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:38:44.852196 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86bedf18_f8dd_48de_8aa0_bae474076aaf.slice/crio-e9c201886298fda6f3f13af56a8d34418bccbc9b7fe93a097589b42483eb3d05 WatchSource:0}: Error finding container e9c201886298fda6f3f13af56a8d34418bccbc9b7fe93a097589b42483eb3d05: Status 404 returned error can't find the container with id e9c201886298fda6f3f13af56a8d34418bccbc9b7fe93a097589b42483eb3d05 Jun 15 01:38:45.021155 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:45.021086 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 01:33:44 +0000 UTC" deadline="2027-11-29 16:08:39.165362496 +0000 UTC" Jun 15 01:38:45.021523 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:45.021161 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12782h29m54.144213915s" Jun 15 01:38:45.052971 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:45.052941 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xqcdr" event={"ID":"b842d4f5-5f7d-417a-9473-1271dc39b8eb","Type":"ContainerStarted","Data":"87cc86287086af913161743146486b6eae032e54c5e3b0c152c36aaa739eec90"} Jun 15 01:38:45.054260 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:45.054231 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4sfxm" event={"ID":"0de16715-e524-4336-b795-5cb526c63bdc","Type":"ContainerStarted","Data":"37eec138ac66f6fdeb4ab29d63587aef2eb25e1621602f731d169df706874fb1"} Jun 15 01:38:45.055269 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:45.055244 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" event={"ID":"2eaab3bc-5c5e-4538-9ece-1484335779c9","Type":"ContainerStarted","Data":"9f7e04215ef7ac50d811742eb54c9228626d52963932fbb73706889797dc5ce8"} Jun 15 01:38:45.056193 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:45.056175 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7gxl6" event={"ID":"7c47a1e6-73c9-4bf5-ae77-06cb3d055991","Type":"ContainerStarted","Data":"f867dadfe5119a8eced8bd4acfeb02e9260e82fad7a39b33ef13488e8d3ae277"} Jun 15 01:38:45.057076 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:45.057057 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qprql" event={"ID":"5ae81fe9-f019-4365-8c0c-2451927c6932","Type":"ContainerStarted","Data":"e059dee0b9fec42006e47509721afabe3f065fb471079f310d65599891d035c6"} Jun 15 01:38:45.058042 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:45.058021 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xngcq" event={"ID":"6060d82e-9d20-4244-b25e-ebbffe02c1aa","Type":"ContainerStarted","Data":"111b6e926b05382982aa706d948cfa1ba3b01b3823128abecba1c8a88f042ddd"} Jun 15 01:38:45.059034 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:45.059017 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whwth" event={"ID":"4081b3d4-8b74-4d97-b9d8-e4d131dd46df","Type":"ContainerStarted","Data":"240a6b4166bd3296c2832d55b46bee9da075b1afdd91fff9d4f668a26b855037"} Jun 15 01:38:45.060018 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:45.059998 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kqxqs" event={"ID":"11c51e69-484c-4efa-bebe-0eb0ccf33029","Type":"ContainerStarted","Data":"464f402acef108eada335baf44c3bd1e45904cbef939215e851aa5f8c3309f1b"} Jun 15 01:38:45.061646 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:45.061615 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-124.ec2.internal" event={"ID":"fdbf0aa446b2930d878266db1bc6b1f0","Type":"ContainerStarted","Data":"1a54614161c273e4189013f13ec1d1c75704c23a539af0ee378e732a62010895"} Jun 15 01:38:45.064667 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:45.064259 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t9zjx" event={"ID":"86bedf18-f8dd-48de-8aa0-bae474076aaf","Type":"ContainerStarted","Data":"e9c201886298fda6f3f13af56a8d34418bccbc9b7fe93a097589b42483eb3d05"} Jun 15 01:38:45.076764 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:45.076717 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-124.ec2.internal" podStartSLOduration=2.076703631 podStartE2EDuration="2.076703631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:38:45.076105455 +0000 UTC m=+3.434645852" watchObservedRunningTime="2026-06-15 01:38:45.076703631 +0000 UTC m=+3.435244028" Jun 15 01:38:45.610429 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:45.609765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqv4s\" (UniqueName: \"kubernetes.io/projected/840c3654-07ac-4e2d-b17e-a21149308654-kube-api-access-nqv4s\") pod \"network-check-target-lbh9n\" (UID: \"840c3654-07ac-4e2d-b17e-a21149308654\") " pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:38:45.610429 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:45.609966 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:38:45.610429 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:45.609989 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:38:45.610429 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:45.610003 2576 projected.go:196] Error preparing data for projected volume kube-api-access-nqv4s for pod openshift-network-diagnostics/network-check-target-lbh9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:45.610429 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:45.610064 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/840c3654-07ac-4e2d-b17e-a21149308654-kube-api-access-nqv4s podName:840c3654-07ac-4e2d-b17e-a21149308654 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:47.610045121 +0000 UTC m=+5.968585511 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqv4s" (UniqueName: "kubernetes.io/projected/840c3654-07ac-4e2d-b17e-a21149308654-kube-api-access-nqv4s") pod "network-check-target-lbh9n" (UID: "840c3654-07ac-4e2d-b17e-a21149308654") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:45.710769 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:45.710723 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs\") pod \"network-metrics-daemon-26h5n\" (UID: \"2e027e5e-259c-4e7d-a90f-7dbf717f7701\") " pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:38:45.710937 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:45.710782 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1113a386-54ff-45c9-88c7-0696fd879022-original-pull-secret\") pod \"global-pull-secret-syncer-szg9h\" (UID: \"1113a386-54ff-45c9-88c7-0696fd879022\") " pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:38:45.710937 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:45.710934 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:45.711058 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:45.710994 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1113a386-54ff-45c9-88c7-0696fd879022-original-pull-secret podName:1113a386-54ff-45c9-88c7-0696fd879022 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:47.710975769 +0000 UTC m=+6.069516157 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1113a386-54ff-45c9-88c7-0696fd879022-original-pull-secret") pod "global-pull-secret-syncer-szg9h" (UID: "1113a386-54ff-45c9-88c7-0696fd879022") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:45.711417 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:45.711398 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:45.711514 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:45.711454 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs podName:2e027e5e-259c-4e7d-a90f-7dbf717f7701 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:47.711438447 +0000 UTC m=+6.069978837 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs") pod "network-metrics-daemon-26h5n" (UID: "2e027e5e-259c-4e7d-a90f-7dbf717f7701") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:46.022288 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:46.022184 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 01:33:44 +0000 UTC" deadline="2028-01-25 23:14:11.483085273 +0000 UTC" Jun 15 01:38:46.022288 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:46.022253 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14157h35m25.460836067s" Jun 15 01:38:46.048385 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:46.047435 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:38:46.048385 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:46.047563 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbh9n" podUID="840c3654-07ac-4e2d-b17e-a21149308654" Jun 15 01:38:46.048385 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:46.047978 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:38:46.048385 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:46.048076 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szg9h" podUID="1113a386-54ff-45c9-88c7-0696fd879022" Jun 15 01:38:46.048385 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:46.048146 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:38:46.048385 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:46.048262 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26h5n" podUID="2e027e5e-259c-4e7d-a90f-7dbf717f7701" Jun 15 01:38:46.097301 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:46.097259 2576 generic.go:356] "Generic (PLEG): container finished" podID="bf4310eb0511ab78d8a84f23e6330eb0" containerID="692ea5afd32f13aa646d64a746a9c4d80c161e1501697a3eb5adaa23c501a40d" exitCode=0 Jun 15 01:38:46.098055 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:46.097986 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-124.ec2.internal" event={"ID":"bf4310eb0511ab78d8a84f23e6330eb0","Type":"ContainerDied","Data":"692ea5afd32f13aa646d64a746a9c4d80c161e1501697a3eb5adaa23c501a40d"} Jun 15 01:38:47.118579 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:47.118493 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-124.ec2.internal" event={"ID":"bf4310eb0511ab78d8a84f23e6330eb0","Type":"ContainerStarted","Data":"97babcc526eb3322a601afee73f93ba1ed6c37206585e419554cd12932732dde"} Jun 15 01:38:47.626067 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:47.626028 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqv4s\" (UniqueName: \"kubernetes.io/projected/840c3654-07ac-4e2d-b17e-a21149308654-kube-api-access-nqv4s\") pod \"network-check-target-lbh9n\" (UID: \"840c3654-07ac-4e2d-b17e-a21149308654\") " pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:38:47.626269 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:47.626251 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:38:47.626362 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:47.626275 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:38:47.626362 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:47.626290 2576 projected.go:196] Error preparing data for projected volume kube-api-access-nqv4s for pod openshift-network-diagnostics/network-check-target-lbh9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:47.626461 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:47.626373 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/840c3654-07ac-4e2d-b17e-a21149308654-kube-api-access-nqv4s podName:840c3654-07ac-4e2d-b17e-a21149308654 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:51.626353253 +0000 UTC m=+9.984893644 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqv4s" (UniqueName: "kubernetes.io/projected/840c3654-07ac-4e2d-b17e-a21149308654-kube-api-access-nqv4s") pod "network-check-target-lbh9n" (UID: "840c3654-07ac-4e2d-b17e-a21149308654") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:47.727147 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:47.727111 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs\") pod \"network-metrics-daemon-26h5n\" (UID: \"2e027e5e-259c-4e7d-a90f-7dbf717f7701\") " pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:38:47.727359 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:47.727162 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1113a386-54ff-45c9-88c7-0696fd879022-original-pull-secret\") pod \"global-pull-secret-syncer-szg9h\" (UID: \"1113a386-54ff-45c9-88c7-0696fd879022\") " pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:38:47.727359 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:47.727298 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:47.727469 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:47.727372 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1113a386-54ff-45c9-88c7-0696fd879022-original-pull-secret podName:1113a386-54ff-45c9-88c7-0696fd879022 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:51.727353289 +0000 UTC m=+10.085893682 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1113a386-54ff-45c9-88c7-0696fd879022-original-pull-secret") pod "global-pull-secret-syncer-szg9h" (UID: "1113a386-54ff-45c9-88c7-0696fd879022") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:47.727469 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:47.727453 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:47.727583 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:47.727500 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs podName:2e027e5e-259c-4e7d-a90f-7dbf717f7701 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:51.727488132 +0000 UTC m=+10.086028520 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs") pod "network-metrics-daemon-26h5n" (UID: "2e027e5e-259c-4e7d-a90f-7dbf717f7701") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:48.044906 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:48.044791 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:38:48.045063 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:48.044927 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbh9n" podUID="840c3654-07ac-4e2d-b17e-a21149308654" Jun 15 01:38:48.045122 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:48.045096 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:38:48.045167 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:48.045160 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:38:48.045304 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:48.045269 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26h5n" podUID="2e027e5e-259c-4e7d-a90f-7dbf717f7701" Jun 15 01:38:48.045404 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:48.045366 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szg9h" podUID="1113a386-54ff-45c9-88c7-0696fd879022" Jun 15 01:38:50.048815 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:50.048780 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:38:50.049244 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:50.048780 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:38:50.049244 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:50.048907 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szg9h" podUID="1113a386-54ff-45c9-88c7-0696fd879022" Jun 15 01:38:50.049244 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:50.048781 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:38:50.049244 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:50.048999 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26h5n" podUID="2e027e5e-259c-4e7d-a90f-7dbf717f7701" Jun 15 01:38:50.049244 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:50.049066 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbh9n" podUID="840c3654-07ac-4e2d-b17e-a21149308654" Jun 15 01:38:51.660296 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:51.659638 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqv4s\" (UniqueName: \"kubernetes.io/projected/840c3654-07ac-4e2d-b17e-a21149308654-kube-api-access-nqv4s\") pod \"network-check-target-lbh9n\" (UID: \"840c3654-07ac-4e2d-b17e-a21149308654\") " pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:38:51.660296 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:51.659835 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:38:51.660296 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:51.659860 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:38:51.660296 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:51.659875 2576 projected.go:196] Error preparing data for projected volume kube-api-access-nqv4s for pod openshift-network-diagnostics/network-check-target-lbh9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:51.660296 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:51.659937 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/840c3654-07ac-4e2d-b17e-a21149308654-kube-api-access-nqv4s podName:840c3654-07ac-4e2d-b17e-a21149308654 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:59.659916974 +0000 UTC m=+18.018457348 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqv4s" (UniqueName: "kubernetes.io/projected/840c3654-07ac-4e2d-b17e-a21149308654-kube-api-access-nqv4s") pod "network-check-target-lbh9n" (UID: "840c3654-07ac-4e2d-b17e-a21149308654") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:51.760576 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:51.760540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1113a386-54ff-45c9-88c7-0696fd879022-original-pull-secret\") pod \"global-pull-secret-syncer-szg9h\" (UID: \"1113a386-54ff-45c9-88c7-0696fd879022\") " pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:38:51.760753 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:51.760632 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs\") pod \"network-metrics-daemon-26h5n\" (UID: \"2e027e5e-259c-4e7d-a90f-7dbf717f7701\") " pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:38:51.760817 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:51.760766 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:51.760862 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:51.760827 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs podName:2e027e5e-259c-4e7d-a90f-7dbf717f7701 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:59.760808059 +0000 UTC m=+18.119348436 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs") pod "network-metrics-daemon-26h5n" (UID: "2e027e5e-259c-4e7d-a90f-7dbf717f7701") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:51.761038 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:51.761014 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:51.761148 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:51.761067 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1113a386-54ff-45c9-88c7-0696fd879022-original-pull-secret podName:1113a386-54ff-45c9-88c7-0696fd879022 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:59.761052503 +0000 UTC m=+18.119592894 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1113a386-54ff-45c9-88c7-0696fd879022-original-pull-secret") pod "global-pull-secret-syncer-szg9h" (UID: "1113a386-54ff-45c9-88c7-0696fd879022") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:52.045232 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:52.045150 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:38:52.045400 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:52.045289 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26h5n" podUID="2e027e5e-259c-4e7d-a90f-7dbf717f7701" Jun 15 01:38:52.045400 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:52.045316 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:38:52.045400 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:52.045326 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:38:52.045568 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:52.045433 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbh9n" podUID="840c3654-07ac-4e2d-b17e-a21149308654" Jun 15 01:38:52.046574 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:52.046546 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szg9h" podUID="1113a386-54ff-45c9-88c7-0696fd879022" Jun 15 01:38:54.045048 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:54.045013 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:38:54.045524 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:54.045146 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbh9n" podUID="840c3654-07ac-4e2d-b17e-a21149308654" Jun 15 01:38:54.045524 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:54.045207 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:38:54.045524 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:54.045315 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26h5n" podUID="2e027e5e-259c-4e7d-a90f-7dbf717f7701" Jun 15 01:38:54.045524 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:54.045414 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:38:54.045524 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:54.045501 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szg9h" podUID="1113a386-54ff-45c9-88c7-0696fd879022" Jun 15 01:38:56.047878 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:56.047843 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:38:56.047878 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:56.047867 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:38:56.047878 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:56.047877 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:38:56.048364 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:56.047949 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szg9h" podUID="1113a386-54ff-45c9-88c7-0696fd879022" Jun 15 01:38:56.048364 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:56.048046 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26h5n" podUID="2e027e5e-259c-4e7d-a90f-7dbf717f7701" Jun 15 01:38:56.048364 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:56.048120 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbh9n" podUID="840c3654-07ac-4e2d-b17e-a21149308654" Jun 15 01:38:58.044819 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:58.044786 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:38:58.044819 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:58.044802 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:38:58.045323 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:58.044786 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:38:58.045323 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:58.044940 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26h5n" podUID="2e027e5e-259c-4e7d-a90f-7dbf717f7701" Jun 15 01:38:58.045323 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:58.045008 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbh9n" podUID="840c3654-07ac-4e2d-b17e-a21149308654" Jun 15 01:38:58.045323 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:58.045114 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szg9h" podUID="1113a386-54ff-45c9-88c7-0696fd879022" Jun 15 01:38:59.727430 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:59.727398 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqv4s\" (UniqueName: \"kubernetes.io/projected/840c3654-07ac-4e2d-b17e-a21149308654-kube-api-access-nqv4s\") pod \"network-check-target-lbh9n\" (UID: \"840c3654-07ac-4e2d-b17e-a21149308654\") " pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:38:59.727864 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:59.727562 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:38:59.727864 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:59.727589 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:38:59.727864 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:59.727602 2576 projected.go:196] Error preparing data for projected volume kube-api-access-nqv4s for pod openshift-network-diagnostics/network-check-target-lbh9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:59.727864 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:59.727650 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/840c3654-07ac-4e2d-b17e-a21149308654-kube-api-access-nqv4s podName:840c3654-07ac-4e2d-b17e-a21149308654 nodeName:}" failed. No retries permitted until 2026-06-15 01:39:15.727637591 +0000 UTC m=+34.086177964 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqv4s" (UniqueName: "kubernetes.io/projected/840c3654-07ac-4e2d-b17e-a21149308654-kube-api-access-nqv4s") pod "network-check-target-lbh9n" (UID: "840c3654-07ac-4e2d-b17e-a21149308654") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:59.828499 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:59.828465 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1113a386-54ff-45c9-88c7-0696fd879022-original-pull-secret\") pod \"global-pull-secret-syncer-szg9h\" (UID: \"1113a386-54ff-45c9-88c7-0696fd879022\") " pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:38:59.828653 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:38:59.828538 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs\") pod \"network-metrics-daemon-26h5n\" (UID: \"2e027e5e-259c-4e7d-a90f-7dbf717f7701\") " pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:38:59.828653 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:59.828623 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:59.828755 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:59.828678 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs podName:2e027e5e-259c-4e7d-a90f-7dbf717f7701 nodeName:}" failed. No retries permitted until 2026-06-15 01:39:15.828662982 +0000 UTC m=+34.187203372 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs") pod "network-metrics-daemon-26h5n" (UID: "2e027e5e-259c-4e7d-a90f-7dbf717f7701") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:59.828755 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:59.828623 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:59.828855 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:38:59.828756 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1113a386-54ff-45c9-88c7-0696fd879022-original-pull-secret podName:1113a386-54ff-45c9-88c7-0696fd879022 nodeName:}" failed. No retries permitted until 2026-06-15 01:39:15.828739649 +0000 UTC m=+34.187280043 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1113a386-54ff-45c9-88c7-0696fd879022-original-pull-secret") pod "global-pull-secret-syncer-szg9h" (UID: "1113a386-54ff-45c9-88c7-0696fd879022") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:39:00.044826 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:00.044751 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:39:00.044826 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:00.044788 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:39:00.045040 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:00.044750 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:39:00.045040 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:00.044860 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szg9h" podUID="1113a386-54ff-45c9-88c7-0696fd879022" Jun 15 01:39:00.045040 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:00.044921 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbh9n" podUID="840c3654-07ac-4e2d-b17e-a21149308654" Jun 15 01:39:00.045040 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:00.045008 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26h5n" podUID="2e027e5e-259c-4e7d-a90f-7dbf717f7701" Jun 15 01:39:02.047238 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:02.047205 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:39:02.047739 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:02.047309 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:39:02.047739 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:02.047346 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:39:02.047739 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:02.047322 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26h5n" podUID="2e027e5e-259c-4e7d-a90f-7dbf717f7701" Jun 15 01:39:02.047739 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:02.047409 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbh9n" podUID="840c3654-07ac-4e2d-b17e-a21149308654" Jun 15 01:39:02.047739 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:02.047460 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szg9h" podUID="1113a386-54ff-45c9-88c7-0696fd879022" Jun 15 01:39:04.044716 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:04.044694 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:39:04.045429 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:04.044800 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szg9h" podUID="1113a386-54ff-45c9-88c7-0696fd879022" Jun 15 01:39:04.045429 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:04.044810 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:39:04.045429 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:04.044896 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26h5n" podUID="2e027e5e-259c-4e7d-a90f-7dbf717f7701" Jun 15 01:39:04.045429 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:04.044694 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:39:04.045429 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:04.044967 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbh9n" podUID="840c3654-07ac-4e2d-b17e-a21149308654" Jun 15 01:39:04.151754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:04.151723 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t9zjx" event={"ID":"86bedf18-f8dd-48de-8aa0-bae474076aaf","Type":"ContainerStarted","Data":"ee2dc23884e79fa7e350a7d5341d26441861e5a73cb3f9865051c506db18635d"} Jun 15 01:39:04.153253 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:04.153226 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xqcdr" event={"ID":"b842d4f5-5f7d-417a-9473-1271dc39b8eb","Type":"ContainerStarted","Data":"435da3681eac162cabb81f1527baff5d559d72214d4e48d27d6a8363ec21f199"} Jun 15 01:39:04.154729 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:04.154697 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" event={"ID":"2eaab3bc-5c5e-4538-9ece-1484335779c9","Type":"ContainerStarted","Data":"da240e2efbc583d9fe65e4499a2d0759344edadf5a8e6a811cf7855abda908cd"} Jun 15 01:39:04.157992 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:04.157970 2576 generic.go:356] "Generic (PLEG): container finished" podID="7c47a1e6-73c9-4bf5-ae77-06cb3d055991" containerID="3131cf52c99a7cee25e3b3ba8ba8b9d8e59707466b0b8f419b3fc5716f6a5021" exitCode=0 Jun 15 01:39:04.158103 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:04.158031 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7gxl6" event={"ID":"7c47a1e6-73c9-4bf5-ae77-06cb3d055991","Type":"ContainerDied","Data":"3131cf52c99a7cee25e3b3ba8ba8b9d8e59707466b0b8f419b3fc5716f6a5021"} Jun 15 01:39:04.159590 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:04.159559 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qprql" event={"ID":"5ae81fe9-f019-4365-8c0c-2451927c6932","Type":"ContainerStarted","Data":"b57cb4398ea2c03542feac666d9273cad823df2f62319be0b32fc2c5eacd15e3"} Jun 15 01:39:04.161182 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:04.161148 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xngcq" event={"ID":"6060d82e-9d20-4244-b25e-ebbffe02c1aa","Type":"ContainerStarted","Data":"92a1d0a3ff50b8aad001184c6c4e3b9852c670e124d080fa5f98a51d06e01a7d"} Jun 15 01:39:04.163353 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:04.163322 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whwth" event={"ID":"4081b3d4-8b74-4d97-b9d8-e4d131dd46df","Type":"ContainerStarted","Data":"965c89fa819ea20b3415123b330cb32491a54627588ff195777f8fe04802727e"} Jun 15 01:39:04.163455 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:04.163393 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whwth" event={"ID":"4081b3d4-8b74-4d97-b9d8-e4d131dd46df","Type":"ContainerStarted","Data":"98a27115f76247d77bd2d0e928e4a56d6a883332154f662aca2df1eb1d012c7a"} Jun 15 01:39:04.163455 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:04.163426 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whwth" event={"ID":"4081b3d4-8b74-4d97-b9d8-e4d131dd46df","Type":"ContainerStarted","Data":"7ea4ed90e2ca6f81c3891ec7217dd5d471ba1bc01ae83482bab3240fb832503d"} Jun 15 01:39:04.164983 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:04.164953 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kqxqs" event={"ID":"11c51e69-484c-4efa-bebe-0eb0ccf33029","Type":"ContainerStarted","Data":"a3421cc547a17f0ebfe37be06897cb809ac22d218d182a8b252e33c8748c8169"} Jun 15 01:39:04.166077 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:04.166025 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-124.ec2.internal" podStartSLOduration=21.166007019 podStartE2EDuration="21.166007019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:38:47.134661846 +0000 UTC m=+5.493202250" watchObservedRunningTime="2026-06-15 01:39:04.166007019 +0000 UTC m=+22.524547417" Jun 15 01:39:04.178365 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:04.178312 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t9zjx" podStartSLOduration=7.824267581 podStartE2EDuration="22.17830009s" totalImagesPullingTime="14.354032509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:04.165390763 +0000 UTC m=+22.523931158" watchObservedRunningTime="2026-06-15 01:39:04.17830009 +0000 UTC m=+22.536840482" Jun 15 01:39:04.178474 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:04.178441 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xqcdr" podStartSLOduration=3.2634117590000002 podStartE2EDuration="22.178436812s" totalImagesPullingTime="18.915025053s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:04.177826167 +0000 UTC m=+22.536366573" watchObservedRunningTime="2026-06-15 01:39:04.178436812 +0000 UTC m=+22.536977207" Jun 15 01:39:04.192265 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:04.192222 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qprql" podStartSLOduration=3.267024276 podStartE2EDuration="22.192210567s" totalImagesPullingTime="18.925186291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:04.191869889 +0000 UTC m=+22.550410285" watchObservedRunningTime="2026-06-15 01:39:04.192210567 +0000 UTC m=+22.550750962" Jun 15 01:39:04.228533 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:04.228480 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kqxqs" podStartSLOduration=3.29735951 podStartE2EDuration="22.228461997s" totalImagesPullingTime="18.931102487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:04.228080393 +0000 UTC m=+22.586620788" watchObservedRunningTime="2026-06-15 01:39:04.228461997 +0000 UTC m=+22.587002394" Jun 15 01:39:04.246529 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:04.246490 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xngcq" podStartSLOduration=3.079229896 podStartE2EDuration="22.246476527s" totalImagesPullingTime="19.167246631s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:04.246274676 +0000 UTC m=+22.604815071" watchObservedRunningTime="2026-06-15 01:39:04.246476527 +0000 UTC m=+22.605016922" Jun 15 01:39:05.094424 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:05.094392 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t9zjx" Jun 15 01:39:05.094934 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:05.094918 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t9zjx" Jun 15 01:39:05.170242 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:05.170201 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whwth" event={"ID":"4081b3d4-8b74-4d97-b9d8-e4d131dd46df","Type":"ContainerStarted","Data":"fbeb3fb8bf196bf90b80b7fd7544a6b17daf9ab04d90a219a6325f90d95c8064"} Jun 15 01:39:05.170400 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:05.170297 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whwth" event={"ID":"4081b3d4-8b74-4d97-b9d8-e4d131dd46df","Type":"ContainerStarted","Data":"3bca82b19cf63f48fd229650bbeb0632d6e0e2ebc66d13d1186130657309683a"} Jun 15 01:39:05.170400 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:05.170368 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whwth" event={"ID":"4081b3d4-8b74-4d97-b9d8-e4d131dd46df","Type":"ContainerStarted","Data":"32d43cf5f6dadb6c83b2346fe45f6222e09bb8a9e48cf0f7e7fc614ce10c429e"} Jun 15 01:39:05.170601 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:05.170577 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t9zjx" Jun 15 01:39:05.170994 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:05.170974 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t9zjx" Jun 15 01:39:05.485618 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:05.485593 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 15 01:39:06.045311 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:06.045089 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:39:06.045500 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:06.045118 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:39:06.045500 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:06.045118 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:39:06.045500 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:06.045444 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26h5n" podUID="2e027e5e-259c-4e7d-a90f-7dbf717f7701" Jun 15 01:39:06.045833 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:06.045807 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szg9h" podUID="1113a386-54ff-45c9-88c7-0696fd879022" Jun 15 01:39:06.045903 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:06.045878 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbh9n" podUID="840c3654-07ac-4e2d-b17e-a21149308654" Jun 15 01:39:06.059849 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:06.059764 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-15T01:39:05.485614555Z","UUID":"4a6619e8-05ab-435f-94d3-a10f6e2664e2","Handler":null,"Name":"","Endpoint":""} Jun 15 01:39:06.061780 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:06.061760 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 15 01:39:06.061871 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:06.061795 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 15 01:39:06.175036 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:06.175005 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4sfxm" event={"ID":"0de16715-e524-4336-b795-5cb526c63bdc","Type":"ContainerStarted","Data":"007fdc1dba713e2d259adcff13b5982be9c3afce560e8c05f30b2f2845be1541"} Jun 15 01:39:06.177554 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:06.177514 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" event={"ID":"2eaab3bc-5c5e-4538-9ece-1484335779c9","Type":"ContainerStarted","Data":"354e9e9ab59a300081a803daedd845d25c89f1bdf382c15f8c17950635e4ce43"} Jun 15 01:39:06.189234 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:06.189190 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4sfxm" podStartSLOduration=5.28617184 podStartE2EDuration="24.189175264s" totalImagesPullingTime="18.903003424s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:06.189020216 +0000 UTC m=+24.547560613" watchObservedRunningTime="2026-06-15 01:39:06.189175264 +0000 UTC m=+24.547715660" Jun 15 01:39:07.182182 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:07.182145 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" event={"ID":"2eaab3bc-5c5e-4538-9ece-1484335779c9","Type":"ContainerStarted","Data":"5c464fa4e44045dec2ae33ac4d97e463bf4cf834c2bc364a325ba7cdf60b2b93"} Jun 15 01:39:07.186027 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:07.185998 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whwth" event={"ID":"4081b3d4-8b74-4d97-b9d8-e4d131dd46df","Type":"ContainerStarted","Data":"f2e9f0ecc91454f1f32e953ea60698840b3fa7db809b20545cb453831884b305"} Jun 15 01:39:07.200540 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:07.200489 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cdtkl" podStartSLOduration=3.669291045 podStartE2EDuration="25.200471652s" totalImagesPullingTime="21.531180607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:07.200020783 +0000 UTC m=+25.558561180" watchObservedRunningTime="2026-06-15 01:39:07.200471652 +0000 UTC m=+25.559012261" Jun 15 01:39:08.048250 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:08.048223 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:39:08.048250 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:08.048254 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:39:08.048511 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:08.048254 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:39:08.048511 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:08.048353 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szg9h" podUID="1113a386-54ff-45c9-88c7-0696fd879022" Jun 15 01:39:08.048511 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:08.048440 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbh9n" podUID="840c3654-07ac-4e2d-b17e-a21149308654" Jun 15 01:39:08.048652 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:08.048561 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26h5n" podUID="2e027e5e-259c-4e7d-a90f-7dbf717f7701" Jun 15 01:39:09.194012 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:09.193832 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whwth" event={"ID":"4081b3d4-8b74-4d97-b9d8-e4d131dd46df","Type":"ContainerStarted","Data":"60eb0a3c8d7fdfa1a4faf1cbbbcee7145be12a727902f246d512aaa7aae7e411"} Jun 15 01:39:09.194590 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:09.194053 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:39:09.196269 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:09.196242 2576 generic.go:356] "Generic (PLEG): container finished" podID="7c47a1e6-73c9-4bf5-ae77-06cb3d055991" containerID="89e0c948faa5159700e68b087a9362e91074c9c7c668988654b52acdae9a3bb7" exitCode=0 Jun 15 01:39:09.196407 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:09.196278 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7gxl6" event={"ID":"7c47a1e6-73c9-4bf5-ae77-06cb3d055991","Type":"ContainerDied","Data":"89e0c948faa5159700e68b087a9362e91074c9c7c668988654b52acdae9a3bb7"} Jun 15 01:39:09.210393 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:09.210372 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:39:09.223486 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:09.223449 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-whwth" podStartSLOduration=8.252405759 podStartE2EDuration="27.223435473s" totalImagesPullingTime="18.971029714s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:09.222014505 +0000 UTC m=+27.580554900" watchObservedRunningTime="2026-06-15 01:39:09.223435473 +0000 UTC m=+27.581975859" Jun 15 01:39:10.045146 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:10.045115 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:39:10.045420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:10.045118 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:39:10.045420 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:10.045237 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szg9h" podUID="1113a386-54ff-45c9-88c7-0696fd879022" Jun 15 01:39:10.045420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:10.045119 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:39:10.045688 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:10.045323 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbh9n" podUID="840c3654-07ac-4e2d-b17e-a21149308654" Jun 15 01:39:10.045688 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:10.045515 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26h5n" podUID="2e027e5e-259c-4e7d-a90f-7dbf717f7701" Jun 15 01:39:10.198852 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:10.198825 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:39:10.199461 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:10.198893 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:39:10.212543 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:10.212521 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:39:10.723813 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:10.723641 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-szg9h"] Jun 15 01:39:10.723946 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:10.723852 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:39:10.723993 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:10.723936 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szg9h" podUID="1113a386-54ff-45c9-88c7-0696fd879022" Jun 15 01:39:10.726734 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:10.726706 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lbh9n"] Jun 15 01:39:10.726844 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:10.726779 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:39:10.726904 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:10.726844 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbh9n" podUID="840c3654-07ac-4e2d-b17e-a21149308654" Jun 15 01:39:10.727188 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:10.727168 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-26h5n"] Jun 15 01:39:10.727255 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:10.727244 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:39:10.727346 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:10.727319 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26h5n" podUID="2e027e5e-259c-4e7d-a90f-7dbf717f7701" Jun 15 01:39:11.202860 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:11.202829 2576 generic.go:356] "Generic (PLEG): container finished" podID="7c47a1e6-73c9-4bf5-ae77-06cb3d055991" containerID="6a6637de539882a35d160ae70d36c8862ed1c607ec60e6a31b2b333dc8e02f09" exitCode=0 Jun 15 01:39:11.203210 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:11.202915 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7gxl6" event={"ID":"7c47a1e6-73c9-4bf5-ae77-06cb3d055991","Type":"ContainerDied","Data":"6a6637de539882a35d160ae70d36c8862ed1c607ec60e6a31b2b333dc8e02f09"} Jun 15 01:39:12.046146 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:12.046114 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:39:12.046464 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:12.046209 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbh9n" podUID="840c3654-07ac-4e2d-b17e-a21149308654" Jun 15 01:39:12.046464 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:12.046311 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:39:12.046464 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:12.046455 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szg9h" podUID="1113a386-54ff-45c9-88c7-0696fd879022" Jun 15 01:39:12.046627 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:12.046494 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:39:12.046627 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:12.046598 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26h5n" podUID="2e027e5e-259c-4e7d-a90f-7dbf717f7701" Jun 15 01:39:13.209912 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:13.209883 2576 generic.go:356] "Generic (PLEG): container finished" podID="7c47a1e6-73c9-4bf5-ae77-06cb3d055991" containerID="c387783a1eebc6510ffade69f7a764afcbfdfe93cbf9b95d2f564f0da2cfd94c" exitCode=0 Jun 15 01:39:13.210479 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:13.209931 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7gxl6" event={"ID":"7c47a1e6-73c9-4bf5-ae77-06cb3d055991","Type":"ContainerDied","Data":"c387783a1eebc6510ffade69f7a764afcbfdfe93cbf9b95d2f564f0da2cfd94c"} Jun 15 01:39:14.048350 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:14.048309 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:39:14.048513 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:14.048452 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:39:14.048513 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:14.048443 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbh9n" podUID="840c3654-07ac-4e2d-b17e-a21149308654" Jun 15 01:39:14.048600 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:14.048451 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:39:14.048600 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:14.048522 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26h5n" podUID="2e027e5e-259c-4e7d-a90f-7dbf717f7701" Jun 15 01:39:14.048657 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:14.048609 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szg9h" podUID="1113a386-54ff-45c9-88c7-0696fd879022" Jun 15 01:39:15.742814 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:15.742783 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqv4s\" (UniqueName: \"kubernetes.io/projected/840c3654-07ac-4e2d-b17e-a21149308654-kube-api-access-nqv4s\") pod \"network-check-target-lbh9n\" (UID: \"840c3654-07ac-4e2d-b17e-a21149308654\") " pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:39:15.743288 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:15.742916 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:39:15.743288 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:15.742932 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:39:15.743288 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:15.742940 2576 projected.go:196] Error preparing data for projected volume kube-api-access-nqv4s for pod openshift-network-diagnostics/network-check-target-lbh9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:39:15.743288 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:15.742984 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/840c3654-07ac-4e2d-b17e-a21149308654-kube-api-access-nqv4s podName:840c3654-07ac-4e2d-b17e-a21149308654 nodeName:}" failed. No retries permitted until 2026-06-15 01:39:47.742972874 +0000 UTC m=+66.101513261 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqv4s" (UniqueName: "kubernetes.io/projected/840c3654-07ac-4e2d-b17e-a21149308654-kube-api-access-nqv4s") pod "network-check-target-lbh9n" (UID: "840c3654-07ac-4e2d-b17e-a21149308654") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:39:15.843196 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:15.843170 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs\") pod \"network-metrics-daemon-26h5n\" (UID: \"2e027e5e-259c-4e7d-a90f-7dbf717f7701\") " pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:39:15.843454 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:15.843219 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1113a386-54ff-45c9-88c7-0696fd879022-original-pull-secret\") pod \"global-pull-secret-syncer-szg9h\" (UID: \"1113a386-54ff-45c9-88c7-0696fd879022\") " pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:39:15.843454 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:15.843308 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:39:15.843454 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:15.843328 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:39:15.843454 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:15.843384 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs podName:2e027e5e-259c-4e7d-a90f-7dbf717f7701 nodeName:}" failed. No retries permitted until 2026-06-15 01:39:47.843366307 +0000 UTC m=+66.201906687 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs") pod "network-metrics-daemon-26h5n" (UID: "2e027e5e-259c-4e7d-a90f-7dbf717f7701") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:39:15.843454 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:15.843398 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1113a386-54ff-45c9-88c7-0696fd879022-original-pull-secret podName:1113a386-54ff-45c9-88c7-0696fd879022 nodeName:}" failed. No retries permitted until 2026-06-15 01:39:47.843392059 +0000 UTC m=+66.201932432 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1113a386-54ff-45c9-88c7-0696fd879022-original-pull-secret") pod "global-pull-secret-syncer-szg9h" (UID: "1113a386-54ff-45c9-88c7-0696fd879022") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:39:16.047786 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:16.047716 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:39:16.047786 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:16.047759 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:39:16.047974 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:16.047854 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26h5n" podUID="2e027e5e-259c-4e7d-a90f-7dbf717f7701" Jun 15 01:39:16.047974 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:16.047905 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbh9n" podUID="840c3654-07ac-4e2d-b17e-a21149308654" Jun 15 01:39:16.047974 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:16.047946 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:39:16.048107 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:16.048017 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-szg9h" podUID="1113a386-54ff-45c9-88c7-0696fd879022" Jun 15 01:39:17.406365 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.406175 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-124.ec2.internal" event="NodeReady" Jun 15 01:39:17.406761 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.406511 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 15 01:39:17.447317 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.447278 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8wcmz"] Jun 15 01:39:17.450916 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.450892 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nwmph"] Jun 15 01:39:17.451042 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.450973 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8wcmz" Jun 15 01:39:17.453495 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.453464 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 15 01:39:17.453607 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.453581 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 15 01:39:17.453607 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.453593 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-55pqm\"" Jun 15 01:39:17.454110 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.454094 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nwmph" Jun 15 01:39:17.456634 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.456473 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 15 01:39:17.456634 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.456527 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 15 01:39:17.456634 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.456593 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 15 01:39:17.456634 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.456593 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8gwn9\"" Jun 15 01:39:17.459976 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.459945 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8wcmz"] Jun 15 01:39:17.462210 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.462193 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nwmph"] Jun 15 01:39:17.554944 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.554915 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khhsx\" (UniqueName: \"kubernetes.io/projected/b00f4d8c-52d9-48c5-8a37-a69c3da3d450-kube-api-access-khhsx\") pod \"ingress-canary-nwmph\" (UID: \"b00f4d8c-52d9-48c5-8a37-a69c3da3d450\") " pod="openshift-ingress-canary/ingress-canary-nwmph" Jun 15 01:39:17.554944 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.554954 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78c57d75-c63a-4a72-81f1-fe8285631a98-tmp-dir\") pod \"dns-default-8wcmz\" (UID: \"78c57d75-c63a-4a72-81f1-fe8285631a98\") " pod="openshift-dns/dns-default-8wcmz" Jun 15 01:39:17.555175 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.554979 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5lrk\" (UniqueName: \"kubernetes.io/projected/78c57d75-c63a-4a72-81f1-fe8285631a98-kube-api-access-k5lrk\") pod \"dns-default-8wcmz\" (UID: \"78c57d75-c63a-4a72-81f1-fe8285631a98\") " pod="openshift-dns/dns-default-8wcmz" Jun 15 01:39:17.555175 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.555022 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls\") pod \"dns-default-8wcmz\" (UID: \"78c57d75-c63a-4a72-81f1-fe8285631a98\") " pod="openshift-dns/dns-default-8wcmz" Jun 15 01:39:17.555175 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.555075 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b00f4d8c-52d9-48c5-8a37-a69c3da3d450-cert\") pod \"ingress-canary-nwmph\" (UID: \"b00f4d8c-52d9-48c5-8a37-a69c3da3d450\") " pod="openshift-ingress-canary/ingress-canary-nwmph" Jun 15 01:39:17.555175 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.555106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/78c57d75-c63a-4a72-81f1-fe8285631a98-config-volume\") pod \"dns-default-8wcmz\" (UID: \"78c57d75-c63a-4a72-81f1-fe8285631a98\") " pod="openshift-dns/dns-default-8wcmz" Jun 15 01:39:17.655594 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.655569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/78c57d75-c63a-4a72-81f1-fe8285631a98-config-volume\") pod \"dns-default-8wcmz\" (UID: \"78c57d75-c63a-4a72-81f1-fe8285631a98\") " pod="openshift-dns/dns-default-8wcmz" Jun 15 01:39:17.655695 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.655620 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khhsx\" (UniqueName: \"kubernetes.io/projected/b00f4d8c-52d9-48c5-8a37-a69c3da3d450-kube-api-access-khhsx\") pod \"ingress-canary-nwmph\" (UID: \"b00f4d8c-52d9-48c5-8a37-a69c3da3d450\") " pod="openshift-ingress-canary/ingress-canary-nwmph" Jun 15 01:39:17.655695 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.655641 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78c57d75-c63a-4a72-81f1-fe8285631a98-tmp-dir\") pod \"dns-default-8wcmz\" (UID: \"78c57d75-c63a-4a72-81f1-fe8285631a98\") " pod="openshift-dns/dns-default-8wcmz" Jun 15 01:39:17.655695 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.655662 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5lrk\" (UniqueName: \"kubernetes.io/projected/78c57d75-c63a-4a72-81f1-fe8285631a98-kube-api-access-k5lrk\") pod \"dns-default-8wcmz\" (UID: \"78c57d75-c63a-4a72-81f1-fe8285631a98\") " pod="openshift-dns/dns-default-8wcmz" Jun 15 01:39:17.655695 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.655689 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls\") pod \"dns-default-8wcmz\" (UID: \"78c57d75-c63a-4a72-81f1-fe8285631a98\") " pod="openshift-dns/dns-default-8wcmz" Jun 15 01:39:17.655894 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.655710 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b00f4d8c-52d9-48c5-8a37-a69c3da3d450-cert\") pod \"ingress-canary-nwmph\" (UID: \"b00f4d8c-52d9-48c5-8a37-a69c3da3d450\") " pod="openshift-ingress-canary/ingress-canary-nwmph" Jun 15 01:39:17.655894 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:17.655818 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:39:17.655894 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:17.655880 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls podName:78c57d75-c63a-4a72-81f1-fe8285631a98 nodeName:}" failed. No retries permitted until 2026-06-15 01:39:18.155861488 +0000 UTC m=+36.514401870 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls") pod "dns-default-8wcmz" (UID: "78c57d75-c63a-4a72-81f1-fe8285631a98") : secret "dns-default-metrics-tls" not found Jun 15 01:39:17.656053 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.655938 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78c57d75-c63a-4a72-81f1-fe8285631a98-tmp-dir\") pod \"dns-default-8wcmz\" (UID: \"78c57d75-c63a-4a72-81f1-fe8285631a98\") " pod="openshift-dns/dns-default-8wcmz" Jun 15 01:39:17.656252 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.656233 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/78c57d75-c63a-4a72-81f1-fe8285631a98-config-volume\") pod \"dns-default-8wcmz\" (UID: \"78c57d75-c63a-4a72-81f1-fe8285631a98\") " pod="openshift-dns/dns-default-8wcmz" Jun 15 01:39:17.659819 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.659796 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b00f4d8c-52d9-48c5-8a37-a69c3da3d450-cert\") pod \"ingress-canary-nwmph\" (UID: \"b00f4d8c-52d9-48c5-8a37-a69c3da3d450\") " pod="openshift-ingress-canary/ingress-canary-nwmph" Jun 15 01:39:17.663804 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.663781 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5lrk\" (UniqueName: \"kubernetes.io/projected/78c57d75-c63a-4a72-81f1-fe8285631a98-kube-api-access-k5lrk\") pod \"dns-default-8wcmz\" (UID: \"78c57d75-c63a-4a72-81f1-fe8285631a98\") " pod="openshift-dns/dns-default-8wcmz" Jun 15 01:39:17.663903 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.663874 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khhsx\" (UniqueName: \"kubernetes.io/projected/b00f4d8c-52d9-48c5-8a37-a69c3da3d450-kube-api-access-khhsx\") pod \"ingress-canary-nwmph\" (UID: \"b00f4d8c-52d9-48c5-8a37-a69c3da3d450\") " pod="openshift-ingress-canary/ingress-canary-nwmph" Jun 15 01:39:17.769423 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.769398 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nwmph" Jun 15 01:39:17.902676 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:17.902613 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nwmph"] Jun 15 01:39:17.905936 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:39:17.905910 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb00f4d8c_52d9_48c5_8a37_a69c3da3d450.slice/crio-b4d0679d9cfcf704b70f800303a67566cb3e6ac56e46538c1f8e837bca938f46 WatchSource:0}: Error finding container b4d0679d9cfcf704b70f800303a67566cb3e6ac56e46538c1f8e837bca938f46: Status 404 returned error can't find the container with id b4d0679d9cfcf704b70f800303a67566cb3e6ac56e46538c1f8e837bca938f46 Jun 15 01:39:18.044956 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:18.044923 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:39:18.045108 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:18.044923 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:39:18.045167 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:18.044923 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:39:18.048347 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:18.048310 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 01:39:18.048347 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:18.048318 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 01:39:18.048512 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:18.048367 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hkjfs\"" Jun 15 01:39:18.049277 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:18.049257 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 01:39:18.049277 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:18.049275 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 01:39:18.049459 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:18.049265 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-46p56\"" Jun 15 01:39:18.158330 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:18.158260 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls\") pod \"dns-default-8wcmz\" (UID: \"78c57d75-c63a-4a72-81f1-fe8285631a98\") " pod="openshift-dns/dns-default-8wcmz" Jun 15 01:39:18.158452 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:18.158418 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:39:18.158511 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:18.158480 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls podName:78c57d75-c63a-4a72-81f1-fe8285631a98 nodeName:}" failed. No retries permitted until 2026-06-15 01:39:19.158466123 +0000 UTC m=+37.517006515 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls") pod "dns-default-8wcmz" (UID: "78c57d75-c63a-4a72-81f1-fe8285631a98") : secret "dns-default-metrics-tls" not found Jun 15 01:39:18.223392 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:18.223371 2576 generic.go:356] "Generic (PLEG): container finished" podID="7c47a1e6-73c9-4bf5-ae77-06cb3d055991" containerID="9441acd969bd11513ec18142271a6a5898e789a771576d0fca7e7a97c7181da0" exitCode=0 Jun 15 01:39:18.223487 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:18.223461 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7gxl6" event={"ID":"7c47a1e6-73c9-4bf5-ae77-06cb3d055991","Type":"ContainerDied","Data":"9441acd969bd11513ec18142271a6a5898e789a771576d0fca7e7a97c7181da0"} Jun 15 01:39:18.224493 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:18.224472 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nwmph" event={"ID":"b00f4d8c-52d9-48c5-8a37-a69c3da3d450","Type":"ContainerStarted","Data":"b4d0679d9cfcf704b70f800303a67566cb3e6ac56e46538c1f8e837bca938f46"} Jun 15 01:39:19.166193 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:19.166023 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls\") pod \"dns-default-8wcmz\" (UID: \"78c57d75-c63a-4a72-81f1-fe8285631a98\") " pod="openshift-dns/dns-default-8wcmz" Jun 15 01:39:19.166193 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:19.166178 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:39:19.166629 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:19.166245 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls podName:78c57d75-c63a-4a72-81f1-fe8285631a98 nodeName:}" failed. No retries permitted until 2026-06-15 01:39:21.166226691 +0000 UTC m=+39.524767084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls") pod "dns-default-8wcmz" (UID: "78c57d75-c63a-4a72-81f1-fe8285631a98") : secret "dns-default-metrics-tls" not found Jun 15 01:39:19.230402 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:19.230376 2576 generic.go:356] "Generic (PLEG): container finished" podID="7c47a1e6-73c9-4bf5-ae77-06cb3d055991" containerID="ce7312fcf2006209bfa3f28ef4b897511cef9992aef2c7a5767a0de2462624e3" exitCode=0 Jun 15 01:39:19.230552 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:19.230431 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7gxl6" event={"ID":"7c47a1e6-73c9-4bf5-ae77-06cb3d055991","Type":"ContainerDied","Data":"ce7312fcf2006209bfa3f28ef4b897511cef9992aef2c7a5767a0de2462624e3"} Jun 15 01:39:20.235408 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:20.235376 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7gxl6" event={"ID":"7c47a1e6-73c9-4bf5-ae77-06cb3d055991","Type":"ContainerStarted","Data":"572fc14d63afd7cc024bd849967ddb9cf3c2a47dd8d9a7b1c8823c87314c43f5"} Jun 15 01:39:20.236795 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:20.236772 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nwmph" event={"ID":"b00f4d8c-52d9-48c5-8a37-a69c3da3d450","Type":"ContainerStarted","Data":"cc8f8cd15aeb86617a3157a2009e7935dd9a4bcf2699a66e8eee9540c56f2910"} Jun 15 01:39:20.256672 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:20.256633 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7gxl6" podStartSLOduration=8.30973096 podStartE2EDuration="38.256617793s" totalImagesPullingTime="29.946886833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:20.255431983 +0000 UTC m=+38.613972379" watchObservedRunningTime="2026-06-15 01:39:20.256617793 +0000 UTC m=+38.615158191" Jun 15 01:39:20.269632 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:20.269595 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nwmph" podStartSLOduration=1.5012524649999999 podStartE2EDuration="3.269585352s" totalImagesPullingTime="1.768332887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:39:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:20.268987327 +0000 UTC m=+38.627527735" watchObservedRunningTime="2026-06-15 01:39:20.269585352 +0000 UTC m=+38.628125749" Jun 15 01:39:21.177748 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:21.177710 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls\") pod \"dns-default-8wcmz\" (UID: \"78c57d75-c63a-4a72-81f1-fe8285631a98\") " pod="openshift-dns/dns-default-8wcmz" Jun 15 01:39:21.177922 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:21.177824 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:39:21.177922 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:21.177875 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls podName:78c57d75-c63a-4a72-81f1-fe8285631a98 nodeName:}" failed. No retries permitted until 2026-06-15 01:39:25.177862434 +0000 UTC m=+43.536402831 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls") pod "dns-default-8wcmz" (UID: "78c57d75-c63a-4a72-81f1-fe8285631a98") : secret "dns-default-metrics-tls" not found Jun 15 01:39:25.206053 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:25.206015 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls\") pod \"dns-default-8wcmz\" (UID: \"78c57d75-c63a-4a72-81f1-fe8285631a98\") " pod="openshift-dns/dns-default-8wcmz" Jun 15 01:39:25.206456 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:25.206155 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:39:25.206456 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:25.206209 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls podName:78c57d75-c63a-4a72-81f1-fe8285631a98 nodeName:}" failed. No retries permitted until 2026-06-15 01:39:33.206196609 +0000 UTC m=+51.564736983 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls") pod "dns-default-8wcmz" (UID: "78c57d75-c63a-4a72-81f1-fe8285631a98") : secret "dns-default-metrics-tls" not found Jun 15 01:39:33.260607 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:33.260570 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls\") pod \"dns-default-8wcmz\" (UID: \"78c57d75-c63a-4a72-81f1-fe8285631a98\") " pod="openshift-dns/dns-default-8wcmz" Jun 15 01:39:33.261133 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:33.260713 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:39:33.261133 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:33.260782 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls podName:78c57d75-c63a-4a72-81f1-fe8285631a98 nodeName:}" failed. No retries permitted until 2026-06-15 01:39:49.260767834 +0000 UTC m=+67.619308223 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls") pod "dns-default-8wcmz" (UID: "78c57d75-c63a-4a72-81f1-fe8285631a98") : secret "dns-default-metrics-tls" not found Jun 15 01:39:40.841912 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:40.841879 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d98c88bf8-gmwld"] Jun 15 01:39:40.844023 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:40.843999 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d98c88bf8-gmwld" Jun 15 01:39:40.847618 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:40.847594 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 15 01:39:40.847618 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:40.847606 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 15 01:39:40.847618 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:40.847594 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-sghxq\"" Jun 15 01:39:40.847862 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:40.847606 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 15 01:39:40.847862 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:40.847607 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 15 01:39:40.855654 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:40.855631 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d98c88bf8-gmwld"] Jun 15 01:39:41.008442 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:41.008407 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/239e32fd-df28-4f37-acfd-a843da601f42-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d98c88bf8-gmwld\" (UID: \"239e32fd-df28-4f37-acfd-a843da601f42\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d98c88bf8-gmwld" Jun 15 01:39:41.008625 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:41.008488 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8fjl\" (UniqueName: \"kubernetes.io/projected/239e32fd-df28-4f37-acfd-a843da601f42-kube-api-access-q8fjl\") pod \"managed-serviceaccount-addon-agent-d98c88bf8-gmwld\" (UID: \"239e32fd-df28-4f37-acfd-a843da601f42\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d98c88bf8-gmwld" Jun 15 01:39:41.109226 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:41.109131 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8fjl\" (UniqueName: \"kubernetes.io/projected/239e32fd-df28-4f37-acfd-a843da601f42-kube-api-access-q8fjl\") pod \"managed-serviceaccount-addon-agent-d98c88bf8-gmwld\" (UID: \"239e32fd-df28-4f37-acfd-a843da601f42\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d98c88bf8-gmwld" Jun 15 01:39:41.109226 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:41.109192 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/239e32fd-df28-4f37-acfd-a843da601f42-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d98c88bf8-gmwld\" (UID: \"239e32fd-df28-4f37-acfd-a843da601f42\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d98c88bf8-gmwld" Jun 15 01:39:41.112683 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:41.112665 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/239e32fd-df28-4f37-acfd-a843da601f42-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d98c88bf8-gmwld\" (UID: \"239e32fd-df28-4f37-acfd-a843da601f42\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d98c88bf8-gmwld" Jun 15 01:39:41.116895 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:41.116871 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8fjl\" (UniqueName: \"kubernetes.io/projected/239e32fd-df28-4f37-acfd-a843da601f42-kube-api-access-q8fjl\") pod \"managed-serviceaccount-addon-agent-d98c88bf8-gmwld\" (UID: \"239e32fd-df28-4f37-acfd-a843da601f42\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d98c88bf8-gmwld" Jun 15 01:39:41.164978 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:41.164956 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d98c88bf8-gmwld" Jun 15 01:39:41.280737 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:41.280699 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d98c88bf8-gmwld"] Jun 15 01:39:41.284808 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:39:41.284782 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod239e32fd_df28_4f37_acfd_a843da601f42.slice/crio-2dea57151ebd7f82fa8c77d44f3a5a10ede9b6763c73e92dfbb4badd6969353f WatchSource:0}: Error finding container 2dea57151ebd7f82fa8c77d44f3a5a10ede9b6763c73e92dfbb4badd6969353f: Status 404 returned error can't find the container with id 2dea57151ebd7f82fa8c77d44f3a5a10ede9b6763c73e92dfbb4badd6969353f Jun 15 01:39:42.221182 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:42.221148 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-whwth" Jun 15 01:39:42.289403 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:42.289360 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d98c88bf8-gmwld" event={"ID":"239e32fd-df28-4f37-acfd-a843da601f42","Type":"ContainerStarted","Data":"2dea57151ebd7f82fa8c77d44f3a5a10ede9b6763c73e92dfbb4badd6969353f"} Jun 15 01:39:44.295241 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:44.295148 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d98c88bf8-gmwld" event={"ID":"239e32fd-df28-4f37-acfd-a843da601f42","Type":"ContainerStarted","Data":"b859295ba9b4aeb7219a28c8d142ecda20b85adc70ead5d036fd0dff22807eed"} Jun 15 01:39:44.309833 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:44.309783 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d98c88bf8-gmwld" podStartSLOduration=1.719552795 podStartE2EDuration="4.309768317s" totalImagesPullingTime="2.590215522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:44.309001066 +0000 UTC m=+62.667541464" watchObservedRunningTime="2026-06-15 01:39:44.309768317 +0000 UTC m=+62.668308754" Jun 15 01:39:47.759404 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:47.759362 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqv4s\" (UniqueName: \"kubernetes.io/projected/840c3654-07ac-4e2d-b17e-a21149308654-kube-api-access-nqv4s\") pod \"network-check-target-lbh9n\" (UID: \"840c3654-07ac-4e2d-b17e-a21149308654\") " pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:39:47.762054 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:47.762030 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 01:39:47.772356 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:47.772309 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 01:39:47.782623 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:47.782591 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqv4s\" (UniqueName: \"kubernetes.io/projected/840c3654-07ac-4e2d-b17e-a21149308654-kube-api-access-nqv4s\") pod \"network-check-target-lbh9n\" (UID: \"840c3654-07ac-4e2d-b17e-a21149308654\") " pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:39:47.860634 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:47.860591 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs\") pod \"network-metrics-daemon-26h5n\" (UID: \"2e027e5e-259c-4e7d-a90f-7dbf717f7701\") " pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:39:47.860634 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:47.860639 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1113a386-54ff-45c9-88c7-0696fd879022-original-pull-secret\") pod \"global-pull-secret-syncer-szg9h\" (UID: \"1113a386-54ff-45c9-88c7-0696fd879022\") " pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:39:47.863097 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:47.863076 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 01:39:47.863190 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:47.863168 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 01:39:47.871233 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:47.871213 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 01:39:47.871350 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:47.871280 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs podName:2e027e5e-259c-4e7d-a90f-7dbf717f7701 nodeName:}" failed. No retries permitted until 2026-06-15 01:40:51.87126325 +0000 UTC m=+130.229803638 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs") pod "network-metrics-daemon-26h5n" (UID: "2e027e5e-259c-4e7d-a90f-7dbf717f7701") : secret "metrics-daemon-secret" not found Jun 15 01:39:47.873292 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:47.873271 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1113a386-54ff-45c9-88c7-0696fd879022-original-pull-secret\") pod \"global-pull-secret-syncer-szg9h\" (UID: \"1113a386-54ff-45c9-88c7-0696fd879022\") " pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:39:48.055882 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:48.055807 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-szg9h" Jun 15 01:39:48.068802 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:48.068781 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hkjfs\"" Jun 15 01:39:48.076811 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:48.076783 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:39:48.181744 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:48.181695 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-szg9h"] Jun 15 01:39:48.185482 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:39:48.185448 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1113a386_54ff_45c9_88c7_0696fd879022.slice/crio-0d921c74763ba6d8daa4e3ae36b876bd3f213adba205b9b85baeae75469f4b17 WatchSource:0}: Error finding container 0d921c74763ba6d8daa4e3ae36b876bd3f213adba205b9b85baeae75469f4b17: Status 404 returned error can't find the container with id 0d921c74763ba6d8daa4e3ae36b876bd3f213adba205b9b85baeae75469f4b17 Jun 15 01:39:48.211326 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:48.211298 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lbh9n"] Jun 15 01:39:48.214230 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:39:48.214204 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod840c3654_07ac_4e2d_b17e_a21149308654.slice/crio-00983b469e2bca002d40221349572fefea8d90e1866d492b85e6a01964d974ed WatchSource:0}: Error finding container 00983b469e2bca002d40221349572fefea8d90e1866d492b85e6a01964d974ed: Status 404 returned error can't find the container with id 00983b469e2bca002d40221349572fefea8d90e1866d492b85e6a01964d974ed Jun 15 01:39:48.305575 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:48.305539 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lbh9n" event={"ID":"840c3654-07ac-4e2d-b17e-a21149308654","Type":"ContainerStarted","Data":"00983b469e2bca002d40221349572fefea8d90e1866d492b85e6a01964d974ed"} Jun 15 01:39:48.306692 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:48.306632 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-szg9h" event={"ID":"1113a386-54ff-45c9-88c7-0696fd879022","Type":"ContainerStarted","Data":"0d921c74763ba6d8daa4e3ae36b876bd3f213adba205b9b85baeae75469f4b17"} Jun 15 01:39:49.270430 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:49.270386 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls\") pod \"dns-default-8wcmz\" (UID: \"78c57d75-c63a-4a72-81f1-fe8285631a98\") " pod="openshift-dns/dns-default-8wcmz" Jun 15 01:39:49.270972 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:49.270529 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:39:49.270972 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:39:49.270611 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls podName:78c57d75-c63a-4a72-81f1-fe8285631a98 nodeName:}" failed. No retries permitted until 2026-06-15 01:40:21.270591102 +0000 UTC m=+99.629131490 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls") pod "dns-default-8wcmz" (UID: "78c57d75-c63a-4a72-81f1-fe8285631a98") : secret "dns-default-metrics-tls" not found Jun 15 01:39:53.322025 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:53.321988 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lbh9n" event={"ID":"840c3654-07ac-4e2d-b17e-a21149308654","Type":"ContainerStarted","Data":"afd36e491e94efc5b4d15a889f49ad524ebea8d9cea49c76cd9101509bb0087c"} Jun 15 01:39:53.322483 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:53.322131 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:39:53.323489 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:53.323463 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-szg9h" event={"ID":"1113a386-54ff-45c9-88c7-0696fd879022","Type":"ContainerStarted","Data":"b091268ca4366463e81fc79cd841312eed64c9ed40e41ae197f6d31f057b7154"} Jun 15 01:39:53.338084 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:53.338043 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lbh9n" podStartSLOduration=66.932702972 podStartE2EDuration="1m11.338031436s" totalImagesPullingTime="4.405328464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:53.336467778 +0000 UTC m=+71.695008173" watchObservedRunningTime="2026-06-15 01:39:53.338031436 +0000 UTC m=+71.696571881" Jun 15 01:39:53.349276 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:39:53.349201 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-szg9h" podStartSLOduration=66.912298406 podStartE2EDuration="1m11.349188362s" totalImagesPullingTime="4.436889956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:53.349121496 +0000 UTC m=+71.707661895" watchObservedRunningTime="2026-06-15 01:39:53.349188362 +0000 UTC m=+71.707728759" Jun 15 01:40:21.288084 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:40:21.288028 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls\") pod \"dns-default-8wcmz\" (UID: \"78c57d75-c63a-4a72-81f1-fe8285631a98\") " pod="openshift-dns/dns-default-8wcmz" Jun 15 01:40:21.288562 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:40:21.288151 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:40:21.288562 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:40:21.288208 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls podName:78c57d75-c63a-4a72-81f1-fe8285631a98 nodeName:}" failed. No retries permitted until 2026-06-15 01:41:25.288192347 +0000 UTC m=+163.646732735 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls") pod "dns-default-8wcmz" (UID: "78c57d75-c63a-4a72-81f1-fe8285631a98") : secret "dns-default-metrics-tls" not found Jun 15 01:40:24.329369 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:40:24.329319 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lbh9n" Jun 15 01:40:51.893166 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:40:51.893123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs\") pod \"network-metrics-daemon-26h5n\" (UID: \"2e027e5e-259c-4e7d-a90f-7dbf717f7701\") " pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:40:51.893686 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:40:51.893278 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 01:40:51.893686 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:40:51.893373 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs podName:2e027e5e-259c-4e7d-a90f-7dbf717f7701 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:53.893357463 +0000 UTC m=+252.251897849 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs") pod "network-metrics-daemon-26h5n" (UID: "2e027e5e-259c-4e7d-a90f-7dbf717f7701") : secret "metrics-daemon-secret" not found Jun 15 01:41:20.463544 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:41:20.463505 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8wcmz" podUID="78c57d75-c63a-4a72-81f1-fe8285631a98" Jun 15 01:41:20.527678 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:41:20.527649 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8wcmz" Jun 15 01:41:21.061838 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:41:21.061784 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-26h5n" podUID="2e027e5e-259c-4e7d-a90f-7dbf717f7701" Jun 15 01:41:25.321410 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:41:25.321368 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls\") pod \"dns-default-8wcmz\" (UID: \"78c57d75-c63a-4a72-81f1-fe8285631a98\") " pod="openshift-dns/dns-default-8wcmz" Jun 15 01:41:25.321795 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:41:25.321507 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:41:25.321795 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:41:25.321563 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls podName:78c57d75-c63a-4a72-81f1-fe8285631a98 nodeName:}" failed. No retries permitted until 2026-06-15 01:43:27.321549035 +0000 UTC m=+285.680089423 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls") pod "dns-default-8wcmz" (UID: "78c57d75-c63a-4a72-81f1-fe8285631a98") : secret "dns-default-metrics-tls" not found Jun 15 01:41:35.045462 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:41:35.045324 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:41:44.581852 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:41:44.581817 2576 generic.go:356] "Generic (PLEG): container finished" podID="239e32fd-df28-4f37-acfd-a843da601f42" containerID="b859295ba9b4aeb7219a28c8d142ecda20b85adc70ead5d036fd0dff22807eed" exitCode=255 Jun 15 01:41:44.582241 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:41:44.581882 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d98c88bf8-gmwld" event={"ID":"239e32fd-df28-4f37-acfd-a843da601f42","Type":"ContainerDied","Data":"b859295ba9b4aeb7219a28c8d142ecda20b85adc70ead5d036fd0dff22807eed"} Jun 15 01:41:44.587636 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:41:44.587616 2576 scope.go:117] "RemoveContainer" containerID="b859295ba9b4aeb7219a28c8d142ecda20b85adc70ead5d036fd0dff22807eed" Jun 15 01:41:45.586082 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:41:45.586051 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d98c88bf8-gmwld" event={"ID":"239e32fd-df28-4f37-acfd-a843da601f42","Type":"ContainerStarted","Data":"95de9bbc424322c1a2bfa16a94177cd64b2e32669ea033a5ed85a1664994b247"} Jun 15 01:42:00.654890 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.654852 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-2kplp"] Jun 15 01:42:00.657502 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.657481 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-5fggm"] Jun 15 01:42:00.657619 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.657597 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-2kplp" Jun 15 01:42:00.659911 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.659886 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-846697d79d-m7gkq"] Jun 15 01:42:00.659911 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.659889 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-z58hk\"" Jun 15 01:42:00.660069 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.659960 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-5fggm" Jun 15 01:42:00.662122 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.662102 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 15 01:42:00.662225 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.662105 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7lzkx\"" Jun 15 01:42:00.662421 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.662405 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 15 01:42:00.662645 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.662626 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:00.664536 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.664515 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 15 01:42:00.664797 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.664780 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zszhr\"" Jun 15 01:42:00.664917 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.664904 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 15 01:42:00.665415 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.665400 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 15 01:42:00.665492 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.665429 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 15 01:42:00.665492 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.665436 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 15 01:42:00.667735 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.667716 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 15 01:42:00.668417 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.668401 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-2kplp"] Jun 15 01:42:00.673379 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.673324 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-5fggm"] Jun 15 01:42:00.686077 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.686055 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-846697d79d-m7gkq"] Jun 15 01:42:00.746088 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.746052 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-6hxg8"] Jun 15 01:42:00.748874 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.748859 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-6hxg8" Jun 15 01:42:00.751345 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.751313 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 15 01:42:00.752766 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.752744 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 15 01:42:00.753281 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.753263 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-4zj2j\"" Jun 15 01:42:00.753538 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.753509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/52b7be5b-ae33-4595-bcc6-54e125bd6de8-default-certificate\") pod \"router-default-846697d79d-m7gkq\" (UID: \"52b7be5b-ae33-4595-bcc6-54e125bd6de8\") " pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:00.753635 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.753548 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52b7be5b-ae33-4595-bcc6-54e125bd6de8-metrics-certs\") pod \"router-default-846697d79d-m7gkq\" (UID: \"52b7be5b-ae33-4595-bcc6-54e125bd6de8\") " pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:00.753635 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.753576 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvxzx\" (UniqueName: \"kubernetes.io/projected/52b7be5b-ae33-4595-bcc6-54e125bd6de8-kube-api-access-cvxzx\") pod \"router-default-846697d79d-m7gkq\" (UID: \"52b7be5b-ae33-4595-bcc6-54e125bd6de8\") " pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:00.753635 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.753601 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/451dde2a-7ed3-46cf-8b3c-ce96077ad565-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-5fggm\" (UID: \"451dde2a-7ed3-46cf-8b3c-ce96077ad565\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-5fggm" Jun 15 01:42:00.753789 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.753699 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/52b7be5b-ae33-4595-bcc6-54e125bd6de8-stats-auth\") pod \"router-default-846697d79d-m7gkq\" (UID: \"52b7be5b-ae33-4595-bcc6-54e125bd6de8\") " pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:00.753849 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.753784 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbtbp\" (UniqueName: \"kubernetes.io/projected/db8d21a4-3a6a-435c-963d-8a9d50fe3653-kube-api-access-gbtbp\") pod \"network-check-source-6947749cfc-2kplp\" (UID: \"db8d21a4-3a6a-435c-963d-8a9d50fe3653\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-2kplp" Jun 15 01:42:00.753849 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.753815 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-5qb7h"] Jun 15 01:42:00.753943 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.753835 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/451dde2a-7ed3-46cf-8b3c-ce96077ad565-nginx-conf\") pod \"networking-console-plugin-867b76cb74-5fggm\" (UID: \"451dde2a-7ed3-46cf-8b3c-ce96077ad565\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-5fggm" Jun 15 01:42:00.753943 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.753895 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b7be5b-ae33-4595-bcc6-54e125bd6de8-service-ca-bundle\") pod \"router-default-846697d79d-m7gkq\" (UID: \"52b7be5b-ae33-4595-bcc6-54e125bd6de8\") " pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:00.756790 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.756772 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-r9nkg"] Jun 15 01:42:00.756904 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.756888 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" Jun 15 01:42:00.759656 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.759636 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67dbf94d-tc445"] Jun 15 01:42:00.759823 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.759804 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-r9nkg" Jun 15 01:42:00.759952 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.759933 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 15 01:42:00.760086 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.760067 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 15 01:42:00.760176 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.759970 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 15 01:42:00.760238 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.760205 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 15 01:42:00.760407 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.760386 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kl76s\"" Jun 15 01:42:00.762306 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.762288 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 15 01:42:00.762464 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.762447 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 15 01:42:00.762848 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.762831 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-6hxg8"] Jun 15 01:42:00.763061 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.762898 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:00.763261 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.763243 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 15 01:42:00.763541 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.763522 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2lvk7\"" Jun 15 01:42:00.765090 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.765067 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 15 01:42:00.765894 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.765875 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vq2mt\"" Jun 15 01:42:00.766012 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.765991 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 15 01:42:00.766187 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.765877 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 15 01:42:00.770531 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.770375 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 15 01:42:00.773285 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.773266 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-5qb7h"] Jun 15 01:42:00.776707 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.776685 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 15 01:42:00.776917 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.776906 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-r9nkg"] Jun 15 01:42:00.777603 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.777585 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67dbf94d-tc445"] Jun 15 01:42:00.854554 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.854523 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee20262f-ced8-4d5c-8bf8-15fefc664812-config\") pod \"console-operator-5dbbb5d744-5qb7h\" (UID: \"ee20262f-ced8-4d5c-8bf8-15fefc664812\") " pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" Jun 15 01:42:00.854725 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.854559 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-trusted-ca\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:00.854725 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.854580 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-installation-pull-secrets\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:00.854725 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.854613 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52b7be5b-ae33-4595-bcc6-54e125bd6de8-metrics-certs\") pod \"router-default-846697d79d-m7gkq\" (UID: \"52b7be5b-ae33-4595-bcc6-54e125bd6de8\") " pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:00.854725 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.854630 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/451dde2a-7ed3-46cf-8b3c-ce96077ad565-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-5fggm\" (UID: \"451dde2a-7ed3-46cf-8b3c-ce96077ad565\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-5fggm" Jun 15 01:42:00.854725 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.854646 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkdbx\" (UniqueName: \"kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-kube-api-access-hkdbx\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:00.854725 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.854664 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee20262f-ced8-4d5c-8bf8-15fefc664812-serving-cert\") pod \"console-operator-5dbbb5d744-5qb7h\" (UID: \"ee20262f-ced8-4d5c-8bf8-15fefc664812\") " pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" Jun 15 01:42:00.854725 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.854679 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t49s2\" (UniqueName: \"kubernetes.io/projected/5f18ae0f-77ec-416d-8126-3f89810ff472-kube-api-access-t49s2\") pod \"cluster-samples-operator-9547488fd-r9nkg\" (UID: \"5f18ae0f-77ec-416d-8126-3f89810ff472\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-r9nkg" Jun 15 01:42:00.855044 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.854720 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdcp5\" (UniqueName: \"kubernetes.io/projected/b1e1b881-33ed-4baf-bb43-39fa0b626035-kube-api-access-jdcp5\") pod \"volume-data-source-validator-bd4ccd799-6hxg8\" (UID: \"b1e1b881-33ed-4baf-bb43-39fa0b626035\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-6hxg8" Jun 15 01:42:00.855044 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.854777 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-ca-trust-extracted\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:00.855044 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:00.854811 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 01:42:00.855044 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:00.854811 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 01:42:00.855044 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.854839 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/52b7be5b-ae33-4595-bcc6-54e125bd6de8-stats-auth\") pod \"router-default-846697d79d-m7gkq\" (UID: \"52b7be5b-ae33-4595-bcc6-54e125bd6de8\") " pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:00.855044 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.854903 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f18ae0f-77ec-416d-8126-3f89810ff472-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-r9nkg\" (UID: \"5f18ae0f-77ec-416d-8126-3f89810ff472\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-r9nkg" Jun 15 01:42:00.855044 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:00.854918 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/451dde2a-7ed3-46cf-8b3c-ce96077ad565-networking-console-plugin-cert podName:451dde2a-7ed3-46cf-8b3c-ce96077ad565 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:01.354897616 +0000 UTC m=+199.713438013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/451dde2a-7ed3-46cf-8b3c-ce96077ad565-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-5fggm" (UID: "451dde2a-7ed3-46cf-8b3c-ce96077ad565") : secret "networking-console-plugin-cert" not found Jun 15 01:42:00.855044 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:00.854961 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52b7be5b-ae33-4595-bcc6-54e125bd6de8-metrics-certs podName:52b7be5b-ae33-4595-bcc6-54e125bd6de8 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:01.354946787 +0000 UTC m=+199.713487162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52b7be5b-ae33-4595-bcc6-54e125bd6de8-metrics-certs") pod "router-default-846697d79d-m7gkq" (UID: "52b7be5b-ae33-4595-bcc6-54e125bd6de8") : secret "router-metrics-certs-default" not found Jun 15 01:42:00.855044 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.854991 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-image-registry-private-configuration\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:00.855044 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.855028 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/451dde2a-7ed3-46cf-8b3c-ce96077ad565-nginx-conf\") pod \"networking-console-plugin-867b76cb74-5fggm\" (UID: \"451dde2a-7ed3-46cf-8b3c-ce96077ad565\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-5fggm" Jun 15 01:42:00.855468 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.855049 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-certificates\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:00.855468 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.855073 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b7be5b-ae33-4595-bcc6-54e125bd6de8-service-ca-bundle\") pod \"router-default-846697d79d-m7gkq\" (UID: \"52b7be5b-ae33-4595-bcc6-54e125bd6de8\") " pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:00.855468 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.855095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee20262f-ced8-4d5c-8bf8-15fefc664812-trusted-ca\") pod \"console-operator-5dbbb5d744-5qb7h\" (UID: \"ee20262f-ced8-4d5c-8bf8-15fefc664812\") " pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" Jun 15 01:42:00.855468 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.855142 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/52b7be5b-ae33-4595-bcc6-54e125bd6de8-default-certificate\") pod \"router-default-846697d79d-m7gkq\" (UID: \"52b7be5b-ae33-4595-bcc6-54e125bd6de8\") " pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:00.855468 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:00.855193 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52b7be5b-ae33-4595-bcc6-54e125bd6de8-service-ca-bundle podName:52b7be5b-ae33-4595-bcc6-54e125bd6de8 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:01.355178169 +0000 UTC m=+199.713718556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/52b7be5b-ae33-4595-bcc6-54e125bd6de8-service-ca-bundle") pod "router-default-846697d79d-m7gkq" (UID: "52b7be5b-ae33-4595-bcc6-54e125bd6de8") : configmap references non-existent config key: service-ca.crt Jun 15 01:42:00.855468 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.855214 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvxzx\" (UniqueName: \"kubernetes.io/projected/52b7be5b-ae33-4595-bcc6-54e125bd6de8-kube-api-access-cvxzx\") pod \"router-default-846697d79d-m7gkq\" (UID: \"52b7be5b-ae33-4595-bcc6-54e125bd6de8\") " pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:00.855468 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.855248 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-tls\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:00.855468 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.855288 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbtbp\" (UniqueName: \"kubernetes.io/projected/db8d21a4-3a6a-435c-963d-8a9d50fe3653-kube-api-access-gbtbp\") pod \"network-check-source-6947749cfc-2kplp\" (UID: \"db8d21a4-3a6a-435c-963d-8a9d50fe3653\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-2kplp" Jun 15 01:42:00.855468 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.855316 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c594g\" (UniqueName: \"kubernetes.io/projected/ee20262f-ced8-4d5c-8bf8-15fefc664812-kube-api-access-c594g\") pod \"console-operator-5dbbb5d744-5qb7h\" (UID: \"ee20262f-ced8-4d5c-8bf8-15fefc664812\") " pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" Jun 15 01:42:00.855468 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.855454 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-bound-sa-token\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:00.855819 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.855705 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/451dde2a-7ed3-46cf-8b3c-ce96077ad565-nginx-conf\") pod \"networking-console-plugin-867b76cb74-5fggm\" (UID: \"451dde2a-7ed3-46cf-8b3c-ce96077ad565\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-5fggm" Jun 15 01:42:00.857799 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.857759 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/52b7be5b-ae33-4595-bcc6-54e125bd6de8-stats-auth\") pod \"router-default-846697d79d-m7gkq\" (UID: \"52b7be5b-ae33-4595-bcc6-54e125bd6de8\") " pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:00.857911 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.857889 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/52b7be5b-ae33-4595-bcc6-54e125bd6de8-default-certificate\") pod \"router-default-846697d79d-m7gkq\" (UID: \"52b7be5b-ae33-4595-bcc6-54e125bd6de8\") " pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:00.870143 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.870117 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvxzx\" (UniqueName: \"kubernetes.io/projected/52b7be5b-ae33-4595-bcc6-54e125bd6de8-kube-api-access-cvxzx\") pod \"router-default-846697d79d-m7gkq\" (UID: \"52b7be5b-ae33-4595-bcc6-54e125bd6de8\") " pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:00.874234 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.874209 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbtbp\" (UniqueName: \"kubernetes.io/projected/db8d21a4-3a6a-435c-963d-8a9d50fe3653-kube-api-access-gbtbp\") pod \"network-check-source-6947749cfc-2kplp\" (UID: \"db8d21a4-3a6a-435c-963d-8a9d50fe3653\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-2kplp" Jun 15 01:42:00.956657 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.956564 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-certificates\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:00.956657 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.956619 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee20262f-ced8-4d5c-8bf8-15fefc664812-trusted-ca\") pod \"console-operator-5dbbb5d744-5qb7h\" (UID: \"ee20262f-ced8-4d5c-8bf8-15fefc664812\") " pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" Jun 15 01:42:00.956657 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.956647 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-tls\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:00.956921 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.956676 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c594g\" (UniqueName: \"kubernetes.io/projected/ee20262f-ced8-4d5c-8bf8-15fefc664812-kube-api-access-c594g\") pod \"console-operator-5dbbb5d744-5qb7h\" (UID: \"ee20262f-ced8-4d5c-8bf8-15fefc664812\") " pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" Jun 15 01:42:00.956921 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.956699 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-bound-sa-token\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:00.956921 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.956728 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee20262f-ced8-4d5c-8bf8-15fefc664812-config\") pod \"console-operator-5dbbb5d744-5qb7h\" (UID: \"ee20262f-ced8-4d5c-8bf8-15fefc664812\") " pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" Jun 15 01:42:00.956921 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.956755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-trusted-ca\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:00.956921 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.956777 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-installation-pull-secrets\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:00.956921 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:00.956799 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 01:42:00.956921 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:00.956816 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67dbf94d-tc445: secret "image-registry-tls" not found Jun 15 01:42:00.956921 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.956839 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkdbx\" (UniqueName: \"kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-kube-api-access-hkdbx\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:00.956921 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.956872 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee20262f-ced8-4d5c-8bf8-15fefc664812-serving-cert\") pod \"console-operator-5dbbb5d744-5qb7h\" (UID: \"ee20262f-ced8-4d5c-8bf8-15fefc664812\") " pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" Jun 15 01:42:00.956921 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:00.956893 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-tls podName:0afab3f1-b4d1-4686-8e4c-1f9c0faf644b nodeName:}" failed. No retries permitted until 2026-06-15 01:42:01.456867829 +0000 UTC m=+199.815408220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-tls") pod "image-registry-67dbf94d-tc445" (UID: "0afab3f1-b4d1-4686-8e4c-1f9c0faf644b") : secret "image-registry-tls" not found Jun 15 01:42:00.957571 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.956928 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t49s2\" (UniqueName: \"kubernetes.io/projected/5f18ae0f-77ec-416d-8126-3f89810ff472-kube-api-access-t49s2\") pod \"cluster-samples-operator-9547488fd-r9nkg\" (UID: \"5f18ae0f-77ec-416d-8126-3f89810ff472\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-r9nkg" Jun 15 01:42:00.957571 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.956961 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdcp5\" (UniqueName: \"kubernetes.io/projected/b1e1b881-33ed-4baf-bb43-39fa0b626035-kube-api-access-jdcp5\") pod \"volume-data-source-validator-bd4ccd799-6hxg8\" (UID: \"b1e1b881-33ed-4baf-bb43-39fa0b626035\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-6hxg8" Jun 15 01:42:00.957571 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.956990 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-ca-trust-extracted\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:00.957571 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.957023 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f18ae0f-77ec-416d-8126-3f89810ff472-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-r9nkg\" (UID: \"5f18ae0f-77ec-416d-8126-3f89810ff472\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-r9nkg" Jun 15 01:42:00.957571 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.957080 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-image-registry-private-configuration\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:00.957571 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.957315 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-certificates\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:00.957866 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.957631 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee20262f-ced8-4d5c-8bf8-15fefc664812-config\") pod \"console-operator-5dbbb5d744-5qb7h\" (UID: \"ee20262f-ced8-4d5c-8bf8-15fefc664812\") " pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" Jun 15 01:42:00.957866 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.957766 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-ca-trust-extracted\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:00.957866 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:00.957793 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 01:42:00.957866 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:00.957856 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f18ae0f-77ec-416d-8126-3f89810ff472-samples-operator-tls podName:5f18ae0f-77ec-416d-8126-3f89810ff472 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:01.457837747 +0000 UTC m=+199.816378144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5f18ae0f-77ec-416d-8126-3f89810ff472-samples-operator-tls") pod "cluster-samples-operator-9547488fd-r9nkg" (UID: "5f18ae0f-77ec-416d-8126-3f89810ff472") : secret "samples-operator-tls" not found Jun 15 01:42:00.958676 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.958653 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee20262f-ced8-4d5c-8bf8-15fefc664812-trusted-ca\") pod \"console-operator-5dbbb5d744-5qb7h\" (UID: \"ee20262f-ced8-4d5c-8bf8-15fefc664812\") " pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" Jun 15 01:42:00.958906 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.958885 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-trusted-ca\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:00.959851 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.959832 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-image-registry-private-configuration\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:00.959943 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.959922 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-installation-pull-secrets\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:00.960075 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.960058 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee20262f-ced8-4d5c-8bf8-15fefc664812-serving-cert\") pod \"console-operator-5dbbb5d744-5qb7h\" (UID: \"ee20262f-ced8-4d5c-8bf8-15fefc664812\") " pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" Jun 15 01:42:00.965232 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.965196 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t49s2\" (UniqueName: \"kubernetes.io/projected/5f18ae0f-77ec-416d-8126-3f89810ff472-kube-api-access-t49s2\") pod \"cluster-samples-operator-9547488fd-r9nkg\" (UID: \"5f18ae0f-77ec-416d-8126-3f89810ff472\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-r9nkg" Jun 15 01:42:00.965451 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.965386 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c594g\" (UniqueName: \"kubernetes.io/projected/ee20262f-ced8-4d5c-8bf8-15fefc664812-kube-api-access-c594g\") pod \"console-operator-5dbbb5d744-5qb7h\" (UID: \"ee20262f-ced8-4d5c-8bf8-15fefc664812\") " pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" Jun 15 01:42:00.965770 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.965748 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-bound-sa-token\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:00.966083 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.966062 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdcp5\" (UniqueName: \"kubernetes.io/projected/b1e1b881-33ed-4baf-bb43-39fa0b626035-kube-api-access-jdcp5\") pod \"volume-data-source-validator-bd4ccd799-6hxg8\" (UID: \"b1e1b881-33ed-4baf-bb43-39fa0b626035\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-6hxg8" Jun 15 01:42:00.966785 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.966767 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkdbx\" (UniqueName: \"kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-kube-api-access-hkdbx\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:00.967547 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:00.967532 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-2kplp" Jun 15 01:42:01.058380 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:01.058329 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-6hxg8" Jun 15 01:42:01.074463 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:01.074437 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" Jun 15 01:42:01.085473 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:01.085444 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-2kplp"] Jun 15 01:42:01.089633 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:42:01.089607 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb8d21a4_3a6a_435c_963d_8a9d50fe3653.slice/crio-d97d952a6fd4e6ab25453f56808205c97a80f00ef1adf489a61e7c9e03cad2e8 WatchSource:0}: Error finding container d97d952a6fd4e6ab25453f56808205c97a80f00ef1adf489a61e7c9e03cad2e8: Status 404 returned error can't find the container with id d97d952a6fd4e6ab25453f56808205c97a80f00ef1adf489a61e7c9e03cad2e8 Jun 15 01:42:01.193532 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:01.193492 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-6hxg8"] Jun 15 01:42:01.198570 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:42:01.198533 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1e1b881_33ed_4baf_bb43_39fa0b626035.slice/crio-5c879929b12cff48063c8c208337c73dd92962972161f3fd5267594aca1985ce WatchSource:0}: Error finding container 5c879929b12cff48063c8c208337c73dd92962972161f3fd5267594aca1985ce: Status 404 returned error can't find the container with id 5c879929b12cff48063c8c208337c73dd92962972161f3fd5267594aca1985ce Jun 15 01:42:01.214697 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:01.214644 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-5qb7h"] Jun 15 01:42:01.217792 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:42:01.217769 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee20262f_ced8_4d5c_8bf8_15fefc664812.slice/crio-f3cc7f15394c510845216ba911e2cb50325c83a5f1db1f2703bfe1494cbcc255 WatchSource:0}: Error finding container f3cc7f15394c510845216ba911e2cb50325c83a5f1db1f2703bfe1494cbcc255: Status 404 returned error can't find the container with id f3cc7f15394c510845216ba911e2cb50325c83a5f1db1f2703bfe1494cbcc255 Jun 15 01:42:01.360873 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:01.360838 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52b7be5b-ae33-4595-bcc6-54e125bd6de8-metrics-certs\") pod \"router-default-846697d79d-m7gkq\" (UID: \"52b7be5b-ae33-4595-bcc6-54e125bd6de8\") " pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:01.360873 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:01.360876 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/451dde2a-7ed3-46cf-8b3c-ce96077ad565-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-5fggm\" (UID: \"451dde2a-7ed3-46cf-8b3c-ce96077ad565\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-5fggm" Jun 15 01:42:01.361081 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:01.360978 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 01:42:01.361081 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:01.360983 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b7be5b-ae33-4595-bcc6-54e125bd6de8-service-ca-bundle\") pod \"router-default-846697d79d-m7gkq\" (UID: \"52b7be5b-ae33-4595-bcc6-54e125bd6de8\") " pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:01.361081 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:01.361027 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/451dde2a-7ed3-46cf-8b3c-ce96077ad565-networking-console-plugin-cert podName:451dde2a-7ed3-46cf-8b3c-ce96077ad565 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:02.361013907 +0000 UTC m=+200.719554281 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/451dde2a-7ed3-46cf-8b3c-ce96077ad565-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-5fggm" (UID: "451dde2a-7ed3-46cf-8b3c-ce96077ad565") : secret "networking-console-plugin-cert" not found Jun 15 01:42:01.361200 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:01.361083 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52b7be5b-ae33-4595-bcc6-54e125bd6de8-service-ca-bundle podName:52b7be5b-ae33-4595-bcc6-54e125bd6de8 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:02.361068899 +0000 UTC m=+200.719609273 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/52b7be5b-ae33-4595-bcc6-54e125bd6de8-service-ca-bundle") pod "router-default-846697d79d-m7gkq" (UID: "52b7be5b-ae33-4595-bcc6-54e125bd6de8") : configmap references non-existent config key: service-ca.crt Jun 15 01:42:01.361200 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:01.361108 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 01:42:01.361200 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:01.361160 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52b7be5b-ae33-4595-bcc6-54e125bd6de8-metrics-certs podName:52b7be5b-ae33-4595-bcc6-54e125bd6de8 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:02.36114541 +0000 UTC m=+200.719685789 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52b7be5b-ae33-4595-bcc6-54e125bd6de8-metrics-certs") pod "router-default-846697d79d-m7gkq" (UID: "52b7be5b-ae33-4595-bcc6-54e125bd6de8") : secret "router-metrics-certs-default" not found Jun 15 01:42:01.462361 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:01.462304 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f18ae0f-77ec-416d-8126-3f89810ff472-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-r9nkg\" (UID: \"5f18ae0f-77ec-416d-8126-3f89810ff472\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-r9nkg" Jun 15 01:42:01.462500 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:01.462427 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-tls\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:01.462500 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:01.462448 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 01:42:01.462598 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:01.462518 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f18ae0f-77ec-416d-8126-3f89810ff472-samples-operator-tls podName:5f18ae0f-77ec-416d-8126-3f89810ff472 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:02.462500525 +0000 UTC m=+200.821040898 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5f18ae0f-77ec-416d-8126-3f89810ff472-samples-operator-tls") pod "cluster-samples-operator-9547488fd-r9nkg" (UID: "5f18ae0f-77ec-416d-8126-3f89810ff472") : secret "samples-operator-tls" not found Jun 15 01:42:01.462598 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:01.462541 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 01:42:01.462598 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:01.462553 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67dbf94d-tc445: secret "image-registry-tls" not found Jun 15 01:42:01.462713 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:01.462606 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-tls podName:0afab3f1-b4d1-4686-8e4c-1f9c0faf644b nodeName:}" failed. No retries permitted until 2026-06-15 01:42:02.462588716 +0000 UTC m=+200.821129093 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-tls") pod "image-registry-67dbf94d-tc445" (UID: "0afab3f1-b4d1-4686-8e4c-1f9c0faf644b") : secret "image-registry-tls" not found Jun 15 01:42:01.628145 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:01.628108 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-6hxg8" event={"ID":"b1e1b881-33ed-4baf-bb43-39fa0b626035","Type":"ContainerStarted","Data":"5c879929b12cff48063c8c208337c73dd92962972161f3fd5267594aca1985ce"} Jun 15 01:42:01.629542 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:01.629517 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" event={"ID":"ee20262f-ced8-4d5c-8bf8-15fefc664812","Type":"ContainerStarted","Data":"f3cc7f15394c510845216ba911e2cb50325c83a5f1db1f2703bfe1494cbcc255"} Jun 15 01:42:01.631089 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:01.631021 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-2kplp" event={"ID":"db8d21a4-3a6a-435c-963d-8a9d50fe3653","Type":"ContainerStarted","Data":"9c4661997a23f2a19509699aabbd72945a4793ef9740c8b95925e60213ce0023"} Jun 15 01:42:01.631089 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:01.631062 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-2kplp" event={"ID":"db8d21a4-3a6a-435c-963d-8a9d50fe3653","Type":"ContainerStarted","Data":"d97d952a6fd4e6ab25453f56808205c97a80f00ef1adf489a61e7c9e03cad2e8"} Jun 15 01:42:01.645540 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:01.645485 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-2kplp" podStartSLOduration=1.645467536 podStartE2EDuration="1.645467536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:01.64536256 +0000 UTC m=+200.003902952" watchObservedRunningTime="2026-06-15 01:42:01.645467536 +0000 UTC m=+200.004007932" Jun 15 01:42:02.370687 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:02.370655 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b7be5b-ae33-4595-bcc6-54e125bd6de8-service-ca-bundle\") pod \"router-default-846697d79d-m7gkq\" (UID: \"52b7be5b-ae33-4595-bcc6-54e125bd6de8\") " pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:02.371147 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:02.370730 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52b7be5b-ae33-4595-bcc6-54e125bd6de8-metrics-certs\") pod \"router-default-846697d79d-m7gkq\" (UID: \"52b7be5b-ae33-4595-bcc6-54e125bd6de8\") " pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:02.371147 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:02.370752 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/451dde2a-7ed3-46cf-8b3c-ce96077ad565-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-5fggm\" (UID: \"451dde2a-7ed3-46cf-8b3c-ce96077ad565\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-5fggm" Jun 15 01:42:02.371147 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:02.370856 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 01:42:02.371147 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:02.370858 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52b7be5b-ae33-4595-bcc6-54e125bd6de8-service-ca-bundle podName:52b7be5b-ae33-4595-bcc6-54e125bd6de8 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:04.370834447 +0000 UTC m=+202.729374848 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/52b7be5b-ae33-4595-bcc6-54e125bd6de8-service-ca-bundle") pod "router-default-846697d79d-m7gkq" (UID: "52b7be5b-ae33-4595-bcc6-54e125bd6de8") : configmap references non-existent config key: service-ca.crt Jun 15 01:42:02.371147 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:02.370886 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 01:42:02.371147 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:02.370898 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/451dde2a-7ed3-46cf-8b3c-ce96077ad565-networking-console-plugin-cert podName:451dde2a-7ed3-46cf-8b3c-ce96077ad565 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:04.370882621 +0000 UTC m=+202.729422994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/451dde2a-7ed3-46cf-8b3c-ce96077ad565-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-5fggm" (UID: "451dde2a-7ed3-46cf-8b3c-ce96077ad565") : secret "networking-console-plugin-cert" not found Jun 15 01:42:02.371147 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:02.370942 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52b7be5b-ae33-4595-bcc6-54e125bd6de8-metrics-certs podName:52b7be5b-ae33-4595-bcc6-54e125bd6de8 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:04.370926422 +0000 UTC m=+202.729466817 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52b7be5b-ae33-4595-bcc6-54e125bd6de8-metrics-certs") pod "router-default-846697d79d-m7gkq" (UID: "52b7be5b-ae33-4595-bcc6-54e125bd6de8") : secret "router-metrics-certs-default" not found Jun 15 01:42:02.471553 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:02.471474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f18ae0f-77ec-416d-8126-3f89810ff472-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-r9nkg\" (UID: \"5f18ae0f-77ec-416d-8126-3f89810ff472\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-r9nkg" Jun 15 01:42:02.471690 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:02.471607 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 01:42:02.471690 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:02.471618 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-tls\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:02.471690 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:02.471662 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f18ae0f-77ec-416d-8126-3f89810ff472-samples-operator-tls podName:5f18ae0f-77ec-416d-8126-3f89810ff472 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:04.471647734 +0000 UTC m=+202.830188108 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5f18ae0f-77ec-416d-8126-3f89810ff472-samples-operator-tls") pod "cluster-samples-operator-9547488fd-r9nkg" (UID: "5f18ae0f-77ec-416d-8126-3f89810ff472") : secret "samples-operator-tls" not found Jun 15 01:42:02.471795 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:02.471724 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 01:42:02.471795 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:02.471735 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67dbf94d-tc445: secret "image-registry-tls" not found Jun 15 01:42:02.471795 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:02.471775 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-tls podName:0afab3f1-b4d1-4686-8e4c-1f9c0faf644b nodeName:}" failed. No retries permitted until 2026-06-15 01:42:04.471763098 +0000 UTC m=+202.830303471 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-tls") pod "image-registry-67dbf94d-tc445" (UID: "0afab3f1-b4d1-4686-8e4c-1f9c0faf644b") : secret "image-registry-tls" not found Jun 15 01:42:02.636879 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:02.636838 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-6hxg8" event={"ID":"b1e1b881-33ed-4baf-bb43-39fa0b626035","Type":"ContainerStarted","Data":"d242196df4eeef56eef9adc8e25c3e230a3e10ef6c9371a63149ec4289597795"} Jun 15 01:42:02.652157 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:02.652111 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-6hxg8" podStartSLOduration=1.64875035 podStartE2EDuration="2.652096884s" totalImagesPullingTime="1.003346534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:02.65063429 +0000 UTC m=+201.009174706" watchObservedRunningTime="2026-06-15 01:42:02.652096884 +0000 UTC m=+201.010637280" Jun 15 01:42:03.640939 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:03.640914 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-5qb7h_ee20262f-ced8-4d5c-8bf8-15fefc664812/console-operator/0.log" Jun 15 01:42:03.641273 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:03.640950 2576 generic.go:356] "Generic (PLEG): container finished" podID="ee20262f-ced8-4d5c-8bf8-15fefc664812" containerID="5abfe3bec03a50bd0739f3f5203066db44bc29aa8e8e23f1de703d72ae7e4930" exitCode=255 Jun 15 01:42:03.641273 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:03.641023 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" event={"ID":"ee20262f-ced8-4d5c-8bf8-15fefc664812","Type":"ContainerDied","Data":"5abfe3bec03a50bd0739f3f5203066db44bc29aa8e8e23f1de703d72ae7e4930"} Jun 15 01:42:03.641273 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:03.641220 2576 scope.go:117] "RemoveContainer" containerID="5abfe3bec03a50bd0739f3f5203066db44bc29aa8e8e23f1de703d72ae7e4930" Jun 15 01:42:04.386679 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:04.386637 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b7be5b-ae33-4595-bcc6-54e125bd6de8-service-ca-bundle\") pod \"router-default-846697d79d-m7gkq\" (UID: \"52b7be5b-ae33-4595-bcc6-54e125bd6de8\") " pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:04.386852 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:04.386734 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52b7be5b-ae33-4595-bcc6-54e125bd6de8-metrics-certs\") pod \"router-default-846697d79d-m7gkq\" (UID: \"52b7be5b-ae33-4595-bcc6-54e125bd6de8\") " pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:04.386852 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:04.386763 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/451dde2a-7ed3-46cf-8b3c-ce96077ad565-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-5fggm\" (UID: \"451dde2a-7ed3-46cf-8b3c-ce96077ad565\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-5fggm" Jun 15 01:42:04.386852 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:04.386796 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52b7be5b-ae33-4595-bcc6-54e125bd6de8-service-ca-bundle podName:52b7be5b-ae33-4595-bcc6-54e125bd6de8 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:08.386777875 +0000 UTC m=+206.745318249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/52b7be5b-ae33-4595-bcc6-54e125bd6de8-service-ca-bundle") pod "router-default-846697d79d-m7gkq" (UID: "52b7be5b-ae33-4595-bcc6-54e125bd6de8") : configmap references non-existent config key: service-ca.crt Jun 15 01:42:04.387021 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:04.386867 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 01:42:04.387021 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:04.386921 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/451dde2a-7ed3-46cf-8b3c-ce96077ad565-networking-console-plugin-cert podName:451dde2a-7ed3-46cf-8b3c-ce96077ad565 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:08.38690582 +0000 UTC m=+206.745446209 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/451dde2a-7ed3-46cf-8b3c-ce96077ad565-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-5fggm" (UID: "451dde2a-7ed3-46cf-8b3c-ce96077ad565") : secret "networking-console-plugin-cert" not found Jun 15 01:42:04.387021 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:04.386867 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 01:42:04.387021 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:04.386969 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52b7be5b-ae33-4595-bcc6-54e125bd6de8-metrics-certs podName:52b7be5b-ae33-4595-bcc6-54e125bd6de8 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:08.386958808 +0000 UTC m=+206.745499185 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52b7be5b-ae33-4595-bcc6-54e125bd6de8-metrics-certs") pod "router-default-846697d79d-m7gkq" (UID: "52b7be5b-ae33-4595-bcc6-54e125bd6de8") : secret "router-metrics-certs-default" not found Jun 15 01:42:04.487562 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:04.487535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-tls\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:04.487666 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:04.487606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f18ae0f-77ec-416d-8126-3f89810ff472-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-r9nkg\" (UID: \"5f18ae0f-77ec-416d-8126-3f89810ff472\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-r9nkg" Jun 15 01:42:04.487725 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:04.487668 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 01:42:04.487725 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:04.487686 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67dbf94d-tc445: secret "image-registry-tls" not found Jun 15 01:42:04.487725 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:04.487691 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 01:42:04.487828 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:04.487733 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-tls podName:0afab3f1-b4d1-4686-8e4c-1f9c0faf644b nodeName:}" failed. No retries permitted until 2026-06-15 01:42:08.487719657 +0000 UTC m=+206.846260031 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-tls") pod "image-registry-67dbf94d-tc445" (UID: "0afab3f1-b4d1-4686-8e4c-1f9c0faf644b") : secret "image-registry-tls" not found Jun 15 01:42:04.487828 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:04.487747 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f18ae0f-77ec-416d-8126-3f89810ff472-samples-operator-tls podName:5f18ae0f-77ec-416d-8126-3f89810ff472 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:08.487740252 +0000 UTC m=+206.846280625 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5f18ae0f-77ec-416d-8126-3f89810ff472-samples-operator-tls") pod "cluster-samples-operator-9547488fd-r9nkg" (UID: "5f18ae0f-77ec-416d-8126-3f89810ff472") : secret "samples-operator-tls" not found Jun 15 01:42:04.645979 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:04.645907 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-5qb7h_ee20262f-ced8-4d5c-8bf8-15fefc664812/console-operator/1.log" Jun 15 01:42:04.646420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:04.646299 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-5qb7h_ee20262f-ced8-4d5c-8bf8-15fefc664812/console-operator/0.log" Jun 15 01:42:04.646420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:04.646365 2576 generic.go:356] "Generic (PLEG): container finished" podID="ee20262f-ced8-4d5c-8bf8-15fefc664812" containerID="ad5b7c4724761f6ddcdddd011473782d15e1695551d2d7c0550f333bdd6e2e3b" exitCode=255 Jun 15 01:42:04.646510 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:04.646442 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" event={"ID":"ee20262f-ced8-4d5c-8bf8-15fefc664812","Type":"ContainerDied","Data":"ad5b7c4724761f6ddcdddd011473782d15e1695551d2d7c0550f333bdd6e2e3b"} Jun 15 01:42:04.646510 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:04.646493 2576 scope.go:117] "RemoveContainer" containerID="5abfe3bec03a50bd0739f3f5203066db44bc29aa8e8e23f1de703d72ae7e4930" Jun 15 01:42:04.646655 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:04.646640 2576 scope.go:117] "RemoveContainer" containerID="ad5b7c4724761f6ddcdddd011473782d15e1695551d2d7c0550f333bdd6e2e3b" Jun 15 01:42:04.646850 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:04.646830 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-5qb7h_openshift-console-operator(ee20262f-ced8-4d5c-8bf8-15fefc664812)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" podUID="ee20262f-ced8-4d5c-8bf8-15fefc664812" Jun 15 01:42:05.226667 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:05.226632 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rddmj"] Jun 15 01:42:05.231015 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:05.230986 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:05.233624 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:05.233599 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 15 01:42:05.233714 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:05.233641 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 15 01:42:05.233714 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:05.233648 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 15 01:42:05.233887 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:05.233866 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m4nht\"" Jun 15 01:42:05.234816 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:05.234801 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 15 01:42:05.241495 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:05.241476 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rddmj"] Jun 15 01:42:05.294169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:05.294132 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dns4\" (UniqueName: \"kubernetes.io/projected/15461201-5d5b-4459-96f1-555fe778d406-kube-api-access-2dns4\") pod \"insights-runtime-extractor-rddmj\" (UID: \"15461201-5d5b-4459-96f1-555fe778d406\") " pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:05.294358 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:05.294180 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/15461201-5d5b-4459-96f1-555fe778d406-crio-socket\") pod \"insights-runtime-extractor-rddmj\" (UID: \"15461201-5d5b-4459-96f1-555fe778d406\") " pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:05.294358 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:05.294209 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/15461201-5d5b-4459-96f1-555fe778d406-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rddmj\" (UID: \"15461201-5d5b-4459-96f1-555fe778d406\") " pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:05.294358 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:05.294271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/15461201-5d5b-4459-96f1-555fe778d406-data-volume\") pod \"insights-runtime-extractor-rddmj\" (UID: \"15461201-5d5b-4459-96f1-555fe778d406\") " pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:05.294358 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:05.294327 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/15461201-5d5b-4459-96f1-555fe778d406-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rddmj\" (UID: \"15461201-5d5b-4459-96f1-555fe778d406\") " pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:05.395324 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:05.395292 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dns4\" (UniqueName: \"kubernetes.io/projected/15461201-5d5b-4459-96f1-555fe778d406-kube-api-access-2dns4\") pod \"insights-runtime-extractor-rddmj\" (UID: \"15461201-5d5b-4459-96f1-555fe778d406\") " pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:05.395324 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:05.395328 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/15461201-5d5b-4459-96f1-555fe778d406-crio-socket\") pod \"insights-runtime-extractor-rddmj\" (UID: \"15461201-5d5b-4459-96f1-555fe778d406\") " pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:05.395524 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:05.395368 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/15461201-5d5b-4459-96f1-555fe778d406-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rddmj\" (UID: \"15461201-5d5b-4459-96f1-555fe778d406\") " pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:05.395524 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:05.395413 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/15461201-5d5b-4459-96f1-555fe778d406-data-volume\") pod \"insights-runtime-extractor-rddmj\" (UID: \"15461201-5d5b-4459-96f1-555fe778d406\") " pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:05.395524 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:05.395437 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/15461201-5d5b-4459-96f1-555fe778d406-crio-socket\") pod \"insights-runtime-extractor-rddmj\" (UID: \"15461201-5d5b-4459-96f1-555fe778d406\") " pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:05.395524 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:05.395443 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/15461201-5d5b-4459-96f1-555fe778d406-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rddmj\" (UID: \"15461201-5d5b-4459-96f1-555fe778d406\") " pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:05.395714 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:05.395485 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 01:42:05.395714 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:05.395521 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 01:42:05.395714 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:05.395606 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/15461201-5d5b-4459-96f1-555fe778d406-kube-rbac-proxy-cm podName:15461201-5d5b-4459-96f1-555fe778d406 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:05.895589633 +0000 UTC m=+204.254130011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/15461201-5d5b-4459-96f1-555fe778d406-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rddmj" (UID: "15461201-5d5b-4459-96f1-555fe778d406") : configmap "kube-rbac-proxy" not found Jun 15 01:42:05.395714 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:05.395643 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15461201-5d5b-4459-96f1-555fe778d406-insights-runtime-extractor-tls podName:15461201-5d5b-4459-96f1-555fe778d406 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:05.895630001 +0000 UTC m=+204.254170375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/15461201-5d5b-4459-96f1-555fe778d406-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rddmj" (UID: "15461201-5d5b-4459-96f1-555fe778d406") : secret "insights-runtime-extractor-tls" not found Jun 15 01:42:05.395865 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:05.395715 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/15461201-5d5b-4459-96f1-555fe778d406-data-volume\") pod \"insights-runtime-extractor-rddmj\" (UID: \"15461201-5d5b-4459-96f1-555fe778d406\") " pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:05.405179 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:05.405156 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dns4\" (UniqueName: \"kubernetes.io/projected/15461201-5d5b-4459-96f1-555fe778d406-kube-api-access-2dns4\") pod \"insights-runtime-extractor-rddmj\" (UID: \"15461201-5d5b-4459-96f1-555fe778d406\") " pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:05.650878 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:05.650852 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-5qb7h_ee20262f-ced8-4d5c-8bf8-15fefc664812/console-operator/1.log" Jun 15 01:42:05.651248 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:05.651163 2576 scope.go:117] "RemoveContainer" containerID="ad5b7c4724761f6ddcdddd011473782d15e1695551d2d7c0550f333bdd6e2e3b" Jun 15 01:42:05.651322 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:05.651303 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-5qb7h_openshift-console-operator(ee20262f-ced8-4d5c-8bf8-15fefc664812)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" podUID="ee20262f-ced8-4d5c-8bf8-15fefc664812" Jun 15 01:42:05.900131 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:05.900090 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/15461201-5d5b-4459-96f1-555fe778d406-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rddmj\" (UID: \"15461201-5d5b-4459-96f1-555fe778d406\") " pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:05.900285 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:05.900181 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/15461201-5d5b-4459-96f1-555fe778d406-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rddmj\" (UID: \"15461201-5d5b-4459-96f1-555fe778d406\") " pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:05.900285 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:05.900201 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 01:42:05.900285 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:05.900258 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/15461201-5d5b-4459-96f1-555fe778d406-kube-rbac-proxy-cm podName:15461201-5d5b-4459-96f1-555fe778d406 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:06.900241173 +0000 UTC m=+205.258781546 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/15461201-5d5b-4459-96f1-555fe778d406-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rddmj" (UID: "15461201-5d5b-4459-96f1-555fe778d406") : configmap "kube-rbac-proxy" not found Jun 15 01:42:05.900285 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:05.900259 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 01:42:05.900461 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:05.900305 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15461201-5d5b-4459-96f1-555fe778d406-insights-runtime-extractor-tls podName:15461201-5d5b-4459-96f1-555fe778d406 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:06.900294967 +0000 UTC m=+205.258835340 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/15461201-5d5b-4459-96f1-555fe778d406-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rddmj" (UID: "15461201-5d5b-4459-96f1-555fe778d406") : secret "insights-runtime-extractor-tls" not found Jun 15 01:42:06.909289 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:06.909253 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/15461201-5d5b-4459-96f1-555fe778d406-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rddmj\" (UID: \"15461201-5d5b-4459-96f1-555fe778d406\") " pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:06.909819 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:06.909385 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 01:42:06.909819 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:06.909443 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/15461201-5d5b-4459-96f1-555fe778d406-kube-rbac-proxy-cm podName:15461201-5d5b-4459-96f1-555fe778d406 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:08.909429058 +0000 UTC m=+207.267969433 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/15461201-5d5b-4459-96f1-555fe778d406-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rddmj" (UID: "15461201-5d5b-4459-96f1-555fe778d406") : configmap "kube-rbac-proxy" not found Jun 15 01:42:06.909819 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:06.909388 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/15461201-5d5b-4459-96f1-555fe778d406-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rddmj\" (UID: \"15461201-5d5b-4459-96f1-555fe778d406\") " pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:06.909819 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:06.909485 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 01:42:06.909819 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:06.909544 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15461201-5d5b-4459-96f1-555fe778d406-insights-runtime-extractor-tls podName:15461201-5d5b-4459-96f1-555fe778d406 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:08.909527649 +0000 UTC m=+207.268068043 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/15461201-5d5b-4459-96f1-555fe778d406-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rddmj" (UID: "15461201-5d5b-4459-96f1-555fe778d406") : secret "insights-runtime-extractor-tls" not found Jun 15 01:42:08.109109 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:08.109082 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kqxqs_11c51e69-484c-4efa-bebe-0eb0ccf33029/dns-node-resolver/0.log" Jun 15 01:42:08.421245 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:08.421215 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b7be5b-ae33-4595-bcc6-54e125bd6de8-service-ca-bundle\") pod \"router-default-846697d79d-m7gkq\" (UID: \"52b7be5b-ae33-4595-bcc6-54e125bd6de8\") " pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:08.421413 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:08.421299 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52b7be5b-ae33-4595-bcc6-54e125bd6de8-metrics-certs\") pod \"router-default-846697d79d-m7gkq\" (UID: \"52b7be5b-ae33-4595-bcc6-54e125bd6de8\") " pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:08.421413 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:08.421316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/451dde2a-7ed3-46cf-8b3c-ce96077ad565-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-5fggm\" (UID: \"451dde2a-7ed3-46cf-8b3c-ce96077ad565\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-5fggm" Jun 15 01:42:08.421413 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:08.421396 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52b7be5b-ae33-4595-bcc6-54e125bd6de8-service-ca-bundle podName:52b7be5b-ae33-4595-bcc6-54e125bd6de8 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:16.421378436 +0000 UTC m=+214.779918832 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/52b7be5b-ae33-4595-bcc6-54e125bd6de8-service-ca-bundle") pod "router-default-846697d79d-m7gkq" (UID: "52b7be5b-ae33-4595-bcc6-54e125bd6de8") : configmap references non-existent config key: service-ca.crt Jun 15 01:42:08.421521 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:08.421429 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 01:42:08.421521 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:08.421476 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52b7be5b-ae33-4595-bcc6-54e125bd6de8-metrics-certs podName:52b7be5b-ae33-4595-bcc6-54e125bd6de8 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:16.421465033 +0000 UTC m=+214.780005411 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52b7be5b-ae33-4595-bcc6-54e125bd6de8-metrics-certs") pod "router-default-846697d79d-m7gkq" (UID: "52b7be5b-ae33-4595-bcc6-54e125bd6de8") : secret "router-metrics-certs-default" not found Jun 15 01:42:08.421521 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:08.421437 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 01:42:08.421521 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:08.421505 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/451dde2a-7ed3-46cf-8b3c-ce96077ad565-networking-console-plugin-cert podName:451dde2a-7ed3-46cf-8b3c-ce96077ad565 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:16.421499239 +0000 UTC m=+214.780039613 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/451dde2a-7ed3-46cf-8b3c-ce96077ad565-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-5fggm" (UID: "451dde2a-7ed3-46cf-8b3c-ce96077ad565") : secret "networking-console-plugin-cert" not found Jun 15 01:42:08.521711 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:08.521683 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-tls\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:08.521809 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:08.521787 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f18ae0f-77ec-416d-8126-3f89810ff472-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-r9nkg\" (UID: \"5f18ae0f-77ec-416d-8126-3f89810ff472\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-r9nkg" Jun 15 01:42:08.521846 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:08.521806 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 01:42:08.521846 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:08.521820 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67dbf94d-tc445: secret "image-registry-tls" not found Jun 15 01:42:08.521910 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:08.521859 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-tls podName:0afab3f1-b4d1-4686-8e4c-1f9c0faf644b nodeName:}" failed. No retries permitted until 2026-06-15 01:42:16.521846718 +0000 UTC m=+214.880387111 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-tls") pod "image-registry-67dbf94d-tc445" (UID: "0afab3f1-b4d1-4686-8e4c-1f9c0faf644b") : secret "image-registry-tls" not found Jun 15 01:42:08.521910 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:08.521873 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 01:42:08.521973 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:08.521920 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f18ae0f-77ec-416d-8126-3f89810ff472-samples-operator-tls podName:5f18ae0f-77ec-416d-8126-3f89810ff472 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:16.521907323 +0000 UTC m=+214.880447697 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5f18ae0f-77ec-416d-8126-3f89810ff472-samples-operator-tls") pod "cluster-samples-operator-9547488fd-r9nkg" (UID: "5f18ae0f-77ec-416d-8126-3f89810ff472") : secret "samples-operator-tls" not found Jun 15 01:42:08.924243 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:08.924212 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/15461201-5d5b-4459-96f1-555fe778d406-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rddmj\" (UID: \"15461201-5d5b-4459-96f1-555fe778d406\") " pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:08.924450 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:08.924276 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/15461201-5d5b-4459-96f1-555fe778d406-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rddmj\" (UID: \"15461201-5d5b-4459-96f1-555fe778d406\") " pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:08.924450 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:08.924391 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 01:42:08.924450 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:08.924397 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 01:42:08.924450 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:08.924445 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/15461201-5d5b-4459-96f1-555fe778d406-kube-rbac-proxy-cm podName:15461201-5d5b-4459-96f1-555fe778d406 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:12.924432524 +0000 UTC m=+211.282972899 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/15461201-5d5b-4459-96f1-555fe778d406-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rddmj" (UID: "15461201-5d5b-4459-96f1-555fe778d406") : configmap "kube-rbac-proxy" not found Jun 15 01:42:08.924613 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:08.924457 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15461201-5d5b-4459-96f1-555fe778d406-insights-runtime-extractor-tls podName:15461201-5d5b-4459-96f1-555fe778d406 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:12.924451338 +0000 UTC m=+211.282991712 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/15461201-5d5b-4459-96f1-555fe778d406-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rddmj" (UID: "15461201-5d5b-4459-96f1-555fe778d406") : secret "insights-runtime-extractor-tls" not found Jun 15 01:42:09.313197 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:09.313132 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xqcdr_b842d4f5-5f7d-417a-9473-1271dc39b8eb/node-ca/0.log" Jun 15 01:42:09.909955 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:09.909926 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nwmph_b00f4d8c-52d9-48c5-8a37-a69c3da3d450/serve-healthcheck-canary/0.log" Jun 15 01:42:11.075504 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:11.075456 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" Jun 15 01:42:11.075504 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:11.075518 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" Jun 15 01:42:11.075928 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:11.075824 2576 scope.go:117] "RemoveContainer" containerID="ad5b7c4724761f6ddcdddd011473782d15e1695551d2d7c0550f333bdd6e2e3b" Jun 15 01:42:11.075981 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:11.075963 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-5qb7h_openshift-console-operator(ee20262f-ced8-4d5c-8bf8-15fefc664812)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" podUID="ee20262f-ced8-4d5c-8bf8-15fefc664812" Jun 15 01:42:12.958662 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:12.958624 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/15461201-5d5b-4459-96f1-555fe778d406-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rddmj\" (UID: \"15461201-5d5b-4459-96f1-555fe778d406\") " pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:12.959139 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:12.958693 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/15461201-5d5b-4459-96f1-555fe778d406-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rddmj\" (UID: \"15461201-5d5b-4459-96f1-555fe778d406\") " pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:12.959139 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:12.958774 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 01:42:12.959139 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:12.958844 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15461201-5d5b-4459-96f1-555fe778d406-insights-runtime-extractor-tls podName:15461201-5d5b-4459-96f1-555fe778d406 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:20.958829514 +0000 UTC m=+219.317369888 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/15461201-5d5b-4459-96f1-555fe778d406-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rddmj" (UID: "15461201-5d5b-4459-96f1-555fe778d406") : secret "insights-runtime-extractor-tls" not found Jun 15 01:42:12.959139 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:12.958775 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 01:42:12.959139 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:12.958877 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/15461201-5d5b-4459-96f1-555fe778d406-kube-rbac-proxy-cm podName:15461201-5d5b-4459-96f1-555fe778d406 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:20.958870751 +0000 UTC m=+219.317411125 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/15461201-5d5b-4459-96f1-555fe778d406-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rddmj" (UID: "15461201-5d5b-4459-96f1-555fe778d406") : configmap "kube-rbac-proxy" not found Jun 15 01:42:16.487134 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:16.487095 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b7be5b-ae33-4595-bcc6-54e125bd6de8-service-ca-bundle\") pod \"router-default-846697d79d-m7gkq\" (UID: \"52b7be5b-ae33-4595-bcc6-54e125bd6de8\") " pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:16.487638 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:16.487207 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52b7be5b-ae33-4595-bcc6-54e125bd6de8-metrics-certs\") pod \"router-default-846697d79d-m7gkq\" (UID: \"52b7be5b-ae33-4595-bcc6-54e125bd6de8\") " pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:16.487638 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:16.487237 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/451dde2a-7ed3-46cf-8b3c-ce96077ad565-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-5fggm\" (UID: \"451dde2a-7ed3-46cf-8b3c-ce96077ad565\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-5fggm" Jun 15 01:42:16.487739 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:16.487700 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b7be5b-ae33-4595-bcc6-54e125bd6de8-service-ca-bundle\") pod \"router-default-846697d79d-m7gkq\" (UID: \"52b7be5b-ae33-4595-bcc6-54e125bd6de8\") " pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:16.489581 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:16.489560 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/451dde2a-7ed3-46cf-8b3c-ce96077ad565-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-5fggm\" (UID: \"451dde2a-7ed3-46cf-8b3c-ce96077ad565\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-5fggm" Jun 15 01:42:16.489678 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:16.489561 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52b7be5b-ae33-4595-bcc6-54e125bd6de8-metrics-certs\") pod \"router-default-846697d79d-m7gkq\" (UID: \"52b7be5b-ae33-4595-bcc6-54e125bd6de8\") " pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:16.575253 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:16.575226 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-5fggm" Jun 15 01:42:16.579634 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:16.579608 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:16.588505 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:16.588476 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-tls\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:16.588587 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:16.588569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f18ae0f-77ec-416d-8126-3f89810ff472-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-r9nkg\" (UID: \"5f18ae0f-77ec-416d-8126-3f89810ff472\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-r9nkg" Jun 15 01:42:16.591255 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:16.591234 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f18ae0f-77ec-416d-8126-3f89810ff472-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-r9nkg\" (UID: \"5f18ae0f-77ec-416d-8126-3f89810ff472\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-r9nkg" Jun 15 01:42:16.591368 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:16.591268 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-tls\") pod \"image-registry-67dbf94d-tc445\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:16.679874 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:16.679848 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-r9nkg" Jun 15 01:42:16.685186 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:16.685150 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:16.714295 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:16.714259 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-5fggm"] Jun 15 01:42:16.717788 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:42:16.717758 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod451dde2a_7ed3_46cf_8b3c_ce96077ad565.slice/crio-74ba31594c5c5a8908f91661571397ab93647cacd6d4f1d3eeff1ddd347067e4 WatchSource:0}: Error finding container 74ba31594c5c5a8908f91661571397ab93647cacd6d4f1d3eeff1ddd347067e4: Status 404 returned error can't find the container with id 74ba31594c5c5a8908f91661571397ab93647cacd6d4f1d3eeff1ddd347067e4 Jun 15 01:42:16.729071 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:16.729030 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-846697d79d-m7gkq"] Jun 15 01:42:16.734859 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:42:16.734820 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52b7be5b_ae33_4595_bcc6_54e125bd6de8.slice/crio-cef2e5f116e7bcb6a8c386b8c86ec154e35fb0215a693e41b15bd404fdbbf5ef WatchSource:0}: Error finding container cef2e5f116e7bcb6a8c386b8c86ec154e35fb0215a693e41b15bd404fdbbf5ef: Status 404 returned error can't find the container with id cef2e5f116e7bcb6a8c386b8c86ec154e35fb0215a693e41b15bd404fdbbf5ef Jun 15 01:42:16.825405 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:16.825376 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-r9nkg"] Jun 15 01:42:16.839722 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:16.839633 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67dbf94d-tc445"] Jun 15 01:42:16.842360 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:42:16.842318 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0afab3f1_b4d1_4686_8e4c_1f9c0faf644b.slice/crio-ee49d39f00c0342f3a28c765b127a0743b754dc70e2c2e5c1a062488dba82230 WatchSource:0}: Error finding container ee49d39f00c0342f3a28c765b127a0743b754dc70e2c2e5c1a062488dba82230: Status 404 returned error can't find the container with id ee49d39f00c0342f3a28c765b127a0743b754dc70e2c2e5c1a062488dba82230 Jun 15 01:42:17.688621 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:17.688585 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67dbf94d-tc445" event={"ID":"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b","Type":"ContainerStarted","Data":"7943106bf1b61253de437cafb5d58c282fe18fb1f0484e73ca2ff10f7ac889a0"} Jun 15 01:42:17.689061 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:17.688650 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67dbf94d-tc445" event={"ID":"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b","Type":"ContainerStarted","Data":"ee49d39f00c0342f3a28c765b127a0743b754dc70e2c2e5c1a062488dba82230"} Jun 15 01:42:17.689061 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:17.688678 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:17.691349 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:17.691262 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-846697d79d-m7gkq" event={"ID":"52b7be5b-ae33-4595-bcc6-54e125bd6de8","Type":"ContainerStarted","Data":"69feced1bbe7e81e46f6ffb16835708162a8eddf51e91ab1a15724751b6b7cce"} Jun 15 01:42:17.691349 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:17.691306 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-846697d79d-m7gkq" event={"ID":"52b7be5b-ae33-4595-bcc6-54e125bd6de8","Type":"ContainerStarted","Data":"cef2e5f116e7bcb6a8c386b8c86ec154e35fb0215a693e41b15bd404fdbbf5ef"} Jun 15 01:42:17.693493 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:17.693463 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-r9nkg" event={"ID":"5f18ae0f-77ec-416d-8126-3f89810ff472","Type":"ContainerStarted","Data":"517023851c272adb7d05b75c412f5dee905ec368bc6b892bdd41c69ddd722d39"} Jun 15 01:42:17.695510 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:17.695480 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-5fggm" event={"ID":"451dde2a-7ed3-46cf-8b3c-ce96077ad565","Type":"ContainerStarted","Data":"74ba31594c5c5a8908f91661571397ab93647cacd6d4f1d3eeff1ddd347067e4"} Jun 15 01:42:17.706133 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:17.706083 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67dbf94d-tc445" podStartSLOduration=17.706064001 podStartE2EDuration="17.706064001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:17.7052779 +0000 UTC m=+216.063818296" watchObservedRunningTime="2026-06-15 01:42:17.706064001 +0000 UTC m=+216.064604400" Jun 15 01:42:17.723136 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:17.723081 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-846697d79d-m7gkq" podStartSLOduration=17.72306333 podStartE2EDuration="17.72306333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:17.720880546 +0000 UTC m=+216.079420943" watchObservedRunningTime="2026-06-15 01:42:17.72306333 +0000 UTC m=+216.081603706" Jun 15 01:42:18.579827 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:18.579801 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:18.584039 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:18.584016 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:18.701087 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:18.701059 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-r9nkg" event={"ID":"5f18ae0f-77ec-416d-8126-3f89810ff472","Type":"ContainerStarted","Data":"e25c4140e3f8a4d8b27d97c15d1f539f33598aea0c01575abffa17c29433f1c4"} Jun 15 01:42:18.701499 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:18.701113 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-r9nkg" event={"ID":"5f18ae0f-77ec-416d-8126-3f89810ff472","Type":"ContainerStarted","Data":"0bf08835402cf0d31bb7209637c95cb3ec3ab550721347323cb852619c2e4677"} Jun 15 01:42:18.702729 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:18.702703 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-5fggm" event={"ID":"451dde2a-7ed3-46cf-8b3c-ce96077ad565","Type":"ContainerStarted","Data":"ca9a87876cc5cb78e59df863dd9539d112d594d550c687f308c14749a1eca5ef"} Jun 15 01:42:18.703094 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:18.703064 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:18.704084 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:18.704063 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-846697d79d-m7gkq" Jun 15 01:42:18.717145 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:18.717100 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-r9nkg" podStartSLOduration=17.030882131 podStartE2EDuration="18.71708665s" totalImagesPullingTime="1.686204519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:18.716628947 +0000 UTC m=+217.075169362" watchObservedRunningTime="2026-06-15 01:42:18.71708665 +0000 UTC m=+217.075627045" Jun 15 01:42:18.730728 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:18.730687 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-5fggm" podStartSLOduration=17.447009556 podStartE2EDuration="18.730673507s" totalImagesPullingTime="1.283663951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:18.729868208 +0000 UTC m=+217.088408605" watchObservedRunningTime="2026-06-15 01:42:18.730673507 +0000 UTC m=+217.089213902" Jun 15 01:42:21.029128 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:21.029094 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/15461201-5d5b-4459-96f1-555fe778d406-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rddmj\" (UID: \"15461201-5d5b-4459-96f1-555fe778d406\") " pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:21.029524 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:21.029148 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/15461201-5d5b-4459-96f1-555fe778d406-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rddmj\" (UID: \"15461201-5d5b-4459-96f1-555fe778d406\") " pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:21.029612 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:21.029596 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/15461201-5d5b-4459-96f1-555fe778d406-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rddmj\" (UID: \"15461201-5d5b-4459-96f1-555fe778d406\") " pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:21.031317 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:21.031295 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/15461201-5d5b-4459-96f1-555fe778d406-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rddmj\" (UID: \"15461201-5d5b-4459-96f1-555fe778d406\") " pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:21.139453 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:21.139424 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rddmj" Jun 15 01:42:21.262359 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:21.262316 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rddmj"] Jun 15 01:42:21.265287 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:42:21.265244 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15461201_5d5b_4459_96f1_555fe778d406.slice/crio-dddd3fcc27920116ac05dcac4baa85aa4021c88771a306e2ab36b6ac4ef8c0ca WatchSource:0}: Error finding container dddd3fcc27920116ac05dcac4baa85aa4021c88771a306e2ab36b6ac4ef8c0ca: Status 404 returned error can't find the container with id dddd3fcc27920116ac05dcac4baa85aa4021c88771a306e2ab36b6ac4ef8c0ca Jun 15 01:42:21.715517 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:21.715385 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rddmj" event={"ID":"15461201-5d5b-4459-96f1-555fe778d406","Type":"ContainerStarted","Data":"dddd3fcc27920116ac05dcac4baa85aa4021c88771a306e2ab36b6ac4ef8c0ca"} Jun 15 01:42:24.045453 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:24.045416 2576 scope.go:117] "RemoveContainer" containerID="ad5b7c4724761f6ddcdddd011473782d15e1695551d2d7c0550f333bdd6e2e3b" Jun 15 01:42:24.725736 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:24.725705 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rddmj" event={"ID":"15461201-5d5b-4459-96f1-555fe778d406","Type":"ContainerStarted","Data":"8ebfbabd6576b3d747abff369e9e650fdbba65f441a3e1b232f80083b5ab4876"} Jun 15 01:42:24.727437 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:24.727421 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-5qb7h_ee20262f-ced8-4d5c-8bf8-15fefc664812/console-operator/1.log" Jun 15 01:42:24.727532 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:24.727494 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" event={"ID":"ee20262f-ced8-4d5c-8bf8-15fefc664812","Type":"ContainerStarted","Data":"46bf2641eed809ce239771368b6a3d4036cd2dd4d06340314ec1f43c9dfb11c5"} Jun 15 01:42:24.727757 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:24.727737 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" Jun 15 01:42:24.745349 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:24.745303 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" podStartSLOduration=22.784509959 podStartE2EDuration="24.745290363s" totalImagesPullingTime="1.960780404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:24.744674842 +0000 UTC m=+223.103215251" watchObservedRunningTime="2026-06-15 01:42:24.745290363 +0000 UTC m=+223.103830760" Jun 15 01:42:25.413909 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:25.413872 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-5qb7h" Jun 15 01:42:25.734329 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:25.734289 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rddmj" event={"ID":"15461201-5d5b-4459-96f1-555fe778d406","Type":"ContainerStarted","Data":"f10628fee88174843694389f7c05c9f1e0f9ff942fe84cd795695b04ea4aaa68"} Jun 15 01:42:26.618353 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:26.618297 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67dbf94d-tc445"] Jun 15 01:42:27.743223 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:27.743179 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rddmj" event={"ID":"15461201-5d5b-4459-96f1-555fe778d406","Type":"ContainerStarted","Data":"952a4ce631ee4345643acaf4ca73359e01f464ff1df62aaba1f7b9a0ed163694"} Jun 15 01:42:27.760877 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:27.760826 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rddmj" podStartSLOduration=17.188056016 podStartE2EDuration="22.760808811s" totalImagesPullingTime="5.572752795s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:42:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:27.759236672 +0000 UTC m=+226.117777069" watchObservedRunningTime="2026-06-15 01:42:27.760808811 +0000 UTC m=+226.119349207" Jun 15 01:42:34.466757 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.466718 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv"] Jun 15 01:42:34.470136 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.470111 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" Jun 15 01:42:34.471586 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.471565 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-49dbg"] Jun 15 01:42:34.473457 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.473417 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 15 01:42:34.473773 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.473753 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 15 01:42:34.474085 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.474066 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 15 01:42:34.474198 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.474149 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 15 01:42:34.474378 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.474318 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-8hzmp\"" Jun 15 01:42:34.474629 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.474611 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 15 01:42:34.474693 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.474672 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 15 01:42:34.475549 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.475528 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.478376 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.478356 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 15 01:42:34.478462 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.478356 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 15 01:42:34.478462 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.478417 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 15 01:42:34.478563 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.478461 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6684v\"" Jun 15 01:42:34.482714 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.482693 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv"] Jun 15 01:42:34.539909 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.539877 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-node-exporter-tls\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.539909 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.539908 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-metrics-client-ca\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.540115 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.539934 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-node-exporter-textfile\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.540115 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.540001 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/175a9244-1f1d-4e25-a173-563b58059b51-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-nwfhv\" (UID: \"175a9244-1f1d-4e25-a173-563b58059b51\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" Jun 15 01:42:34.540115 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.540032 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/175a9244-1f1d-4e25-a173-563b58059b51-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-nwfhv\" (UID: \"175a9244-1f1d-4e25-a173-563b58059b51\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" Jun 15 01:42:34.540115 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.540050 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.540115 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.540066 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/175a9244-1f1d-4e25-a173-563b58059b51-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-nwfhv\" (UID: \"175a9244-1f1d-4e25-a173-563b58059b51\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" Jun 15 01:42:34.540115 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.540096 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-node-exporter-accelerators-collector-config\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.540293 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.540154 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-node-exporter-wtmp\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.540293 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.540195 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/175a9244-1f1d-4e25-a173-563b58059b51-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-nwfhv\" (UID: \"175a9244-1f1d-4e25-a173-563b58059b51\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" Jun 15 01:42:34.540293 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.540215 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/175a9244-1f1d-4e25-a173-563b58059b51-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-nwfhv\" (UID: \"175a9244-1f1d-4e25-a173-563b58059b51\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" Jun 15 01:42:34.540293 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.540239 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpvds\" (UniqueName: \"kubernetes.io/projected/175a9244-1f1d-4e25-a173-563b58059b51-kube-api-access-vpvds\") pod \"kube-state-metrics-678bc549d7-nwfhv\" (UID: \"175a9244-1f1d-4e25-a173-563b58059b51\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" Jun 15 01:42:34.540293 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.540257 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjgq2\" (UniqueName: \"kubernetes.io/projected/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-kube-api-access-mjgq2\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.540469 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.540303 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-root\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.540469 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.540319 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-sys\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.641445 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.641410 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-node-exporter-accelerators-collector-config\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.641640 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.641456 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-node-exporter-wtmp\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.641640 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.641477 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/175a9244-1f1d-4e25-a173-563b58059b51-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-nwfhv\" (UID: \"175a9244-1f1d-4e25-a173-563b58059b51\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" Jun 15 01:42:34.641640 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.641592 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/175a9244-1f1d-4e25-a173-563b58059b51-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-nwfhv\" (UID: \"175a9244-1f1d-4e25-a173-563b58059b51\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" Jun 15 01:42:34.641746 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.641604 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-node-exporter-wtmp\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.641746 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.641647 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpvds\" (UniqueName: \"kubernetes.io/projected/175a9244-1f1d-4e25-a173-563b58059b51-kube-api-access-vpvds\") pod \"kube-state-metrics-678bc549d7-nwfhv\" (UID: \"175a9244-1f1d-4e25-a173-563b58059b51\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" Jun 15 01:42:34.641746 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.641713 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjgq2\" (UniqueName: \"kubernetes.io/projected/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-kube-api-access-mjgq2\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.641872 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.641766 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-root\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.641872 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.641792 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-sys\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.641872 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.641856 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-sys\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.642033 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.641862 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-root\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.642033 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.641887 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-node-exporter-tls\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.642033 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.641915 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-metrics-client-ca\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.642033 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.641943 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-node-exporter-textfile\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.642033 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.641996 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/175a9244-1f1d-4e25-a173-563b58059b51-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-nwfhv\" (UID: \"175a9244-1f1d-4e25-a173-563b58059b51\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" Jun 15 01:42:34.642033 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:34.642007 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 15 01:42:34.642033 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.642028 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/175a9244-1f1d-4e25-a173-563b58059b51-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-nwfhv\" (UID: \"175a9244-1f1d-4e25-a173-563b58059b51\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" Jun 15 01:42:34.642422 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.642058 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.642422 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:34.642080 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-node-exporter-tls podName:88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb nodeName:}" failed. No retries permitted until 2026-06-15 01:42:35.14206151 +0000 UTC m=+233.500601901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-node-exporter-tls") pod "node-exporter-49dbg" (UID: "88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb") : secret "node-exporter-tls" not found Jun 15 01:42:34.642422 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.642112 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/175a9244-1f1d-4e25-a173-563b58059b51-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-nwfhv\" (UID: \"175a9244-1f1d-4e25-a173-563b58059b51\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" Jun 15 01:42:34.642422 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:34.642155 2576 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 15 01:42:34.642422 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.642196 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-node-exporter-accelerators-collector-config\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.642422 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:34.642241 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/175a9244-1f1d-4e25-a173-563b58059b51-kube-state-metrics-tls podName:175a9244-1f1d-4e25-a173-563b58059b51 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:35.142222913 +0000 UTC m=+233.500763298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/175a9244-1f1d-4e25-a173-563b58059b51-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-nwfhv" (UID: "175a9244-1f1d-4e25-a173-563b58059b51") : secret "kube-state-metrics-tls" not found Jun 15 01:42:34.642422 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.642329 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/175a9244-1f1d-4e25-a173-563b58059b51-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-nwfhv\" (UID: \"175a9244-1f1d-4e25-a173-563b58059b51\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" Jun 15 01:42:34.642422 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.642401 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/175a9244-1f1d-4e25-a173-563b58059b51-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-nwfhv\" (UID: \"175a9244-1f1d-4e25-a173-563b58059b51\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" Jun 15 01:42:34.642731 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.642534 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-metrics-client-ca\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.642731 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.642589 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-node-exporter-textfile\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.642731 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.642679 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/175a9244-1f1d-4e25-a173-563b58059b51-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-nwfhv\" (UID: \"175a9244-1f1d-4e25-a173-563b58059b51\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" Jun 15 01:42:34.644057 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.644034 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/175a9244-1f1d-4e25-a173-563b58059b51-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-nwfhv\" (UID: \"175a9244-1f1d-4e25-a173-563b58059b51\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" Jun 15 01:42:34.644316 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.644299 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.650575 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.650549 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjgq2\" (UniqueName: \"kubernetes.io/projected/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-kube-api-access-mjgq2\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:34.650895 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:34.650873 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpvds\" (UniqueName: \"kubernetes.io/projected/175a9244-1f1d-4e25-a173-563b58059b51-kube-api-access-vpvds\") pod \"kube-state-metrics-678bc549d7-nwfhv\" (UID: \"175a9244-1f1d-4e25-a173-563b58059b51\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" Jun 15 01:42:35.145639 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.145598 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-node-exporter-tls\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:35.145804 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.145662 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/175a9244-1f1d-4e25-a173-563b58059b51-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-nwfhv\" (UID: \"175a9244-1f1d-4e25-a173-563b58059b51\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" Jun 15 01:42:35.147972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.147948 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb-node-exporter-tls\") pod \"node-exporter-49dbg\" (UID: \"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb\") " pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:35.148071 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.148011 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/175a9244-1f1d-4e25-a173-563b58059b51-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-nwfhv\" (UID: \"175a9244-1f1d-4e25-a173-563b58059b51\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" Jun 15 01:42:35.385735 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.385698 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" Jun 15 01:42:35.390905 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.390883 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-49dbg" Jun 15 01:42:35.402043 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:42:35.402016 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88ee4bf8_2b20_4894_b1ec_cdd9d2956aeb.slice/crio-be7cea48a259d311c5cd6530d456c9a55de362f52b1bda18ed29e12fa1b329d5 WatchSource:0}: Error finding container be7cea48a259d311c5cd6530d456c9a55de362f52b1bda18ed29e12fa1b329d5: Status 404 returned error can't find the container with id be7cea48a259d311c5cd6530d456c9a55de362f52b1bda18ed29e12fa1b329d5 Jun 15 01:42:35.515753 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.515722 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv"] Jun 15 01:42:35.518844 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:42:35.518819 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod175a9244_1f1d_4e25_a173_563b58059b51.slice/crio-c542ded85471c141f67acf8b7c5473d485cd4b41c4387fa155c190563aa1b3e1 WatchSource:0}: Error finding container c542ded85471c141f67acf8b7c5473d485cd4b41c4387fa155c190563aa1b3e1: Status 404 returned error can't find the container with id c542ded85471c141f67acf8b7c5473d485cd4b41c4387fa155c190563aa1b3e1 Jun 15 01:42:35.521044 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.521024 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 01:42:35.525774 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.525756 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.528368 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.528347 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 15 01:42:35.528450 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.528366 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 15 01:42:35.528450 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.528354 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 15 01:42:35.528450 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.528351 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 15 01:42:35.528704 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.528688 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 15 01:42:35.528794 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.528733 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 15 01:42:35.528936 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.528921 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 15 01:42:35.529143 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.529129 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kdjc4\"" Jun 15 01:42:35.529207 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.529194 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 15 01:42:35.529252 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.529203 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 15 01:42:35.539874 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.539854 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 01:42:35.649250 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.649173 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.649250 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.649216 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.649250 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.649236 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.649540 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.649290 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-web-config\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.649540 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.649322 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbwzr\" (UniqueName: \"kubernetes.io/projected/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-kube-api-access-nbwzr\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.649540 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.649422 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.649540 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.649479 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.649540 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.649507 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-config-out\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.649540 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.649531 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.649787 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.649614 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.649787 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.649641 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.649787 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.649689 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-config-volume\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.649787 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.649708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.750555 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.750512 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.750745 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.750576 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.750745 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.750599 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-config-out\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.750745 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.750620 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.750745 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.750670 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.750745 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:35.750680 2576 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 15 01:42:35.750971 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:35.750760 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-main-tls podName:22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:36.250738741 +0000 UTC m=+234.609279134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0") : secret "alertmanager-main-tls" not found Jun 15 01:42:35.750971 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.750694 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.750971 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:35.750791 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-alertmanager-trusted-ca-bundle podName:22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:36.250773205 +0000 UTC m=+234.609313595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0") : configmap references non-existent config key: ca-bundle.crt Jun 15 01:42:35.750971 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.750845 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-config-volume\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.750971 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.750867 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.750971 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.750913 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.750971 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.750952 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.751325 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.750981 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.751325 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.751123 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.751466 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.751434 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.751529 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.751487 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-web-config\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.751529 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.751516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbwzr\" (UniqueName: \"kubernetes.io/projected/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-kube-api-access-nbwzr\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.753796 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.753729 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-config-out\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.753924 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.753824 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.754057 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.754031 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-config-volume\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.754157 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.754080 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.754415 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.754396 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.754454 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.754415 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.754454 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.754420 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.754604 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.754585 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-web-config\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.760017 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.759997 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbwzr\" (UniqueName: \"kubernetes.io/projected/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-kube-api-access-nbwzr\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:35.770044 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.770016 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-49dbg" event={"ID":"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb","Type":"ContainerStarted","Data":"be7cea48a259d311c5cd6530d456c9a55de362f52b1bda18ed29e12fa1b329d5"} Jun 15 01:42:35.771210 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:35.771188 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" event={"ID":"175a9244-1f1d-4e25-a173-563b58059b51","Type":"ContainerStarted","Data":"c542ded85471c141f67acf8b7c5473d485cd4b41c4387fa155c190563aa1b3e1"} Jun 15 01:42:36.257306 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:36.257258 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:36.257518 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:36.257332 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:36.258264 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:36.258236 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:36.260378 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:36.260352 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:36.435599 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:36.435559 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:42:36.624962 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:36.624917 2576 patch_prober.go:28] interesting pod/image-registry-67dbf94d-tc445 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 01:42:36.625419 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:36.624983 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-67dbf94d-tc445" podUID="0afab3f1-b4d1-4686-8e4c-1f9c0faf644b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 01:42:36.777453 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:36.777405 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-49dbg" event={"ID":"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb","Type":"ContainerStarted","Data":"6b3b4b57c3a05a6fc78ae61ec1caeb769ac778b0c76ebf776cc9b762d13b16fe"} Jun 15 01:42:36.779975 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:36.779938 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" event={"ID":"175a9244-1f1d-4e25-a173-563b58059b51","Type":"ContainerStarted","Data":"68b473168d03baa0145d9a905ae8e91cca86582008d8c595182d71f06885659c"} Jun 15 01:42:36.797023 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:36.796980 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 01:42:36.802239 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:42:36.802186 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22fa2d8f_7d03_410a_9ffa_fc84e9bc86b0.slice/crio-eccd48c7843d9287bd722dd4fa37543ca13894a2b3a5745b5a90498e922954bc WatchSource:0}: Error finding container eccd48c7843d9287bd722dd4fa37543ca13894a2b3a5745b5a90498e922954bc: Status 404 returned error can't find the container with id eccd48c7843d9287bd722dd4fa37543ca13894a2b3a5745b5a90498e922954bc Jun 15 01:42:37.785206 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:37.785167 2576 generic.go:356] "Generic (PLEG): container finished" podID="88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb" containerID="6b3b4b57c3a05a6fc78ae61ec1caeb769ac778b0c76ebf776cc9b762d13b16fe" exitCode=0 Jun 15 01:42:37.785701 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:37.785242 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-49dbg" event={"ID":"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb","Type":"ContainerDied","Data":"6b3b4b57c3a05a6fc78ae61ec1caeb769ac778b0c76ebf776cc9b762d13b16fe"} Jun 15 01:42:37.787325 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:37.787299 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" event={"ID":"175a9244-1f1d-4e25-a173-563b58059b51","Type":"ContainerStarted","Data":"747d9f16b40720118eececa8182dedc503238e26fcf1e8c63cdb4bf635601670"} Jun 15 01:42:37.787453 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:37.787371 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" event={"ID":"175a9244-1f1d-4e25-a173-563b58059b51","Type":"ContainerStarted","Data":"f978317ea7aa175b2e9b2cac3416c9bc86923fc09cd787e2390c61512f708200"} Jun 15 01:42:37.788328 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:37.788307 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0","Type":"ContainerStarted","Data":"eccd48c7843d9287bd722dd4fa37543ca13894a2b3a5745b5a90498e922954bc"} Jun 15 01:42:37.824583 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:37.824527 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-nwfhv" podStartSLOduration=2.64709977 podStartE2EDuration="3.824510654s" totalImagesPullingTime="1.177410884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:37.823090828 +0000 UTC m=+236.181631245" watchObservedRunningTime="2026-06-15 01:42:37.824510654 +0000 UTC m=+236.183051050" Jun 15 01:42:38.794259 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:38.794222 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-49dbg" event={"ID":"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb","Type":"ContainerStarted","Data":"baac6cbb4f29761aefcbc4801b21ecc36d92db4929b7ebf7f48840d68cfd476e"} Jun 15 01:42:38.794687 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:38.794287 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-49dbg" event={"ID":"88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb","Type":"ContainerStarted","Data":"3a243c74725695decbf790faa54c5361028e24bee8bc60154638c0508fcf1ddb"} Jun 15 01:42:38.795665 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:38.795636 2576 generic.go:356] "Generic (PLEG): container finished" podID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerID="8ba47c66541162413cfe48e1af724fe4eff1029919812e49259adeec14406946" exitCode=0 Jun 15 01:42:38.795771 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:38.795714 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0","Type":"ContainerDied","Data":"8ba47c66541162413cfe48e1af724fe4eff1029919812e49259adeec14406946"} Jun 15 01:42:38.842134 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:38.842083 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-49dbg" podStartSLOduration=3.514656525 podStartE2EDuration="4.84206456s" totalImagesPullingTime="1.249128493s" totalInitContainerRuntime="78.279542ms" isStatefulPod=true podCreationTimestamp="2026-06-15 01:42:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:38.813101264 +0000 UTC m=+237.171641661" watchObservedRunningTime="2026-06-15 01:42:38.84206456 +0000 UTC m=+237.200604961" Jun 15 01:42:38.862081 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:38.862049 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7489cfdbb8-wt8nh"] Jun 15 01:42:38.865315 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:38.865294 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:42:38.868039 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:38.868014 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-j5q6s\"" Jun 15 01:42:38.868039 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:38.868015 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 15 01:42:38.868279 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:38.868014 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-45kc0a8n91jnv\"" Jun 15 01:42:38.868279 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:38.868015 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 15 01:42:38.868279 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:38.868043 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 15 01:42:38.868279 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:38.868266 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 15 01:42:38.873690 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:38.873662 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7489cfdbb8-wt8nh"] Jun 15 01:42:38.983597 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:38.983483 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fca83c0-4883-4e87-b3fd-297939c9df6c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7489cfdbb8-wt8nh\" (UID: \"2fca83c0-4883-4e87-b3fd-297939c9df6c\") " pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:42:38.983597 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:38.983537 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2fca83c0-4883-4e87-b3fd-297939c9df6c-secret-metrics-server-tls\") pod \"metrics-server-7489cfdbb8-wt8nh\" (UID: \"2fca83c0-4883-4e87-b3fd-297939c9df6c\") " pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:42:38.983597 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:38.983558 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxdjw\" (UniqueName: \"kubernetes.io/projected/2fca83c0-4883-4e87-b3fd-297939c9df6c-kube-api-access-dxdjw\") pod \"metrics-server-7489cfdbb8-wt8nh\" (UID: \"2fca83c0-4883-4e87-b3fd-297939c9df6c\") " pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:42:38.983858 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:38.983624 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2fca83c0-4883-4e87-b3fd-297939c9df6c-metrics-server-audit-profiles\") pod \"metrics-server-7489cfdbb8-wt8nh\" (UID: \"2fca83c0-4883-4e87-b3fd-297939c9df6c\") " pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:42:38.983858 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:38.983662 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2fca83c0-4883-4e87-b3fd-297939c9df6c-client-ca-bundle\") pod \"metrics-server-7489cfdbb8-wt8nh\" (UID: \"2fca83c0-4883-4e87-b3fd-297939c9df6c\") " pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:42:38.983858 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:38.983712 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2fca83c0-4883-4e87-b3fd-297939c9df6c-secret-metrics-server-client-certs\") pod \"metrics-server-7489cfdbb8-wt8nh\" (UID: \"2fca83c0-4883-4e87-b3fd-297939c9df6c\") " pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:42:38.983858 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:38.983754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2fca83c0-4883-4e87-b3fd-297939c9df6c-audit-log\") pod \"metrics-server-7489cfdbb8-wt8nh\" (UID: \"2fca83c0-4883-4e87-b3fd-297939c9df6c\") " pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:42:39.085117 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.085080 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2fca83c0-4883-4e87-b3fd-297939c9df6c-secret-metrics-server-client-certs\") pod \"metrics-server-7489cfdbb8-wt8nh\" (UID: \"2fca83c0-4883-4e87-b3fd-297939c9df6c\") " pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:42:39.085331 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.085143 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2fca83c0-4883-4e87-b3fd-297939c9df6c-audit-log\") pod \"metrics-server-7489cfdbb8-wt8nh\" (UID: \"2fca83c0-4883-4e87-b3fd-297939c9df6c\") " pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:42:39.085331 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.085208 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fca83c0-4883-4e87-b3fd-297939c9df6c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7489cfdbb8-wt8nh\" (UID: \"2fca83c0-4883-4e87-b3fd-297939c9df6c\") " pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:42:39.085472 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.085355 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2fca83c0-4883-4e87-b3fd-297939c9df6c-secret-metrics-server-tls\") pod \"metrics-server-7489cfdbb8-wt8nh\" (UID: \"2fca83c0-4883-4e87-b3fd-297939c9df6c\") " pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:42:39.085472 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.085390 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxdjw\" (UniqueName: \"kubernetes.io/projected/2fca83c0-4883-4e87-b3fd-297939c9df6c-kube-api-access-dxdjw\") pod \"metrics-server-7489cfdbb8-wt8nh\" (UID: \"2fca83c0-4883-4e87-b3fd-297939c9df6c\") " pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:42:39.085472 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.085419 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2fca83c0-4883-4e87-b3fd-297939c9df6c-metrics-server-audit-profiles\") pod \"metrics-server-7489cfdbb8-wt8nh\" (UID: \"2fca83c0-4883-4e87-b3fd-297939c9df6c\") " pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:42:39.085472 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.085437 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2fca83c0-4883-4e87-b3fd-297939c9df6c-client-ca-bundle\") pod \"metrics-server-7489cfdbb8-wt8nh\" (UID: \"2fca83c0-4883-4e87-b3fd-297939c9df6c\") " pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:42:39.085672 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.085619 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2fca83c0-4883-4e87-b3fd-297939c9df6c-audit-log\") pod \"metrics-server-7489cfdbb8-wt8nh\" (UID: \"2fca83c0-4883-4e87-b3fd-297939c9df6c\") " pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:42:39.085953 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.085926 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fca83c0-4883-4e87-b3fd-297939c9df6c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7489cfdbb8-wt8nh\" (UID: \"2fca83c0-4883-4e87-b3fd-297939c9df6c\") " pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:42:39.086297 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.086276 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2fca83c0-4883-4e87-b3fd-297939c9df6c-metrics-server-audit-profiles\") pod \"metrics-server-7489cfdbb8-wt8nh\" (UID: \"2fca83c0-4883-4e87-b3fd-297939c9df6c\") " pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:42:39.087851 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.087833 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2fca83c0-4883-4e87-b3fd-297939c9df6c-client-ca-bundle\") pod \"metrics-server-7489cfdbb8-wt8nh\" (UID: \"2fca83c0-4883-4e87-b3fd-297939c9df6c\") " pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:42:39.088190 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.088171 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2fca83c0-4883-4e87-b3fd-297939c9df6c-secret-metrics-server-tls\") pod \"metrics-server-7489cfdbb8-wt8nh\" (UID: \"2fca83c0-4883-4e87-b3fd-297939c9df6c\") " pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:42:39.088273 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.088257 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2fca83c0-4883-4e87-b3fd-297939c9df6c-secret-metrics-server-client-certs\") pod \"metrics-server-7489cfdbb8-wt8nh\" (UID: \"2fca83c0-4883-4e87-b3fd-297939c9df6c\") " pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:42:39.093085 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.093061 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxdjw\" (UniqueName: \"kubernetes.io/projected/2fca83c0-4883-4e87-b3fd-297939c9df6c-kube-api-access-dxdjw\") pod \"metrics-server-7489cfdbb8-wt8nh\" (UID: \"2fca83c0-4883-4e87-b3fd-297939c9df6c\") " pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:42:39.175441 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.175406 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:42:39.235583 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.235507 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-v8njn"] Jun 15 01:42:39.244163 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.244129 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-v8njn" Jun 15 01:42:39.246427 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.246399 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-v8njn"] Jun 15 01:42:39.246572 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.246556 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-p5cg8\"" Jun 15 01:42:39.246624 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.246599 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 15 01:42:39.312187 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.312162 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7489cfdbb8-wt8nh"] Jun 15 01:42:39.314607 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:42:39.314582 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fca83c0_4883_4e87_b3fd_297939c9df6c.slice/crio-4e5feaa15d65d06a947b6b0e21e8e828ce55cb92e9bf5173c28dd81ed52e5d4d WatchSource:0}: Error finding container 4e5feaa15d65d06a947b6b0e21e8e828ce55cb92e9bf5173c28dd81ed52e5d4d: Status 404 returned error can't find the container with id 4e5feaa15d65d06a947b6b0e21e8e828ce55cb92e9bf5173c28dd81ed52e5d4d Jun 15 01:42:39.388977 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.388935 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z4dh\" (UniqueName: \"kubernetes.io/projected/60310176-0e9f-47ee-a166-ecf0eb9d99ad-kube-api-access-6z4dh\") pod \"monitoring-plugin-589576dfc7-v8njn\" (UID: \"60310176-0e9f-47ee-a166-ecf0eb9d99ad\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-v8njn" Jun 15 01:42:39.389154 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.389006 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/60310176-0e9f-47ee-a166-ecf0eb9d99ad-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-v8njn\" (UID: \"60310176-0e9f-47ee-a166-ecf0eb9d99ad\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-v8njn" Jun 15 01:42:39.490575 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.490481 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z4dh\" (UniqueName: \"kubernetes.io/projected/60310176-0e9f-47ee-a166-ecf0eb9d99ad-kube-api-access-6z4dh\") pod \"monitoring-plugin-589576dfc7-v8njn\" (UID: \"60310176-0e9f-47ee-a166-ecf0eb9d99ad\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-v8njn" Jun 15 01:42:39.490575 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.490547 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/60310176-0e9f-47ee-a166-ecf0eb9d99ad-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-v8njn\" (UID: \"60310176-0e9f-47ee-a166-ecf0eb9d99ad\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-v8njn" Jun 15 01:42:39.490822 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:39.490719 2576 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 15 01:42:39.490822 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:42:39.490785 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60310176-0e9f-47ee-a166-ecf0eb9d99ad-monitoring-plugin-cert podName:60310176-0e9f-47ee-a166-ecf0eb9d99ad nodeName:}" failed. No retries permitted until 2026-06-15 01:42:39.990763601 +0000 UTC m=+238.349303978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/60310176-0e9f-47ee-a166-ecf0eb9d99ad-monitoring-plugin-cert") pod "monitoring-plugin-589576dfc7-v8njn" (UID: "60310176-0e9f-47ee-a166-ecf0eb9d99ad") : secret "monitoring-plugin-cert" not found Jun 15 01:42:39.501949 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.501915 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z4dh\" (UniqueName: \"kubernetes.io/projected/60310176-0e9f-47ee-a166-ecf0eb9d99ad-kube-api-access-6z4dh\") pod \"monitoring-plugin-589576dfc7-v8njn\" (UID: \"60310176-0e9f-47ee-a166-ecf0eb9d99ad\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-v8njn" Jun 15 01:42:39.686047 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.686013 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-66647c668b-tf56t"] Jun 15 01:42:39.690031 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.690006 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:39.693607 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.693447 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 15 01:42:39.693607 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.693478 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 15 01:42:39.693607 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.693502 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qg2cm\"" Jun 15 01:42:39.693607 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.693518 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 15 01:42:39.693607 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.693478 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 15 01:42:39.693607 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.693569 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 15 01:42:39.699925 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.699906 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 15 01:42:39.704216 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.704194 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66647c668b-tf56t"] Jun 15 01:42:39.794004 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.793914 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d866a3d2-2075-4a7b-90c0-cb6e0fbe545c-telemeter-client-tls\") pod \"telemeter-client-66647c668b-tf56t\" (UID: \"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c\") " pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:39.794004 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.793979 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f99f\" (UniqueName: \"kubernetes.io/projected/d866a3d2-2075-4a7b-90c0-cb6e0fbe545c-kube-api-access-9f99f\") pod \"telemeter-client-66647c668b-tf56t\" (UID: \"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c\") " pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:39.794220 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.794090 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d866a3d2-2075-4a7b-90c0-cb6e0fbe545c-federate-client-tls\") pod \"telemeter-client-66647c668b-tf56t\" (UID: \"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c\") " pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:39.794220 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.794157 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d866a3d2-2075-4a7b-90c0-cb6e0fbe545c-secret-telemeter-client\") pod \"telemeter-client-66647c668b-tf56t\" (UID: \"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c\") " pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:39.794220 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.794199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d866a3d2-2075-4a7b-90c0-cb6e0fbe545c-serving-certs-ca-bundle\") pod \"telemeter-client-66647c668b-tf56t\" (UID: \"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c\") " pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:39.794693 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.794230 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d866a3d2-2075-4a7b-90c0-cb6e0fbe545c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66647c668b-tf56t\" (UID: \"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c\") " pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:39.794693 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.794278 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d866a3d2-2075-4a7b-90c0-cb6e0fbe545c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66647c668b-tf56t\" (UID: \"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c\") " pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:39.794693 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.794361 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d866a3d2-2075-4a7b-90c0-cb6e0fbe545c-metrics-client-ca\") pod \"telemeter-client-66647c668b-tf56t\" (UID: \"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c\") " pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:39.801720 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.801683 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" event={"ID":"2fca83c0-4883-4e87-b3fd-297939c9df6c","Type":"ContainerStarted","Data":"4e5feaa15d65d06a947b6b0e21e8e828ce55cb92e9bf5173c28dd81ed52e5d4d"} Jun 15 01:42:39.895477 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.895428 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d866a3d2-2075-4a7b-90c0-cb6e0fbe545c-federate-client-tls\") pod \"telemeter-client-66647c668b-tf56t\" (UID: \"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c\") " pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:39.895658 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.895546 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d866a3d2-2075-4a7b-90c0-cb6e0fbe545c-secret-telemeter-client\") pod \"telemeter-client-66647c668b-tf56t\" (UID: \"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c\") " pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:39.895658 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.895583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d866a3d2-2075-4a7b-90c0-cb6e0fbe545c-serving-certs-ca-bundle\") pod \"telemeter-client-66647c668b-tf56t\" (UID: \"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c\") " pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:39.895658 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.895611 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d866a3d2-2075-4a7b-90c0-cb6e0fbe545c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66647c668b-tf56t\" (UID: \"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c\") " pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:39.895843 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.895666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d866a3d2-2075-4a7b-90c0-cb6e0fbe545c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66647c668b-tf56t\" (UID: \"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c\") " pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:39.895843 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.895723 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d866a3d2-2075-4a7b-90c0-cb6e0fbe545c-metrics-client-ca\") pod \"telemeter-client-66647c668b-tf56t\" (UID: \"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c\") " pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:39.895843 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.895776 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d866a3d2-2075-4a7b-90c0-cb6e0fbe545c-telemeter-client-tls\") pod \"telemeter-client-66647c668b-tf56t\" (UID: \"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c\") " pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:39.895987 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.895845 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f99f\" (UniqueName: \"kubernetes.io/projected/d866a3d2-2075-4a7b-90c0-cb6e0fbe545c-kube-api-access-9f99f\") pod \"telemeter-client-66647c668b-tf56t\" (UID: \"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c\") " pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:39.896909 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.896878 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d866a3d2-2075-4a7b-90c0-cb6e0fbe545c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66647c668b-tf56t\" (UID: \"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c\") " pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:39.897046 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.896913 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d866a3d2-2075-4a7b-90c0-cb6e0fbe545c-serving-certs-ca-bundle\") pod \"telemeter-client-66647c668b-tf56t\" (UID: \"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c\") " pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:39.897046 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.896922 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d866a3d2-2075-4a7b-90c0-cb6e0fbe545c-metrics-client-ca\") pod \"telemeter-client-66647c668b-tf56t\" (UID: \"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c\") " pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:39.899276 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.899242 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d866a3d2-2075-4a7b-90c0-cb6e0fbe545c-telemeter-client-tls\") pod \"telemeter-client-66647c668b-tf56t\" (UID: \"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c\") " pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:39.899362 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.899311 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d866a3d2-2075-4a7b-90c0-cb6e0fbe545c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66647c668b-tf56t\" (UID: \"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c\") " pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:39.899799 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.899778 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d866a3d2-2075-4a7b-90c0-cb6e0fbe545c-secret-telemeter-client\") pod \"telemeter-client-66647c668b-tf56t\" (UID: \"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c\") " pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:39.899928 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.899883 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d866a3d2-2075-4a7b-90c0-cb6e0fbe545c-federate-client-tls\") pod \"telemeter-client-66647c668b-tf56t\" (UID: \"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c\") " pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:39.905319 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.905295 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f99f\" (UniqueName: \"kubernetes.io/projected/d866a3d2-2075-4a7b-90c0-cb6e0fbe545c-kube-api-access-9f99f\") pod \"telemeter-client-66647c668b-tf56t\" (UID: \"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c\") " pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:39.997898 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:39.997838 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/60310176-0e9f-47ee-a166-ecf0eb9d99ad-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-v8njn\" (UID: \"60310176-0e9f-47ee-a166-ecf0eb9d99ad\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-v8njn" Jun 15 01:42:40.001064 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:40.001031 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/60310176-0e9f-47ee-a166-ecf0eb9d99ad-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-v8njn\" (UID: \"60310176-0e9f-47ee-a166-ecf0eb9d99ad\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-v8njn" Jun 15 01:42:40.001720 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:40.001695 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" Jun 15 01:42:40.155075 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:40.155039 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-v8njn" Jun 15 01:42:40.372620 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:40.372589 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-v8njn"] Jun 15 01:42:40.404241 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:40.404180 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66647c668b-tf56t"] Jun 15 01:42:40.728828 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:42:40.728786 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd866a3d2_2075_4a7b_90c0_cb6e0fbe545c.slice/crio-94919837d10b01b96ca2a11e522cc2c827c7568c47c522f30d3c584637a9bfcc WatchSource:0}: Error finding container 94919837d10b01b96ca2a11e522cc2c827c7568c47c522f30d3c584637a9bfcc: Status 404 returned error can't find the container with id 94919837d10b01b96ca2a11e522cc2c827c7568c47c522f30d3c584637a9bfcc Jun 15 01:42:40.729664 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:42:40.729637 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60310176_0e9f_47ee_a166_ecf0eb9d99ad.slice/crio-c578295e20da3a8ff28ea8aff84e6026c6574c5e27637d37c9a750113abfdb02 WatchSource:0}: Error finding container c578295e20da3a8ff28ea8aff84e6026c6574c5e27637d37c9a750113abfdb02: Status 404 returned error can't find the container with id c578295e20da3a8ff28ea8aff84e6026c6574c5e27637d37c9a750113abfdb02 Jun 15 01:42:40.806014 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:40.805985 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" event={"ID":"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c","Type":"ContainerStarted","Data":"94919837d10b01b96ca2a11e522cc2c827c7568c47c522f30d3c584637a9bfcc"} Jun 15 01:42:40.807648 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:40.807625 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0","Type":"ContainerStarted","Data":"3d0dc3581193c0551546cafc1fc4670bbfc352c2dbad78121d048f7efa5731a2"} Jun 15 01:42:40.808617 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:40.808594 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-v8njn" event={"ID":"60310176-0e9f-47ee-a166-ecf0eb9d99ad","Type":"ContainerStarted","Data":"c578295e20da3a8ff28ea8aff84e6026c6574c5e27637d37c9a750113abfdb02"} Jun 15 01:42:41.818637 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:41.818593 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0","Type":"ContainerStarted","Data":"ecaa2c9c21685738b392037fb75717afb6e04ff8451e31f4f7a1d7493014bc67"} Jun 15 01:42:41.819117 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:41.818676 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0","Type":"ContainerStarted","Data":"c0e64176411535047b1f2f7c93d5b4325e8ddab1f65498a292aefa7a1a3413c5"} Jun 15 01:42:41.819117 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:41.818717 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0","Type":"ContainerStarted","Data":"5c407fc02f68091c8f455cb5bae7d97af7610d511b00eb8823cbb03d250ddb6a"} Jun 15 01:42:41.819117 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:41.818757 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0","Type":"ContainerStarted","Data":"017da1827f6f2a31e47d8c488e514999b7e7c84cedefb6678a6e1ebbed65fd96"} Jun 15 01:42:41.820644 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:41.820586 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" event={"ID":"2fca83c0-4883-4e87-b3fd-297939c9df6c","Type":"ContainerStarted","Data":"bb1376757afdacbe00daaff95a59d7b981afb037177b481df33107df29d31080"} Jun 15 01:42:41.837654 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:41.837599 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" podStartSLOduration=2.377080986 podStartE2EDuration="3.837583124s" totalImagesPullingTime="1.460502138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:41.837288984 +0000 UTC m=+240.195829395" watchObservedRunningTime="2026-06-15 01:42:41.837583124 +0000 UTC m=+240.196123524" Jun 15 01:42:42.826317 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:42.826284 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-v8njn" event={"ID":"60310176-0e9f-47ee-a166-ecf0eb9d99ad","Type":"ContainerStarted","Data":"76e522eec005d60fb3e79b87c3657373a82c4cd41a656de774839e8255ad2ac5"} Jun 15 01:42:42.826743 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:42.826367 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-v8njn" Jun 15 01:42:42.827864 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:42.827843 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" event={"ID":"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c","Type":"ContainerStarted","Data":"57345ac241a057e1ebadfb2bdbb64c2d067d678f9e09f12d95d43ac4ff513832"} Jun 15 01:42:42.831567 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:42.831543 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0","Type":"ContainerStarted","Data":"1bbe54d68e7a6ad46bd3ac96cb15d77d3743383eec13bc8ed8f98ef5b66d7170"} Jun 15 01:42:42.831790 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:42.831770 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-v8njn" Jun 15 01:42:42.842488 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:42.842450 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-v8njn" podStartSLOduration=1.865963129 podStartE2EDuration="3.842437735s" totalImagesPullingTime="1.976474606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:42.84108121 +0000 UTC m=+241.199621610" watchObservedRunningTime="2026-06-15 01:42:42.842437735 +0000 UTC m=+241.200978132" Jun 15 01:42:42.881718 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:42.881669 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.484271684 podStartE2EDuration="7.881652061s" totalImagesPullingTime="3.377349549s" totalInitContainerRuntime="20.030828ms" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:42.880074361 +0000 UTC m=+241.238614769" watchObservedRunningTime="2026-06-15 01:42:42.881652061 +0000 UTC m=+241.240192490" Jun 15 01:42:43.837483 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:43.837439 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" event={"ID":"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c","Type":"ContainerStarted","Data":"f5c1888b8d6279f9938940e672c7339171681fdcef651b4bd6799fc1c4a4c9d1"} Jun 15 01:42:43.837973 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:43.837509 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" event={"ID":"d866a3d2-2075-4a7b-90c0-cb6e0fbe545c","Type":"ContainerStarted","Data":"2da3bdcd25d01c9408595f40d9fd3c28368fed697f429d7c4aa1af884567887f"} Jun 15 01:42:43.859209 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:43.859163 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-66647c668b-tf56t" podStartSLOduration=2.87686008 podStartE2EDuration="4.859147821s" totalImagesPullingTime="1.982287741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:43.857326278 +0000 UTC m=+242.215866675" watchObservedRunningTime="2026-06-15 01:42:43.859147821 +0000 UTC m=+242.217688217" Jun 15 01:42:46.622698 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:46.622664 2576 patch_prober.go:28] interesting pod/image-registry-67dbf94d-tc445 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 01:42:46.623075 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:46.622713 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-67dbf94d-tc445" podUID="0afab3f1-b4d1-4686-8e4c-1f9c0faf644b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 01:42:51.641139 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:51.641079 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-67dbf94d-tc445" podUID="0afab3f1-b4d1-4686-8e4c-1f9c0faf644b" containerName="registry" containerID="cri-o://7943106bf1b61253de437cafb5d58c282fe18fb1f0484e73ca2ff10f7ac889a0" gracePeriod=30 Jun 15 01:42:51.872982 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:51.872956 2576 generic.go:356] "Generic (PLEG): container finished" podID="0afab3f1-b4d1-4686-8e4c-1f9c0faf644b" containerID="7943106bf1b61253de437cafb5d58c282fe18fb1f0484e73ca2ff10f7ac889a0" exitCode=0 Jun 15 01:42:51.873100 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:51.873037 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67dbf94d-tc445" event={"ID":"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b","Type":"ContainerDied","Data":"7943106bf1b61253de437cafb5d58c282fe18fb1f0484e73ca2ff10f7ac889a0"} Jun 15 01:42:51.873154 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:51.873119 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67dbf94d-tc445" event={"ID":"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b","Type":"ContainerDied","Data":"ee49d39f00c0342f3a28c765b127a0743b754dc70e2c2e5c1a062488dba82230"} Jun 15 01:42:51.873154 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:51.873137 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee49d39f00c0342f3a28c765b127a0743b754dc70e2c2e5c1a062488dba82230" Jun 15 01:42:51.885432 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:51.885410 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:52.006468 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.006367 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkdbx\" (UniqueName: \"kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-kube-api-access-hkdbx\") pod \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " Jun 15 01:42:52.006468 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.006419 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-ca-trust-extracted\") pod \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " Jun 15 01:42:52.006468 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.006446 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-bound-sa-token\") pod \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " Jun 15 01:42:52.006732 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.006476 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-image-registry-private-configuration\") pod \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " Jun 15 01:42:52.006732 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.006513 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-certificates\") pod \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " Jun 15 01:42:52.006732 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.006620 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-tls\") pod \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " Jun 15 01:42:52.006732 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.006703 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-installation-pull-secrets\") pod \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " Jun 15 01:42:52.006933 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.006762 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-trusted-ca\") pod \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\" (UID: \"0afab3f1-b4d1-4686-8e4c-1f9c0faf644b\") " Jun 15 01:42:52.006989 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.006972 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0afab3f1-b4d1-4686-8e4c-1f9c0faf644b" (UID: "0afab3f1-b4d1-4686-8e4c-1f9c0faf644b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:42:52.007221 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.007123 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-certificates\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:42:52.007413 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.007389 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0afab3f1-b4d1-4686-8e4c-1f9c0faf644b" (UID: "0afab3f1-b4d1-4686-8e4c-1f9c0faf644b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:42:52.008991 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.008954 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0afab3f1-b4d1-4686-8e4c-1f9c0faf644b" (UID: "0afab3f1-b4d1-4686-8e4c-1f9c0faf644b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:42:52.009168 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.009144 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-kube-api-access-hkdbx" (OuterVolumeSpecName: "kube-api-access-hkdbx") pod "0afab3f1-b4d1-4686-8e4c-1f9c0faf644b" (UID: "0afab3f1-b4d1-4686-8e4c-1f9c0faf644b"). InnerVolumeSpecName "kube-api-access-hkdbx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:42:52.009245 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.009187 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0afab3f1-b4d1-4686-8e4c-1f9c0faf644b" (UID: "0afab3f1-b4d1-4686-8e4c-1f9c0faf644b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:42:52.009245 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.009218 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0afab3f1-b4d1-4686-8e4c-1f9c0faf644b" (UID: "0afab3f1-b4d1-4686-8e4c-1f9c0faf644b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:42:52.009358 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.009261 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0afab3f1-b4d1-4686-8e4c-1f9c0faf644b" (UID: "0afab3f1-b4d1-4686-8e4c-1f9c0faf644b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:42:52.014709 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.014683 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0afab3f1-b4d1-4686-8e4c-1f9c0faf644b" (UID: "0afab3f1-b4d1-4686-8e4c-1f9c0faf644b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:42:52.108635 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.108597 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-registry-tls\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:42:52.108635 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.108624 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-installation-pull-secrets\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:42:52.108635 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.108635 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-trusted-ca\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:42:52.108635 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.108644 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkdbx\" (UniqueName: \"kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-kube-api-access-hkdbx\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:42:52.108890 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.108653 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-ca-trust-extracted\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:42:52.108890 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.108661 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-bound-sa-token\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:42:52.108890 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.108670 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b-image-registry-private-configuration\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:42:52.876974 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.876943 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67dbf94d-tc445" Jun 15 01:42:52.894727 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.894697 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67dbf94d-tc445"] Jun 15 01:42:52.899533 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:52.899508 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67dbf94d-tc445"] Jun 15 01:42:53.922353 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:53.922302 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs\") pod \"network-metrics-daemon-26h5n\" (UID: \"2e027e5e-259c-4e7d-a90f-7dbf717f7701\") " pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:42:53.924535 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:53.924512 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e027e5e-259c-4e7d-a90f-7dbf717f7701-metrics-certs\") pod \"network-metrics-daemon-26h5n\" (UID: \"2e027e5e-259c-4e7d-a90f-7dbf717f7701\") " pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:42:53.948536 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:53.948515 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-46p56\"" Jun 15 01:42:53.956533 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:53.956515 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26h5n" Jun 15 01:42:54.050921 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:54.050889 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0afab3f1-b4d1-4686-8e4c-1f9c0faf644b" path="/var/lib/kubelet/pods/0afab3f1-b4d1-4686-8e4c-1f9c0faf644b/volumes" Jun 15 01:42:54.082197 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:54.082166 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-26h5n"] Jun 15 01:42:54.085000 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:42:54.084972 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e027e5e_259c_4e7d_a90f_7dbf717f7701.slice/crio-23a331039b3d4d54c19546ca6e78c6ddfc785e51632d93d34d6acaa932995813 WatchSource:0}: Error finding container 23a331039b3d4d54c19546ca6e78c6ddfc785e51632d93d34d6acaa932995813: Status 404 returned error can't find the container with id 23a331039b3d4d54c19546ca6e78c6ddfc785e51632d93d34d6acaa932995813 Jun 15 01:42:54.885801 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:54.885768 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-26h5n" event={"ID":"2e027e5e-259c-4e7d-a90f-7dbf717f7701","Type":"ContainerStarted","Data":"23a331039b3d4d54c19546ca6e78c6ddfc785e51632d93d34d6acaa932995813"} Jun 15 01:42:55.890981 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:55.890937 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-26h5n" event={"ID":"2e027e5e-259c-4e7d-a90f-7dbf717f7701","Type":"ContainerStarted","Data":"ec49ebc027bf6b7ac6352aa153a3070ce988f61d6546972793fa1668afd90808"} Jun 15 01:42:55.891555 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:55.890994 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-26h5n" event={"ID":"2e027e5e-259c-4e7d-a90f-7dbf717f7701","Type":"ContainerStarted","Data":"252ebf65e045e6a5f96ad7feac9d3e9a32331343dda19efe685d87214d9cd7cf"} Jun 15 01:42:55.907236 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:55.907188 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-26h5n" podStartSLOduration=253.049674093 podStartE2EDuration="4m13.907175616s" totalImagesPullingTime="857.501523ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:55.905541699 +0000 UTC m=+254.264082096" watchObservedRunningTime="2026-06-15 01:42:55.907175616 +0000 UTC m=+254.265716012" Jun 15 01:42:59.175635 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:59.175601 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:42:59.176003 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:42:59.175661 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:43:17.283738 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:17.283634 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0/init-config-reloader/0.log" Jun 15 01:43:17.483427 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:17.483401 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0/alertmanager/0.log" Jun 15 01:43:17.683036 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:17.683007 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0/config-reloader/0.log" Jun 15 01:43:17.883875 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:17.883853 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0/kube-rbac-proxy-web/0.log" Jun 15 01:43:18.083478 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:18.083409 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0/kube-rbac-proxy/0.log" Jun 15 01:43:18.283465 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:18.283439 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0/kube-rbac-proxy-metric/0.log" Jun 15 01:43:18.482924 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:18.482897 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0/prom-label-proxy/0.log" Jun 15 01:43:18.886438 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:18.886409 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-nwfhv_175a9244-1f1d-4e25-a173-563b58059b51/kube-state-metrics/0.log" Jun 15 01:43:19.083475 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:19.083446 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-nwfhv_175a9244-1f1d-4e25-a173-563b58059b51/kube-rbac-proxy-main/0.log" Jun 15 01:43:19.180838 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:19.180768 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:43:19.184465 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:19.184446 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7489cfdbb8-wt8nh" Jun 15 01:43:19.284631 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:19.284602 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-nwfhv_175a9244-1f1d-4e25-a173-563b58059b51/kube-rbac-proxy-self/0.log" Jun 15 01:43:19.482924 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:19.482844 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7489cfdbb8-wt8nh_2fca83c0-4883-4e87-b3fd-297939c9df6c/metrics-server/0.log" Jun 15 01:43:19.682750 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:19.682715 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-v8njn_60310176-0e9f-47ee-a166-ecf0eb9d99ad/monitoring-plugin/0.log" Jun 15 01:43:19.884019 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:19.883996 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-49dbg_88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb/init-textfile/0.log" Jun 15 01:43:20.084089 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:20.084059 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-49dbg_88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb/node-exporter/0.log" Jun 15 01:43:20.283792 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:20.283764 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-49dbg_88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb/kube-rbac-proxy/0.log" Jun 15 01:43:23.528558 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:43:23.528516 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8wcmz" podUID="78c57d75-c63a-4a72-81f1-fe8285631a98" Jun 15 01:43:23.994313 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:23.994284 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8wcmz" Jun 15 01:43:24.284411 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:24.284260 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66647c668b-tf56t_d866a3d2-2075-4a7b-90c0-cb6e0fbe545c/telemeter-client/0.log" Jun 15 01:43:24.483107 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:24.483078 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66647c668b-tf56t_d866a3d2-2075-4a7b-90c0-cb6e0fbe545c/reload/0.log" Jun 15 01:43:24.683953 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:24.683919 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66647c668b-tf56t_d866a3d2-2075-4a7b-90c0-cb6e0fbe545c/kube-rbac-proxy/0.log" Jun 15 01:43:26.082711 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:26.082685 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-5fggm_451dde2a-7ed3-46cf-8b3c-ce96077ad565/networking-console-plugin/0.log" Jun 15 01:43:26.282754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:26.282729 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-5qb7h_ee20262f-ced8-4d5c-8bf8-15fefc664812/console-operator/1.log" Jun 15 01:43:26.484530 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:26.484504 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-5qb7h_ee20262f-ced8-4d5c-8bf8-15fefc664812/console-operator/2.log" Jun 15 01:43:27.391209 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:27.391165 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls\") pod \"dns-default-8wcmz\" (UID: \"78c57d75-c63a-4a72-81f1-fe8285631a98\") " pod="openshift-dns/dns-default-8wcmz" Jun 15 01:43:27.393588 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:27.393562 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78c57d75-c63a-4a72-81f1-fe8285631a98-metrics-tls\") pod \"dns-default-8wcmz\" (UID: \"78c57d75-c63a-4a72-81f1-fe8285631a98\") " pod="openshift-dns/dns-default-8wcmz" Jun 15 01:43:27.597058 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:27.597029 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-55pqm\"" Jun 15 01:43:27.605025 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:27.605007 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8wcmz" Jun 15 01:43:27.735277 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:27.735254 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8wcmz"] Jun 15 01:43:27.737635 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:43:27.737609 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78c57d75_c63a_4a72_81f1_fe8285631a98.slice/crio-1c59193a0c6fd97675c5598eb82e2b120c5a796e1602f4eb31886169063c819c WatchSource:0}: Error finding container 1c59193a0c6fd97675c5598eb82e2b120c5a796e1602f4eb31886169063c819c: Status 404 returned error can't find the container with id 1c59193a0c6fd97675c5598eb82e2b120c5a796e1602f4eb31886169063c819c Jun 15 01:43:28.010891 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:28.010817 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8wcmz" event={"ID":"78c57d75-c63a-4a72-81f1-fe8285631a98","Type":"ContainerStarted","Data":"1c59193a0c6fd97675c5598eb82e2b120c5a796e1602f4eb31886169063c819c"} Jun 15 01:43:28.883826 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:28.883799 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kqxqs_11c51e69-484c-4efa-bebe-0eb0ccf33029/dns-node-resolver/0.log" Jun 15 01:43:30.020716 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:30.020676 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8wcmz" event={"ID":"78c57d75-c63a-4a72-81f1-fe8285631a98","Type":"ContainerStarted","Data":"1c462cfe258b72d263d3c6e43e46d8f98eca0440bef2d1124e8a4327292d88f8"} Jun 15 01:43:30.021087 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:30.020772 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8wcmz" Jun 15 01:43:30.021087 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:30.020794 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8wcmz" event={"ID":"78c57d75-c63a-4a72-81f1-fe8285631a98","Type":"ContainerStarted","Data":"8930c0b3fa5e9cf802d98ebb1b09fcd0f6e3aefda075b971d52a155375b7e095"} Jun 15 01:43:30.037240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:30.037193 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8wcmz" podStartSLOduration=251.511246085 podStartE2EDuration="4m13.037181062s" totalImagesPullingTime="1.525934977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:39:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:43:30.035855308 +0000 UTC m=+288.394395704" watchObservedRunningTime="2026-06-15 01:43:30.037181062 +0000 UTC m=+288.395721457" Jun 15 01:43:30.082696 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:30.082674 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xqcdr_b842d4f5-5f7d-417a-9473-1271dc39b8eb/node-ca/0.log" Jun 15 01:43:30.283205 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:30.283144 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-846697d79d-m7gkq_52b7be5b-ae33-4595-bcc6-54e125bd6de8/router/0.log" Jun 15 01:43:30.682766 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:30.682739 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nwmph_b00f4d8c-52d9-48c5-8a37-a69c3da3d450/serve-healthcheck-canary/0.log" Jun 15 01:43:40.027316 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:40.027285 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8wcmz" Jun 15 01:43:41.994938 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:41.994901 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-5qb7h_ee20262f-ced8-4d5c-8bf8-15fefc664812/console-operator/1.log" Jun 15 01:43:41.997023 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:41.997004 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-5qb7h_ee20262f-ced8-4d5c-8bf8-15fefc664812/console-operator/1.log" Jun 15 01:43:42.006478 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:42.006460 2576 kubelet.go:1648] "Image garbage collection succeeded" Jun 15 01:43:54.799023 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:54.798986 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 01:43:54.801806 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:54.799285 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="alertmanager" containerID="cri-o://3d0dc3581193c0551546cafc1fc4670bbfc352c2dbad78121d048f7efa5731a2" gracePeriod=120 Jun 15 01:43:54.801806 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:54.799361 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="kube-rbac-proxy" containerID="cri-o://c0e64176411535047b1f2f7c93d5b4325e8ddab1f65498a292aefa7a1a3413c5" gracePeriod=120 Jun 15 01:43:54.801806 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:54.799353 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="kube-rbac-proxy-metric" containerID="cri-o://ecaa2c9c21685738b392037fb75717afb6e04ff8451e31f4f7a1d7493014bc67" gracePeriod=120 Jun 15 01:43:54.801806 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:54.799397 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="prom-label-proxy" containerID="cri-o://1bbe54d68e7a6ad46bd3ac96cb15d77d3743383eec13bc8ed8f98ef5b66d7170" gracePeriod=120 Jun 15 01:43:54.801806 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:54.799457 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="kube-rbac-proxy-web" containerID="cri-o://5c407fc02f68091c8f455cb5bae7d97af7610d511b00eb8823cbb03d250ddb6a" gracePeriod=120 Jun 15 01:43:54.801806 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:54.799375 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="config-reloader" containerID="cri-o://017da1827f6f2a31e47d8c488e514999b7e7c84cedefb6678a6e1ebbed65fd96" gracePeriod=120 Jun 15 01:43:55.133103 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:55.133056 2576 generic.go:356] "Generic (PLEG): container finished" podID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerID="1bbe54d68e7a6ad46bd3ac96cb15d77d3743383eec13bc8ed8f98ef5b66d7170" exitCode=0 Jun 15 01:43:55.133103 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:55.133098 2576 generic.go:356] "Generic (PLEG): container finished" podID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerID="c0e64176411535047b1f2f7c93d5b4325e8ddab1f65498a292aefa7a1a3413c5" exitCode=0 Jun 15 01:43:55.133103 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:55.133105 2576 generic.go:356] "Generic (PLEG): container finished" podID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerID="017da1827f6f2a31e47d8c488e514999b7e7c84cedefb6678a6e1ebbed65fd96" exitCode=0 Jun 15 01:43:55.133103 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:55.133111 2576 generic.go:356] "Generic (PLEG): container finished" podID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerID="3d0dc3581193c0551546cafc1fc4670bbfc352c2dbad78121d048f7efa5731a2" exitCode=0 Jun 15 01:43:55.133373 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:55.133122 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0","Type":"ContainerDied","Data":"1bbe54d68e7a6ad46bd3ac96cb15d77d3743383eec13bc8ed8f98ef5b66d7170"} Jun 15 01:43:55.133373 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:55.133207 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0","Type":"ContainerDied","Data":"c0e64176411535047b1f2f7c93d5b4325e8ddab1f65498a292aefa7a1a3413c5"} Jun 15 01:43:55.133373 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:55.133233 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0","Type":"ContainerDied","Data":"017da1827f6f2a31e47d8c488e514999b7e7c84cedefb6678a6e1ebbed65fd96"} Jun 15 01:43:55.133373 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:55.133258 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0","Type":"ContainerDied","Data":"3d0dc3581193c0551546cafc1fc4670bbfc352c2dbad78121d048f7efa5731a2"} Jun 15 01:43:56.042818 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.042793 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.140141 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.140042 2576 generic.go:356] "Generic (PLEG): container finished" podID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerID="ecaa2c9c21685738b392037fb75717afb6e04ff8451e31f4f7a1d7493014bc67" exitCode=0 Jun 15 01:43:56.140141 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.140066 2576 generic.go:356] "Generic (PLEG): container finished" podID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerID="5c407fc02f68091c8f455cb5bae7d97af7610d511b00eb8823cbb03d250ddb6a" exitCode=0 Jun 15 01:43:56.140141 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.140120 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0","Type":"ContainerDied","Data":"ecaa2c9c21685738b392037fb75717afb6e04ff8451e31f4f7a1d7493014bc67"} Jun 15 01:43:56.140141 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.140132 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.140497 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.140186 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0","Type":"ContainerDied","Data":"5c407fc02f68091c8f455cb5bae7d97af7610d511b00eb8823cbb03d250ddb6a"} Jun 15 01:43:56.140497 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.140214 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0","Type":"ContainerDied","Data":"eccd48c7843d9287bd722dd4fa37543ca13894a2b3a5745b5a90498e922954bc"} Jun 15 01:43:56.140497 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.140244 2576 scope.go:117] "RemoveContainer" containerID="1bbe54d68e7a6ad46bd3ac96cb15d77d3743383eec13bc8ed8f98ef5b66d7170" Jun 15 01:43:56.147936 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.147919 2576 scope.go:117] "RemoveContainer" containerID="ecaa2c9c21685738b392037fb75717afb6e04ff8451e31f4f7a1d7493014bc67" Jun 15 01:43:56.154915 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.154897 2576 scope.go:117] "RemoveContainer" containerID="c0e64176411535047b1f2f7c93d5b4325e8ddab1f65498a292aefa7a1a3413c5" Jun 15 01:43:56.161485 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.161461 2576 scope.go:117] "RemoveContainer" containerID="5c407fc02f68091c8f455cb5bae7d97af7610d511b00eb8823cbb03d250ddb6a" Jun 15 01:43:56.167992 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.167972 2576 scope.go:117] "RemoveContainer" containerID="017da1827f6f2a31e47d8c488e514999b7e7c84cedefb6678a6e1ebbed65fd96" Jun 15 01:43:56.175058 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.175039 2576 scope.go:117] "RemoveContainer" containerID="3d0dc3581193c0551546cafc1fc4670bbfc352c2dbad78121d048f7efa5731a2" Jun 15 01:43:56.182229 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.182207 2576 scope.go:117] "RemoveContainer" containerID="8ba47c66541162413cfe48e1af724fe4eff1029919812e49259adeec14406946" Jun 15 01:43:56.189387 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.189368 2576 scope.go:117] "RemoveContainer" containerID="1bbe54d68e7a6ad46bd3ac96cb15d77d3743383eec13bc8ed8f98ef5b66d7170" Jun 15 01:43:56.189684 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:43:56.189664 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bbe54d68e7a6ad46bd3ac96cb15d77d3743383eec13bc8ed8f98ef5b66d7170\": container with ID starting with 1bbe54d68e7a6ad46bd3ac96cb15d77d3743383eec13bc8ed8f98ef5b66d7170 not found: ID does not exist" containerID="1bbe54d68e7a6ad46bd3ac96cb15d77d3743383eec13bc8ed8f98ef5b66d7170" Jun 15 01:43:56.189725 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.189695 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bbe54d68e7a6ad46bd3ac96cb15d77d3743383eec13bc8ed8f98ef5b66d7170"} err="failed to get container status \"1bbe54d68e7a6ad46bd3ac96cb15d77d3743383eec13bc8ed8f98ef5b66d7170\": rpc error: code = NotFound desc = could not find container \"1bbe54d68e7a6ad46bd3ac96cb15d77d3743383eec13bc8ed8f98ef5b66d7170\": container with ID starting with 1bbe54d68e7a6ad46bd3ac96cb15d77d3743383eec13bc8ed8f98ef5b66d7170 not found: ID does not exist" Jun 15 01:43:56.189771 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.189728 2576 scope.go:117] "RemoveContainer" containerID="ecaa2c9c21685738b392037fb75717afb6e04ff8451e31f4f7a1d7493014bc67" Jun 15 01:43:56.189966 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:43:56.189949 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecaa2c9c21685738b392037fb75717afb6e04ff8451e31f4f7a1d7493014bc67\": container with ID starting with ecaa2c9c21685738b392037fb75717afb6e04ff8451e31f4f7a1d7493014bc67 not found: ID does not exist" containerID="ecaa2c9c21685738b392037fb75717afb6e04ff8451e31f4f7a1d7493014bc67" Jun 15 01:43:56.190011 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.189971 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecaa2c9c21685738b392037fb75717afb6e04ff8451e31f4f7a1d7493014bc67"} err="failed to get container status \"ecaa2c9c21685738b392037fb75717afb6e04ff8451e31f4f7a1d7493014bc67\": rpc error: code = NotFound desc = could not find container \"ecaa2c9c21685738b392037fb75717afb6e04ff8451e31f4f7a1d7493014bc67\": container with ID starting with ecaa2c9c21685738b392037fb75717afb6e04ff8451e31f4f7a1d7493014bc67 not found: ID does not exist" Jun 15 01:43:56.190011 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.189986 2576 scope.go:117] "RemoveContainer" containerID="c0e64176411535047b1f2f7c93d5b4325e8ddab1f65498a292aefa7a1a3413c5" Jun 15 01:43:56.190204 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:43:56.190189 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0e64176411535047b1f2f7c93d5b4325e8ddab1f65498a292aefa7a1a3413c5\": container with ID starting with c0e64176411535047b1f2f7c93d5b4325e8ddab1f65498a292aefa7a1a3413c5 not found: ID does not exist" containerID="c0e64176411535047b1f2f7c93d5b4325e8ddab1f65498a292aefa7a1a3413c5" Jun 15 01:43:56.190241 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.190209 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0e64176411535047b1f2f7c93d5b4325e8ddab1f65498a292aefa7a1a3413c5"} err="failed to get container status \"c0e64176411535047b1f2f7c93d5b4325e8ddab1f65498a292aefa7a1a3413c5\": rpc error: code = NotFound desc = could not find container \"c0e64176411535047b1f2f7c93d5b4325e8ddab1f65498a292aefa7a1a3413c5\": container with ID starting with c0e64176411535047b1f2f7c93d5b4325e8ddab1f65498a292aefa7a1a3413c5 not found: ID does not exist" Jun 15 01:43:56.190241 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.190223 2576 scope.go:117] "RemoveContainer" containerID="5c407fc02f68091c8f455cb5bae7d97af7610d511b00eb8823cbb03d250ddb6a" Jun 15 01:43:56.190450 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:43:56.190433 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c407fc02f68091c8f455cb5bae7d97af7610d511b00eb8823cbb03d250ddb6a\": container with ID starting with 5c407fc02f68091c8f455cb5bae7d97af7610d511b00eb8823cbb03d250ddb6a not found: ID does not exist" containerID="5c407fc02f68091c8f455cb5bae7d97af7610d511b00eb8823cbb03d250ddb6a" Jun 15 01:43:56.190483 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.190454 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c407fc02f68091c8f455cb5bae7d97af7610d511b00eb8823cbb03d250ddb6a"} err="failed to get container status \"5c407fc02f68091c8f455cb5bae7d97af7610d511b00eb8823cbb03d250ddb6a\": rpc error: code = NotFound desc = could not find container \"5c407fc02f68091c8f455cb5bae7d97af7610d511b00eb8823cbb03d250ddb6a\": container with ID starting with 5c407fc02f68091c8f455cb5bae7d97af7610d511b00eb8823cbb03d250ddb6a not found: ID does not exist" Jun 15 01:43:56.190483 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.190468 2576 scope.go:117] "RemoveContainer" containerID="017da1827f6f2a31e47d8c488e514999b7e7c84cedefb6678a6e1ebbed65fd96" Jun 15 01:43:56.190664 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:43:56.190650 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"017da1827f6f2a31e47d8c488e514999b7e7c84cedefb6678a6e1ebbed65fd96\": container with ID starting with 017da1827f6f2a31e47d8c488e514999b7e7c84cedefb6678a6e1ebbed65fd96 not found: ID does not exist" containerID="017da1827f6f2a31e47d8c488e514999b7e7c84cedefb6678a6e1ebbed65fd96" Jun 15 01:43:56.190706 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.190667 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"017da1827f6f2a31e47d8c488e514999b7e7c84cedefb6678a6e1ebbed65fd96"} err="failed to get container status \"017da1827f6f2a31e47d8c488e514999b7e7c84cedefb6678a6e1ebbed65fd96\": rpc error: code = NotFound desc = could not find container \"017da1827f6f2a31e47d8c488e514999b7e7c84cedefb6678a6e1ebbed65fd96\": container with ID starting with 017da1827f6f2a31e47d8c488e514999b7e7c84cedefb6678a6e1ebbed65fd96 not found: ID does not exist" Jun 15 01:43:56.190706 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.190678 2576 scope.go:117] "RemoveContainer" containerID="3d0dc3581193c0551546cafc1fc4670bbfc352c2dbad78121d048f7efa5731a2" Jun 15 01:43:56.190878 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:43:56.190859 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d0dc3581193c0551546cafc1fc4670bbfc352c2dbad78121d048f7efa5731a2\": container with ID starting with 3d0dc3581193c0551546cafc1fc4670bbfc352c2dbad78121d048f7efa5731a2 not found: ID does not exist" containerID="3d0dc3581193c0551546cafc1fc4670bbfc352c2dbad78121d048f7efa5731a2" Jun 15 01:43:56.190919 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.190882 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d0dc3581193c0551546cafc1fc4670bbfc352c2dbad78121d048f7efa5731a2"} err="failed to get container status \"3d0dc3581193c0551546cafc1fc4670bbfc352c2dbad78121d048f7efa5731a2\": rpc error: code = NotFound desc = could not find container \"3d0dc3581193c0551546cafc1fc4670bbfc352c2dbad78121d048f7efa5731a2\": container with ID starting with 3d0dc3581193c0551546cafc1fc4670bbfc352c2dbad78121d048f7efa5731a2 not found: ID does not exist" Jun 15 01:43:56.190919 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.190896 2576 scope.go:117] "RemoveContainer" containerID="8ba47c66541162413cfe48e1af724fe4eff1029919812e49259adeec14406946" Jun 15 01:43:56.191091 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:43:56.191076 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ba47c66541162413cfe48e1af724fe4eff1029919812e49259adeec14406946\": container with ID starting with 8ba47c66541162413cfe48e1af724fe4eff1029919812e49259adeec14406946 not found: ID does not exist" containerID="8ba47c66541162413cfe48e1af724fe4eff1029919812e49259adeec14406946" Jun 15 01:43:56.191135 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.191095 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ba47c66541162413cfe48e1af724fe4eff1029919812e49259adeec14406946"} err="failed to get container status \"8ba47c66541162413cfe48e1af724fe4eff1029919812e49259adeec14406946\": rpc error: code = NotFound desc = could not find container \"8ba47c66541162413cfe48e1af724fe4eff1029919812e49259adeec14406946\": container with ID starting with 8ba47c66541162413cfe48e1af724fe4eff1029919812e49259adeec14406946 not found: ID does not exist" Jun 15 01:43:56.191135 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.191106 2576 scope.go:117] "RemoveContainer" containerID="1bbe54d68e7a6ad46bd3ac96cb15d77d3743383eec13bc8ed8f98ef5b66d7170" Jun 15 01:43:56.191294 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.191276 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bbe54d68e7a6ad46bd3ac96cb15d77d3743383eec13bc8ed8f98ef5b66d7170"} err="failed to get container status \"1bbe54d68e7a6ad46bd3ac96cb15d77d3743383eec13bc8ed8f98ef5b66d7170\": rpc error: code = NotFound desc = could not find container \"1bbe54d68e7a6ad46bd3ac96cb15d77d3743383eec13bc8ed8f98ef5b66d7170\": container with ID starting with 1bbe54d68e7a6ad46bd3ac96cb15d77d3743383eec13bc8ed8f98ef5b66d7170 not found: ID does not exist" Jun 15 01:43:56.191372 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.191294 2576 scope.go:117] "RemoveContainer" containerID="ecaa2c9c21685738b392037fb75717afb6e04ff8451e31f4f7a1d7493014bc67" Jun 15 01:43:56.191557 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.191536 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecaa2c9c21685738b392037fb75717afb6e04ff8451e31f4f7a1d7493014bc67"} err="failed to get container status \"ecaa2c9c21685738b392037fb75717afb6e04ff8451e31f4f7a1d7493014bc67\": rpc error: code = NotFound desc = could not find container \"ecaa2c9c21685738b392037fb75717afb6e04ff8451e31f4f7a1d7493014bc67\": container with ID starting with ecaa2c9c21685738b392037fb75717afb6e04ff8451e31f4f7a1d7493014bc67 not found: ID does not exist" Jun 15 01:43:56.191615 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.191557 2576 scope.go:117] "RemoveContainer" containerID="c0e64176411535047b1f2f7c93d5b4325e8ddab1f65498a292aefa7a1a3413c5" Jun 15 01:43:56.191761 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.191741 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0e64176411535047b1f2f7c93d5b4325e8ddab1f65498a292aefa7a1a3413c5"} err="failed to get container status \"c0e64176411535047b1f2f7c93d5b4325e8ddab1f65498a292aefa7a1a3413c5\": rpc error: code = NotFound desc = could not find container \"c0e64176411535047b1f2f7c93d5b4325e8ddab1f65498a292aefa7a1a3413c5\": container with ID starting with c0e64176411535047b1f2f7c93d5b4325e8ddab1f65498a292aefa7a1a3413c5 not found: ID does not exist" Jun 15 01:43:56.191761 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.191760 2576 scope.go:117] "RemoveContainer" containerID="5c407fc02f68091c8f455cb5bae7d97af7610d511b00eb8823cbb03d250ddb6a" Jun 15 01:43:56.191930 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.191913 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c407fc02f68091c8f455cb5bae7d97af7610d511b00eb8823cbb03d250ddb6a"} err="failed to get container status \"5c407fc02f68091c8f455cb5bae7d97af7610d511b00eb8823cbb03d250ddb6a\": rpc error: code = NotFound desc = could not find container \"5c407fc02f68091c8f455cb5bae7d97af7610d511b00eb8823cbb03d250ddb6a\": container with ID starting with 5c407fc02f68091c8f455cb5bae7d97af7610d511b00eb8823cbb03d250ddb6a not found: ID does not exist" Jun 15 01:43:56.191970 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.191930 2576 scope.go:117] "RemoveContainer" containerID="017da1827f6f2a31e47d8c488e514999b7e7c84cedefb6678a6e1ebbed65fd96" Jun 15 01:43:56.192167 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.192149 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"017da1827f6f2a31e47d8c488e514999b7e7c84cedefb6678a6e1ebbed65fd96"} err="failed to get container status \"017da1827f6f2a31e47d8c488e514999b7e7c84cedefb6678a6e1ebbed65fd96\": rpc error: code = NotFound desc = could not find container \"017da1827f6f2a31e47d8c488e514999b7e7c84cedefb6678a6e1ebbed65fd96\": container with ID starting with 017da1827f6f2a31e47d8c488e514999b7e7c84cedefb6678a6e1ebbed65fd96 not found: ID does not exist" Jun 15 01:43:56.192217 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.192167 2576 scope.go:117] "RemoveContainer" containerID="3d0dc3581193c0551546cafc1fc4670bbfc352c2dbad78121d048f7efa5731a2" Jun 15 01:43:56.192409 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.192332 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d0dc3581193c0551546cafc1fc4670bbfc352c2dbad78121d048f7efa5731a2"} err="failed to get container status \"3d0dc3581193c0551546cafc1fc4670bbfc352c2dbad78121d048f7efa5731a2\": rpc error: code = NotFound desc = could not find container \"3d0dc3581193c0551546cafc1fc4670bbfc352c2dbad78121d048f7efa5731a2\": container with ID starting with 3d0dc3581193c0551546cafc1fc4670bbfc352c2dbad78121d048f7efa5731a2 not found: ID does not exist" Jun 15 01:43:56.192457 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.192411 2576 scope.go:117] "RemoveContainer" containerID="8ba47c66541162413cfe48e1af724fe4eff1029919812e49259adeec14406946" Jun 15 01:43:56.192619 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.192604 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ba47c66541162413cfe48e1af724fe4eff1029919812e49259adeec14406946"} err="failed to get container status \"8ba47c66541162413cfe48e1af724fe4eff1029919812e49259adeec14406946\": rpc error: code = NotFound desc = could not find container \"8ba47c66541162413cfe48e1af724fe4eff1029919812e49259adeec14406946\": container with ID starting with 8ba47c66541162413cfe48e1af724fe4eff1029919812e49259adeec14406946 not found: ID does not exist" Jun 15 01:43:56.220647 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.220606 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " Jun 15 01:43:56.220804 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.220663 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-kube-rbac-proxy\") pod \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " Jun 15 01:43:56.220804 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.220694 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbwzr\" (UniqueName: \"kubernetes.io/projected/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-kube-api-access-nbwzr\") pod \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " Jun 15 01:43:56.220804 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.220717 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " Jun 15 01:43:56.220804 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.220740 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-config-volume\") pod \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " Jun 15 01:43:56.220804 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.220761 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-metrics-client-ca\") pod \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " Jun 15 01:43:56.221035 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.220805 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-alertmanager-trusted-ca-bundle\") pod \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " Jun 15 01:43:56.221035 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.220967 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-alertmanager-main-db\") pod \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " Jun 15 01:43:56.221138 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.221039 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-web-config\") pod \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " Jun 15 01:43:56.221138 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.221068 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-main-tls\") pod \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " Jun 15 01:43:56.221138 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.221114 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-config-out\") pod \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " Jun 15 01:43:56.221258 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.221143 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-tls-assets\") pod \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " Jun 15 01:43:56.221258 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.221167 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-cluster-tls-config\") pod \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\" (UID: \"22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0\") " Jun 15 01:43:56.221258 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.221203 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" (UID: "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:43:56.221258 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.221238 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" (UID: "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:43:56.221515 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.221492 2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-metrics-client-ca\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:43:56.221515 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.221517 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:43:56.222878 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.222842 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" (UID: "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:43:56.224222 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.224188 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" (UID: "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:43:56.224308 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.224231 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" (UID: "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:43:56.224308 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.224246 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-kube-api-access-nbwzr" (OuterVolumeSpecName: "kube-api-access-nbwzr") pod "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" (UID: "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0"). InnerVolumeSpecName "kube-api-access-nbwzr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:43:56.224447 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.224429 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" (UID: "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:43:56.224688 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.224659 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" (UID: "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:43:56.224916 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.224898 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-config-out" (OuterVolumeSpecName: "config-out") pod "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" (UID: "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:43:56.224985 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.224914 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" (UID: "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:43:56.225088 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.225025 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-config-volume" (OuterVolumeSpecName: "config-volume") pod "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" (UID: "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:43:56.228487 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.228460 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" (UID: "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:43:56.235085 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.235065 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-web-config" (OuterVolumeSpecName: "web-config") pod "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" (UID: "22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:43:56.322146 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.322100 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-alertmanager-main-db\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:43:56.322146 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.322143 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-web-config\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:43:56.322146 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.322153 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-main-tls\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:43:56.322146 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.322161 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-config-out\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:43:56.322416 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.322170 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-tls-assets\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:43:56.322416 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.322177 2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-cluster-tls-config\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:43:56.322416 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.322186 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:43:56.322416 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.322197 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:43:56.322416 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.322205 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbwzr\" (UniqueName: \"kubernetes.io/projected/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-kube-api-access-nbwzr\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:43:56.322416 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.322213 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:43:56.322416 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.322221 2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0-config-volume\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:43:56.464921 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.464864 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 01:43:56.469847 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.469815 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 01:43:56.490568 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.490537 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 01:43:56.490824 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.490812 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="alertmanager" Jun 15 01:43:56.490876 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.490825 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="alertmanager" Jun 15 01:43:56.490876 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.490834 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="config-reloader" Jun 15 01:43:56.490876 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.490839 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="config-reloader" Jun 15 01:43:56.490876 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.490845 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="kube-rbac-proxy-web" Jun 15 01:43:56.490876 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.490850 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="kube-rbac-proxy-web" Jun 15 01:43:56.490876 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.490858 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0afab3f1-b4d1-4686-8e4c-1f9c0faf644b" containerName="registry" Jun 15 01:43:56.490876 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.490863 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0afab3f1-b4d1-4686-8e4c-1f9c0faf644b" containerName="registry" Jun 15 01:43:56.490876 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.490872 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="init-config-reloader" Jun 15 01:43:56.490876 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.490877 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="init-config-reloader" Jun 15 01:43:56.491126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.490887 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="prom-label-proxy" Jun 15 01:43:56.491126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.490892 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="prom-label-proxy" Jun 15 01:43:56.491126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.490900 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="kube-rbac-proxy" Jun 15 01:43:56.491126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.490906 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="kube-rbac-proxy" Jun 15 01:43:56.491126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.490914 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="kube-rbac-proxy-metric" Jun 15 01:43:56.491126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.490921 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="kube-rbac-proxy-metric" Jun 15 01:43:56.491126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.490969 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="config-reloader" Jun 15 01:43:56.491126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.490977 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="alertmanager" Jun 15 01:43:56.491126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.490983 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="kube-rbac-proxy-web" Jun 15 01:43:56.491126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.490988 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="kube-rbac-proxy-metric" Jun 15 01:43:56.491126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.490994 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="kube-rbac-proxy" Jun 15 01:43:56.491126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.490999 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0afab3f1-b4d1-4686-8e4c-1f9c0faf644b" containerName="registry" Jun 15 01:43:56.491126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.491005 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" containerName="prom-label-proxy" Jun 15 01:43:56.496052 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.496031 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.498453 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.498432 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 15 01:43:56.498566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.498547 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 15 01:43:56.498566 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.498559 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 15 01:43:56.498812 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.498655 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 15 01:43:56.498812 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.498824 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 15 01:43:56.498969 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.498839 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 15 01:43:56.498969 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.498865 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 15 01:43:56.498969 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.498894 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 15 01:43:56.498969 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.498932 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kdjc4\"" Jun 15 01:43:56.504635 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.504614 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 15 01:43:56.508250 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.508228 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 01:43:56.625090 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.625058 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0437bcd7-9567-49a6-a830-9563646b9351-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.625269 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.625100 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0437bcd7-9567-49a6-a830-9563646b9351-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.625269 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.625123 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0437bcd7-9567-49a6-a830-9563646b9351-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.625269 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.625180 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0437bcd7-9567-49a6-a830-9563646b9351-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.625269 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.625228 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0437bcd7-9567-49a6-a830-9563646b9351-config-out\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.625269 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.625251 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0437bcd7-9567-49a6-a830-9563646b9351-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.625487 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.625290 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5txc2\" (UniqueName: \"kubernetes.io/projected/0437bcd7-9567-49a6-a830-9563646b9351-kube-api-access-5txc2\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.625487 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.625315 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0437bcd7-9567-49a6-a830-9563646b9351-web-config\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.625487 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.625331 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0437bcd7-9567-49a6-a830-9563646b9351-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.625487 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.625374 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0437bcd7-9567-49a6-a830-9563646b9351-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.625487 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.625400 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0437bcd7-9567-49a6-a830-9563646b9351-config-volume\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.625487 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.625416 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0437bcd7-9567-49a6-a830-9563646b9351-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.625487 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.625430 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0437bcd7-9567-49a6-a830-9563646b9351-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.726726 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.726626 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0437bcd7-9567-49a6-a830-9563646b9351-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.726726 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.726679 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0437bcd7-9567-49a6-a830-9563646b9351-config-out\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.726726 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.726709 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0437bcd7-9567-49a6-a830-9563646b9351-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.726992 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.726756 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5txc2\" (UniqueName: \"kubernetes.io/projected/0437bcd7-9567-49a6-a830-9563646b9351-kube-api-access-5txc2\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.726992 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.726889 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0437bcd7-9567-49a6-a830-9563646b9351-web-config\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.726992 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.726933 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0437bcd7-9567-49a6-a830-9563646b9351-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.726992 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.726959 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0437bcd7-9567-49a6-a830-9563646b9351-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.726992 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.726988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0437bcd7-9567-49a6-a830-9563646b9351-config-volume\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.727221 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.727021 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0437bcd7-9567-49a6-a830-9563646b9351-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.727853 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.727389 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0437bcd7-9567-49a6-a830-9563646b9351-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.727853 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.727438 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0437bcd7-9567-49a6-a830-9563646b9351-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.727853 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.727496 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0437bcd7-9567-49a6-a830-9563646b9351-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.727853 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.727534 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0437bcd7-9567-49a6-a830-9563646b9351-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.729548 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.728610 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0437bcd7-9567-49a6-a830-9563646b9351-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.729548 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.729210 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0437bcd7-9567-49a6-a830-9563646b9351-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.729873 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.729854 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0437bcd7-9567-49a6-a830-9563646b9351-config-volume\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.729983 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.729961 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0437bcd7-9567-49a6-a830-9563646b9351-config-out\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.730054 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.729985 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0437bcd7-9567-49a6-a830-9563646b9351-web-config\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.730054 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.729966 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0437bcd7-9567-49a6-a830-9563646b9351-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.730054 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.730014 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0437bcd7-9567-49a6-a830-9563646b9351-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.730185 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.730127 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0437bcd7-9567-49a6-a830-9563646b9351-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.730422 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.730406 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0437bcd7-9567-49a6-a830-9563646b9351-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.730486 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.730471 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0437bcd7-9567-49a6-a830-9563646b9351-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.731221 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.731201 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0437bcd7-9567-49a6-a830-9563646b9351-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.731828 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.731811 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0437bcd7-9567-49a6-a830-9563646b9351-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.735675 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.735656 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5txc2\" (UniqueName: \"kubernetes.io/projected/0437bcd7-9567-49a6-a830-9563646b9351-kube-api-access-5txc2\") pod \"alertmanager-main-0\" (UID: \"0437bcd7-9567-49a6-a830-9563646b9351\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.806240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.806203 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:43:56.943804 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:56.943768 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 01:43:56.944891 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:43:56.944867 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0437bcd7_9567_49a6_a830_9563646b9351.slice/crio-5837994ea2dcc66afcf9a9e0debfa2087b7a80aa13cef7d5bd044cb9015dd3fa WatchSource:0}: Error finding container 5837994ea2dcc66afcf9a9e0debfa2087b7a80aa13cef7d5bd044cb9015dd3fa: Status 404 returned error can't find the container with id 5837994ea2dcc66afcf9a9e0debfa2087b7a80aa13cef7d5bd044cb9015dd3fa Jun 15 01:43:57.145523 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:57.145483 2576 generic.go:356] "Generic (PLEG): container finished" podID="0437bcd7-9567-49a6-a830-9563646b9351" containerID="97ab09d8c3d712584027b4291b5f5109f89ee7083be12d155c67cb7346fa9a59" exitCode=0 Jun 15 01:43:57.145884 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:57.145537 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0437bcd7-9567-49a6-a830-9563646b9351","Type":"ContainerDied","Data":"97ab09d8c3d712584027b4291b5f5109f89ee7083be12d155c67cb7346fa9a59"} Jun 15 01:43:57.145884 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:57.145607 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0437bcd7-9567-49a6-a830-9563646b9351","Type":"ContainerStarted","Data":"5837994ea2dcc66afcf9a9e0debfa2087b7a80aa13cef7d5bd044cb9015dd3fa"} Jun 15 01:43:58.050292 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:58.050258 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0" path="/var/lib/kubelet/pods/22fa2d8f-7d03-410a-9ffa-fc84e9bc86b0/volumes" Jun 15 01:43:58.152447 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:58.152356 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0437bcd7-9567-49a6-a830-9563646b9351","Type":"ContainerStarted","Data":"4b736a5dd7dc0fafdf18a0985a91c4a3c966960da5aed93e815522aa39a0ab3f"} Jun 15 01:43:58.152447 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:58.152427 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0437bcd7-9567-49a6-a830-9563646b9351","Type":"ContainerStarted","Data":"a6d32f4ed202f261c19a33728e57512219ddfe61e6c34eef683e681064a178f8"} Jun 15 01:43:58.152844 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:58.152459 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0437bcd7-9567-49a6-a830-9563646b9351","Type":"ContainerStarted","Data":"4c735971c8ce61514daafc014731bb13034ba15ad47bbc34ac96becc21fe5425"} Jun 15 01:43:58.152844 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:58.152484 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0437bcd7-9567-49a6-a830-9563646b9351","Type":"ContainerStarted","Data":"b10ca4ddcefa17e73fc5bf084eee62ef279b893ac06a54018cb441ac3d54c832"} Jun 15 01:43:58.152844 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:58.152522 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0437bcd7-9567-49a6-a830-9563646b9351","Type":"ContainerStarted","Data":"b6d2201b82fc8bacc917708c6dea4cd583e014b79797c40f52b0efc2b9d0a415"} Jun 15 01:43:58.152844 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:58.152545 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0437bcd7-9567-49a6-a830-9563646b9351","Type":"ContainerStarted","Data":"dcac4bb2f40031c1307952681440aa9007293c945743ecdf4c3c16759c645476"} Jun 15 01:43:58.178159 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:43:58.178106 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.16201355 podStartE2EDuration="2.178085013s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.071463ms" isStatefulPod=false podCreationTimestamp="2026-06-15 01:43:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:43:58.175943632 +0000 UTC m=+316.534484066" watchObservedRunningTime="2026-06-15 01:43:58.178085013 +0000 UTC m=+316.536625408" Jun 15 01:47:17.702317 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:17.702283 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn"] Jun 15 01:47:17.705722 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:17.705704 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn" Jun 15 01:47:17.708709 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:17.708683 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 01:47:17.708865 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:17.708848 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 01:47:17.709871 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:17.709858 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jcb4x\"" Jun 15 01:47:17.727117 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:17.727094 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn"] Jun 15 01:47:17.798327 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:17.798291 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvbpd\" (UniqueName: \"kubernetes.io/projected/127199e3-37f1-4f8e-bdcf-50c8ec202699-kube-api-access-lvbpd\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn\" (UID: \"127199e3-37f1-4f8e-bdcf-50c8ec202699\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn" Jun 15 01:47:17.798530 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:17.798330 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/127199e3-37f1-4f8e-bdcf-50c8ec202699-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn\" (UID: \"127199e3-37f1-4f8e-bdcf-50c8ec202699\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn" Jun 15 01:47:17.798530 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:17.798435 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/127199e3-37f1-4f8e-bdcf-50c8ec202699-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn\" (UID: \"127199e3-37f1-4f8e-bdcf-50c8ec202699\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn" Jun 15 01:47:17.899441 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:17.899399 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/127199e3-37f1-4f8e-bdcf-50c8ec202699-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn\" (UID: \"127199e3-37f1-4f8e-bdcf-50c8ec202699\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn" Jun 15 01:47:17.899640 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:17.899472 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvbpd\" (UniqueName: \"kubernetes.io/projected/127199e3-37f1-4f8e-bdcf-50c8ec202699-kube-api-access-lvbpd\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn\" (UID: \"127199e3-37f1-4f8e-bdcf-50c8ec202699\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn" Jun 15 01:47:17.899640 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:17.899497 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/127199e3-37f1-4f8e-bdcf-50c8ec202699-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn\" (UID: \"127199e3-37f1-4f8e-bdcf-50c8ec202699\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn" Jun 15 01:47:17.899787 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:17.899764 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/127199e3-37f1-4f8e-bdcf-50c8ec202699-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn\" (UID: \"127199e3-37f1-4f8e-bdcf-50c8ec202699\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn" Jun 15 01:47:17.899848 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:17.899833 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/127199e3-37f1-4f8e-bdcf-50c8ec202699-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn\" (UID: \"127199e3-37f1-4f8e-bdcf-50c8ec202699\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn" Jun 15 01:47:17.908740 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:17.908720 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvbpd\" (UniqueName: \"kubernetes.io/projected/127199e3-37f1-4f8e-bdcf-50c8ec202699-kube-api-access-lvbpd\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn\" (UID: \"127199e3-37f1-4f8e-bdcf-50c8ec202699\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn" Jun 15 01:47:18.014645 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:18.014551 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn" Jun 15 01:47:18.143422 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:18.143381 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn"] Jun 15 01:47:18.146129 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:47:18.146102 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod127199e3_37f1_4f8e_bdcf_50c8ec202699.slice/crio-42a106ca18bf98fa4650e4bc8cd62195e62c3b4b887dc25d32b97246a93e176d WatchSource:0}: Error finding container 42a106ca18bf98fa4650e4bc8cd62195e62c3b4b887dc25d32b97246a93e176d: Status 404 returned error can't find the container with id 42a106ca18bf98fa4650e4bc8cd62195e62c3b4b887dc25d32b97246a93e176d Jun 15 01:47:18.148086 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:18.148072 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 01:47:18.929107 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:18.929066 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn" event={"ID":"127199e3-37f1-4f8e-bdcf-50c8ec202699","Type":"ContainerStarted","Data":"42a106ca18bf98fa4650e4bc8cd62195e62c3b4b887dc25d32b97246a93e176d"} Jun 15 01:47:25.960395 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:25.960358 2576 generic.go:356] "Generic (PLEG): container finished" podID="127199e3-37f1-4f8e-bdcf-50c8ec202699" containerID="2b67c50a0fae9572e90043115b4e4582769a73abcc68036af3973778de82d98d" exitCode=0 Jun 15 01:47:25.960776 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:25.960413 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn" event={"ID":"127199e3-37f1-4f8e-bdcf-50c8ec202699","Type":"ContainerDied","Data":"2b67c50a0fae9572e90043115b4e4582769a73abcc68036af3973778de82d98d"} Jun 15 01:47:28.974526 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:28.974491 2576 generic.go:356] "Generic (PLEG): container finished" podID="127199e3-37f1-4f8e-bdcf-50c8ec202699" containerID="d5ad102907d3709a4f3eb41e9d13577bf143d3e472fd3eb72af638c2028268da" exitCode=0 Jun 15 01:47:28.974897 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:28.974535 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn" event={"ID":"127199e3-37f1-4f8e-bdcf-50c8ec202699","Type":"ContainerDied","Data":"d5ad102907d3709a4f3eb41e9d13577bf143d3e472fd3eb72af638c2028268da"} Jun 15 01:47:36.006736 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:36.006703 2576 generic.go:356] "Generic (PLEG): container finished" podID="127199e3-37f1-4f8e-bdcf-50c8ec202699" containerID="7fa0f50ce75bb0bcb469677c2a550c5da4c4610070e43521209a50aebe5bd953" exitCode=0 Jun 15 01:47:36.007117 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:36.006794 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn" event={"ID":"127199e3-37f1-4f8e-bdcf-50c8ec202699","Type":"ContainerDied","Data":"7fa0f50ce75bb0bcb469677c2a550c5da4c4610070e43521209a50aebe5bd953"} Jun 15 01:47:37.129279 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:37.129253 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn" Jun 15 01:47:37.166200 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:37.166172 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvbpd\" (UniqueName: \"kubernetes.io/projected/127199e3-37f1-4f8e-bdcf-50c8ec202699-kube-api-access-lvbpd\") pod \"127199e3-37f1-4f8e-bdcf-50c8ec202699\" (UID: \"127199e3-37f1-4f8e-bdcf-50c8ec202699\") " Jun 15 01:47:37.166363 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:37.166225 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/127199e3-37f1-4f8e-bdcf-50c8ec202699-bundle\") pod \"127199e3-37f1-4f8e-bdcf-50c8ec202699\" (UID: \"127199e3-37f1-4f8e-bdcf-50c8ec202699\") " Jun 15 01:47:37.166363 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:37.166304 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/127199e3-37f1-4f8e-bdcf-50c8ec202699-util\") pod \"127199e3-37f1-4f8e-bdcf-50c8ec202699\" (UID: \"127199e3-37f1-4f8e-bdcf-50c8ec202699\") " Jun 15 01:47:37.167065 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:37.167039 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/127199e3-37f1-4f8e-bdcf-50c8ec202699-bundle" (OuterVolumeSpecName: "bundle") pod "127199e3-37f1-4f8e-bdcf-50c8ec202699" (UID: "127199e3-37f1-4f8e-bdcf-50c8ec202699"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:47:37.168735 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:37.168705 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/127199e3-37f1-4f8e-bdcf-50c8ec202699-kube-api-access-lvbpd" (OuterVolumeSpecName: "kube-api-access-lvbpd") pod "127199e3-37f1-4f8e-bdcf-50c8ec202699" (UID: "127199e3-37f1-4f8e-bdcf-50c8ec202699"). InnerVolumeSpecName "kube-api-access-lvbpd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:47:37.171644 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:37.171617 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/127199e3-37f1-4f8e-bdcf-50c8ec202699-util" (OuterVolumeSpecName: "util") pod "127199e3-37f1-4f8e-bdcf-50c8ec202699" (UID: "127199e3-37f1-4f8e-bdcf-50c8ec202699"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:47:37.267392 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:37.267321 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/127199e3-37f1-4f8e-bdcf-50c8ec202699-util\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:47:37.267392 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:37.267362 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvbpd\" (UniqueName: \"kubernetes.io/projected/127199e3-37f1-4f8e-bdcf-50c8ec202699-kube-api-access-lvbpd\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:47:37.267392 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:37.267372 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/127199e3-37f1-4f8e-bdcf-50c8ec202699-bundle\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:47:38.015472 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:38.015432 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn" event={"ID":"127199e3-37f1-4f8e-bdcf-50c8ec202699","Type":"ContainerDied","Data":"42a106ca18bf98fa4650e4bc8cd62195e62c3b4b887dc25d32b97246a93e176d"} Jun 15 01:47:38.015635 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:38.015479 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcwgrn" Jun 15 01:47:38.015635 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:38.015489 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42a106ca18bf98fa4650e4bc8cd62195e62c3b4b887dc25d32b97246a93e176d" Jun 15 01:47:51.101170 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:51.101134 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf"] Jun 15 01:47:51.101592 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:51.101449 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="127199e3-37f1-4f8e-bdcf-50c8ec202699" containerName="extract" Jun 15 01:47:51.101592 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:51.101462 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="127199e3-37f1-4f8e-bdcf-50c8ec202699" containerName="extract" Jun 15 01:47:51.101592 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:51.101476 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="127199e3-37f1-4f8e-bdcf-50c8ec202699" containerName="pull" Jun 15 01:47:51.101592 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:51.101482 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="127199e3-37f1-4f8e-bdcf-50c8ec202699" containerName="pull" Jun 15 01:47:51.101592 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:51.101492 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="127199e3-37f1-4f8e-bdcf-50c8ec202699" containerName="util" Jun 15 01:47:51.101592 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:51.101497 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="127199e3-37f1-4f8e-bdcf-50c8ec202699" containerName="util" Jun 15 01:47:51.101592 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:51.101580 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="127199e3-37f1-4f8e-bdcf-50c8ec202699" containerName="extract" Jun 15 01:47:51.105461 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:51.105439 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf" Jun 15 01:47:51.108701 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:51.108676 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 01:47:51.108862 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:51.108748 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jcb4x\"" Jun 15 01:47:51.109788 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:51.109773 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 01:47:51.130833 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:51.130805 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf"] Jun 15 01:47:51.175907 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:51.175876 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb2kj\" (UniqueName: \"kubernetes.io/projected/45993346-ec95-48c2-aadc-368f846ac6e6-kube-api-access-kb2kj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf\" (UID: \"45993346-ec95-48c2-aadc-368f846ac6e6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf" Jun 15 01:47:51.176073 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:51.175926 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45993346-ec95-48c2-aadc-368f846ac6e6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf\" (UID: \"45993346-ec95-48c2-aadc-368f846ac6e6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf" Jun 15 01:47:51.176073 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:51.176033 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45993346-ec95-48c2-aadc-368f846ac6e6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf\" (UID: \"45993346-ec95-48c2-aadc-368f846ac6e6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf" Jun 15 01:47:51.277210 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:51.277181 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45993346-ec95-48c2-aadc-368f846ac6e6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf\" (UID: \"45993346-ec95-48c2-aadc-368f846ac6e6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf" Jun 15 01:47:51.277364 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:51.277263 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45993346-ec95-48c2-aadc-368f846ac6e6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf\" (UID: \"45993346-ec95-48c2-aadc-368f846ac6e6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf" Jun 15 01:47:51.277364 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:51.277290 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb2kj\" (UniqueName: \"kubernetes.io/projected/45993346-ec95-48c2-aadc-368f846ac6e6-kube-api-access-kb2kj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf\" (UID: \"45993346-ec95-48c2-aadc-368f846ac6e6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf" Jun 15 01:47:51.277652 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:51.277631 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45993346-ec95-48c2-aadc-368f846ac6e6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf\" (UID: \"45993346-ec95-48c2-aadc-368f846ac6e6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf" Jun 15 01:47:51.277652 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:51.277643 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45993346-ec95-48c2-aadc-368f846ac6e6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf\" (UID: \"45993346-ec95-48c2-aadc-368f846ac6e6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf" Jun 15 01:47:51.307905 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:51.307879 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb2kj\" (UniqueName: \"kubernetes.io/projected/45993346-ec95-48c2-aadc-368f846ac6e6-kube-api-access-kb2kj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf\" (UID: \"45993346-ec95-48c2-aadc-368f846ac6e6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf" Jun 15 01:47:51.414808 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:51.414770 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf" Jun 15 01:47:51.559991 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:51.559966 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf"] Jun 15 01:47:51.561776 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:47:51.561749 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45993346_ec95_48c2_aadc_368f846ac6e6.slice/crio-e0a240a836f13fe75658018e4b6a44c6761e0365d7d57b0f3a9c4edb3a02f547 WatchSource:0}: Error finding container e0a240a836f13fe75658018e4b6a44c6761e0365d7d57b0f3a9c4edb3a02f547: Status 404 returned error can't find the container with id e0a240a836f13fe75658018e4b6a44c6761e0365d7d57b0f3a9c4edb3a02f547 Jun 15 01:47:52.074447 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:52.074411 2576 generic.go:356] "Generic (PLEG): container finished" podID="45993346-ec95-48c2-aadc-368f846ac6e6" containerID="03c7f7fd47e902bb10f739d0b92742daa9d3c2ebefc7515c36dc6d95986705b4" exitCode=0 Jun 15 01:47:52.074630 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:52.074495 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf" event={"ID":"45993346-ec95-48c2-aadc-368f846ac6e6","Type":"ContainerDied","Data":"03c7f7fd47e902bb10f739d0b92742daa9d3c2ebefc7515c36dc6d95986705b4"} Jun 15 01:47:52.074630 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:52.074544 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf" event={"ID":"45993346-ec95-48c2-aadc-368f846ac6e6","Type":"ContainerStarted","Data":"e0a240a836f13fe75658018e4b6a44c6761e0365d7d57b0f3a9c4edb3a02f547"} Jun 15 01:47:52.873789 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:52.873752 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-fphxs"] Jun 15 01:47:52.875650 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:52.875633 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-fphxs" Jun 15 01:47:52.878799 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:52.878783 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 15 01:47:52.879795 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:52.879776 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-cb2ll\"" Jun 15 01:47:52.879795 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:52.879794 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 15 01:47:52.888476 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:52.888456 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-fphxs"] Jun 15 01:47:52.992802 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:52.992741 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg45d\" (UniqueName: \"kubernetes.io/projected/c484d2b6-f149-4424-b87e-9d4c6060edc2-kube-api-access-lg45d\") pod \"cert-manager-webhook-7dc76cbb94-fphxs\" (UID: \"c484d2b6-f149-4424-b87e-9d4c6060edc2\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-fphxs" Jun 15 01:47:52.992962 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:52.992824 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c484d2b6-f149-4424-b87e-9d4c6060edc2-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-fphxs\" (UID: \"c484d2b6-f149-4424-b87e-9d4c6060edc2\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-fphxs" Jun 15 01:47:53.093736 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:53.093691 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg45d\" (UniqueName: \"kubernetes.io/projected/c484d2b6-f149-4424-b87e-9d4c6060edc2-kube-api-access-lg45d\") pod \"cert-manager-webhook-7dc76cbb94-fphxs\" (UID: \"c484d2b6-f149-4424-b87e-9d4c6060edc2\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-fphxs" Jun 15 01:47:53.093924 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:53.093769 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c484d2b6-f149-4424-b87e-9d4c6060edc2-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-fphxs\" (UID: \"c484d2b6-f149-4424-b87e-9d4c6060edc2\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-fphxs" Jun 15 01:47:53.102662 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:53.102628 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c484d2b6-f149-4424-b87e-9d4c6060edc2-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-fphxs\" (UID: \"c484d2b6-f149-4424-b87e-9d4c6060edc2\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-fphxs" Jun 15 01:47:53.102864 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:53.102755 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg45d\" (UniqueName: \"kubernetes.io/projected/c484d2b6-f149-4424-b87e-9d4c6060edc2-kube-api-access-lg45d\") pod \"cert-manager-webhook-7dc76cbb94-fphxs\" (UID: \"c484d2b6-f149-4424-b87e-9d4c6060edc2\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-fphxs" Jun 15 01:47:53.184160 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:53.184081 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-fphxs" Jun 15 01:47:53.326007 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:53.325970 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-fphxs"] Jun 15 01:47:53.328126 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:47:53.328106 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc484d2b6_f149_4424_b87e_9d4c6060edc2.slice/crio-56e5b0cf3ff4572cb875265265a420d99772cec71d984a43f1069bccb9c3cce8 WatchSource:0}: Error finding container 56e5b0cf3ff4572cb875265265a420d99772cec71d984a43f1069bccb9c3cce8: Status 404 returned error can't find the container with id 56e5b0cf3ff4572cb875265265a420d99772cec71d984a43f1069bccb9c3cce8 Jun 15 01:47:54.085669 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:54.085628 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-fphxs" event={"ID":"c484d2b6-f149-4424-b87e-9d4c6060edc2","Type":"ContainerStarted","Data":"56e5b0cf3ff4572cb875265265a420d99772cec71d984a43f1069bccb9c3cce8"} Jun 15 01:47:55.093160 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:55.093129 2576 generic.go:356] "Generic (PLEG): container finished" podID="45993346-ec95-48c2-aadc-368f846ac6e6" containerID="08d6a4ac97541e5394fcd14a2cf49dc57ccea926ab32f03ece11c1ea09d71c33" exitCode=0 Jun 15 01:47:55.093600 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:55.093169 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf" event={"ID":"45993346-ec95-48c2-aadc-368f846ac6e6","Type":"ContainerDied","Data":"08d6a4ac97541e5394fcd14a2cf49dc57ccea926ab32f03ece11c1ea09d71c33"} Jun 15 01:47:56.099984 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:56.099948 2576 generic.go:356] "Generic (PLEG): container finished" podID="45993346-ec95-48c2-aadc-368f846ac6e6" containerID="3b2c91b7fa337e153b8b61ec83cbc0d072d08d9e6e2d54d32fb95bacd64b0e2e" exitCode=0 Jun 15 01:47:56.100466 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:56.100041 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf" event={"ID":"45993346-ec95-48c2-aadc-368f846ac6e6","Type":"ContainerDied","Data":"3b2c91b7fa337e153b8b61ec83cbc0d072d08d9e6e2d54d32fb95bacd64b0e2e"} Jun 15 01:47:57.105541 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:57.105451 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-fphxs" event={"ID":"c484d2b6-f149-4424-b87e-9d4c6060edc2","Type":"ContainerStarted","Data":"12b756aeb439597cb1c16caff943e637b43719038b68f0e9927d5759921f38a3"} Jun 15 01:47:57.128997 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:57.128949 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-fphxs" podStartSLOduration=1.7834890479999999 podStartE2EDuration="5.128932548s" totalImagesPullingTime="3.3454435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:47:57.127518635 +0000 UTC m=+555.486059036" watchObservedRunningTime="2026-06-15 01:47:57.128932548 +0000 UTC m=+555.487472944" Jun 15 01:47:57.228765 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:57.228744 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf" Jun 15 01:47:57.329762 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:57.329733 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45993346-ec95-48c2-aadc-368f846ac6e6-bundle\") pod \"45993346-ec95-48c2-aadc-368f846ac6e6\" (UID: \"45993346-ec95-48c2-aadc-368f846ac6e6\") " Jun 15 01:47:57.329903 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:57.329782 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kb2kj\" (UniqueName: \"kubernetes.io/projected/45993346-ec95-48c2-aadc-368f846ac6e6-kube-api-access-kb2kj\") pod \"45993346-ec95-48c2-aadc-368f846ac6e6\" (UID: \"45993346-ec95-48c2-aadc-368f846ac6e6\") " Jun 15 01:47:57.329903 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:57.329868 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45993346-ec95-48c2-aadc-368f846ac6e6-util\") pod \"45993346-ec95-48c2-aadc-368f846ac6e6\" (UID: \"45993346-ec95-48c2-aadc-368f846ac6e6\") " Jun 15 01:47:57.330166 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:57.330142 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45993346-ec95-48c2-aadc-368f846ac6e6-bundle" (OuterVolumeSpecName: "bundle") pod "45993346-ec95-48c2-aadc-368f846ac6e6" (UID: "45993346-ec95-48c2-aadc-368f846ac6e6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:47:57.331988 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:57.331963 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45993346-ec95-48c2-aadc-368f846ac6e6-kube-api-access-kb2kj" (OuterVolumeSpecName: "kube-api-access-kb2kj") pod "45993346-ec95-48c2-aadc-368f846ac6e6" (UID: "45993346-ec95-48c2-aadc-368f846ac6e6"). InnerVolumeSpecName "kube-api-access-kb2kj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:47:57.334598 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:57.334574 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45993346-ec95-48c2-aadc-368f846ac6e6-util" (OuterVolumeSpecName: "util") pod "45993346-ec95-48c2-aadc-368f846ac6e6" (UID: "45993346-ec95-48c2-aadc-368f846ac6e6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:47:57.431023 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:57.430995 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45993346-ec95-48c2-aadc-368f846ac6e6-bundle\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:47:57.431023 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:57.431022 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kb2kj\" (UniqueName: \"kubernetes.io/projected/45993346-ec95-48c2-aadc-368f846ac6e6-kube-api-access-kb2kj\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:47:57.431183 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:57.431036 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45993346-ec95-48c2-aadc-368f846ac6e6-util\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:47:58.110846 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:58.110822 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf" Jun 15 01:47:58.111262 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:58.110842 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f898qf" event={"ID":"45993346-ec95-48c2-aadc-368f846ac6e6","Type":"ContainerDied","Data":"e0a240a836f13fe75658018e4b6a44c6761e0365d7d57b0f3a9c4edb3a02f547"} Jun 15 01:47:58.111262 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:58.110883 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e0a240a836f13fe75658018e4b6a44c6761e0365d7d57b0f3a9c4edb3a02f547" Jun 15 01:47:58.111262 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:47:58.111188 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-fphxs" Jun 15 01:48:03.131396 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:03.131362 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-ms2f6"] Jun 15 01:48:03.131774 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:03.131684 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45993346-ec95-48c2-aadc-368f846ac6e6" containerName="util" Jun 15 01:48:03.131774 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:03.131697 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="45993346-ec95-48c2-aadc-368f846ac6e6" containerName="util" Jun 15 01:48:03.131774 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:03.131710 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45993346-ec95-48c2-aadc-368f846ac6e6" containerName="extract" Jun 15 01:48:03.131774 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:03.131715 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="45993346-ec95-48c2-aadc-368f846ac6e6" containerName="extract" Jun 15 01:48:03.131774 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:03.131730 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45993346-ec95-48c2-aadc-368f846ac6e6" containerName="pull" Jun 15 01:48:03.131774 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:03.131735 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="45993346-ec95-48c2-aadc-368f846ac6e6" containerName="pull" Jun 15 01:48:03.131951 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:03.131780 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="45993346-ec95-48c2-aadc-368f846ac6e6" containerName="extract" Jun 15 01:48:03.134662 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:03.134643 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-ms2f6" Jun 15 01:48:03.137103 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:03.137082 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-dmbgt\"" Jun 15 01:48:03.142315 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:03.142295 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-ms2f6"] Jun 15 01:48:03.277636 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:03.277601 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjkgt\" (UniqueName: \"kubernetes.io/projected/2dd89dfb-e41f-4b8d-acf2-703b958f373e-kube-api-access-xjkgt\") pod \"cert-manager-59c77684cc-ms2f6\" (UID: \"2dd89dfb-e41f-4b8d-acf2-703b958f373e\") " pod="cert-manager/cert-manager-59c77684cc-ms2f6" Jun 15 01:48:03.277841 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:03.277656 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2dd89dfb-e41f-4b8d-acf2-703b958f373e-bound-sa-token\") pod \"cert-manager-59c77684cc-ms2f6\" (UID: \"2dd89dfb-e41f-4b8d-acf2-703b958f373e\") " pod="cert-manager/cert-manager-59c77684cc-ms2f6" Jun 15 01:48:03.378522 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:03.378487 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjkgt\" (UniqueName: \"kubernetes.io/projected/2dd89dfb-e41f-4b8d-acf2-703b958f373e-kube-api-access-xjkgt\") pod \"cert-manager-59c77684cc-ms2f6\" (UID: \"2dd89dfb-e41f-4b8d-acf2-703b958f373e\") " pod="cert-manager/cert-manager-59c77684cc-ms2f6" Jun 15 01:48:03.378731 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:03.378549 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2dd89dfb-e41f-4b8d-acf2-703b958f373e-bound-sa-token\") pod \"cert-manager-59c77684cc-ms2f6\" (UID: \"2dd89dfb-e41f-4b8d-acf2-703b958f373e\") " pod="cert-manager/cert-manager-59c77684cc-ms2f6" Jun 15 01:48:03.387452 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:03.387383 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2dd89dfb-e41f-4b8d-acf2-703b958f373e-bound-sa-token\") pod \"cert-manager-59c77684cc-ms2f6\" (UID: \"2dd89dfb-e41f-4b8d-acf2-703b958f373e\") " pod="cert-manager/cert-manager-59c77684cc-ms2f6" Jun 15 01:48:03.387563 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:03.387455 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjkgt\" (UniqueName: \"kubernetes.io/projected/2dd89dfb-e41f-4b8d-acf2-703b958f373e-kube-api-access-xjkgt\") pod \"cert-manager-59c77684cc-ms2f6\" (UID: \"2dd89dfb-e41f-4b8d-acf2-703b958f373e\") " pod="cert-manager/cert-manager-59c77684cc-ms2f6" Jun 15 01:48:03.444118 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:03.444068 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-ms2f6" Jun 15 01:48:03.572888 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:03.572729 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-ms2f6"] Jun 15 01:48:03.575072 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:48:03.575041 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2dd89dfb_e41f_4b8d_acf2_703b958f373e.slice/crio-cba79df082282118f6adae16ceb8d35079c85cc2384bbe7d98033bedfb6eb7a4 WatchSource:0}: Error finding container cba79df082282118f6adae16ceb8d35079c85cc2384bbe7d98033bedfb6eb7a4: Status 404 returned error can't find the container with id cba79df082282118f6adae16ceb8d35079c85cc2384bbe7d98033bedfb6eb7a4 Jun 15 01:48:04.116839 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:04.116807 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-fphxs" Jun 15 01:48:04.135901 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:04.135872 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-ms2f6" event={"ID":"2dd89dfb-e41f-4b8d-acf2-703b958f373e","Type":"ContainerStarted","Data":"5c340992a0989160cc8903ad15b2bc885dd042e941b70fd9c5c1d464059c69af"} Jun 15 01:48:04.136259 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:04.135909 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-ms2f6" event={"ID":"2dd89dfb-e41f-4b8d-acf2-703b958f373e","Type":"ContainerStarted","Data":"cba79df082282118f6adae16ceb8d35079c85cc2384bbe7d98033bedfb6eb7a4"} Jun 15 01:48:04.158865 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:04.158741 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-ms2f6" podStartSLOduration=1.158705885 podStartE2EDuration="1.158705885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:48:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:48:04.158253271 +0000 UTC m=+562.516793671" watchObservedRunningTime="2026-06-15 01:48:04.158705885 +0000 UTC m=+562.517246281" Jun 15 01:48:21.640680 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:21.640640 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk"] Jun 15 01:48:21.646612 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:21.646589 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk" Jun 15 01:48:21.651142 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:21.651096 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jcb4x\"" Jun 15 01:48:21.651142 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:21.651137 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 01:48:21.651399 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:21.651103 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 01:48:21.652798 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:21.652770 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk"] Jun 15 01:48:21.725665 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:21.725639 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c11adbda-36bf-4a5f-b4ff-9071357b3d9f-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk\" (UID: \"c11adbda-36bf-4a5f-b4ff-9071357b3d9f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk" Jun 15 01:48:21.725790 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:21.725723 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mtp9\" (UniqueName: \"kubernetes.io/projected/c11adbda-36bf-4a5f-b4ff-9071357b3d9f-kube-api-access-8mtp9\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk\" (UID: \"c11adbda-36bf-4a5f-b4ff-9071357b3d9f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk" Jun 15 01:48:21.725790 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:21.725764 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c11adbda-36bf-4a5f-b4ff-9071357b3d9f-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk\" (UID: \"c11adbda-36bf-4a5f-b4ff-9071357b3d9f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk" Jun 15 01:48:21.826321 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:21.826294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c11adbda-36bf-4a5f-b4ff-9071357b3d9f-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk\" (UID: \"c11adbda-36bf-4a5f-b4ff-9071357b3d9f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk" Jun 15 01:48:21.826476 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:21.826393 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mtp9\" (UniqueName: \"kubernetes.io/projected/c11adbda-36bf-4a5f-b4ff-9071357b3d9f-kube-api-access-8mtp9\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk\" (UID: \"c11adbda-36bf-4a5f-b4ff-9071357b3d9f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk" Jun 15 01:48:21.826476 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:21.826430 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c11adbda-36bf-4a5f-b4ff-9071357b3d9f-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk\" (UID: \"c11adbda-36bf-4a5f-b4ff-9071357b3d9f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk" Jun 15 01:48:21.826651 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:21.826633 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c11adbda-36bf-4a5f-b4ff-9071357b3d9f-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk\" (UID: \"c11adbda-36bf-4a5f-b4ff-9071357b3d9f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk" Jun 15 01:48:21.826723 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:21.826667 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c11adbda-36bf-4a5f-b4ff-9071357b3d9f-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk\" (UID: \"c11adbda-36bf-4a5f-b4ff-9071357b3d9f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk" Jun 15 01:48:21.835083 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:21.835054 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mtp9\" (UniqueName: \"kubernetes.io/projected/c11adbda-36bf-4a5f-b4ff-9071357b3d9f-kube-api-access-8mtp9\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk\" (UID: \"c11adbda-36bf-4a5f-b4ff-9071357b3d9f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk" Jun 15 01:48:21.957191 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:21.957137 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk" Jun 15 01:48:22.083865 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:22.083838 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk"] Jun 15 01:48:22.085845 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:48:22.085820 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc11adbda_36bf_4a5f_b4ff_9071357b3d9f.slice/crio-a85b5e927cbc24eceedf47d10acc44a0fa566da58bb467f3a2b2f529ec65b7d0 WatchSource:0}: Error finding container a85b5e927cbc24eceedf47d10acc44a0fa566da58bb467f3a2b2f529ec65b7d0: Status 404 returned error can't find the container with id a85b5e927cbc24eceedf47d10acc44a0fa566da58bb467f3a2b2f529ec65b7d0 Jun 15 01:48:22.214052 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:22.214000 2576 generic.go:356] "Generic (PLEG): container finished" podID="c11adbda-36bf-4a5f-b4ff-9071357b3d9f" containerID="e6e79ba55355f7afe601d54a5a7423b80a79db68bbf4ec73d0e2117f66815afb" exitCode=0 Jun 15 01:48:22.214160 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:22.214067 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk" event={"ID":"c11adbda-36bf-4a5f-b4ff-9071357b3d9f","Type":"ContainerDied","Data":"e6e79ba55355f7afe601d54a5a7423b80a79db68bbf4ec73d0e2117f66815afb"} Jun 15 01:48:22.214160 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:22.214107 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk" event={"ID":"c11adbda-36bf-4a5f-b4ff-9071357b3d9f","Type":"ContainerStarted","Data":"a85b5e927cbc24eceedf47d10acc44a0fa566da58bb467f3a2b2f529ec65b7d0"} Jun 15 01:48:23.219896 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:23.219858 2576 generic.go:356] "Generic (PLEG): container finished" podID="c11adbda-36bf-4a5f-b4ff-9071357b3d9f" containerID="ac8c1f70b95f70d668651dff8e24fd50e20cafa2654871959262444f3c3e87b4" exitCode=0 Jun 15 01:48:23.220263 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:23.219933 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk" event={"ID":"c11adbda-36bf-4a5f-b4ff-9071357b3d9f","Type":"ContainerDied","Data":"ac8c1f70b95f70d668651dff8e24fd50e20cafa2654871959262444f3c3e87b4"} Jun 15 01:48:24.226199 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:24.226164 2576 generic.go:356] "Generic (PLEG): container finished" podID="c11adbda-36bf-4a5f-b4ff-9071357b3d9f" containerID="047ee101be1d3af0ca7081ed7f024912b4c1412d8c40b55cd631fd83c8d1cc6c" exitCode=0 Jun 15 01:48:24.226664 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:24.226245 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk" event={"ID":"c11adbda-36bf-4a5f-b4ff-9071357b3d9f","Type":"ContainerDied","Data":"047ee101be1d3af0ca7081ed7f024912b4c1412d8c40b55cd631fd83c8d1cc6c"} Jun 15 01:48:25.364562 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:25.364535 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk" Jun 15 01:48:25.465678 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:25.465640 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c11adbda-36bf-4a5f-b4ff-9071357b3d9f-bundle\") pod \"c11adbda-36bf-4a5f-b4ff-9071357b3d9f\" (UID: \"c11adbda-36bf-4a5f-b4ff-9071357b3d9f\") " Jun 15 01:48:25.465678 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:25.465683 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c11adbda-36bf-4a5f-b4ff-9071357b3d9f-util\") pod \"c11adbda-36bf-4a5f-b4ff-9071357b3d9f\" (UID: \"c11adbda-36bf-4a5f-b4ff-9071357b3d9f\") " Jun 15 01:48:25.465867 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:25.465703 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mtp9\" (UniqueName: \"kubernetes.io/projected/c11adbda-36bf-4a5f-b4ff-9071357b3d9f-kube-api-access-8mtp9\") pod \"c11adbda-36bf-4a5f-b4ff-9071357b3d9f\" (UID: \"c11adbda-36bf-4a5f-b4ff-9071357b3d9f\") " Jun 15 01:48:25.466376 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:25.466322 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c11adbda-36bf-4a5f-b4ff-9071357b3d9f-bundle" (OuterVolumeSpecName: "bundle") pod "c11adbda-36bf-4a5f-b4ff-9071357b3d9f" (UID: "c11adbda-36bf-4a5f-b4ff-9071357b3d9f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:48:25.467858 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:25.467834 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c11adbda-36bf-4a5f-b4ff-9071357b3d9f-kube-api-access-8mtp9" (OuterVolumeSpecName: "kube-api-access-8mtp9") pod "c11adbda-36bf-4a5f-b4ff-9071357b3d9f" (UID: "c11adbda-36bf-4a5f-b4ff-9071357b3d9f"). InnerVolumeSpecName "kube-api-access-8mtp9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:48:25.471106 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:25.471084 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c11adbda-36bf-4a5f-b4ff-9071357b3d9f-util" (OuterVolumeSpecName: "util") pod "c11adbda-36bf-4a5f-b4ff-9071357b3d9f" (UID: "c11adbda-36bf-4a5f-b4ff-9071357b3d9f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:48:25.566445 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:25.566357 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c11adbda-36bf-4a5f-b4ff-9071357b3d9f-bundle\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:48:25.566445 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:25.566386 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c11adbda-36bf-4a5f-b4ff-9071357b3d9f-util\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:48:25.566445 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:25.566395 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mtp9\" (UniqueName: \"kubernetes.io/projected/c11adbda-36bf-4a5f-b4ff-9071357b3d9f-kube-api-access-8mtp9\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:48:26.236948 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:26.236915 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk" Jun 15 01:48:26.236948 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:26.236928 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdds4hk" event={"ID":"c11adbda-36bf-4a5f-b4ff-9071357b3d9f","Type":"ContainerDied","Data":"a85b5e927cbc24eceedf47d10acc44a0fa566da58bb467f3a2b2f529ec65b7d0"} Jun 15 01:48:26.237164 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:26.236979 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a85b5e927cbc24eceedf47d10acc44a0fa566da58bb467f3a2b2f529ec65b7d0" Jun 15 01:48:28.417136 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.417101 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cddd79ffb-ql59t"] Jun 15 01:48:28.417616 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.417564 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c11adbda-36bf-4a5f-b4ff-9071357b3d9f" containerName="extract" Jun 15 01:48:28.417616 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.417582 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c11adbda-36bf-4a5f-b4ff-9071357b3d9f" containerName="extract" Jun 15 01:48:28.417616 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.417602 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c11adbda-36bf-4a5f-b4ff-9071357b3d9f" containerName="util" Jun 15 01:48:28.417616 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.417611 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c11adbda-36bf-4a5f-b4ff-9071357b3d9f" containerName="util" Jun 15 01:48:28.417819 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.417619 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c11adbda-36bf-4a5f-b4ff-9071357b3d9f" containerName="pull" Jun 15 01:48:28.417819 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.417629 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c11adbda-36bf-4a5f-b4ff-9071357b3d9f" containerName="pull" Jun 15 01:48:28.417819 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.417720 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c11adbda-36bf-4a5f-b4ff-9071357b3d9f" containerName="extract" Jun 15 01:48:28.420962 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.420943 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-ql59t" Jun 15 01:48:28.423833 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.423815 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 15 01:48:28.423950 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.423929 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 15 01:48:28.425025 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.424988 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 15 01:48:28.425126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.424988 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 15 01:48:28.425126 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.425030 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tgvph\"" Jun 15 01:48:28.425243 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.425136 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 15 01:48:28.428593 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.428561 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cddd79ffb-ql59t"] Jun 15 01:48:28.596891 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.596850 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/85e25c13-87c8-4abf-a5fb-7f6f3db79fd4-manager-config\") pod \"lws-controller-manager-5cddd79ffb-ql59t\" (UID: \"85e25c13-87c8-4abf-a5fb-7f6f3db79fd4\") " pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-ql59t" Jun 15 01:48:28.597085 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.596919 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/85e25c13-87c8-4abf-a5fb-7f6f3db79fd4-metrics-cert\") pod \"lws-controller-manager-5cddd79ffb-ql59t\" (UID: \"85e25c13-87c8-4abf-a5fb-7f6f3db79fd4\") " pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-ql59t" Jun 15 01:48:28.597085 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.596945 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85e25c13-87c8-4abf-a5fb-7f6f3db79fd4-cert\") pod \"lws-controller-manager-5cddd79ffb-ql59t\" (UID: \"85e25c13-87c8-4abf-a5fb-7f6f3db79fd4\") " pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-ql59t" Jun 15 01:48:28.597085 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.596981 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jjts\" (UniqueName: \"kubernetes.io/projected/85e25c13-87c8-4abf-a5fb-7f6f3db79fd4-kube-api-access-2jjts\") pod \"lws-controller-manager-5cddd79ffb-ql59t\" (UID: \"85e25c13-87c8-4abf-a5fb-7f6f3db79fd4\") " pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-ql59t" Jun 15 01:48:28.698411 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.698285 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/85e25c13-87c8-4abf-a5fb-7f6f3db79fd4-manager-config\") pod \"lws-controller-manager-5cddd79ffb-ql59t\" (UID: \"85e25c13-87c8-4abf-a5fb-7f6f3db79fd4\") " pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-ql59t" Jun 15 01:48:28.698411 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.698385 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/85e25c13-87c8-4abf-a5fb-7f6f3db79fd4-metrics-cert\") pod \"lws-controller-manager-5cddd79ffb-ql59t\" (UID: \"85e25c13-87c8-4abf-a5fb-7f6f3db79fd4\") " pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-ql59t" Jun 15 01:48:28.698619 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.698416 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85e25c13-87c8-4abf-a5fb-7f6f3db79fd4-cert\") pod \"lws-controller-manager-5cddd79ffb-ql59t\" (UID: \"85e25c13-87c8-4abf-a5fb-7f6f3db79fd4\") " pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-ql59t" Jun 15 01:48:28.698619 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.698468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jjts\" (UniqueName: \"kubernetes.io/projected/85e25c13-87c8-4abf-a5fb-7f6f3db79fd4-kube-api-access-2jjts\") pod \"lws-controller-manager-5cddd79ffb-ql59t\" (UID: \"85e25c13-87c8-4abf-a5fb-7f6f3db79fd4\") " pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-ql59t" Jun 15 01:48:28.699805 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.699773 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/85e25c13-87c8-4abf-a5fb-7f6f3db79fd4-manager-config\") pod \"lws-controller-manager-5cddd79ffb-ql59t\" (UID: \"85e25c13-87c8-4abf-a5fb-7f6f3db79fd4\") " pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-ql59t" Jun 15 01:48:28.702897 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.702868 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/85e25c13-87c8-4abf-a5fb-7f6f3db79fd4-metrics-cert\") pod \"lws-controller-manager-5cddd79ffb-ql59t\" (UID: \"85e25c13-87c8-4abf-a5fb-7f6f3db79fd4\") " pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-ql59t" Jun 15 01:48:28.704480 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.704457 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85e25c13-87c8-4abf-a5fb-7f6f3db79fd4-cert\") pod \"lws-controller-manager-5cddd79ffb-ql59t\" (UID: \"85e25c13-87c8-4abf-a5fb-7f6f3db79fd4\") " pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-ql59t" Jun 15 01:48:28.707012 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.706990 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jjts\" (UniqueName: \"kubernetes.io/projected/85e25c13-87c8-4abf-a5fb-7f6f3db79fd4-kube-api-access-2jjts\") pod \"lws-controller-manager-5cddd79ffb-ql59t\" (UID: \"85e25c13-87c8-4abf-a5fb-7f6f3db79fd4\") " pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-ql59t" Jun 15 01:48:28.731376 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.731329 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-ql59t" Jun 15 01:48:28.889865 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:28.889727 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cddd79ffb-ql59t"] Jun 15 01:48:28.892691 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:48:28.892666 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85e25c13_87c8_4abf_a5fb_7f6f3db79fd4.slice/crio-c851461116dd711fbd28844ca6def0c511545d5e98c7be89bed047835ae9ab0a WatchSource:0}: Error finding container c851461116dd711fbd28844ca6def0c511545d5e98c7be89bed047835ae9ab0a: Status 404 returned error can't find the container with id c851461116dd711fbd28844ca6def0c511545d5e98c7be89bed047835ae9ab0a Jun 15 01:48:29.250152 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:29.250118 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-ql59t" event={"ID":"85e25c13-87c8-4abf-a5fb-7f6f3db79fd4","Type":"ContainerStarted","Data":"c851461116dd711fbd28844ca6def0c511545d5e98c7be89bed047835ae9ab0a"} Jun 15 01:48:31.261020 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:31.260921 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-ql59t" event={"ID":"85e25c13-87c8-4abf-a5fb-7f6f3db79fd4","Type":"ContainerStarted","Data":"0550de212dbcf8cd0ebf8016deed2d70c3e57ec29791670d0ec0c3f77980ed52"} Jun 15 01:48:31.261020 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:31.260991 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-ql59t" Jun 15 01:48:31.291725 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:31.291668 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-ql59t" podStartSLOduration=1.259179474 podStartE2EDuration="3.29165099s" totalImagesPullingTime="2.032471516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:48:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:48:31.289392788 +0000 UTC m=+589.647933201" watchObservedRunningTime="2026-06-15 01:48:31.29165099 +0000 UTC m=+589.650191385" Jun 15 01:48:32.952715 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:32.952679 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn"] Jun 15 01:48:32.956312 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:32.956294 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn" Jun 15 01:48:32.962596 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:32.962571 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 15 01:48:32.962596 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:32.962590 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 15 01:48:32.962905 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:32.962882 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7gcdp\"" Jun 15 01:48:32.963039 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:32.962985 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 15 01:48:32.963408 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:32.963036 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 15 01:48:32.973515 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:32.973488 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn"] Jun 15 01:48:33.035973 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:33.035935 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6d21dfe1-80aa-430f-a314-3160a701a3af-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-p96xn\" (UID: \"6d21dfe1-80aa-430f-a314-3160a701a3af\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn" Jun 15 01:48:33.036167 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:33.035985 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d21dfe1-80aa-430f-a314-3160a701a3af-tmp\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-p96xn\" (UID: \"6d21dfe1-80aa-430f-a314-3160a701a3af\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn" Jun 15 01:48:33.036167 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:33.036047 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d21dfe1-80aa-430f-a314-3160a701a3af-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-p96xn\" (UID: \"6d21dfe1-80aa-430f-a314-3160a701a3af\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn" Jun 15 01:48:33.036167 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:33.036067 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6d21dfe1-80aa-430f-a314-3160a701a3af-manifests\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-p96xn\" (UID: \"6d21dfe1-80aa-430f-a314-3160a701a3af\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn" Jun 15 01:48:33.036167 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:33.036105 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crc4c\" (UniqueName: \"kubernetes.io/projected/6d21dfe1-80aa-430f-a314-3160a701a3af-kube-api-access-crc4c\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-p96xn\" (UID: \"6d21dfe1-80aa-430f-a314-3160a701a3af\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn" Jun 15 01:48:33.137146 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:33.137103 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6d21dfe1-80aa-430f-a314-3160a701a3af-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-p96xn\" (UID: \"6d21dfe1-80aa-430f-a314-3160a701a3af\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn" Jun 15 01:48:33.137393 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:33.137157 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d21dfe1-80aa-430f-a314-3160a701a3af-tmp\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-p96xn\" (UID: \"6d21dfe1-80aa-430f-a314-3160a701a3af\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn" Jun 15 01:48:33.137393 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:33.137193 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d21dfe1-80aa-430f-a314-3160a701a3af-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-p96xn\" (UID: \"6d21dfe1-80aa-430f-a314-3160a701a3af\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn" Jun 15 01:48:33.137393 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:33.137217 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6d21dfe1-80aa-430f-a314-3160a701a3af-manifests\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-p96xn\" (UID: \"6d21dfe1-80aa-430f-a314-3160a701a3af\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn" Jun 15 01:48:33.137552 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:33.137386 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crc4c\" (UniqueName: \"kubernetes.io/projected/6d21dfe1-80aa-430f-a314-3160a701a3af-kube-api-access-crc4c\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-p96xn\" (UID: \"6d21dfe1-80aa-430f-a314-3160a701a3af\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn" Jun 15 01:48:33.137754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:33.137735 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6d21dfe1-80aa-430f-a314-3160a701a3af-manifests\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-p96xn\" (UID: \"6d21dfe1-80aa-430f-a314-3160a701a3af\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn" Jun 15 01:48:33.139724 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:33.139698 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d21dfe1-80aa-430f-a314-3160a701a3af-tmp\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-p96xn\" (UID: \"6d21dfe1-80aa-430f-a314-3160a701a3af\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn" Jun 15 01:48:33.139825 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:33.139782 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6d21dfe1-80aa-430f-a314-3160a701a3af-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-p96xn\" (UID: \"6d21dfe1-80aa-430f-a314-3160a701a3af\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn" Jun 15 01:48:33.139825 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:33.139802 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d21dfe1-80aa-430f-a314-3160a701a3af-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-p96xn\" (UID: \"6d21dfe1-80aa-430f-a314-3160a701a3af\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn" Jun 15 01:48:33.147289 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:33.147237 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crc4c\" (UniqueName: \"kubernetes.io/projected/6d21dfe1-80aa-430f-a314-3160a701a3af-kube-api-access-crc4c\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-p96xn\" (UID: \"6d21dfe1-80aa-430f-a314-3160a701a3af\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn" Jun 15 01:48:33.266433 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:33.266323 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn" Jun 15 01:48:33.405988 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:33.405917 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn"] Jun 15 01:48:33.408443 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:48:33.408409 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d21dfe1_80aa_430f_a314_3160a701a3af.slice/crio-2af499ce87769eef4f58368ca27b976d6c5b5798a35568ab4547e05d5771e072 WatchSource:0}: Error finding container 2af499ce87769eef4f58368ca27b976d6c5b5798a35568ab4547e05d5771e072: Status 404 returned error can't find the container with id 2af499ce87769eef4f58368ca27b976d6c5b5798a35568ab4547e05d5771e072 Jun 15 01:48:34.278218 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:34.278176 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn" event={"ID":"6d21dfe1-80aa-430f-a314-3160a701a3af","Type":"ContainerStarted","Data":"2af499ce87769eef4f58368ca27b976d6c5b5798a35568ab4547e05d5771e072"} Jun 15 01:48:37.294309 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:37.294269 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn" event={"ID":"6d21dfe1-80aa-430f-a314-3160a701a3af","Type":"ContainerStarted","Data":"b1ad0cce4e56bb4120a3b6c8efb3a45d6d8c4e97f4471b830091bae2b0e2787a"} Jun 15 01:48:38.300321 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:38.300287 2576 generic.go:356] "Generic (PLEG): container finished" podID="6d21dfe1-80aa-430f-a314-3160a701a3af" containerID="b1ad0cce4e56bb4120a3b6c8efb3a45d6d8c4e97f4471b830091bae2b0e2787a" exitCode=0 Jun 15 01:48:38.300738 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:38.300349 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn" event={"ID":"6d21dfe1-80aa-430f-a314-3160a701a3af","Type":"ContainerDied","Data":"b1ad0cce4e56bb4120a3b6c8efb3a45d6d8c4e97f4471b830091bae2b0e2787a"} Jun 15 01:48:39.307113 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:39.307078 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn" event={"ID":"6d21dfe1-80aa-430f-a314-3160a701a3af","Type":"ContainerStarted","Data":"c073c8ed3a6563fb6dedfedd64667adecce513711b5038e4ce30d94221f81bb4"} Jun 15 01:48:39.307562 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:39.307188 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn" Jun 15 01:48:39.329169 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:39.329113 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn" podStartSLOduration=3.032607283 podStartE2EDuration="7.329097685s" totalImagesPullingTime="3.245527488s" totalInitContainerRuntime="1.050962914s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:48:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:48:39.327306097 +0000 UTC m=+597.685846494" watchObservedRunningTime="2026-06-15 01:48:39.329097685 +0000 UTC m=+597.687638080" Jun 15 01:48:42.026791 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:42.026763 2576 scope.go:117] "RemoveContainer" containerID="7943106bf1b61253de437cafb5d58c282fe18fb1f0484e73ca2ff10f7ac889a0" Jun 15 01:48:42.028043 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:42.027787 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-5qb7h_ee20262f-ced8-4d5c-8bf8-15fefc664812/console-operator/1.log" Jun 15 01:48:42.028043 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:42.027905 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-5qb7h_ee20262f-ced8-4d5c-8bf8-15fefc664812/console-operator/1.log" Jun 15 01:48:42.268481 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:42.268451 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5cddd79ffb-ql59t" Jun 15 01:48:50.315136 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:50.315101 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-p96xn" Jun 15 01:48:54.207201 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:54.207163 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j"] Jun 15 01:48:54.223652 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:54.223626 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j"] Jun 15 01:48:54.223800 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:54.223735 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j" Jun 15 01:48:54.226518 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:54.226490 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 01:48:54.227535 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:54.227516 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jcb4x\"" Jun 15 01:48:54.227666 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:54.227554 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 01:48:54.303067 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:54.303018 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt54w\" (UniqueName: \"kubernetes.io/projected/0eef2f26-2725-4176-858c-638e7e967d09-kube-api-access-zt54w\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j\" (UID: \"0eef2f26-2725-4176-858c-638e7e967d09\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j" Jun 15 01:48:54.303284 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:54.303126 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0eef2f26-2725-4176-858c-638e7e967d09-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j\" (UID: \"0eef2f26-2725-4176-858c-638e7e967d09\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j" Jun 15 01:48:54.303284 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:54.303182 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0eef2f26-2725-4176-858c-638e7e967d09-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j\" (UID: \"0eef2f26-2725-4176-858c-638e7e967d09\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j" Jun 15 01:48:54.403805 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:54.403770 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0eef2f26-2725-4176-858c-638e7e967d09-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j\" (UID: \"0eef2f26-2725-4176-858c-638e7e967d09\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j" Jun 15 01:48:54.404006 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:54.403819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt54w\" (UniqueName: \"kubernetes.io/projected/0eef2f26-2725-4176-858c-638e7e967d09-kube-api-access-zt54w\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j\" (UID: \"0eef2f26-2725-4176-858c-638e7e967d09\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j" Jun 15 01:48:54.404006 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:54.403863 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0eef2f26-2725-4176-858c-638e7e967d09-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j\" (UID: \"0eef2f26-2725-4176-858c-638e7e967d09\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j" Jun 15 01:48:54.404194 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:54.404168 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0eef2f26-2725-4176-858c-638e7e967d09-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j\" (UID: \"0eef2f26-2725-4176-858c-638e7e967d09\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j" Jun 15 01:48:54.404259 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:54.404192 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0eef2f26-2725-4176-858c-638e7e967d09-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j\" (UID: \"0eef2f26-2725-4176-858c-638e7e967d09\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j" Jun 15 01:48:54.413054 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:54.413023 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt54w\" (UniqueName: \"kubernetes.io/projected/0eef2f26-2725-4176-858c-638e7e967d09-kube-api-access-zt54w\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j\" (UID: \"0eef2f26-2725-4176-858c-638e7e967d09\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j" Jun 15 01:48:54.535062 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:54.534975 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j" Jun 15 01:48:54.689649 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:54.689622 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j"] Jun 15 01:48:54.691370 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:48:54.691320 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eef2f26_2725_4176_858c_638e7e967d09.slice/crio-791cf12216ebaccd34c1147bf73742736622742895ddcd599a869437ccdddc3a WatchSource:0}: Error finding container 791cf12216ebaccd34c1147bf73742736622742895ddcd599a869437ccdddc3a: Status 404 returned error can't find the container with id 791cf12216ebaccd34c1147bf73742736622742895ddcd599a869437ccdddc3a Jun 15 01:48:55.381428 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:55.381391 2576 generic.go:356] "Generic (PLEG): container finished" podID="0eef2f26-2725-4176-858c-638e7e967d09" containerID="99dcc40a8a9332797cdd036e8ad5c6ba3dc890c99f2305bf28dbfd8672bdb9f9" exitCode=0 Jun 15 01:48:55.383765 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:55.381469 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j" event={"ID":"0eef2f26-2725-4176-858c-638e7e967d09","Type":"ContainerDied","Data":"99dcc40a8a9332797cdd036e8ad5c6ba3dc890c99f2305bf28dbfd8672bdb9f9"} Jun 15 01:48:55.383765 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:55.381521 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j" event={"ID":"0eef2f26-2725-4176-858c-638e7e967d09","Type":"ContainerStarted","Data":"791cf12216ebaccd34c1147bf73742736622742895ddcd599a869437ccdddc3a"} Jun 15 01:48:56.387614 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:56.387583 2576 generic.go:356] "Generic (PLEG): container finished" podID="0eef2f26-2725-4176-858c-638e7e967d09" containerID="dd51fc5911c5fdd480fd276b6af0966b0eecc1f69c56d77fabfe2294445d4c54" exitCode=0 Jun 15 01:48:56.387614 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:56.387623 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j" event={"ID":"0eef2f26-2725-4176-858c-638e7e967d09","Type":"ContainerDied","Data":"dd51fc5911c5fdd480fd276b6af0966b0eecc1f69c56d77fabfe2294445d4c54"} Jun 15 01:48:57.394054 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:57.394023 2576 generic.go:356] "Generic (PLEG): container finished" podID="0eef2f26-2725-4176-858c-638e7e967d09" containerID="8ec71fb61423f6c5f528a3be993e8030d5a7df2abca4ab69b79c6ebe27ea4a4f" exitCode=0 Jun 15 01:48:57.394472 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:57.394104 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j" event={"ID":"0eef2f26-2725-4176-858c-638e7e967d09","Type":"ContainerDied","Data":"8ec71fb61423f6c5f528a3be993e8030d5a7df2abca4ab69b79c6ebe27ea4a4f"} Jun 15 01:48:58.523224 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:58.523193 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j" Jun 15 01:48:58.639127 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:58.639091 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0eef2f26-2725-4176-858c-638e7e967d09-bundle\") pod \"0eef2f26-2725-4176-858c-638e7e967d09\" (UID: \"0eef2f26-2725-4176-858c-638e7e967d09\") " Jun 15 01:48:58.639300 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:58.639151 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0eef2f26-2725-4176-858c-638e7e967d09-util\") pod \"0eef2f26-2725-4176-858c-638e7e967d09\" (UID: \"0eef2f26-2725-4176-858c-638e7e967d09\") " Jun 15 01:48:58.639300 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:58.639220 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zt54w\" (UniqueName: \"kubernetes.io/projected/0eef2f26-2725-4176-858c-638e7e967d09-kube-api-access-zt54w\") pod \"0eef2f26-2725-4176-858c-638e7e967d09\" (UID: \"0eef2f26-2725-4176-858c-638e7e967d09\") " Jun 15 01:48:58.640224 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:58.640196 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0eef2f26-2725-4176-858c-638e7e967d09-bundle" (OuterVolumeSpecName: "bundle") pod "0eef2f26-2725-4176-858c-638e7e967d09" (UID: "0eef2f26-2725-4176-858c-638e7e967d09"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:48:58.641323 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:58.641299 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0eef2f26-2725-4176-858c-638e7e967d09-kube-api-access-zt54w" (OuterVolumeSpecName: "kube-api-access-zt54w") pod "0eef2f26-2725-4176-858c-638e7e967d09" (UID: "0eef2f26-2725-4176-858c-638e7e967d09"). InnerVolumeSpecName "kube-api-access-zt54w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:48:58.645205 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:58.645183 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0eef2f26-2725-4176-858c-638e7e967d09-util" (OuterVolumeSpecName: "util") pod "0eef2f26-2725-4176-858c-638e7e967d09" (UID: "0eef2f26-2725-4176-858c-638e7e967d09"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:48:58.740523 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:58.740429 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0eef2f26-2725-4176-858c-638e7e967d09-util\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:48:58.740523 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:58.740463 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zt54w\" (UniqueName: \"kubernetes.io/projected/0eef2f26-2725-4176-858c-638e7e967d09-kube-api-access-zt54w\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:48:58.740523 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:58.740474 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0eef2f26-2725-4176-858c-638e7e967d09-bundle\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:48:59.404983 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:59.404954 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j" Jun 15 01:48:59.405177 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:59.404948 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06k4p6j" event={"ID":"0eef2f26-2725-4176-858c-638e7e967d09","Type":"ContainerDied","Data":"791cf12216ebaccd34c1147bf73742736622742895ddcd599a869437ccdddc3a"} Jun 15 01:48:59.405177 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:48:59.405069 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="791cf12216ebaccd34c1147bf73742736622742895ddcd599a869437ccdddc3a" Jun 15 01:49:05.033619 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:05.033535 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth"] Jun 15 01:49:05.033970 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:05.033866 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eef2f26-2725-4176-858c-638e7e967d09" containerName="util" Jun 15 01:49:05.033970 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:05.033876 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eef2f26-2725-4176-858c-638e7e967d09" containerName="util" Jun 15 01:49:05.033970 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:05.033884 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eef2f26-2725-4176-858c-638e7e967d09" containerName="pull" Jun 15 01:49:05.033970 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:05.033890 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eef2f26-2725-4176-858c-638e7e967d09" containerName="pull" Jun 15 01:49:05.033970 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:05.033897 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eef2f26-2725-4176-858c-638e7e967d09" containerName="extract" Jun 15 01:49:05.033970 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:05.033902 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eef2f26-2725-4176-858c-638e7e967d09" containerName="extract" Jun 15 01:49:05.033970 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:05.033960 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0eef2f26-2725-4176-858c-638e7e967d09" containerName="extract" Jun 15 01:49:05.036074 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:05.036057 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth" Jun 15 01:49:05.040591 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:05.040559 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jcb4x\"" Jun 15 01:49:05.041075 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:05.041058 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 01:49:05.041905 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:05.041885 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 01:49:05.057868 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:05.057838 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth"] Jun 15 01:49:05.101787 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:05.101748 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c5be12a-d23c-4086-abd5-7a8cef35fd2f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth\" (UID: \"4c5be12a-d23c-4086-abd5-7a8cef35fd2f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth" Jun 15 01:49:05.101787 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:05.101792 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c5be12a-d23c-4086-abd5-7a8cef35fd2f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth\" (UID: \"4c5be12a-d23c-4086-abd5-7a8cef35fd2f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth" Jun 15 01:49:05.102002 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:05.101812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb4tn\" (UniqueName: \"kubernetes.io/projected/4c5be12a-d23c-4086-abd5-7a8cef35fd2f-kube-api-access-pb4tn\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth\" (UID: \"4c5be12a-d23c-4086-abd5-7a8cef35fd2f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth" Jun 15 01:49:05.202665 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:05.202622 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c5be12a-d23c-4086-abd5-7a8cef35fd2f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth\" (UID: \"4c5be12a-d23c-4086-abd5-7a8cef35fd2f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth" Jun 15 01:49:05.202665 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:05.202667 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c5be12a-d23c-4086-abd5-7a8cef35fd2f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth\" (UID: \"4c5be12a-d23c-4086-abd5-7a8cef35fd2f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth" Jun 15 01:49:05.202880 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:05.202690 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb4tn\" (UniqueName: \"kubernetes.io/projected/4c5be12a-d23c-4086-abd5-7a8cef35fd2f-kube-api-access-pb4tn\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth\" (UID: \"4c5be12a-d23c-4086-abd5-7a8cef35fd2f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth" Jun 15 01:49:05.203121 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:05.203094 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c5be12a-d23c-4086-abd5-7a8cef35fd2f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth\" (UID: \"4c5be12a-d23c-4086-abd5-7a8cef35fd2f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth" Jun 15 01:49:05.203159 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:05.203106 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c5be12a-d23c-4086-abd5-7a8cef35fd2f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth\" (UID: \"4c5be12a-d23c-4086-abd5-7a8cef35fd2f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth" Jun 15 01:49:05.215381 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:05.215350 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb4tn\" (UniqueName: \"kubernetes.io/projected/4c5be12a-d23c-4086-abd5-7a8cef35fd2f-kube-api-access-pb4tn\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth\" (UID: \"4c5be12a-d23c-4086-abd5-7a8cef35fd2f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth" Jun 15 01:49:05.345553 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:05.345458 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth" Jun 15 01:49:05.486788 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:05.486700 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth"] Jun 15 01:49:05.498809 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:49:05.498751 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c5be12a_d23c_4086_abd5_7a8cef35fd2f.slice/crio-7798c8454fbfdd5d9945fc87a004f82c87c4ed4cf6d6f33b78abc31898625831 WatchSource:0}: Error finding container 7798c8454fbfdd5d9945fc87a004f82c87c4ed4cf6d6f33b78abc31898625831: Status 404 returned error can't find the container with id 7798c8454fbfdd5d9945fc87a004f82c87c4ed4cf6d6f33b78abc31898625831 Jun 15 01:49:06.440241 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:06.440199 2576 generic.go:356] "Generic (PLEG): container finished" podID="4c5be12a-d23c-4086-abd5-7a8cef35fd2f" containerID="364fe44f2680818fe51890c2db6b24431f0df27890f3ee73ec9dbc90b91945c0" exitCode=0 Jun 15 01:49:06.440742 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:06.440287 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth" event={"ID":"4c5be12a-d23c-4086-abd5-7a8cef35fd2f","Type":"ContainerDied","Data":"364fe44f2680818fe51890c2db6b24431f0df27890f3ee73ec9dbc90b91945c0"} Jun 15 01:49:06.440742 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:06.440350 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth" event={"ID":"4c5be12a-d23c-4086-abd5-7a8cef35fd2f","Type":"ContainerStarted","Data":"7798c8454fbfdd5d9945fc87a004f82c87c4ed4cf6d6f33b78abc31898625831"} Jun 15 01:49:07.451847 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:07.451813 2576 generic.go:356] "Generic (PLEG): container finished" podID="4c5be12a-d23c-4086-abd5-7a8cef35fd2f" containerID="fdf12ac78102ca42f199feee895a5fc9f82cd5c1010ad1173eb57cebb051dec8" exitCode=0 Jun 15 01:49:07.452285 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:07.451855 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth" event={"ID":"4c5be12a-d23c-4086-abd5-7a8cef35fd2f","Type":"ContainerDied","Data":"fdf12ac78102ca42f199feee895a5fc9f82cd5c1010ad1173eb57cebb051dec8"} Jun 15 01:49:08.458206 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:08.458172 2576 generic.go:356] "Generic (PLEG): container finished" podID="4c5be12a-d23c-4086-abd5-7a8cef35fd2f" containerID="755191bce1924c1f58931f17863591ca40630861151c585bf68c54f8e329a835" exitCode=0 Jun 15 01:49:08.458608 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:08.458213 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth" event={"ID":"4c5be12a-d23c-4086-abd5-7a8cef35fd2f","Type":"ContainerDied","Data":"755191bce1924c1f58931f17863591ca40630861151c585bf68c54f8e329a835"} Jun 15 01:49:09.214684 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:09.214652 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-845d6f7cf8-rblxg"] Jun 15 01:49:09.216868 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:09.216845 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-845d6f7cf8-rblxg" Jun 15 01:49:09.219859 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:09.219838 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zbhdc\"" Jun 15 01:49:09.219980 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:09.219855 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 15 01:49:09.230722 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:09.230699 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-845d6f7cf8-rblxg"] Jun 15 01:49:09.355064 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:09.355020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/26e3fc9a-0f55-4935-83ad-8ff2caa4ea49-redirect-config\") pod \"dashboard-redirect-845d6f7cf8-rblxg\" (UID: \"26e3fc9a-0f55-4935-83ad-8ff2caa4ea49\") " pod="opendatahub/dashboard-redirect-845d6f7cf8-rblxg" Jun 15 01:49:09.355064 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:09.355064 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmd4q\" (UniqueName: \"kubernetes.io/projected/26e3fc9a-0f55-4935-83ad-8ff2caa4ea49-kube-api-access-rmd4q\") pod \"dashboard-redirect-845d6f7cf8-rblxg\" (UID: \"26e3fc9a-0f55-4935-83ad-8ff2caa4ea49\") " pod="opendatahub/dashboard-redirect-845d6f7cf8-rblxg" Jun 15 01:49:09.456416 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:09.456377 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/26e3fc9a-0f55-4935-83ad-8ff2caa4ea49-redirect-config\") pod \"dashboard-redirect-845d6f7cf8-rblxg\" (UID: \"26e3fc9a-0f55-4935-83ad-8ff2caa4ea49\") " pod="opendatahub/dashboard-redirect-845d6f7cf8-rblxg" Jun 15 01:49:09.456416 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:09.456421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmd4q\" (UniqueName: \"kubernetes.io/projected/26e3fc9a-0f55-4935-83ad-8ff2caa4ea49-kube-api-access-rmd4q\") pod \"dashboard-redirect-845d6f7cf8-rblxg\" (UID: \"26e3fc9a-0f55-4935-83ad-8ff2caa4ea49\") " pod="opendatahub/dashboard-redirect-845d6f7cf8-rblxg" Jun 15 01:49:09.457121 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:09.457094 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/26e3fc9a-0f55-4935-83ad-8ff2caa4ea49-redirect-config\") pod \"dashboard-redirect-845d6f7cf8-rblxg\" (UID: \"26e3fc9a-0f55-4935-83ad-8ff2caa4ea49\") " pod="opendatahub/dashboard-redirect-845d6f7cf8-rblxg" Jun 15 01:49:09.466400 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:09.466325 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmd4q\" (UniqueName: \"kubernetes.io/projected/26e3fc9a-0f55-4935-83ad-8ff2caa4ea49-kube-api-access-rmd4q\") pod \"dashboard-redirect-845d6f7cf8-rblxg\" (UID: \"26e3fc9a-0f55-4935-83ad-8ff2caa4ea49\") " pod="opendatahub/dashboard-redirect-845d6f7cf8-rblxg" Jun 15 01:49:09.527743 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:09.527704 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-845d6f7cf8-rblxg" Jun 15 01:49:09.600906 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:09.600879 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth" Jun 15 01:49:09.661926 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:09.661903 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-845d6f7cf8-rblxg"] Jun 15 01:49:09.664219 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:49:09.664191 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26e3fc9a_0f55_4935_83ad_8ff2caa4ea49.slice/crio-8bf99dcd4c81a970b37aa5e16c59485b27baad88eaf2a5873d1d4ab9da75ccb2 WatchSource:0}: Error finding container 8bf99dcd4c81a970b37aa5e16c59485b27baad88eaf2a5873d1d4ab9da75ccb2: Status 404 returned error can't find the container with id 8bf99dcd4c81a970b37aa5e16c59485b27baad88eaf2a5873d1d4ab9da75ccb2 Jun 15 01:49:09.758885 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:09.758802 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c5be12a-d23c-4086-abd5-7a8cef35fd2f-util\") pod \"4c5be12a-d23c-4086-abd5-7a8cef35fd2f\" (UID: \"4c5be12a-d23c-4086-abd5-7a8cef35fd2f\") " Jun 15 01:49:09.758885 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:09.758851 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c5be12a-d23c-4086-abd5-7a8cef35fd2f-bundle\") pod \"4c5be12a-d23c-4086-abd5-7a8cef35fd2f\" (UID: \"4c5be12a-d23c-4086-abd5-7a8cef35fd2f\") " Jun 15 01:49:09.759085 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:09.758892 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pb4tn\" (UniqueName: \"kubernetes.io/projected/4c5be12a-d23c-4086-abd5-7a8cef35fd2f-kube-api-access-pb4tn\") pod \"4c5be12a-d23c-4086-abd5-7a8cef35fd2f\" (UID: \"4c5be12a-d23c-4086-abd5-7a8cef35fd2f\") " Jun 15 01:49:09.759860 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:09.759829 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c5be12a-d23c-4086-abd5-7a8cef35fd2f-bundle" (OuterVolumeSpecName: "bundle") pod "4c5be12a-d23c-4086-abd5-7a8cef35fd2f" (UID: "4c5be12a-d23c-4086-abd5-7a8cef35fd2f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:49:09.761046 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:09.761025 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c5be12a-d23c-4086-abd5-7a8cef35fd2f-kube-api-access-pb4tn" (OuterVolumeSpecName: "kube-api-access-pb4tn") pod "4c5be12a-d23c-4086-abd5-7a8cef35fd2f" (UID: "4c5be12a-d23c-4086-abd5-7a8cef35fd2f"). InnerVolumeSpecName "kube-api-access-pb4tn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:49:09.767814 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:09.767782 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c5be12a-d23c-4086-abd5-7a8cef35fd2f-util" (OuterVolumeSpecName: "util") pod "4c5be12a-d23c-4086-abd5-7a8cef35fd2f" (UID: "4c5be12a-d23c-4086-abd5-7a8cef35fd2f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:49:09.859632 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:09.859595 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c5be12a-d23c-4086-abd5-7a8cef35fd2f-bundle\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:49:09.859632 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:09.859625 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pb4tn\" (UniqueName: \"kubernetes.io/projected/4c5be12a-d23c-4086-abd5-7a8cef35fd2f-kube-api-access-pb4tn\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:49:09.859632 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:09.859635 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c5be12a-d23c-4086-abd5-7a8cef35fd2f-util\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:49:10.469845 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:10.469819 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth" Jun 15 01:49:10.470253 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:10.469818 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afrjth" event={"ID":"4c5be12a-d23c-4086-abd5-7a8cef35fd2f","Type":"ContainerDied","Data":"7798c8454fbfdd5d9945fc87a004f82c87c4ed4cf6d6f33b78abc31898625831"} Jun 15 01:49:10.470253 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:10.469942 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7798c8454fbfdd5d9945fc87a004f82c87c4ed4cf6d6f33b78abc31898625831" Jun 15 01:49:10.471065 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:10.471039 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-845d6f7cf8-rblxg" event={"ID":"26e3fc9a-0f55-4935-83ad-8ff2caa4ea49","Type":"ContainerStarted","Data":"8bf99dcd4c81a970b37aa5e16c59485b27baad88eaf2a5873d1d4ab9da75ccb2"} Jun 15 01:49:12.482157 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:12.482118 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-845d6f7cf8-rblxg" event={"ID":"26e3fc9a-0f55-4935-83ad-8ff2caa4ea49","Type":"ContainerStarted","Data":"aa9d015b406342a0e7855109e90ed4b7b07907bffe4f9812623d5bf5ff15f68b"} Jun 15 01:49:12.500262 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:12.500210 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-845d6f7cf8-rblxg" podStartSLOduration=1.213966716 podStartE2EDuration="3.500195073s" totalImagesPullingTime="2.286228357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:49:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:49:12.497650182 +0000 UTC m=+630.856190575" watchObservedRunningTime="2026-06-15 01:49:12.500195073 +0000 UTC m=+630.858735470" Jun 15 01:49:26.799181 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.799140 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9"] Jun 15 01:49:26.799897 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.799537 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c5be12a-d23c-4086-abd5-7a8cef35fd2f" containerName="pull" Jun 15 01:49:26.799897 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.799550 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c5be12a-d23c-4086-abd5-7a8cef35fd2f" containerName="pull" Jun 15 01:49:26.799897 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.799560 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c5be12a-d23c-4086-abd5-7a8cef35fd2f" containerName="extract" Jun 15 01:49:26.799897 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.799566 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c5be12a-d23c-4086-abd5-7a8cef35fd2f" containerName="extract" Jun 15 01:49:26.799897 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.799576 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c5be12a-d23c-4086-abd5-7a8cef35fd2f" containerName="util" Jun 15 01:49:26.799897 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.799582 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c5be12a-d23c-4086-abd5-7a8cef35fd2f" containerName="util" Jun 15 01:49:26.799897 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.799643 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c5be12a-d23c-4086-abd5-7a8cef35fd2f" containerName="extract" Jun 15 01:49:26.802456 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.802440 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.805368 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.805325 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-7lhdm\"" Jun 15 01:49:26.805581 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.805351 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 15 01:49:26.812347 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.812312 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8ca1c08-3253-4628-b5e9-c7286f219fa9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.812479 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.812394 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfrmb\" (UniqueName: \"kubernetes.io/projected/f8ca1c08-3253-4628-b5e9-c7286f219fa9-kube-api-access-sfrmb\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.812544 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.812504 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8ca1c08-3253-4628-b5e9-c7286f219fa9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.812701 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.812679 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8ca1c08-3253-4628-b5e9-c7286f219fa9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.812758 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.812745 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8ca1c08-3253-4628-b5e9-c7286f219fa9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.812909 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.812892 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8ca1c08-3253-4628-b5e9-c7286f219fa9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.812971 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.812944 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8ca1c08-3253-4628-b5e9-c7286f219fa9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.813033 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.812997 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8ca1c08-3253-4628-b5e9-c7286f219fa9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.813033 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.813024 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8ca1c08-3253-4628-b5e9-c7286f219fa9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.819457 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.819434 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9"] Jun 15 01:49:26.914177 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.914142 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8ca1c08-3253-4628-b5e9-c7286f219fa9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.914177 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.914182 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8ca1c08-3253-4628-b5e9-c7286f219fa9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.914477 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.914210 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8ca1c08-3253-4628-b5e9-c7286f219fa9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.914477 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.914233 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfrmb\" (UniqueName: \"kubernetes.io/projected/f8ca1c08-3253-4628-b5e9-c7286f219fa9-kube-api-access-sfrmb\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.914477 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.914258 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8ca1c08-3253-4628-b5e9-c7286f219fa9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.914477 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.914283 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8ca1c08-3253-4628-b5e9-c7286f219fa9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.914477 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.914352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8ca1c08-3253-4628-b5e9-c7286f219fa9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.914477 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.914400 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8ca1c08-3253-4628-b5e9-c7286f219fa9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.914477 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.914455 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8ca1c08-3253-4628-b5e9-c7286f219fa9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.914829 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.914611 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8ca1c08-3253-4628-b5e9-c7286f219fa9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.914829 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.914689 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8ca1c08-3253-4628-b5e9-c7286f219fa9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.914829 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.914771 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8ca1c08-3253-4628-b5e9-c7286f219fa9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.914938 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.914922 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8ca1c08-3253-4628-b5e9-c7286f219fa9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.914980 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.914965 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8ca1c08-3253-4628-b5e9-c7286f219fa9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.916662 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.916640 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8ca1c08-3253-4628-b5e9-c7286f219fa9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.916775 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.916754 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8ca1c08-3253-4628-b5e9-c7286f219fa9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.927377 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.927349 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8ca1c08-3253-4628-b5e9-c7286f219fa9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:26.927482 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:26.927435 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfrmb\" (UniqueName: \"kubernetes.io/projected/f8ca1c08-3253-4628-b5e9-c7286f219fa9-kube-api-access-sfrmb\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w4mx9\" (UID: \"f8ca1c08-3253-4628-b5e9-c7286f219fa9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:27.115003 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:27.114913 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:27.251184 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:27.251159 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9"] Jun 15 01:49:27.252785 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:49:27.252760 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8ca1c08_3253_4628_b5e9_c7286f219fa9.slice/crio-8ef7f5f2ca3637e7ceea1a5a2b8a912906bf4f48209464b3e9419f18975bb01d WatchSource:0}: Error finding container 8ef7f5f2ca3637e7ceea1a5a2b8a912906bf4f48209464b3e9419f18975bb01d: Status 404 returned error can't find the container with id 8ef7f5f2ca3637e7ceea1a5a2b8a912906bf4f48209464b3e9419f18975bb01d Jun 15 01:49:27.558068 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:27.558032 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" event={"ID":"f8ca1c08-3253-4628-b5e9-c7286f219fa9","Type":"ContainerStarted","Data":"8ef7f5f2ca3637e7ceea1a5a2b8a912906bf4f48209464b3e9419f18975bb01d"} Jun 15 01:49:30.279352 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:30.279298 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 15 01:49:30.279747 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:30.279409 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 15 01:49:30.279747 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:30.279461 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 15 01:49:30.575775 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:30.575692 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" event={"ID":"f8ca1c08-3253-4628-b5e9-c7286f219fa9","Type":"ContainerStarted","Data":"d09663a38f757de310e1aa157bc2fa510871a5684dc18e49111795a1924955d1"} Jun 15 01:49:30.598934 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:30.598882 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" podStartSLOduration=1.574696447 podStartE2EDuration="4.598866424s" totalImagesPullingTime="3.024169977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:49:30.596516724 +0000 UTC m=+648.955057123" watchObservedRunningTime="2026-06-15 01:49:30.598866424 +0000 UTC m=+648.957406820" Jun 15 01:49:31.116011 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:31.115971 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:31.120744 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:31.120721 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:31.580655 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:31.580622 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:31.581513 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:31.581495 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w4mx9" Jun 15 01:49:53.501540 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:53.501499 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hczs6"] Jun 15 01:49:53.513743 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:53.513714 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hczs6" Jun 15 01:49:53.514429 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:53.514040 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hczs6"] Jun 15 01:49:53.516603 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:53.516578 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 15 01:49:53.516720 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:53.516578 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 15 01:49:53.517639 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:53.517587 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-j6jdd\"" Jun 15 01:49:53.612508 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:53.612476 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxsqk\" (UniqueName: \"kubernetes.io/projected/2b11b8d4-8adb-4eec-a658-f0ab5e2faee0-kube-api-access-mxsqk\") pod \"kuadrant-operator-catalog-hczs6\" (UID: \"2b11b8d4-8adb-4eec-a658-f0ab5e2faee0\") " pod="kuadrant-system/kuadrant-operator-catalog-hczs6" Jun 15 01:49:53.713707 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:53.713667 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxsqk\" (UniqueName: \"kubernetes.io/projected/2b11b8d4-8adb-4eec-a658-f0ab5e2faee0-kube-api-access-mxsqk\") pod \"kuadrant-operator-catalog-hczs6\" (UID: \"2b11b8d4-8adb-4eec-a658-f0ab5e2faee0\") " pod="kuadrant-system/kuadrant-operator-catalog-hczs6" Jun 15 01:49:53.721718 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:53.721692 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxsqk\" (UniqueName: \"kubernetes.io/projected/2b11b8d4-8adb-4eec-a658-f0ab5e2faee0-kube-api-access-mxsqk\") pod \"kuadrant-operator-catalog-hczs6\" (UID: \"2b11b8d4-8adb-4eec-a658-f0ab5e2faee0\") " pod="kuadrant-system/kuadrant-operator-catalog-hczs6" Jun 15 01:49:53.825062 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:53.824967 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hczs6" Jun 15 01:49:53.869070 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:53.869034 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hczs6"] Jun 15 01:49:53.958544 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:53.958520 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hczs6"] Jun 15 01:49:53.960682 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:49:53.960655 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b11b8d4_8adb_4eec_a658_f0ab5e2faee0.slice/crio-37da4984e7d4170ed00605821f77d8100f4fa48923091c303eb850b490c6654c WatchSource:0}: Error finding container 37da4984e7d4170ed00605821f77d8100f4fa48923091c303eb850b490c6654c: Status 404 returned error can't find the container with id 37da4984e7d4170ed00605821f77d8100f4fa48923091c303eb850b490c6654c Jun 15 01:49:54.078192 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:54.078114 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zsxg6"] Jun 15 01:49:54.083062 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:54.083037 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zsxg6" Jun 15 01:49:54.088522 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:54.088492 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zsxg6"] Jun 15 01:49:54.118392 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:54.118357 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjd8t\" (UniqueName: \"kubernetes.io/projected/5c6196cc-b13a-4203-89e5-b75e7d981286-kube-api-access-jjd8t\") pod \"kuadrant-operator-catalog-zsxg6\" (UID: \"5c6196cc-b13a-4203-89e5-b75e7d981286\") " pod="kuadrant-system/kuadrant-operator-catalog-zsxg6" Jun 15 01:49:54.219287 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:54.219240 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjd8t\" (UniqueName: \"kubernetes.io/projected/5c6196cc-b13a-4203-89e5-b75e7d981286-kube-api-access-jjd8t\") pod \"kuadrant-operator-catalog-zsxg6\" (UID: \"5c6196cc-b13a-4203-89e5-b75e7d981286\") " pod="kuadrant-system/kuadrant-operator-catalog-zsxg6" Jun 15 01:49:54.227991 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:54.227955 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjd8t\" (UniqueName: \"kubernetes.io/projected/5c6196cc-b13a-4203-89e5-b75e7d981286-kube-api-access-jjd8t\") pod \"kuadrant-operator-catalog-zsxg6\" (UID: \"5c6196cc-b13a-4203-89e5-b75e7d981286\") " pod="kuadrant-system/kuadrant-operator-catalog-zsxg6" Jun 15 01:49:54.394352 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:54.394316 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zsxg6" Jun 15 01:49:54.542503 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:54.542473 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zsxg6"] Jun 15 01:49:54.561627 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:49:54.561589 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c6196cc_b13a_4203_89e5_b75e7d981286.slice/crio-47541a30037b4c666a6658cd78305f1bb55c1ec119eb0503d89e13eb931aaf69 WatchSource:0}: Error finding container 47541a30037b4c666a6658cd78305f1bb55c1ec119eb0503d89e13eb931aaf69: Status 404 returned error can't find the container with id 47541a30037b4c666a6658cd78305f1bb55c1ec119eb0503d89e13eb931aaf69 Jun 15 01:49:54.701574 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:54.701473 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hczs6" event={"ID":"2b11b8d4-8adb-4eec-a658-f0ab5e2faee0","Type":"ContainerStarted","Data":"37da4984e7d4170ed00605821f77d8100f4fa48923091c303eb850b490c6654c"} Jun 15 01:49:54.702541 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:54.702509 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zsxg6" event={"ID":"5c6196cc-b13a-4203-89e5-b75e7d981286","Type":"ContainerStarted","Data":"47541a30037b4c666a6658cd78305f1bb55c1ec119eb0503d89e13eb931aaf69"} Jun 15 01:49:56.714559 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:56.714522 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hczs6" event={"ID":"2b11b8d4-8adb-4eec-a658-f0ab5e2faee0","Type":"ContainerStarted","Data":"90af5544d1cd13e3bdcfb5fb512a5caafb4b5083b603159b333a9042ffe80d0a"} Jun 15 01:49:56.715044 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:56.714579 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-hczs6" podUID="2b11b8d4-8adb-4eec-a658-f0ab5e2faee0" containerName="registry-server" containerID="cri-o://90af5544d1cd13e3bdcfb5fb512a5caafb4b5083b603159b333a9042ffe80d0a" gracePeriod=2 Jun 15 01:49:56.716144 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:56.716115 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zsxg6" event={"ID":"5c6196cc-b13a-4203-89e5-b75e7d981286","Type":"ContainerStarted","Data":"aca18922f40eb205884461f8cd741807439fd5d7a2ce97a44e394579504e60a3"} Jun 15 01:49:56.731275 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:56.731229 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hczs6" podStartSLOduration=1.5819830430000001 podStartE2EDuration="3.731206866s" totalImagesPullingTime="2.149223823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:49:56.72988194 +0000 UTC m=+675.088422364" watchObservedRunningTime="2026-06-15 01:49:56.731206866 +0000 UTC m=+675.089747262" Jun 15 01:49:56.748203 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:56.748147 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zsxg6" podStartSLOduration=1.197042884 podStartE2EDuration="2.748132608s" totalImagesPullingTime="1.551089724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:49:56.745775732 +0000 UTC m=+675.104316129" watchObservedRunningTime="2026-06-15 01:49:56.748132608 +0000 UTC m=+675.106673035" Jun 15 01:49:56.974188 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:56.974122 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hczs6" Jun 15 01:49:57.049231 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:57.049194 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxsqk\" (UniqueName: \"kubernetes.io/projected/2b11b8d4-8adb-4eec-a658-f0ab5e2faee0-kube-api-access-mxsqk\") pod \"2b11b8d4-8adb-4eec-a658-f0ab5e2faee0\" (UID: \"2b11b8d4-8adb-4eec-a658-f0ab5e2faee0\") " Jun 15 01:49:57.051276 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:57.051246 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b11b8d4-8adb-4eec-a658-f0ab5e2faee0-kube-api-access-mxsqk" (OuterVolumeSpecName: "kube-api-access-mxsqk") pod "2b11b8d4-8adb-4eec-a658-f0ab5e2faee0" (UID: "2b11b8d4-8adb-4eec-a658-f0ab5e2faee0"). InnerVolumeSpecName "kube-api-access-mxsqk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:49:57.150717 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:57.150685 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxsqk\" (UniqueName: \"kubernetes.io/projected/2b11b8d4-8adb-4eec-a658-f0ab5e2faee0-kube-api-access-mxsqk\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:49:57.722933 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:57.722899 2576 generic.go:356] "Generic (PLEG): container finished" podID="2b11b8d4-8adb-4eec-a658-f0ab5e2faee0" containerID="90af5544d1cd13e3bdcfb5fb512a5caafb4b5083b603159b333a9042ffe80d0a" exitCode=0 Jun 15 01:49:57.723531 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:57.722951 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hczs6" Jun 15 01:49:57.723531 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:57.722981 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hczs6" event={"ID":"2b11b8d4-8adb-4eec-a658-f0ab5e2faee0","Type":"ContainerDied","Data":"90af5544d1cd13e3bdcfb5fb512a5caafb4b5083b603159b333a9042ffe80d0a"} Jun 15 01:49:57.723531 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:57.723030 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hczs6" event={"ID":"2b11b8d4-8adb-4eec-a658-f0ab5e2faee0","Type":"ContainerDied","Data":"37da4984e7d4170ed00605821f77d8100f4fa48923091c303eb850b490c6654c"} Jun 15 01:49:57.723531 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:57.723050 2576 scope.go:117] "RemoveContainer" containerID="90af5544d1cd13e3bdcfb5fb512a5caafb4b5083b603159b333a9042ffe80d0a" Jun 15 01:49:57.732119 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:57.732102 2576 scope.go:117] "RemoveContainer" containerID="90af5544d1cd13e3bdcfb5fb512a5caafb4b5083b603159b333a9042ffe80d0a" Jun 15 01:49:57.732415 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:49:57.732395 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90af5544d1cd13e3bdcfb5fb512a5caafb4b5083b603159b333a9042ffe80d0a\": container with ID starting with 90af5544d1cd13e3bdcfb5fb512a5caafb4b5083b603159b333a9042ffe80d0a not found: ID does not exist" containerID="90af5544d1cd13e3bdcfb5fb512a5caafb4b5083b603159b333a9042ffe80d0a" Jun 15 01:49:57.732481 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:57.732428 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90af5544d1cd13e3bdcfb5fb512a5caafb4b5083b603159b333a9042ffe80d0a"} err="failed to get container status \"90af5544d1cd13e3bdcfb5fb512a5caafb4b5083b603159b333a9042ffe80d0a\": rpc error: code = NotFound desc = could not find container \"90af5544d1cd13e3bdcfb5fb512a5caafb4b5083b603159b333a9042ffe80d0a\": container with ID starting with 90af5544d1cd13e3bdcfb5fb512a5caafb4b5083b603159b333a9042ffe80d0a not found: ID does not exist" Jun 15 01:49:57.743788 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:57.743765 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hczs6"] Jun 15 01:49:57.747118 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:57.747098 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hczs6"] Jun 15 01:49:58.050277 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:49:58.050191 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b11b8d4-8adb-4eec-a658-f0ab5e2faee0" path="/var/lib/kubelet/pods/2b11b8d4-8adb-4eec-a658-f0ab5e2faee0/volumes" Jun 15 01:50:04.395010 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:04.394972 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-zsxg6" Jun 15 01:50:04.395557 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:04.395059 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-zsxg6" Jun 15 01:50:04.417428 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:04.417402 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-zsxg6" Jun 15 01:50:04.779598 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:04.779507 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-zsxg6" Jun 15 01:50:08.714350 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:08.714307 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4"] Jun 15 01:50:08.714728 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:08.714658 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b11b8d4-8adb-4eec-a658-f0ab5e2faee0" containerName="registry-server" Jun 15 01:50:08.714728 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:08.714670 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b11b8d4-8adb-4eec-a658-f0ab5e2faee0" containerName="registry-server" Jun 15 01:50:08.714800 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:08.714734 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b11b8d4-8adb-4eec-a658-f0ab5e2faee0" containerName="registry-server" Jun 15 01:50:08.717940 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:08.717921 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4" Jun 15 01:50:08.720603 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:08.720580 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6whwg\"" Jun 15 01:50:08.725781 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:08.725763 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4"] Jun 15 01:50:08.854528 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:08.854482 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0cdacc16-3c29-4d56-af54-1ae5e68aed54-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4\" (UID: \"0cdacc16-3c29-4d56-af54-1ae5e68aed54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4" Jun 15 01:50:08.854528 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:08.854528 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llgj7\" (UniqueName: \"kubernetes.io/projected/0cdacc16-3c29-4d56-af54-1ae5e68aed54-kube-api-access-llgj7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4\" (UID: \"0cdacc16-3c29-4d56-af54-1ae5e68aed54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4" Jun 15 01:50:08.854754 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:08.854559 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0cdacc16-3c29-4d56-af54-1ae5e68aed54-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4\" (UID: \"0cdacc16-3c29-4d56-af54-1ae5e68aed54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4" Jun 15 01:50:08.955966 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:08.955927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0cdacc16-3c29-4d56-af54-1ae5e68aed54-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4\" (UID: \"0cdacc16-3c29-4d56-af54-1ae5e68aed54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4" Jun 15 01:50:08.955966 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:08.955966 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llgj7\" (UniqueName: \"kubernetes.io/projected/0cdacc16-3c29-4d56-af54-1ae5e68aed54-kube-api-access-llgj7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4\" (UID: \"0cdacc16-3c29-4d56-af54-1ae5e68aed54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4" Jun 15 01:50:08.956292 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:08.955989 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0cdacc16-3c29-4d56-af54-1ae5e68aed54-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4\" (UID: \"0cdacc16-3c29-4d56-af54-1ae5e68aed54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4" Jun 15 01:50:08.956451 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:08.956427 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0cdacc16-3c29-4d56-af54-1ae5e68aed54-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4\" (UID: \"0cdacc16-3c29-4d56-af54-1ae5e68aed54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4" Jun 15 01:50:08.956451 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:08.956442 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0cdacc16-3c29-4d56-af54-1ae5e68aed54-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4\" (UID: \"0cdacc16-3c29-4d56-af54-1ae5e68aed54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4" Jun 15 01:50:08.963949 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:08.963926 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llgj7\" (UniqueName: \"kubernetes.io/projected/0cdacc16-3c29-4d56-af54-1ae5e68aed54-kube-api-access-llgj7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4\" (UID: \"0cdacc16-3c29-4d56-af54-1ae5e68aed54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4" Jun 15 01:50:09.028077 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:09.027982 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4" Jun 15 01:50:09.164847 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:09.164700 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4"] Jun 15 01:50:09.167750 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:50:09.167723 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cdacc16_3c29_4d56_af54_1ae5e68aed54.slice/crio-f789f465b55a8ff2c6990ca1813b8778bfa0a5b5764bf31802f45ad2574ec27b WatchSource:0}: Error finding container f789f465b55a8ff2c6990ca1813b8778bfa0a5b5764bf31802f45ad2574ec27b: Status 404 returned error can't find the container with id f789f465b55a8ff2c6990ca1813b8778bfa0a5b5764bf31802f45ad2574ec27b Jun 15 01:50:09.510476 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:09.510436 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5"] Jun 15 01:50:09.514058 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:09.514038 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5" Jun 15 01:50:09.521686 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:09.521661 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5"] Jun 15 01:50:09.663752 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:09.663709 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zp85\" (UniqueName: \"kubernetes.io/projected/4178e06a-cefa-487d-a93b-81cf3eacfeab-kube-api-access-8zp85\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5\" (UID: \"4178e06a-cefa-487d-a93b-81cf3eacfeab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5" Jun 15 01:50:09.663947 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:09.663769 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4178e06a-cefa-487d-a93b-81cf3eacfeab-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5\" (UID: \"4178e06a-cefa-487d-a93b-81cf3eacfeab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5" Jun 15 01:50:09.663947 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:09.663797 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4178e06a-cefa-487d-a93b-81cf3eacfeab-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5\" (UID: \"4178e06a-cefa-487d-a93b-81cf3eacfeab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5" Jun 15 01:50:09.765351 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:09.765228 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4178e06a-cefa-487d-a93b-81cf3eacfeab-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5\" (UID: \"4178e06a-cefa-487d-a93b-81cf3eacfeab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5" Jun 15 01:50:09.765351 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:09.765273 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4178e06a-cefa-487d-a93b-81cf3eacfeab-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5\" (UID: \"4178e06a-cefa-487d-a93b-81cf3eacfeab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5" Jun 15 01:50:09.765858 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:09.765383 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zp85\" (UniqueName: \"kubernetes.io/projected/4178e06a-cefa-487d-a93b-81cf3eacfeab-kube-api-access-8zp85\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5\" (UID: \"4178e06a-cefa-487d-a93b-81cf3eacfeab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5" Jun 15 01:50:09.765858 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:09.765637 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4178e06a-cefa-487d-a93b-81cf3eacfeab-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5\" (UID: \"4178e06a-cefa-487d-a93b-81cf3eacfeab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5" Jun 15 01:50:09.765858 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:09.765710 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4178e06a-cefa-487d-a93b-81cf3eacfeab-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5\" (UID: \"4178e06a-cefa-487d-a93b-81cf3eacfeab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5" Jun 15 01:50:09.773986 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:09.773955 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zp85\" (UniqueName: \"kubernetes.io/projected/4178e06a-cefa-487d-a93b-81cf3eacfeab-kube-api-access-8zp85\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5\" (UID: \"4178e06a-cefa-487d-a93b-81cf3eacfeab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5" Jun 15 01:50:09.784296 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:09.784268 2576 generic.go:356] "Generic (PLEG): container finished" podID="0cdacc16-3c29-4d56-af54-1ae5e68aed54" containerID="5349c68e8813262a1cfd5e033b6c16792c5db91b9c08b929befa85624a4f5520" exitCode=0 Jun 15 01:50:09.784448 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:09.784364 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4" event={"ID":"0cdacc16-3c29-4d56-af54-1ae5e68aed54","Type":"ContainerDied","Data":"5349c68e8813262a1cfd5e033b6c16792c5db91b9c08b929befa85624a4f5520"} Jun 15 01:50:09.784448 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:09.784417 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4" event={"ID":"0cdacc16-3c29-4d56-af54-1ae5e68aed54","Type":"ContainerStarted","Data":"f789f465b55a8ff2c6990ca1813b8778bfa0a5b5764bf31802f45ad2574ec27b"} Jun 15 01:50:09.824403 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:09.824370 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5" Jun 15 01:50:09.955786 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:09.955685 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5"] Jun 15 01:50:09.957918 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:50:09.957891 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4178e06a_cefa_487d_a93b_81cf3eacfeab.slice/crio-3f07396fc849dab47b8a52001dbb84e9b2e3069eb4ef26be4ed1aca88830e22d WatchSource:0}: Error finding container 3f07396fc849dab47b8a52001dbb84e9b2e3069eb4ef26be4ed1aca88830e22d: Status 404 returned error can't find the container with id 3f07396fc849dab47b8a52001dbb84e9b2e3069eb4ef26be4ed1aca88830e22d Jun 15 01:50:10.114528 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.114494 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8"] Jun 15 01:50:10.120509 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.118669 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8" Jun 15 01:50:10.125935 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.125906 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8"] Jun 15 01:50:10.271044 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.271006 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19162444-15cf-49df-89a8-b3ebfc8bb844-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8\" (UID: \"19162444-15cf-49df-89a8-b3ebfc8bb844\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8" Jun 15 01:50:10.271044 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.271044 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19162444-15cf-49df-89a8-b3ebfc8bb844-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8\" (UID: \"19162444-15cf-49df-89a8-b3ebfc8bb844\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8" Jun 15 01:50:10.271287 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.271082 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbmwc\" (UniqueName: \"kubernetes.io/projected/19162444-15cf-49df-89a8-b3ebfc8bb844-kube-api-access-cbmwc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8\" (UID: \"19162444-15cf-49df-89a8-b3ebfc8bb844\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8" Jun 15 01:50:10.372714 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.372682 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19162444-15cf-49df-89a8-b3ebfc8bb844-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8\" (UID: \"19162444-15cf-49df-89a8-b3ebfc8bb844\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8" Jun 15 01:50:10.372890 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.372722 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19162444-15cf-49df-89a8-b3ebfc8bb844-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8\" (UID: \"19162444-15cf-49df-89a8-b3ebfc8bb844\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8" Jun 15 01:50:10.372890 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.372755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbmwc\" (UniqueName: \"kubernetes.io/projected/19162444-15cf-49df-89a8-b3ebfc8bb844-kube-api-access-cbmwc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8\" (UID: \"19162444-15cf-49df-89a8-b3ebfc8bb844\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8" Jun 15 01:50:10.373070 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.373048 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19162444-15cf-49df-89a8-b3ebfc8bb844-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8\" (UID: \"19162444-15cf-49df-89a8-b3ebfc8bb844\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8" Jun 15 01:50:10.373133 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.373093 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19162444-15cf-49df-89a8-b3ebfc8bb844-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8\" (UID: \"19162444-15cf-49df-89a8-b3ebfc8bb844\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8" Jun 15 01:50:10.384089 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.384061 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbmwc\" (UniqueName: \"kubernetes.io/projected/19162444-15cf-49df-89a8-b3ebfc8bb844-kube-api-access-cbmwc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8\" (UID: \"19162444-15cf-49df-89a8-b3ebfc8bb844\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8" Jun 15 01:50:10.432051 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.432021 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8" Jun 15 01:50:10.516381 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.516348 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq"] Jun 15 01:50:10.520545 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.520526 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq" Jun 15 01:50:10.527271 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.527243 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq"] Jun 15 01:50:10.578509 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.578397 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8"] Jun 15 01:50:10.581289 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:50:10.581260 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19162444_15cf_49df_89a8_b3ebfc8bb844.slice/crio-76a01f4d3f615bb16cc289ebc210b4ec561ffcb78b3267b773c6e47005c1dbde WatchSource:0}: Error finding container 76a01f4d3f615bb16cc289ebc210b4ec561ffcb78b3267b773c6e47005c1dbde: Status 404 returned error can't find the container with id 76a01f4d3f615bb16cc289ebc210b4ec561ffcb78b3267b773c6e47005c1dbde Jun 15 01:50:10.675522 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.675481 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb8l2\" (UniqueName: \"kubernetes.io/projected/b1c2733e-0151-4f43-8db1-51f245892a2d-kube-api-access-kb8l2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq\" (UID: \"b1c2733e-0151-4f43-8db1-51f245892a2d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq" Jun 15 01:50:10.675674 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.675550 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1c2733e-0151-4f43-8db1-51f245892a2d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq\" (UID: \"b1c2733e-0151-4f43-8db1-51f245892a2d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq" Jun 15 01:50:10.675674 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.675627 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1c2733e-0151-4f43-8db1-51f245892a2d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq\" (UID: \"b1c2733e-0151-4f43-8db1-51f245892a2d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq" Jun 15 01:50:10.776570 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.776527 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb8l2\" (UniqueName: \"kubernetes.io/projected/b1c2733e-0151-4f43-8db1-51f245892a2d-kube-api-access-kb8l2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq\" (UID: \"b1c2733e-0151-4f43-8db1-51f245892a2d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq" Jun 15 01:50:10.777120 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.776614 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1c2733e-0151-4f43-8db1-51f245892a2d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq\" (UID: \"b1c2733e-0151-4f43-8db1-51f245892a2d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq" Jun 15 01:50:10.777120 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.776697 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1c2733e-0151-4f43-8db1-51f245892a2d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq\" (UID: \"b1c2733e-0151-4f43-8db1-51f245892a2d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq" Jun 15 01:50:10.777120 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.776992 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1c2733e-0151-4f43-8db1-51f245892a2d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq\" (UID: \"b1c2733e-0151-4f43-8db1-51f245892a2d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq" Jun 15 01:50:10.777120 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.777046 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1c2733e-0151-4f43-8db1-51f245892a2d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq\" (UID: \"b1c2733e-0151-4f43-8db1-51f245892a2d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq" Jun 15 01:50:10.785127 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.785089 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb8l2\" (UniqueName: \"kubernetes.io/projected/b1c2733e-0151-4f43-8db1-51f245892a2d-kube-api-access-kb8l2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq\" (UID: \"b1c2733e-0151-4f43-8db1-51f245892a2d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq" Jun 15 01:50:10.790619 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.790593 2576 generic.go:356] "Generic (PLEG): container finished" podID="4178e06a-cefa-487d-a93b-81cf3eacfeab" containerID="8661c8ef58f706a471d568f2d0f2a1bf592f32dfba11c6feba32ef5df9d02534" exitCode=0 Jun 15 01:50:10.790733 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.790678 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5" event={"ID":"4178e06a-cefa-487d-a93b-81cf3eacfeab","Type":"ContainerDied","Data":"8661c8ef58f706a471d568f2d0f2a1bf592f32dfba11c6feba32ef5df9d02534"} Jun 15 01:50:10.790796 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.790732 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5" event={"ID":"4178e06a-cefa-487d-a93b-81cf3eacfeab","Type":"ContainerStarted","Data":"3f07396fc849dab47b8a52001dbb84e9b2e3069eb4ef26be4ed1aca88830e22d"} Jun 15 01:50:10.792646 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.792601 2576 generic.go:356] "Generic (PLEG): container finished" podID="0cdacc16-3c29-4d56-af54-1ae5e68aed54" containerID="56224786873b9608141cdbc48aade2a02065ea9d9c58ef78bc11e57034d658d0" exitCode=0 Jun 15 01:50:10.792777 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.792683 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4" event={"ID":"0cdacc16-3c29-4d56-af54-1ae5e68aed54","Type":"ContainerDied","Data":"56224786873b9608141cdbc48aade2a02065ea9d9c58ef78bc11e57034d658d0"} Jun 15 01:50:10.794256 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.794231 2576 generic.go:356] "Generic (PLEG): container finished" podID="19162444-15cf-49df-89a8-b3ebfc8bb844" containerID="bd99c85cb6b3da22e4974991b4fc0483469eccfcd8d2effef49367d8e5612155" exitCode=0 Jun 15 01:50:10.794413 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.794260 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8" event={"ID":"19162444-15cf-49df-89a8-b3ebfc8bb844","Type":"ContainerDied","Data":"bd99c85cb6b3da22e4974991b4fc0483469eccfcd8d2effef49367d8e5612155"} Jun 15 01:50:10.794413 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.794299 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8" event={"ID":"19162444-15cf-49df-89a8-b3ebfc8bb844","Type":"ContainerStarted","Data":"76a01f4d3f615bb16cc289ebc210b4ec561ffcb78b3267b773c6e47005c1dbde"} Jun 15 01:50:10.858681 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.858646 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq" Jun 15 01:50:10.994210 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:10.994180 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq"] Jun 15 01:50:10.995759 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:50:10.995728 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c2733e_0151_4f43_8db1_51f245892a2d.slice/crio-3236fbd826391a44c7f94e45d5a0e70975f84b88711f09cd49ad6f686cebbd41 WatchSource:0}: Error finding container 3236fbd826391a44c7f94e45d5a0e70975f84b88711f09cd49ad6f686cebbd41: Status 404 returned error can't find the container with id 3236fbd826391a44c7f94e45d5a0e70975f84b88711f09cd49ad6f686cebbd41 Jun 15 01:50:11.801597 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:11.801503 2576 generic.go:356] "Generic (PLEG): container finished" podID="0cdacc16-3c29-4d56-af54-1ae5e68aed54" containerID="79af55b50df76487f079c1814c74e439648cb57351b114edbc5775d2fd7699d5" exitCode=0 Jun 15 01:50:11.801986 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:11.801586 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4" event={"ID":"0cdacc16-3c29-4d56-af54-1ae5e68aed54","Type":"ContainerDied","Data":"79af55b50df76487f079c1814c74e439648cb57351b114edbc5775d2fd7699d5"} Jun 15 01:50:11.803479 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:11.803450 2576 generic.go:356] "Generic (PLEG): container finished" podID="19162444-15cf-49df-89a8-b3ebfc8bb844" containerID="1509c73e6065f6dcf9472101800a9d5d8d2d4c7874a3c6db9397340cf5361542" exitCode=0 Jun 15 01:50:11.803621 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:11.803531 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8" event={"ID":"19162444-15cf-49df-89a8-b3ebfc8bb844","Type":"ContainerDied","Data":"1509c73e6065f6dcf9472101800a9d5d8d2d4c7874a3c6db9397340cf5361542"} Jun 15 01:50:11.805568 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:11.805545 2576 generic.go:356] "Generic (PLEG): container finished" podID="4178e06a-cefa-487d-a93b-81cf3eacfeab" containerID="57435391f85f6dc228b520d59c6dd34e380ff9fde8591132026cb879424f176a" exitCode=0 Jun 15 01:50:11.805674 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:11.805572 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5" event={"ID":"4178e06a-cefa-487d-a93b-81cf3eacfeab","Type":"ContainerDied","Data":"57435391f85f6dc228b520d59c6dd34e380ff9fde8591132026cb879424f176a"} Jun 15 01:50:11.807271 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:11.807250 2576 generic.go:356] "Generic (PLEG): container finished" podID="b1c2733e-0151-4f43-8db1-51f245892a2d" containerID="c05576d81defb9e2e76b3e80d3a2b4914082f7aa9e62ad57389a671ab00022a7" exitCode=0 Jun 15 01:50:11.807376 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:11.807278 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq" event={"ID":"b1c2733e-0151-4f43-8db1-51f245892a2d","Type":"ContainerDied","Data":"c05576d81defb9e2e76b3e80d3a2b4914082f7aa9e62ad57389a671ab00022a7"} Jun 15 01:50:11.807376 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:11.807329 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq" event={"ID":"b1c2733e-0151-4f43-8db1-51f245892a2d","Type":"ContainerStarted","Data":"3236fbd826391a44c7f94e45d5a0e70975f84b88711f09cd49ad6f686cebbd41"} Jun 15 01:50:12.815298 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:12.815262 2576 generic.go:356] "Generic (PLEG): container finished" podID="4178e06a-cefa-487d-a93b-81cf3eacfeab" containerID="225d64f1c0aa7e153407b9d706f83fed909a0823ee8e82a78ae8f359a1711749" exitCode=0 Jun 15 01:50:12.815771 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:12.815363 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5" event={"ID":"4178e06a-cefa-487d-a93b-81cf3eacfeab","Type":"ContainerDied","Data":"225d64f1c0aa7e153407b9d706f83fed909a0823ee8e82a78ae8f359a1711749"} Jun 15 01:50:12.817648 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:12.817436 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq" event={"ID":"b1c2733e-0151-4f43-8db1-51f245892a2d","Type":"ContainerStarted","Data":"2483f39e6a005cb456855644c3ef2dc4cecf36441f01cdfdc56feceb7fd92fb5"} Jun 15 01:50:12.819936 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:12.819913 2576 generic.go:356] "Generic (PLEG): container finished" podID="19162444-15cf-49df-89a8-b3ebfc8bb844" containerID="8042c9d08899ed407f56506c74273128b05c95b6443a24bec923a306a539598d" exitCode=0 Jun 15 01:50:12.820046 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:12.820002 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8" event={"ID":"19162444-15cf-49df-89a8-b3ebfc8bb844","Type":"ContainerDied","Data":"8042c9d08899ed407f56506c74273128b05c95b6443a24bec923a306a539598d"} Jun 15 01:50:12.958416 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:12.958391 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4" Jun 15 01:50:13.100448 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:13.100359 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0cdacc16-3c29-4d56-af54-1ae5e68aed54-bundle\") pod \"0cdacc16-3c29-4d56-af54-1ae5e68aed54\" (UID: \"0cdacc16-3c29-4d56-af54-1ae5e68aed54\") " Jun 15 01:50:13.100448 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:13.100421 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0cdacc16-3c29-4d56-af54-1ae5e68aed54-util\") pod \"0cdacc16-3c29-4d56-af54-1ae5e68aed54\" (UID: \"0cdacc16-3c29-4d56-af54-1ae5e68aed54\") " Jun 15 01:50:13.100626 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:13.100483 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llgj7\" (UniqueName: \"kubernetes.io/projected/0cdacc16-3c29-4d56-af54-1ae5e68aed54-kube-api-access-llgj7\") pod \"0cdacc16-3c29-4d56-af54-1ae5e68aed54\" (UID: \"0cdacc16-3c29-4d56-af54-1ae5e68aed54\") " Jun 15 01:50:13.100883 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:13.100853 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cdacc16-3c29-4d56-af54-1ae5e68aed54-bundle" (OuterVolumeSpecName: "bundle") pod "0cdacc16-3c29-4d56-af54-1ae5e68aed54" (UID: "0cdacc16-3c29-4d56-af54-1ae5e68aed54"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:50:13.102617 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:13.102591 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cdacc16-3c29-4d56-af54-1ae5e68aed54-kube-api-access-llgj7" (OuterVolumeSpecName: "kube-api-access-llgj7") pod "0cdacc16-3c29-4d56-af54-1ae5e68aed54" (UID: "0cdacc16-3c29-4d56-af54-1ae5e68aed54"). InnerVolumeSpecName "kube-api-access-llgj7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:50:13.105978 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:13.105946 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cdacc16-3c29-4d56-af54-1ae5e68aed54-util" (OuterVolumeSpecName: "util") pod "0cdacc16-3c29-4d56-af54-1ae5e68aed54" (UID: "0cdacc16-3c29-4d56-af54-1ae5e68aed54"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:50:13.201089 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:13.201061 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0cdacc16-3c29-4d56-af54-1ae5e68aed54-bundle\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:50:13.201089 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:13.201086 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0cdacc16-3c29-4d56-af54-1ae5e68aed54-util\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:50:13.201089 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:13.201095 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llgj7\" (UniqueName: \"kubernetes.io/projected/0cdacc16-3c29-4d56-af54-1ae5e68aed54-kube-api-access-llgj7\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:50:13.827230 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:13.827185 2576 generic.go:356] "Generic (PLEG): container finished" podID="b1c2733e-0151-4f43-8db1-51f245892a2d" containerID="2483f39e6a005cb456855644c3ef2dc4cecf36441f01cdfdc56feceb7fd92fb5" exitCode=0 Jun 15 01:50:13.827635 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:13.827280 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq" event={"ID":"b1c2733e-0151-4f43-8db1-51f245892a2d","Type":"ContainerDied","Data":"2483f39e6a005cb456855644c3ef2dc4cecf36441f01cdfdc56feceb7fd92fb5"} Jun 15 01:50:13.829199 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:13.829177 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4" Jun 15 01:50:13.829199 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:13.829187 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4" event={"ID":"0cdacc16-3c29-4d56-af54-1ae5e68aed54","Type":"ContainerDied","Data":"f789f465b55a8ff2c6990ca1813b8778bfa0a5b5764bf31802f45ad2574ec27b"} Jun 15 01:50:13.829326 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:13.829228 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f789f465b55a8ff2c6990ca1813b8778bfa0a5b5764bf31802f45ad2574ec27b" Jun 15 01:50:13.971278 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:13.971250 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5" Jun 15 01:50:14.047981 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.047953 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8" Jun 15 01:50:14.109368 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.109272 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4178e06a-cefa-487d-a93b-81cf3eacfeab-bundle\") pod \"4178e06a-cefa-487d-a93b-81cf3eacfeab\" (UID: \"4178e06a-cefa-487d-a93b-81cf3eacfeab\") " Jun 15 01:50:14.109498 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.109417 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4178e06a-cefa-487d-a93b-81cf3eacfeab-util\") pod \"4178e06a-cefa-487d-a93b-81cf3eacfeab\" (UID: \"4178e06a-cefa-487d-a93b-81cf3eacfeab\") " Jun 15 01:50:14.109498 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.109453 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zp85\" (UniqueName: \"kubernetes.io/projected/4178e06a-cefa-487d-a93b-81cf3eacfeab-kube-api-access-8zp85\") pod \"4178e06a-cefa-487d-a93b-81cf3eacfeab\" (UID: \"4178e06a-cefa-487d-a93b-81cf3eacfeab\") " Jun 15 01:50:14.109848 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.109813 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4178e06a-cefa-487d-a93b-81cf3eacfeab-bundle" (OuterVolumeSpecName: "bundle") pod "4178e06a-cefa-487d-a93b-81cf3eacfeab" (UID: "4178e06a-cefa-487d-a93b-81cf3eacfeab"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:50:14.111630 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.111607 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4178e06a-cefa-487d-a93b-81cf3eacfeab-kube-api-access-8zp85" (OuterVolumeSpecName: "kube-api-access-8zp85") pod "4178e06a-cefa-487d-a93b-81cf3eacfeab" (UID: "4178e06a-cefa-487d-a93b-81cf3eacfeab"). InnerVolumeSpecName "kube-api-access-8zp85". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:50:14.114732 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.114707 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4178e06a-cefa-487d-a93b-81cf3eacfeab-util" (OuterVolumeSpecName: "util") pod "4178e06a-cefa-487d-a93b-81cf3eacfeab" (UID: "4178e06a-cefa-487d-a93b-81cf3eacfeab"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:50:14.210435 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.210380 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbmwc\" (UniqueName: \"kubernetes.io/projected/19162444-15cf-49df-89a8-b3ebfc8bb844-kube-api-access-cbmwc\") pod \"19162444-15cf-49df-89a8-b3ebfc8bb844\" (UID: \"19162444-15cf-49df-89a8-b3ebfc8bb844\") " Jun 15 01:50:14.210435 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.210448 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19162444-15cf-49df-89a8-b3ebfc8bb844-util\") pod \"19162444-15cf-49df-89a8-b3ebfc8bb844\" (UID: \"19162444-15cf-49df-89a8-b3ebfc8bb844\") " Jun 15 01:50:14.210693 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.210528 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19162444-15cf-49df-89a8-b3ebfc8bb844-bundle\") pod \"19162444-15cf-49df-89a8-b3ebfc8bb844\" (UID: \"19162444-15cf-49df-89a8-b3ebfc8bb844\") " Jun 15 01:50:14.210814 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.210794 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4178e06a-cefa-487d-a93b-81cf3eacfeab-util\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:50:14.210875 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.210820 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zp85\" (UniqueName: \"kubernetes.io/projected/4178e06a-cefa-487d-a93b-81cf3eacfeab-kube-api-access-8zp85\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:50:14.210875 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.210830 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4178e06a-cefa-487d-a93b-81cf3eacfeab-bundle\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:50:14.211181 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.211155 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19162444-15cf-49df-89a8-b3ebfc8bb844-bundle" (OuterVolumeSpecName: "bundle") pod "19162444-15cf-49df-89a8-b3ebfc8bb844" (UID: "19162444-15cf-49df-89a8-b3ebfc8bb844"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:50:14.212545 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.212521 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19162444-15cf-49df-89a8-b3ebfc8bb844-kube-api-access-cbmwc" (OuterVolumeSpecName: "kube-api-access-cbmwc") pod "19162444-15cf-49df-89a8-b3ebfc8bb844" (UID: "19162444-15cf-49df-89a8-b3ebfc8bb844"). InnerVolumeSpecName "kube-api-access-cbmwc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:50:14.215483 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.215443 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19162444-15cf-49df-89a8-b3ebfc8bb844-util" (OuterVolumeSpecName: "util") pod "19162444-15cf-49df-89a8-b3ebfc8bb844" (UID: "19162444-15cf-49df-89a8-b3ebfc8bb844"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:50:14.312230 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.312188 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19162444-15cf-49df-89a8-b3ebfc8bb844-bundle\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:50:14.312230 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.312220 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbmwc\" (UniqueName: \"kubernetes.io/projected/19162444-15cf-49df-89a8-b3ebfc8bb844-kube-api-access-cbmwc\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:50:14.312230 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.312229 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19162444-15cf-49df-89a8-b3ebfc8bb844-util\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:50:14.837658 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.837619 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5" event={"ID":"4178e06a-cefa-487d-a93b-81cf3eacfeab","Type":"ContainerDied","Data":"3f07396fc849dab47b8a52001dbb84e9b2e3069eb4ef26be4ed1aca88830e22d"} Jun 15 01:50:14.837658 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.837638 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5" Jun 15 01:50:14.838104 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.837673 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f07396fc849dab47b8a52001dbb84e9b2e3069eb4ef26be4ed1aca88830e22d" Jun 15 01:50:14.839896 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.839874 2576 generic.go:356] "Generic (PLEG): container finished" podID="b1c2733e-0151-4f43-8db1-51f245892a2d" containerID="0602ed7cf99f500a0300424a340c16e5b94a21afd14d44b4f5e2271eb99a3c65" exitCode=0 Jun 15 01:50:14.840030 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.839906 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq" event={"ID":"b1c2733e-0151-4f43-8db1-51f245892a2d","Type":"ContainerDied","Data":"0602ed7cf99f500a0300424a340c16e5b94a21afd14d44b4f5e2271eb99a3c65"} Jun 15 01:50:14.842072 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.842049 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8" event={"ID":"19162444-15cf-49df-89a8-b3ebfc8bb844","Type":"ContainerDied","Data":"76a01f4d3f615bb16cc289ebc210b4ec561ffcb78b3267b773c6e47005c1dbde"} Jun 15 01:50:14.842072 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.842060 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8" Jun 15 01:50:14.842243 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:14.842083 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76a01f4d3f615bb16cc289ebc210b4ec561ffcb78b3267b773c6e47005c1dbde" Jun 15 01:50:15.984204 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:15.984166 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq" Jun 15 01:50:16.129048 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:16.129014 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kb8l2\" (UniqueName: \"kubernetes.io/projected/b1c2733e-0151-4f43-8db1-51f245892a2d-kube-api-access-kb8l2\") pod \"b1c2733e-0151-4f43-8db1-51f245892a2d\" (UID: \"b1c2733e-0151-4f43-8db1-51f245892a2d\") " Jun 15 01:50:16.129247 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:16.129061 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1c2733e-0151-4f43-8db1-51f245892a2d-bundle\") pod \"b1c2733e-0151-4f43-8db1-51f245892a2d\" (UID: \"b1c2733e-0151-4f43-8db1-51f245892a2d\") " Jun 15 01:50:16.129247 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:16.129123 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1c2733e-0151-4f43-8db1-51f245892a2d-util\") pod \"b1c2733e-0151-4f43-8db1-51f245892a2d\" (UID: \"b1c2733e-0151-4f43-8db1-51f245892a2d\") " Jun 15 01:50:16.129737 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:16.129707 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1c2733e-0151-4f43-8db1-51f245892a2d-bundle" (OuterVolumeSpecName: "bundle") pod "b1c2733e-0151-4f43-8db1-51f245892a2d" (UID: "b1c2733e-0151-4f43-8db1-51f245892a2d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:50:16.131242 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:16.131208 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1c2733e-0151-4f43-8db1-51f245892a2d-kube-api-access-kb8l2" (OuterVolumeSpecName: "kube-api-access-kb8l2") pod "b1c2733e-0151-4f43-8db1-51f245892a2d" (UID: "b1c2733e-0151-4f43-8db1-51f245892a2d"). InnerVolumeSpecName "kube-api-access-kb8l2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:50:16.134567 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:16.134537 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1c2733e-0151-4f43-8db1-51f245892a2d-util" (OuterVolumeSpecName: "util") pod "b1c2733e-0151-4f43-8db1-51f245892a2d" (UID: "b1c2733e-0151-4f43-8db1-51f245892a2d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:50:16.229812 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:16.229770 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kb8l2\" (UniqueName: \"kubernetes.io/projected/b1c2733e-0151-4f43-8db1-51f245892a2d-kube-api-access-kb8l2\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:50:16.229812 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:16.229805 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1c2733e-0151-4f43-8db1-51f245892a2d-bundle\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:50:16.229812 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:16.229815 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1c2733e-0151-4f43-8db1-51f245892a2d-util\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:50:16.854707 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:16.854672 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq" Jun 15 01:50:16.854707 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:16.854690 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq" event={"ID":"b1c2733e-0151-4f43-8db1-51f245892a2d","Type":"ContainerDied","Data":"3236fbd826391a44c7f94e45d5a0e70975f84b88711f09cd49ad6f686cebbd41"} Jun 15 01:50:16.854906 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:16.854739 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3236fbd826391a44c7f94e45d5a0e70975f84b88711f09cd49ad6f686cebbd41" Jun 15 01:50:27.038697 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.038660 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkpsn"] Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039029 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19162444-15cf-49df-89a8-b3ebfc8bb844" containerName="pull" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039040 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="19162444-15cf-49df-89a8-b3ebfc8bb844" containerName="pull" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039051 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cdacc16-3c29-4d56-af54-1ae5e68aed54" containerName="pull" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039057 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cdacc16-3c29-4d56-af54-1ae5e68aed54" containerName="pull" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039062 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19162444-15cf-49df-89a8-b3ebfc8bb844" containerName="extract" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039068 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="19162444-15cf-49df-89a8-b3ebfc8bb844" containerName="extract" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039073 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4178e06a-cefa-487d-a93b-81cf3eacfeab" containerName="extract" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039079 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4178e06a-cefa-487d-a93b-81cf3eacfeab" containerName="extract" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039088 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1c2733e-0151-4f43-8db1-51f245892a2d" containerName="util" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039093 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1c2733e-0151-4f43-8db1-51f245892a2d" containerName="util" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039101 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1c2733e-0151-4f43-8db1-51f245892a2d" containerName="extract" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039107 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1c2733e-0151-4f43-8db1-51f245892a2d" containerName="extract" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039113 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cdacc16-3c29-4d56-af54-1ae5e68aed54" containerName="util" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039118 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cdacc16-3c29-4d56-af54-1ae5e68aed54" containerName="util" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039128 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19162444-15cf-49df-89a8-b3ebfc8bb844" containerName="util" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039133 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="19162444-15cf-49df-89a8-b3ebfc8bb844" containerName="util" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039138 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cdacc16-3c29-4d56-af54-1ae5e68aed54" containerName="extract" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039143 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cdacc16-3c29-4d56-af54-1ae5e68aed54" containerName="extract" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039148 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4178e06a-cefa-487d-a93b-81cf3eacfeab" containerName="pull" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039153 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4178e06a-cefa-487d-a93b-81cf3eacfeab" containerName="pull" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039159 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4178e06a-cefa-487d-a93b-81cf3eacfeab" containerName="util" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039164 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4178e06a-cefa-487d-a93b-81cf3eacfeab" containerName="util" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039173 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1c2733e-0151-4f43-8db1-51f245892a2d" containerName="pull" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039178 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1c2733e-0151-4f43-8db1-51f245892a2d" containerName="pull" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039249 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cdacc16-3c29-4d56-af54-1ae5e68aed54" containerName="extract" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039257 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4178e06a-cefa-487d-a93b-81cf3eacfeab" containerName="extract" Jun 15 01:50:27.039240 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039263 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1c2733e-0151-4f43-8db1-51f245892a2d" containerName="extract" Jun 15 01:50:27.040588 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.039269 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="19162444-15cf-49df-89a8-b3ebfc8bb844" containerName="extract" Jun 15 01:50:27.042731 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.042709 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkpsn" Jun 15 01:50:27.045918 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.045897 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zxjqs\"" Jun 15 01:50:27.062032 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.061994 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkpsn"] Jun 15 01:50:27.134726 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.134681 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b9c303f-a5c2-4e1a-a161-5b3670bbb678-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wkpsn\" (UID: \"2b9c303f-a5c2-4e1a-a161-5b3670bbb678\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkpsn" Jun 15 01:50:27.134894 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.134863 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgpgv\" (UniqueName: \"kubernetes.io/projected/2b9c303f-a5c2-4e1a-a161-5b3670bbb678-kube-api-access-xgpgv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wkpsn\" (UID: \"2b9c303f-a5c2-4e1a-a161-5b3670bbb678\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkpsn" Jun 15 01:50:27.235604 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.235563 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgpgv\" (UniqueName: \"kubernetes.io/projected/2b9c303f-a5c2-4e1a-a161-5b3670bbb678-kube-api-access-xgpgv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wkpsn\" (UID: \"2b9c303f-a5c2-4e1a-a161-5b3670bbb678\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkpsn" Jun 15 01:50:27.235764 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.235653 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b9c303f-a5c2-4e1a-a161-5b3670bbb678-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wkpsn\" (UID: \"2b9c303f-a5c2-4e1a-a161-5b3670bbb678\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkpsn" Jun 15 01:50:27.235978 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.235963 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b9c303f-a5c2-4e1a-a161-5b3670bbb678-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wkpsn\" (UID: \"2b9c303f-a5c2-4e1a-a161-5b3670bbb678\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkpsn" Jun 15 01:50:27.244515 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.244480 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgpgv\" (UniqueName: \"kubernetes.io/projected/2b9c303f-a5c2-4e1a-a161-5b3670bbb678-kube-api-access-xgpgv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wkpsn\" (UID: \"2b9c303f-a5c2-4e1a-a161-5b3670bbb678\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkpsn" Jun 15 01:50:27.361309 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.361210 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkpsn" Jun 15 01:50:27.509535 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.509506 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkpsn"] Jun 15 01:50:27.512808 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:50:27.512777 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b9c303f_a5c2_4e1a_a161_5b3670bbb678.slice/crio-66dff13a270200d0be1efd3196103fb9e438ed9ce9eba03ff05b06cf97fe9eec WatchSource:0}: Error finding container 66dff13a270200d0be1efd3196103fb9e438ed9ce9eba03ff05b06cf97fe9eec: Status 404 returned error can't find the container with id 66dff13a270200d0be1efd3196103fb9e438ed9ce9eba03ff05b06cf97fe9eec Jun 15 01:50:27.917550 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:27.917503 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkpsn" event={"ID":"2b9c303f-a5c2-4e1a-a161-5b3670bbb678","Type":"ContainerStarted","Data":"66dff13a270200d0be1efd3196103fb9e438ed9ce9eba03ff05b06cf97fe9eec"} Jun 15 01:50:34.962116 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:34.962082 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkpsn" event={"ID":"2b9c303f-a5c2-4e1a-a161-5b3670bbb678","Type":"ContainerStarted","Data":"dde83e951e8578193d98378612cda9c65f55f31ff7924d879470f96bd9642f7f"} Jun 15 01:50:34.962544 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:34.962155 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkpsn" Jun 15 01:50:34.982349 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:34.982281 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkpsn" podStartSLOduration=1.2480775849999999 podStartE2EDuration="7.982265189s" totalImagesPullingTime="6.734187604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:50:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:50:34.979727802 +0000 UTC m=+713.338268200" watchObservedRunningTime="2026-06-15 01:50:34.982265189 +0000 UTC m=+713.340805584" Jun 15 01:50:35.422284 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:35.422240 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vkw8s"] Jun 15 01:50:35.426003 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:35.425979 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vkw8s" Jun 15 01:50:35.428488 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:35.428463 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-krdhl\"" Jun 15 01:50:35.436956 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:35.436930 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vkw8s"] Jun 15 01:50:35.510363 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:35.510311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hls7\" (UniqueName: \"kubernetes.io/projected/bc655a10-aae2-460e-9444-c7c2da271963-kube-api-access-2hls7\") pod \"authorino-operator-75cc8d5cb7-vkw8s\" (UID: \"bc655a10-aae2-460e-9444-c7c2da271963\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vkw8s" Jun 15 01:50:35.611824 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:35.611775 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hls7\" (UniqueName: \"kubernetes.io/projected/bc655a10-aae2-460e-9444-c7c2da271963-kube-api-access-2hls7\") pod \"authorino-operator-75cc8d5cb7-vkw8s\" (UID: \"bc655a10-aae2-460e-9444-c7c2da271963\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vkw8s" Jun 15 01:50:35.620678 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:35.620657 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hls7\" (UniqueName: \"kubernetes.io/projected/bc655a10-aae2-460e-9444-c7c2da271963-kube-api-access-2hls7\") pod \"authorino-operator-75cc8d5cb7-vkw8s\" (UID: \"bc655a10-aae2-460e-9444-c7c2da271963\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vkw8s" Jun 15 01:50:35.737316 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:35.737225 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vkw8s" Jun 15 01:50:35.874284 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:35.874254 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vkw8s"] Jun 15 01:50:35.876136 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:50:35.876107 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc655a10_aae2_460e_9444_c7c2da271963.slice/crio-70a7b814f313a30ed43c83a8e955c21e8e12da53e5e3643f8672906e6a4d48b5 WatchSource:0}: Error finding container 70a7b814f313a30ed43c83a8e955c21e8e12da53e5e3643f8672906e6a4d48b5: Status 404 returned error can't find the container with id 70a7b814f313a30ed43c83a8e955c21e8e12da53e5e3643f8672906e6a4d48b5 Jun 15 01:50:35.970014 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:35.969979 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vkw8s" event={"ID":"bc655a10-aae2-460e-9444-c7c2da271963","Type":"ContainerStarted","Data":"70a7b814f313a30ed43c83a8e955c21e8e12da53e5e3643f8672906e6a4d48b5"} Jun 15 01:50:38.994204 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:38.992394 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vkw8s" event={"ID":"bc655a10-aae2-460e-9444-c7c2da271963","Type":"ContainerStarted","Data":"332615877bf975877f9c861b65583cf125c059dd753199a6320cf86622522bdd"} Jun 15 01:50:38.994204 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:38.993239 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vkw8s" Jun 15 01:50:39.013476 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:39.013426 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vkw8s" podStartSLOduration=1.873685766 podStartE2EDuration="4.013410165s" totalImagesPullingTime="2.139724399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:50:39.012299265 +0000 UTC m=+717.370839660" watchObservedRunningTime="2026-06-15 01:50:39.013410165 +0000 UTC m=+717.371950561" Jun 15 01:50:45.972255 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:45.972217 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkpsn" Jun 15 01:50:47.687061 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:47.686993 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkpsn"] Jun 15 01:50:47.687581 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:47.687426 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkpsn" podUID="2b9c303f-a5c2-4e1a-a161-5b3670bbb678" containerName="manager" containerID="cri-o://dde83e951e8578193d98378612cda9c65f55f31ff7924d879470f96bd9642f7f" gracePeriod=2 Jun 15 01:50:47.690167 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:50:47.690127 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wkpsn\" is forbidden: User \"system:node:ip-10-0-132-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-124.ec2.internal' and this object" podUID="2b9c303f-a5c2-4e1a-a161-5b3670bbb678" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkpsn" Jun 15 01:50:47.690894 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:47.690869 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkpsn"] Jun 15 01:50:47.726822 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:47.726788 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7z7fk"] Jun 15 01:50:47.727156 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:47.727141 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b9c303f-a5c2-4e1a-a161-5b3670bbb678" containerName="manager" Jun 15 01:50:47.727156 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:47.727155 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b9c303f-a5c2-4e1a-a161-5b3670bbb678" containerName="manager" Jun 15 01:50:47.727495 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:47.727225 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b9c303f-a5c2-4e1a-a161-5b3670bbb678" containerName="manager" Jun 15 01:50:47.730428 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:47.730405 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7z7fk" Jun 15 01:50:47.732722 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:50:47.732693 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wkpsn\" is forbidden: User \"system:node:ip-10-0-132-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-124.ec2.internal' and this object" podUID="2b9c303f-a5c2-4e1a-a161-5b3670bbb678" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkpsn" Jun 15 01:50:47.747805 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:47.747771 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7z7fk"] Jun 15 01:50:47.825227 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:47.825188 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gt85\" (UniqueName: \"kubernetes.io/projected/ba8cecd8-6122-46bd-a3ed-e5861a83499b-kube-api-access-9gt85\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7z7fk\" (UID: \"ba8cecd8-6122-46bd-a3ed-e5861a83499b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7z7fk" Jun 15 01:50:47.825401 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:47.825258 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba8cecd8-6122-46bd-a3ed-e5861a83499b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7z7fk\" (UID: \"ba8cecd8-6122-46bd-a3ed-e5861a83499b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7z7fk" Jun 15 01:50:47.926013 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:47.925985 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gt85\" (UniqueName: \"kubernetes.io/projected/ba8cecd8-6122-46bd-a3ed-e5861a83499b-kube-api-access-9gt85\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7z7fk\" (UID: \"ba8cecd8-6122-46bd-a3ed-e5861a83499b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7z7fk" Jun 15 01:50:47.926104 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:47.926045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba8cecd8-6122-46bd-a3ed-e5861a83499b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7z7fk\" (UID: \"ba8cecd8-6122-46bd-a3ed-e5861a83499b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7z7fk" Jun 15 01:50:47.926534 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:47.926507 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba8cecd8-6122-46bd-a3ed-e5861a83499b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7z7fk\" (UID: \"ba8cecd8-6122-46bd-a3ed-e5861a83499b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7z7fk" Jun 15 01:50:47.935357 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:47.935313 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gt85\" (UniqueName: \"kubernetes.io/projected/ba8cecd8-6122-46bd-a3ed-e5861a83499b-kube-api-access-9gt85\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7z7fk\" (UID: \"ba8cecd8-6122-46bd-a3ed-e5861a83499b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7z7fk" Jun 15 01:50:47.948456 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:47.948396 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkpsn" Jun 15 01:50:47.950894 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:50:47.950869 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wkpsn\" is forbidden: User \"system:node:ip-10-0-132-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-124.ec2.internal' and this object" podUID="2b9c303f-a5c2-4e1a-a161-5b3670bbb678" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkpsn" Jun 15 01:50:48.027488 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:48.027453 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b9c303f-a5c2-4e1a-a161-5b3670bbb678-extensions-socket-volume\") pod \"2b9c303f-a5c2-4e1a-a161-5b3670bbb678\" (UID: \"2b9c303f-a5c2-4e1a-a161-5b3670bbb678\") " Jun 15 01:50:48.027680 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:48.027515 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgpgv\" (UniqueName: \"kubernetes.io/projected/2b9c303f-a5c2-4e1a-a161-5b3670bbb678-kube-api-access-xgpgv\") pod \"2b9c303f-a5c2-4e1a-a161-5b3670bbb678\" (UID: \"2b9c303f-a5c2-4e1a-a161-5b3670bbb678\") " Jun 15 01:50:48.027952 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:48.027926 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b9c303f-a5c2-4e1a-a161-5b3670bbb678-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2b9c303f-a5c2-4e1a-a161-5b3670bbb678" (UID: "2b9c303f-a5c2-4e1a-a161-5b3670bbb678"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:50:48.029672 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:48.029649 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b9c303f-a5c2-4e1a-a161-5b3670bbb678-kube-api-access-xgpgv" (OuterVolumeSpecName: "kube-api-access-xgpgv") pod "2b9c303f-a5c2-4e1a-a161-5b3670bbb678" (UID: "2b9c303f-a5c2-4e1a-a161-5b3670bbb678"). InnerVolumeSpecName "kube-api-access-xgpgv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:50:48.048999 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:48.048969 2576 generic.go:356] "Generic (PLEG): container finished" podID="2b9c303f-a5c2-4e1a-a161-5b3670bbb678" containerID="dde83e951e8578193d98378612cda9c65f55f31ff7924d879470f96bd9642f7f" exitCode=0 Jun 15 01:50:48.049158 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:48.049092 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkpsn" Jun 15 01:50:48.050855 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:48.050830 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b9c303f-a5c2-4e1a-a161-5b3670bbb678" path="/var/lib/kubelet/pods/2b9c303f-a5c2-4e1a-a161-5b3670bbb678/volumes" Jun 15 01:50:48.051192 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:48.051180 2576 scope.go:117] "RemoveContainer" containerID="dde83e951e8578193d98378612cda9c65f55f31ff7924d879470f96bd9642f7f" Jun 15 01:50:48.056382 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:50:48.056353 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wkpsn\" is forbidden: User \"system:node:ip-10-0-132-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-124.ec2.internal' and this object" podUID="2b9c303f-a5c2-4e1a-a161-5b3670bbb678" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkpsn" Jun 15 01:50:48.061137 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:48.061121 2576 scope.go:117] "RemoveContainer" containerID="dde83e951e8578193d98378612cda9c65f55f31ff7924d879470f96bd9642f7f" Jun 15 01:50:48.061439 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:50:48.061419 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dde83e951e8578193d98378612cda9c65f55f31ff7924d879470f96bd9642f7f\": container with ID starting with dde83e951e8578193d98378612cda9c65f55f31ff7924d879470f96bd9642f7f not found: ID does not exist" containerID="dde83e951e8578193d98378612cda9c65f55f31ff7924d879470f96bd9642f7f" Jun 15 01:50:48.061492 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:48.061448 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dde83e951e8578193d98378612cda9c65f55f31ff7924d879470f96bd9642f7f"} err="failed to get container status \"dde83e951e8578193d98378612cda9c65f55f31ff7924d879470f96bd9642f7f\": rpc error: code = NotFound desc = could not find container \"dde83e951e8578193d98378612cda9c65f55f31ff7924d879470f96bd9642f7f\": container with ID starting with dde83e951e8578193d98378612cda9c65f55f31ff7924d879470f96bd9642f7f not found: ID does not exist" Jun 15 01:50:48.068646 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:48.068615 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7z7fk" Jun 15 01:50:48.128525 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:48.128490 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgpgv\" (UniqueName: \"kubernetes.io/projected/2b9c303f-a5c2-4e1a-a161-5b3670bbb678-kube-api-access-xgpgv\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:50:48.128655 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:48.128528 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b9c303f-a5c2-4e1a-a161-5b3670bbb678-extensions-socket-volume\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:50:48.212773 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:48.212710 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7z7fk"] Jun 15 01:50:48.215876 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:50:48.215846 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba8cecd8_6122_46bd_a3ed_e5861a83499b.slice/crio-199d6fb3d9a16a08cf4e12e2ee0ecd5268f022dcc260d08cd7a795dc8a37dcd6 WatchSource:0}: Error finding container 199d6fb3d9a16a08cf4e12e2ee0ecd5268f022dcc260d08cd7a795dc8a37dcd6: Status 404 returned error can't find the container with id 199d6fb3d9a16a08cf4e12e2ee0ecd5268f022dcc260d08cd7a795dc8a37dcd6 Jun 15 01:50:48.832459 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:48.832416 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nsf2h"] Jun 15 01:50:48.836010 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:48.835992 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nsf2h" Jun 15 01:50:48.867166 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:48.867129 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nsf2h"] Jun 15 01:50:48.934972 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:48.934933 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54zcj\" (UniqueName: \"kubernetes.io/projected/b73acb3e-c97e-4b35-9d13-e7ccec5185a5-kube-api-access-54zcj\") pod \"kuadrant-operator-controller-manager-86878c769f-nsf2h\" (UID: \"b73acb3e-c97e-4b35-9d13-e7ccec5185a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nsf2h" Jun 15 01:50:48.935173 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:48.935011 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b73acb3e-c97e-4b35-9d13-e7ccec5185a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nsf2h\" (UID: \"b73acb3e-c97e-4b35-9d13-e7ccec5185a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nsf2h" Jun 15 01:50:49.035760 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:49.035719 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b73acb3e-c97e-4b35-9d13-e7ccec5185a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nsf2h\" (UID: \"b73acb3e-c97e-4b35-9d13-e7ccec5185a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nsf2h" Jun 15 01:50:49.035957 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:49.035828 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54zcj\" (UniqueName: \"kubernetes.io/projected/b73acb3e-c97e-4b35-9d13-e7ccec5185a5-kube-api-access-54zcj\") pod \"kuadrant-operator-controller-manager-86878c769f-nsf2h\" (UID: \"b73acb3e-c97e-4b35-9d13-e7ccec5185a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nsf2h" Jun 15 01:50:49.036144 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:49.036119 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b73acb3e-c97e-4b35-9d13-e7ccec5185a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nsf2h\" (UID: \"b73acb3e-c97e-4b35-9d13-e7ccec5185a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nsf2h" Jun 15 01:50:49.046993 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:49.046957 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54zcj\" (UniqueName: \"kubernetes.io/projected/b73acb3e-c97e-4b35-9d13-e7ccec5185a5-kube-api-access-54zcj\") pod \"kuadrant-operator-controller-manager-86878c769f-nsf2h\" (UID: \"b73acb3e-c97e-4b35-9d13-e7ccec5185a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nsf2h" Jun 15 01:50:49.057860 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:49.057830 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7z7fk" event={"ID":"ba8cecd8-6122-46bd-a3ed-e5861a83499b","Type":"ContainerStarted","Data":"3dd07c26e65a7035ace2fbef327e96e9bc034a54001be8f542bfdffde96182cc"} Jun 15 01:50:49.058021 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:49.057879 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7z7fk" event={"ID":"ba8cecd8-6122-46bd-a3ed-e5861a83499b","Type":"ContainerStarted","Data":"199d6fb3d9a16a08cf4e12e2ee0ecd5268f022dcc260d08cd7a795dc8a37dcd6"} Jun 15 01:50:49.058021 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:49.057960 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7z7fk" Jun 15 01:50:49.084063 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:49.083942 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7z7fk" podStartSLOduration=2.083917339 podStartE2EDuration="2.083917339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:50:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:50:49.0819799 +0000 UTC m=+727.440520296" watchObservedRunningTime="2026-06-15 01:50:49.083917339 +0000 UTC m=+727.442457735" Jun 15 01:50:49.146259 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:49.146219 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nsf2h" Jun 15 01:50:49.288302 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:49.288275 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nsf2h"] Jun 15 01:50:49.290014 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:50:49.289986 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb73acb3e_c97e_4b35_9d13_e7ccec5185a5.slice/crio-862df35baf94bc396c824e54c82600dd13a8ba7e7e1b65891b539637b93f7743 WatchSource:0}: Error finding container 862df35baf94bc396c824e54c82600dd13a8ba7e7e1b65891b539637b93f7743: Status 404 returned error can't find the container with id 862df35baf94bc396c824e54c82600dd13a8ba7e7e1b65891b539637b93f7743 Jun 15 01:50:50.065328 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:50.065284 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nsf2h" event={"ID":"b73acb3e-c97e-4b35-9d13-e7ccec5185a5","Type":"ContainerStarted","Data":"42e29aa98a5d365a276bc8ff59abee85100550101a1d4716156de1e7795e43c2"} Jun 15 01:50:50.065740 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:50.065365 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nsf2h" event={"ID":"b73acb3e-c97e-4b35-9d13-e7ccec5185a5","Type":"ContainerStarted","Data":"862df35baf94bc396c824e54c82600dd13a8ba7e7e1b65891b539637b93f7743"} Jun 15 01:50:50.065740 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:50.065458 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nsf2h" Jun 15 01:50:50.086409 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:50.086357 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nsf2h" podStartSLOduration=2.086324914 podStartE2EDuration="2.086324914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:50:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:50:50.083253393 +0000 UTC m=+728.441793788" watchObservedRunningTime="2026-06-15 01:50:50.086324914 +0000 UTC m=+728.444865309" Jun 15 01:50:51.006292 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:50:51.006263 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vkw8s" Jun 15 01:51:00.067391 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:00.067360 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7z7fk" Jun 15 01:51:01.074600 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:01.074566 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nsf2h" Jun 15 01:51:01.129320 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:01.129290 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7z7fk"] Jun 15 01:51:01.129525 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:01.129496 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7z7fk" podUID="ba8cecd8-6122-46bd-a3ed-e5861a83499b" containerName="manager" containerID="cri-o://3dd07c26e65a7035ace2fbef327e96e9bc034a54001be8f542bfdffde96182cc" gracePeriod=10 Jun 15 01:51:01.397035 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:01.397003 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7z7fk" Jun 15 01:51:01.549582 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:01.549543 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gt85\" (UniqueName: \"kubernetes.io/projected/ba8cecd8-6122-46bd-a3ed-e5861a83499b-kube-api-access-9gt85\") pod \"ba8cecd8-6122-46bd-a3ed-e5861a83499b\" (UID: \"ba8cecd8-6122-46bd-a3ed-e5861a83499b\") " Jun 15 01:51:01.549582 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:01.549586 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba8cecd8-6122-46bd-a3ed-e5861a83499b-extensions-socket-volume\") pod \"ba8cecd8-6122-46bd-a3ed-e5861a83499b\" (UID: \"ba8cecd8-6122-46bd-a3ed-e5861a83499b\") " Jun 15 01:51:01.550050 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:01.550020 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba8cecd8-6122-46bd-a3ed-e5861a83499b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ba8cecd8-6122-46bd-a3ed-e5861a83499b" (UID: "ba8cecd8-6122-46bd-a3ed-e5861a83499b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:51:01.551830 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:01.551808 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba8cecd8-6122-46bd-a3ed-e5861a83499b-kube-api-access-9gt85" (OuterVolumeSpecName: "kube-api-access-9gt85") pod "ba8cecd8-6122-46bd-a3ed-e5861a83499b" (UID: "ba8cecd8-6122-46bd-a3ed-e5861a83499b"). InnerVolumeSpecName "kube-api-access-9gt85". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:51:01.651077 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:01.651041 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gt85\" (UniqueName: \"kubernetes.io/projected/ba8cecd8-6122-46bd-a3ed-e5861a83499b-kube-api-access-9gt85\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:51:01.651077 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:01.651072 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba8cecd8-6122-46bd-a3ed-e5861a83499b-extensions-socket-volume\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:51:02.135636 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:02.135600 2576 generic.go:356] "Generic (PLEG): container finished" podID="ba8cecd8-6122-46bd-a3ed-e5861a83499b" containerID="3dd07c26e65a7035ace2fbef327e96e9bc034a54001be8f542bfdffde96182cc" exitCode=0 Jun 15 01:51:02.135636 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:02.135640 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7z7fk" Jun 15 01:51:02.136113 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:02.135658 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7z7fk" event={"ID":"ba8cecd8-6122-46bd-a3ed-e5861a83499b","Type":"ContainerDied","Data":"3dd07c26e65a7035ace2fbef327e96e9bc034a54001be8f542bfdffde96182cc"} Jun 15 01:51:02.136113 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:02.135708 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7z7fk" event={"ID":"ba8cecd8-6122-46bd-a3ed-e5861a83499b","Type":"ContainerDied","Data":"199d6fb3d9a16a08cf4e12e2ee0ecd5268f022dcc260d08cd7a795dc8a37dcd6"} Jun 15 01:51:02.136113 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:02.135733 2576 scope.go:117] "RemoveContainer" containerID="3dd07c26e65a7035ace2fbef327e96e9bc034a54001be8f542bfdffde96182cc" Jun 15 01:51:02.145001 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:02.144979 2576 scope.go:117] "RemoveContainer" containerID="3dd07c26e65a7035ace2fbef327e96e9bc034a54001be8f542bfdffde96182cc" Jun 15 01:51:02.145238 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:51:02.145220 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dd07c26e65a7035ace2fbef327e96e9bc034a54001be8f542bfdffde96182cc\": container with ID starting with 3dd07c26e65a7035ace2fbef327e96e9bc034a54001be8f542bfdffde96182cc not found: ID does not exist" containerID="3dd07c26e65a7035ace2fbef327e96e9bc034a54001be8f542bfdffde96182cc" Jun 15 01:51:02.145292 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:02.145247 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dd07c26e65a7035ace2fbef327e96e9bc034a54001be8f542bfdffde96182cc"} err="failed to get container status \"3dd07c26e65a7035ace2fbef327e96e9bc034a54001be8f542bfdffde96182cc\": rpc error: code = NotFound desc = could not find container \"3dd07c26e65a7035ace2fbef327e96e9bc034a54001be8f542bfdffde96182cc\": container with ID starting with 3dd07c26e65a7035ace2fbef327e96e9bc034a54001be8f542bfdffde96182cc not found: ID does not exist" Jun 15 01:51:02.162480 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:02.162442 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7z7fk"] Jun 15 01:51:02.170104 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:02.170076 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7z7fk"] Jun 15 01:51:04.051014 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:04.050974 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba8cecd8-6122-46bd-a3ed-e5861a83499b" path="/var/lib/kubelet/pods/ba8cecd8-6122-46bd-a3ed-e5861a83499b/volumes" Jun 15 01:51:23.078953 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.078915 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 01:51:23.082355 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.082309 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba8cecd8-6122-46bd-a3ed-e5861a83499b" containerName="manager" Jun 15 01:51:23.082517 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.082373 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba8cecd8-6122-46bd-a3ed-e5861a83499b" containerName="manager" Jun 15 01:51:23.082572 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.082556 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba8cecd8-6122-46bd-a3ed-e5861a83499b" containerName="manager" Jun 15 01:51:23.093400 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.093371 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-lmkk9" Jun 15 01:51:23.095071 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.095043 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 01:51:23.097017 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.096993 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6whwg\"" Jun 15 01:51:23.097154 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.096993 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 15 01:51:23.107149 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.107123 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 01:51:23.143432 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.143396 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr5mz\" (UniqueName: \"kubernetes.io/projected/13adb24d-d4a9-4c1a-9c53-2b776bb523a3-kube-api-access-fr5mz\") pod \"limitador-limitador-54d6d988d5-lmkk9\" (UID: \"13adb24d-d4a9-4c1a-9c53-2b776bb523a3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lmkk9" Jun 15 01:51:23.143637 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.143530 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/13adb24d-d4a9-4c1a-9c53-2b776bb523a3-config-file\") pod \"limitador-limitador-54d6d988d5-lmkk9\" (UID: \"13adb24d-d4a9-4c1a-9c53-2b776bb523a3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lmkk9" Jun 15 01:51:23.244730 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.244700 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/13adb24d-d4a9-4c1a-9c53-2b776bb523a3-config-file\") pod \"limitador-limitador-54d6d988d5-lmkk9\" (UID: \"13adb24d-d4a9-4c1a-9c53-2b776bb523a3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lmkk9" Jun 15 01:51:23.244933 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.244748 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr5mz\" (UniqueName: \"kubernetes.io/projected/13adb24d-d4a9-4c1a-9c53-2b776bb523a3-kube-api-access-fr5mz\") pod \"limitador-limitador-54d6d988d5-lmkk9\" (UID: \"13adb24d-d4a9-4c1a-9c53-2b776bb523a3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lmkk9" Jun 15 01:51:23.245332 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.245312 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/13adb24d-d4a9-4c1a-9c53-2b776bb523a3-config-file\") pod \"limitador-limitador-54d6d988d5-lmkk9\" (UID: \"13adb24d-d4a9-4c1a-9c53-2b776bb523a3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lmkk9" Jun 15 01:51:23.252941 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.252911 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr5mz\" (UniqueName: \"kubernetes.io/projected/13adb24d-d4a9-4c1a-9c53-2b776bb523a3-kube-api-access-fr5mz\") pod \"limitador-limitador-54d6d988d5-lmkk9\" (UID: \"13adb24d-d4a9-4c1a-9c53-2b776bb523a3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lmkk9" Jun 15 01:51:23.409289 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.409245 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-lmkk9" Jun 15 01:51:23.478137 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.478105 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-t5jzk"] Jun 15 01:51:23.483958 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.483933 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-t5jzk" Jun 15 01:51:23.486646 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.486614 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6xchh\"" Jun 15 01:51:23.492461 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.492438 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-t5jzk"] Jun 15 01:51:23.547572 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.547538 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p278\" (UniqueName: \"kubernetes.io/projected/3f7182cd-5f2a-4e54-9e40-90ceb50607f2-kube-api-access-6p278\") pod \"authorino-58cd955675-t5jzk\" (UID: \"3f7182cd-5f2a-4e54-9e40-90ceb50607f2\") " pod="kuadrant-system/authorino-58cd955675-t5jzk" Jun 15 01:51:23.556706 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.556679 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 01:51:23.557837 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:51:23.557800 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13adb24d_d4a9_4c1a_9c53_2b776bb523a3.slice/crio-96c8c1dd24cb0e29f5597dfd85a9b0ef72f6ef7903a3fe726a8bd4af748771c4 WatchSource:0}: Error finding container 96c8c1dd24cb0e29f5597dfd85a9b0ef72f6ef7903a3fe726a8bd4af748771c4: Status 404 returned error can't find the container with id 96c8c1dd24cb0e29f5597dfd85a9b0ef72f6ef7903a3fe726a8bd4af748771c4 Jun 15 01:51:23.648976 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.648934 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p278\" (UniqueName: \"kubernetes.io/projected/3f7182cd-5f2a-4e54-9e40-90ceb50607f2-kube-api-access-6p278\") pod \"authorino-58cd955675-t5jzk\" (UID: \"3f7182cd-5f2a-4e54-9e40-90ceb50607f2\") " pod="kuadrant-system/authorino-58cd955675-t5jzk" Jun 15 01:51:23.657646 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.657617 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p278\" (UniqueName: \"kubernetes.io/projected/3f7182cd-5f2a-4e54-9e40-90ceb50607f2-kube-api-access-6p278\") pod \"authorino-58cd955675-t5jzk\" (UID: \"3f7182cd-5f2a-4e54-9e40-90ceb50607f2\") " pod="kuadrant-system/authorino-58cd955675-t5jzk" Jun 15 01:51:23.795480 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.795392 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-t5jzk" Jun 15 01:51:23.930466 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:23.930438 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-t5jzk"] Jun 15 01:51:23.931132 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:51:23.931102 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f7182cd_5f2a_4e54_9e40_90ceb50607f2.slice/crio-55fc3d613951d33ffbce06bb04364d574bc00859fffa6be741d1102d2f10b3e1 WatchSource:0}: Error finding container 55fc3d613951d33ffbce06bb04364d574bc00859fffa6be741d1102d2f10b3e1: Status 404 returned error can't find the container with id 55fc3d613951d33ffbce06bb04364d574bc00859fffa6be741d1102d2f10b3e1 Jun 15 01:51:24.259496 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:24.259460 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-lmkk9" event={"ID":"13adb24d-d4a9-4c1a-9c53-2b776bb523a3","Type":"ContainerStarted","Data":"96c8c1dd24cb0e29f5597dfd85a9b0ef72f6ef7903a3fe726a8bd4af748771c4"} Jun 15 01:51:24.261117 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:24.261082 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-t5jzk" event={"ID":"3f7182cd-5f2a-4e54-9e40-90ceb50607f2","Type":"ContainerStarted","Data":"55fc3d613951d33ffbce06bb04364d574bc00859fffa6be741d1102d2f10b3e1"} Jun 15 01:51:28.289608 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:28.289564 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-t5jzk" event={"ID":"3f7182cd-5f2a-4e54-9e40-90ceb50607f2","Type":"ContainerStarted","Data":"d3d9485d6816c92fc8d10bf8d2f874749f8161ad0c7eee3cf2bc06e567943696"} Jun 15 01:51:28.291269 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:28.291237 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-lmkk9" event={"ID":"13adb24d-d4a9-4c1a-9c53-2b776bb523a3","Type":"ContainerStarted","Data":"b2f885b567443ba5811fefce5734c98e05096fb450b88f81c3af9f00344f2707"} Jun 15 01:51:28.291381 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:28.291300 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-lmkk9" Jun 15 01:51:28.307150 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:28.307105 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-t5jzk" podStartSLOduration=1.429727547 podStartE2EDuration="5.307093135s" totalImagesPullingTime="3.877365588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:51:28.304760449 +0000 UTC m=+766.663300845" watchObservedRunningTime="2026-06-15 01:51:28.307093135 +0000 UTC m=+766.665633531" Jun 15 01:51:28.325313 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:28.325249 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-lmkk9" podStartSLOduration=1.075345344 podStartE2EDuration="5.325225548s" totalImagesPullingTime="4.249880204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:51:28.321367092 +0000 UTC m=+766.679907486" watchObservedRunningTime="2026-06-15 01:51:28.325225548 +0000 UTC m=+766.683765945" Jun 15 01:51:28.693649 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:28.693616 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-t5jzk"] Jun 15 01:51:30.302201 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:30.302157 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-t5jzk" podUID="3f7182cd-5f2a-4e54-9e40-90ceb50607f2" containerName="authorino" containerID="cri-o://d3d9485d6816c92fc8d10bf8d2f874749f8161ad0c7eee3cf2bc06e567943696" gracePeriod=30 Jun 15 01:51:30.556985 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:30.556914 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-t5jzk" Jun 15 01:51:30.617776 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:30.617731 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6p278\" (UniqueName: \"kubernetes.io/projected/3f7182cd-5f2a-4e54-9e40-90ceb50607f2-kube-api-access-6p278\") pod \"3f7182cd-5f2a-4e54-9e40-90ceb50607f2\" (UID: \"3f7182cd-5f2a-4e54-9e40-90ceb50607f2\") " Jun 15 01:51:30.619791 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:30.619767 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f7182cd-5f2a-4e54-9e40-90ceb50607f2-kube-api-access-6p278" (OuterVolumeSpecName: "kube-api-access-6p278") pod "3f7182cd-5f2a-4e54-9e40-90ceb50607f2" (UID: "3f7182cd-5f2a-4e54-9e40-90ceb50607f2"). InnerVolumeSpecName "kube-api-access-6p278". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:51:30.719501 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:30.719445 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6p278\" (UniqueName: \"kubernetes.io/projected/3f7182cd-5f2a-4e54-9e40-90ceb50607f2-kube-api-access-6p278\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:51:31.308952 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:31.308915 2576 generic.go:356] "Generic (PLEG): container finished" podID="3f7182cd-5f2a-4e54-9e40-90ceb50607f2" containerID="d3d9485d6816c92fc8d10bf8d2f874749f8161ad0c7eee3cf2bc06e567943696" exitCode=0 Jun 15 01:51:31.309353 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:31.308959 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-t5jzk" Jun 15 01:51:31.309353 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:31.309003 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-t5jzk" event={"ID":"3f7182cd-5f2a-4e54-9e40-90ceb50607f2","Type":"ContainerDied","Data":"d3d9485d6816c92fc8d10bf8d2f874749f8161ad0c7eee3cf2bc06e567943696"} Jun 15 01:51:31.309353 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:31.309054 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-t5jzk" event={"ID":"3f7182cd-5f2a-4e54-9e40-90ceb50607f2","Type":"ContainerDied","Data":"55fc3d613951d33ffbce06bb04364d574bc00859fffa6be741d1102d2f10b3e1"} Jun 15 01:51:31.309353 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:31.309071 2576 scope.go:117] "RemoveContainer" containerID="d3d9485d6816c92fc8d10bf8d2f874749f8161ad0c7eee3cf2bc06e567943696" Jun 15 01:51:31.318256 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:31.318238 2576 scope.go:117] "RemoveContainer" containerID="d3d9485d6816c92fc8d10bf8d2f874749f8161ad0c7eee3cf2bc06e567943696" Jun 15 01:51:31.318550 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:51:31.318526 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3d9485d6816c92fc8d10bf8d2f874749f8161ad0c7eee3cf2bc06e567943696\": container with ID starting with d3d9485d6816c92fc8d10bf8d2f874749f8161ad0c7eee3cf2bc06e567943696 not found: ID does not exist" containerID="d3d9485d6816c92fc8d10bf8d2f874749f8161ad0c7eee3cf2bc06e567943696" Jun 15 01:51:31.318638 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:31.318560 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3d9485d6816c92fc8d10bf8d2f874749f8161ad0c7eee3cf2bc06e567943696"} err="failed to get container status \"d3d9485d6816c92fc8d10bf8d2f874749f8161ad0c7eee3cf2bc06e567943696\": rpc error: code = NotFound desc = could not find container \"d3d9485d6816c92fc8d10bf8d2f874749f8161ad0c7eee3cf2bc06e567943696\": container with ID starting with d3d9485d6816c92fc8d10bf8d2f874749f8161ad0c7eee3cf2bc06e567943696 not found: ID does not exist" Jun 15 01:51:31.330420 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:31.330393 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-t5jzk"] Jun 15 01:51:31.332602 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:31.332584 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-t5jzk"] Jun 15 01:51:32.050563 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:32.050530 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f7182cd-5f2a-4e54-9e40-90ceb50607f2" path="/var/lib/kubelet/pods/3f7182cd-5f2a-4e54-9e40-90ceb50607f2/volumes" Jun 15 01:51:39.297688 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:39.297656 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-lmkk9" Jun 15 01:51:56.022511 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:56.022476 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j"] Jun 15 01:51:56.022981 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:56.022889 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f7182cd-5f2a-4e54-9e40-90ceb50607f2" containerName="authorino" Jun 15 01:51:56.022981 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:56.022900 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f7182cd-5f2a-4e54-9e40-90ceb50607f2" containerName="authorino" Jun 15 01:51:56.022981 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:56.022964 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f7182cd-5f2a-4e54-9e40-90ceb50607f2" containerName="authorino" Jun 15 01:51:56.027544 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:56.027527 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j" Jun 15 01:51:56.030524 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:56.030501 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 01:51:56.031485 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:56.031471 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jcb4x\"" Jun 15 01:51:56.031586 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:56.031508 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 01:51:56.036476 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:56.036456 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j"] Jun 15 01:51:56.135247 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:56.135210 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfplp\" (UniqueName: \"kubernetes.io/projected/ea7f4226-c3d5-4d63-8ba6-d01bb0203391-kube-api-access-xfplp\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j\" (UID: \"ea7f4226-c3d5-4d63-8ba6-d01bb0203391\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j" Jun 15 01:51:56.135398 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:56.135312 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea7f4226-c3d5-4d63-8ba6-d01bb0203391-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j\" (UID: \"ea7f4226-c3d5-4d63-8ba6-d01bb0203391\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j" Jun 15 01:51:56.135398 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:56.135359 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea7f4226-c3d5-4d63-8ba6-d01bb0203391-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j\" (UID: \"ea7f4226-c3d5-4d63-8ba6-d01bb0203391\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j" Jun 15 01:51:56.236652 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:56.236622 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea7f4226-c3d5-4d63-8ba6-d01bb0203391-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j\" (UID: \"ea7f4226-c3d5-4d63-8ba6-d01bb0203391\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j" Jun 15 01:51:56.236770 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:56.236657 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea7f4226-c3d5-4d63-8ba6-d01bb0203391-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j\" (UID: \"ea7f4226-c3d5-4d63-8ba6-d01bb0203391\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j" Jun 15 01:51:56.236770 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:56.236712 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfplp\" (UniqueName: \"kubernetes.io/projected/ea7f4226-c3d5-4d63-8ba6-d01bb0203391-kube-api-access-xfplp\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j\" (UID: \"ea7f4226-c3d5-4d63-8ba6-d01bb0203391\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j" Jun 15 01:51:56.237071 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:56.237051 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea7f4226-c3d5-4d63-8ba6-d01bb0203391-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j\" (UID: \"ea7f4226-c3d5-4d63-8ba6-d01bb0203391\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j" Jun 15 01:51:56.237121 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:56.237060 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea7f4226-c3d5-4d63-8ba6-d01bb0203391-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j\" (UID: \"ea7f4226-c3d5-4d63-8ba6-d01bb0203391\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j" Jun 15 01:51:56.251558 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:56.251535 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfplp\" (UniqueName: \"kubernetes.io/projected/ea7f4226-c3d5-4d63-8ba6-d01bb0203391-kube-api-access-xfplp\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j\" (UID: \"ea7f4226-c3d5-4d63-8ba6-d01bb0203391\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j" Jun 15 01:51:56.337760 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:56.337694 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j" Jun 15 01:51:56.467410 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:56.467382 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j"] Jun 15 01:51:56.469165 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:51:56.469143 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea7f4226_c3d5_4d63_8ba6_d01bb0203391.slice/crio-0dd99e4359eeb4b6bb7e331c93b5c691c4f8bce18de8ada43db1d8d25ab7b60e WatchSource:0}: Error finding container 0dd99e4359eeb4b6bb7e331c93b5c691c4f8bce18de8ada43db1d8d25ab7b60e: Status 404 returned error can't find the container with id 0dd99e4359eeb4b6bb7e331c93b5c691c4f8bce18de8ada43db1d8d25ab7b60e Jun 15 01:51:57.453697 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:57.453658 2576 generic.go:356] "Generic (PLEG): container finished" podID="ea7f4226-c3d5-4d63-8ba6-d01bb0203391" containerID="fa986d39fc28ce2422a0154727609fcc87eaaf85aa41e520b38bf15f7ab96650" exitCode=0 Jun 15 01:51:57.454194 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:57.453725 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j" event={"ID":"ea7f4226-c3d5-4d63-8ba6-d01bb0203391","Type":"ContainerDied","Data":"fa986d39fc28ce2422a0154727609fcc87eaaf85aa41e520b38bf15f7ab96650"} Jun 15 01:51:57.454194 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:57.453823 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j" event={"ID":"ea7f4226-c3d5-4d63-8ba6-d01bb0203391","Type":"ContainerStarted","Data":"0dd99e4359eeb4b6bb7e331c93b5c691c4f8bce18de8ada43db1d8d25ab7b60e"} Jun 15 01:51:59.465509 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:59.465463 2576 generic.go:356] "Generic (PLEG): container finished" podID="ea7f4226-c3d5-4d63-8ba6-d01bb0203391" containerID="986a49805c41fbc01e7af2345573d87614db87df4c1c8b8d9630fac2d56a6153" exitCode=0 Jun 15 01:51:59.465903 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:51:59.465548 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j" event={"ID":"ea7f4226-c3d5-4d63-8ba6-d01bb0203391","Type":"ContainerDied","Data":"986a49805c41fbc01e7af2345573d87614db87df4c1c8b8d9630fac2d56a6153"} Jun 15 01:52:00.475394 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:00.475357 2576 generic.go:356] "Generic (PLEG): container finished" podID="ea7f4226-c3d5-4d63-8ba6-d01bb0203391" containerID="e510e53a95521570e1b7d34ef7fb133e41dc450953c0b63fcd9bd764423a7299" exitCode=0 Jun 15 01:52:00.475394 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:00.475391 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j" event={"ID":"ea7f4226-c3d5-4d63-8ba6-d01bb0203391","Type":"ContainerDied","Data":"e510e53a95521570e1b7d34ef7fb133e41dc450953c0b63fcd9bd764423a7299"} Jun 15 01:52:01.617474 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:01.617449 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j" Jun 15 01:52:01.787249 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:01.787146 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea7f4226-c3d5-4d63-8ba6-d01bb0203391-util\") pod \"ea7f4226-c3d5-4d63-8ba6-d01bb0203391\" (UID: \"ea7f4226-c3d5-4d63-8ba6-d01bb0203391\") " Jun 15 01:52:01.787249 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:01.787186 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea7f4226-c3d5-4d63-8ba6-d01bb0203391-bundle\") pod \"ea7f4226-c3d5-4d63-8ba6-d01bb0203391\" (UID: \"ea7f4226-c3d5-4d63-8ba6-d01bb0203391\") " Jun 15 01:52:01.787249 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:01.787231 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfplp\" (UniqueName: \"kubernetes.io/projected/ea7f4226-c3d5-4d63-8ba6-d01bb0203391-kube-api-access-xfplp\") pod \"ea7f4226-c3d5-4d63-8ba6-d01bb0203391\" (UID: \"ea7f4226-c3d5-4d63-8ba6-d01bb0203391\") " Jun 15 01:52:01.787781 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:01.787757 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea7f4226-c3d5-4d63-8ba6-d01bb0203391-bundle" (OuterVolumeSpecName: "bundle") pod "ea7f4226-c3d5-4d63-8ba6-d01bb0203391" (UID: "ea7f4226-c3d5-4d63-8ba6-d01bb0203391"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:52:01.789329 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:01.789305 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea7f4226-c3d5-4d63-8ba6-d01bb0203391-kube-api-access-xfplp" (OuterVolumeSpecName: "kube-api-access-xfplp") pod "ea7f4226-c3d5-4d63-8ba6-d01bb0203391" (UID: "ea7f4226-c3d5-4d63-8ba6-d01bb0203391"). InnerVolumeSpecName "kube-api-access-xfplp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:52:01.792975 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:01.792934 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea7f4226-c3d5-4d63-8ba6-d01bb0203391-util" (OuterVolumeSpecName: "util") pod "ea7f4226-c3d5-4d63-8ba6-d01bb0203391" (UID: "ea7f4226-c3d5-4d63-8ba6-d01bb0203391"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 01:52:01.888210 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:01.888182 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea7f4226-c3d5-4d63-8ba6-d01bb0203391-bundle\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:52:01.888210 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:01.888207 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfplp\" (UniqueName: \"kubernetes.io/projected/ea7f4226-c3d5-4d63-8ba6-d01bb0203391-kube-api-access-xfplp\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:52:01.888210 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:01.888218 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea7f4226-c3d5-4d63-8ba6-d01bb0203391-util\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:52:02.488150 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:02.488114 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j" event={"ID":"ea7f4226-c3d5-4d63-8ba6-d01bb0203391","Type":"ContainerDied","Data":"0dd99e4359eeb4b6bb7e331c93b5c691c4f8bce18de8ada43db1d8d25ab7b60e"} Jun 15 01:52:02.488355 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:02.488159 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486pp5j" Jun 15 01:52:02.488355 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:02.488162 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0dd99e4359eeb4b6bb7e331c93b5c691c4f8bce18de8ada43db1d8d25ab7b60e" Jun 15 01:52:24.233716 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:24.233681 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 01:52:24.234091 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:24.234062 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea7f4226-c3d5-4d63-8ba6-d01bb0203391" containerName="pull" Jun 15 01:52:24.234091 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:24.234075 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea7f4226-c3d5-4d63-8ba6-d01bb0203391" containerName="pull" Jun 15 01:52:24.234163 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:24.234097 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea7f4226-c3d5-4d63-8ba6-d01bb0203391" containerName="extract" Jun 15 01:52:24.234163 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:24.234105 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea7f4226-c3d5-4d63-8ba6-d01bb0203391" containerName="extract" Jun 15 01:52:24.234163 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:24.234114 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea7f4226-c3d5-4d63-8ba6-d01bb0203391" containerName="util" Jun 15 01:52:24.234163 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:24.234123 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea7f4226-c3d5-4d63-8ba6-d01bb0203391" containerName="util" Jun 15 01:52:24.234287 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:24.234183 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea7f4226-c3d5-4d63-8ba6-d01bb0203391" containerName="extract" Jun 15 01:52:24.237245 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:24.237228 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 01:52:24.239850 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:24.239828 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-v467p\"" Jun 15 01:52:24.239964 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:24.239872 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 15 01:52:24.240899 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:24.240878 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 15 01:52:24.240994 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:24.240945 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 15 01:52:24.245905 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:24.245885 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 01:52:24.285216 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:24.285181 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqgbh\" (UniqueName: \"kubernetes.io/projected/ab1020b7-3a1a-47a1-962a-740a3c4776bd-kube-api-access-xqgbh\") pod \"maas-keycloak-0\" (UID: \"ab1020b7-3a1a-47a1-962a-740a3c4776bd\") " pod="keycloak-system/maas-keycloak-0" Jun 15 01:52:24.386391 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:24.386346 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqgbh\" (UniqueName: \"kubernetes.io/projected/ab1020b7-3a1a-47a1-962a-740a3c4776bd-kube-api-access-xqgbh\") pod \"maas-keycloak-0\" (UID: \"ab1020b7-3a1a-47a1-962a-740a3c4776bd\") " pod="keycloak-system/maas-keycloak-0" Jun 15 01:52:24.394057 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:24.394024 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqgbh\" (UniqueName: \"kubernetes.io/projected/ab1020b7-3a1a-47a1-962a-740a3c4776bd-kube-api-access-xqgbh\") pod \"maas-keycloak-0\" (UID: \"ab1020b7-3a1a-47a1-962a-740a3c4776bd\") " pod="keycloak-system/maas-keycloak-0" Jun 15 01:52:24.547989 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:24.547899 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 01:52:24.686127 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:24.686098 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 01:52:24.687812 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:52:24.687782 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab1020b7_3a1a_47a1_962a_740a3c4776bd.slice/crio-68efa364e8d4ca5a507d50190601030c54e22cb6246053b94f58cdc596359705 WatchSource:0}: Error finding container 68efa364e8d4ca5a507d50190601030c54e22cb6246053b94f58cdc596359705: Status 404 returned error can't find the container with id 68efa364e8d4ca5a507d50190601030c54e22cb6246053b94f58cdc596359705 Jun 15 01:52:24.689241 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:24.689221 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 01:52:25.619163 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:25.619078 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ab1020b7-3a1a-47a1-962a-740a3c4776bd","Type":"ContainerStarted","Data":"68efa364e8d4ca5a507d50190601030c54e22cb6246053b94f58cdc596359705"} Jun 15 01:52:29.646433 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:29.646391 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ab1020b7-3a1a-47a1-962a-740a3c4776bd","Type":"ContainerStarted","Data":"78cae51a5505164c8ed74f26c8b9d49ecac22371a26d9846dff0e7dcf796292c"} Jun 15 01:52:29.664888 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:29.664811 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.307802547 podStartE2EDuration="5.664789223s" totalImagesPullingTime="4.356986676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:52:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:52:29.662237024 +0000 UTC m=+828.020777421" watchObservedRunningTime="2026-06-15 01:52:29.664789223 +0000 UTC m=+828.023329621" Jun 15 01:52:30.548541 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:30.548492 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 15 01:52:30.550550 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:30.550507 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ab1020b7-3a1a-47a1-962a-740a3c4776bd" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 15 01:52:31.548479 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:31.548434 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ab1020b7-3a1a-47a1-962a-740a3c4776bd" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 15 01:52:32.548883 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:32.548828 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ab1020b7-3a1a-47a1-962a-740a3c4776bd" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 15 01:52:33.548444 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:33.548393 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ab1020b7-3a1a-47a1-962a-740a3c4776bd" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 15 01:52:34.548644 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:34.548594 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 15 01:52:34.550314 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:34.549890 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ab1020b7-3a1a-47a1-962a-740a3c4776bd" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 15 01:52:35.549086 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:35.549026 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ab1020b7-3a1a-47a1-962a-740a3c4776bd" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 15 01:52:36.549204 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:36.549142 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ab1020b7-3a1a-47a1-962a-740a3c4776bd" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 15 01:52:37.548412 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:37.548362 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ab1020b7-3a1a-47a1-962a-740a3c4776bd" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 15 01:52:38.548669 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:38.548614 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ab1020b7-3a1a-47a1-962a-740a3c4776bd" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 15 01:52:39.549244 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:39.549192 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ab1020b7-3a1a-47a1-962a-740a3c4776bd" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 15 01:52:40.548887 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:40.548832 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ab1020b7-3a1a-47a1-962a-740a3c4776bd" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 15 01:52:41.548967 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:41.548916 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ab1020b7-3a1a-47a1-962a-740a3c4776bd" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 15 01:52:42.674019 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:42.673981 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 15 01:52:42.693583 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:42.693535 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="ab1020b7-3a1a-47a1-962a-740a3c4776bd" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 01:52:52.679830 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:52.679793 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 15 01:52:53.776084 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:53.776051 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-glt25"] Jun 15 01:52:53.783014 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:53.782995 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-glt25" Jun 15 01:52:53.786588 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:53.786562 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6xchh\"" Jun 15 01:52:53.786710 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:53.786621 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 15 01:52:53.789155 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:53.789123 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-glt25"] Jun 15 01:52:53.811797 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:53.811773 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-glt25"] Jun 15 01:52:53.812090 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:52:53.812065 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-mkp4t tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-mkp4t tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-glt25" podUID="8a6e0d8a-1ba1-4cfa-9c09-c6d0f27fc56a" Jun 15 01:52:53.823504 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:53.823480 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-glt25" Jun 15 01:52:53.828856 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:53.828838 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-glt25" Jun 15 01:52:54.828216 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:54.828186 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-glt25" Jun 15 01:52:54.854317 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:54.854275 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-glt25"] Jun 15 01:52:54.857571 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:54.857543 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-glt25"] Jun 15 01:52:56.050553 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:52:56.050521 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a6e0d8a-1ba1-4cfa-9c09-c6d0f27fc56a" path="/var/lib/kubelet/pods/8a6e0d8a-1ba1-4cfa-9c09-c6d0f27fc56a/volumes" Jun 15 01:53:30.764164 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:30.764076 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 01:53:42.070097 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:42.070067 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-5qb7h_ee20262f-ced8-4d5c-8bf8-15fefc664812/console-operator/1.log" Jun 15 01:53:42.070677 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:42.070660 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-5qb7h_ee20262f-ced8-4d5c-8bf8-15fefc664812/console-operator/1.log" Jun 15 01:53:42.242860 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:42.242819 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 01:53:42.243163 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:42.243107 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="ab1020b7-3a1a-47a1-962a-740a3c4776bd" containerName="keycloak" containerID="cri-o://78cae51a5505164c8ed74f26c8b9d49ecac22371a26d9846dff0e7dcf796292c" gracePeriod=30 Jun 15 01:53:42.678499 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:42.678455 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="ab1020b7-3a1a-47a1-962a-740a3c4776bd" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 01:53:43.905621 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:43.905597 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 01:53:44.027230 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.027135 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqgbh\" (UniqueName: \"kubernetes.io/projected/ab1020b7-3a1a-47a1-962a-740a3c4776bd-kube-api-access-xqgbh\") pod \"ab1020b7-3a1a-47a1-962a-740a3c4776bd\" (UID: \"ab1020b7-3a1a-47a1-962a-740a3c4776bd\") " Jun 15 01:53:44.029312 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.029281 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab1020b7-3a1a-47a1-962a-740a3c4776bd-kube-api-access-xqgbh" (OuterVolumeSpecName: "kube-api-access-xqgbh") pod "ab1020b7-3a1a-47a1-962a-740a3c4776bd" (UID: "ab1020b7-3a1a-47a1-962a-740a3c4776bd"). InnerVolumeSpecName "kube-api-access-xqgbh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:53:44.097109 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.097072 2576 generic.go:356] "Generic (PLEG): container finished" podID="ab1020b7-3a1a-47a1-962a-740a3c4776bd" containerID="78cae51a5505164c8ed74f26c8b9d49ecac22371a26d9846dff0e7dcf796292c" exitCode=143 Jun 15 01:53:44.097285 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.097120 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 01:53:44.097285 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.097158 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ab1020b7-3a1a-47a1-962a-740a3c4776bd","Type":"ContainerDied","Data":"78cae51a5505164c8ed74f26c8b9d49ecac22371a26d9846dff0e7dcf796292c"} Jun 15 01:53:44.097285 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.097213 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ab1020b7-3a1a-47a1-962a-740a3c4776bd","Type":"ContainerDied","Data":"68efa364e8d4ca5a507d50190601030c54e22cb6246053b94f58cdc596359705"} Jun 15 01:53:44.097285 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.097238 2576 scope.go:117] "RemoveContainer" containerID="78cae51a5505164c8ed74f26c8b9d49ecac22371a26d9846dff0e7dcf796292c" Jun 15 01:53:44.107443 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.107423 2576 scope.go:117] "RemoveContainer" containerID="78cae51a5505164c8ed74f26c8b9d49ecac22371a26d9846dff0e7dcf796292c" Jun 15 01:53:44.107698 ip-10-0-132-124 kubenswrapper[2576]: E0615 01:53:44.107679 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78cae51a5505164c8ed74f26c8b9d49ecac22371a26d9846dff0e7dcf796292c\": container with ID starting with 78cae51a5505164c8ed74f26c8b9d49ecac22371a26d9846dff0e7dcf796292c not found: ID does not exist" containerID="78cae51a5505164c8ed74f26c8b9d49ecac22371a26d9846dff0e7dcf796292c" Jun 15 01:53:44.107767 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.107711 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78cae51a5505164c8ed74f26c8b9d49ecac22371a26d9846dff0e7dcf796292c"} err="failed to get container status \"78cae51a5505164c8ed74f26c8b9d49ecac22371a26d9846dff0e7dcf796292c\": rpc error: code = NotFound desc = could not find container \"78cae51a5505164c8ed74f26c8b9d49ecac22371a26d9846dff0e7dcf796292c\": container with ID starting with 78cae51a5505164c8ed74f26c8b9d49ecac22371a26d9846dff0e7dcf796292c not found: ID does not exist" Jun 15 01:53:44.115181 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.115155 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 01:53:44.119873 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.119854 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 01:53:44.128745 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.128730 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqgbh\" (UniqueName: \"kubernetes.io/projected/ab1020b7-3a1a-47a1-962a-740a3c4776bd-kube-api-access-xqgbh\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 01:53:44.141988 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.141957 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 01:53:44.142455 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.142437 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab1020b7-3a1a-47a1-962a-740a3c4776bd" containerName="keycloak" Jun 15 01:53:44.142455 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.142456 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab1020b7-3a1a-47a1-962a-740a3c4776bd" containerName="keycloak" Jun 15 01:53:44.142617 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.142549 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab1020b7-3a1a-47a1-962a-740a3c4776bd" containerName="keycloak" Jun 15 01:53:44.146809 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.146790 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 01:53:44.149535 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.149489 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 15 01:53:44.149633 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.149497 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 15 01:53:44.149709 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.149695 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-v467p\"" Jun 15 01:53:44.149774 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.149758 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 15 01:53:44.149840 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.149824 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 15 01:53:44.157259 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.157239 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 01:53:44.229547 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.229515 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/130be831-3769-4a43-b3f4-dce7bbbd871a-test-realms\") pod \"maas-keycloak-0\" (UID: \"130be831-3769-4a43-b3f4-dce7bbbd871a\") " pod="keycloak-system/maas-keycloak-0" Jun 15 01:53:44.229680 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.229553 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbx5h\" (UniqueName: \"kubernetes.io/projected/130be831-3769-4a43-b3f4-dce7bbbd871a-kube-api-access-bbx5h\") pod \"maas-keycloak-0\" (UID: \"130be831-3769-4a43-b3f4-dce7bbbd871a\") " pod="keycloak-system/maas-keycloak-0" Jun 15 01:53:44.330767 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.330695 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/130be831-3769-4a43-b3f4-dce7bbbd871a-test-realms\") pod \"maas-keycloak-0\" (UID: \"130be831-3769-4a43-b3f4-dce7bbbd871a\") " pod="keycloak-system/maas-keycloak-0" Jun 15 01:53:44.330767 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.330728 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbx5h\" (UniqueName: \"kubernetes.io/projected/130be831-3769-4a43-b3f4-dce7bbbd871a-kube-api-access-bbx5h\") pod \"maas-keycloak-0\" (UID: \"130be831-3769-4a43-b3f4-dce7bbbd871a\") " pod="keycloak-system/maas-keycloak-0" Jun 15 01:53:44.331441 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.331423 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/130be831-3769-4a43-b3f4-dce7bbbd871a-test-realms\") pod \"maas-keycloak-0\" (UID: \"130be831-3769-4a43-b3f4-dce7bbbd871a\") " pod="keycloak-system/maas-keycloak-0" Jun 15 01:53:44.339892 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.339863 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbx5h\" (UniqueName: \"kubernetes.io/projected/130be831-3769-4a43-b3f4-dce7bbbd871a-kube-api-access-bbx5h\") pod \"maas-keycloak-0\" (UID: \"130be831-3769-4a43-b3f4-dce7bbbd871a\") " pod="keycloak-system/maas-keycloak-0" Jun 15 01:53:44.457408 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.457377 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 01:53:44.586409 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:44.586385 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 01:53:44.588123 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:53:44.588092 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod130be831_3769_4a43_b3f4_dce7bbbd871a.slice/crio-a2a80d2fd90b037810ef4ce4031cd8a3fee63394e4688bde974b684e4e9c48ce WatchSource:0}: Error finding container a2a80d2fd90b037810ef4ce4031cd8a3fee63394e4688bde974b684e4e9c48ce: Status 404 returned error can't find the container with id a2a80d2fd90b037810ef4ce4031cd8a3fee63394e4688bde974b684e4e9c48ce Jun 15 01:53:45.105360 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:45.105311 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"130be831-3769-4a43-b3f4-dce7bbbd871a","Type":"ContainerStarted","Data":"e5395dd867694310e37bdeb5858f478f900c46b394a1e15c5893d7325aca8a2c"} Jun 15 01:53:45.105757 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:45.105462 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"130be831-3769-4a43-b3f4-dce7bbbd871a","Type":"ContainerStarted","Data":"a2a80d2fd90b037810ef4ce4031cd8a3fee63394e4688bde974b684e4e9c48ce"} Jun 15 01:53:45.125071 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:45.124529 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.704765379 podStartE2EDuration="1.124510401s" totalImagesPullingTime="419.745022ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:53:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:53:45.122833331 +0000 UTC m=+903.481373726" watchObservedRunningTime="2026-06-15 01:53:45.124510401 +0000 UTC m=+903.483050798" Jun 15 01:53:45.457594 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:45.457555 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 15 01:53:45.459400 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:45.459365 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="130be831-3769-4a43-b3f4-dce7bbbd871a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 15 01:53:46.054558 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:46.054517 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab1020b7-3a1a-47a1-962a-740a3c4776bd" path="/var/lib/kubelet/pods/ab1020b7-3a1a-47a1-962a-740a3c4776bd/volumes" Jun 15 01:53:46.458282 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:46.458219 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="130be831-3769-4a43-b3f4-dce7bbbd871a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 15 01:53:47.458307 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:47.458255 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="130be831-3769-4a43-b3f4-dce7bbbd871a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 15 01:53:48.458816 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:48.458762 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="130be831-3769-4a43-b3f4-dce7bbbd871a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 15 01:53:49.458811 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:49.458760 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="130be831-3769-4a43-b3f4-dce7bbbd871a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 15 01:53:50.458281 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:50.458230 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="130be831-3769-4a43-b3f4-dce7bbbd871a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 15 01:53:51.458670 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:51.458620 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="130be831-3769-4a43-b3f4-dce7bbbd871a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 15 01:53:52.458460 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:52.458393 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="130be831-3769-4a43-b3f4-dce7bbbd871a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 15 01:53:53.458646 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:53.458597 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="130be831-3769-4a43-b3f4-dce7bbbd871a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 15 01:53:54.457990 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:54.457943 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 15 01:53:54.458359 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:54.458296 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="130be831-3769-4a43-b3f4-dce7bbbd871a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 15 01:53:55.458661 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:55.458521 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="130be831-3769-4a43-b3f4-dce7bbbd871a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 15 01:53:56.458742 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:56.458704 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="130be831-3769-4a43-b3f4-dce7bbbd871a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 15 01:53:57.458467 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:57.458420 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="130be831-3769-4a43-b3f4-dce7bbbd871a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 15 01:53:58.584180 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:58.584138 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 15 01:53:58.597990 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:53:58.597936 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="130be831-3769-4a43-b3f4-dce7bbbd871a" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 01:54:08.590276 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:54:08.590240 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 15 01:54:36.738517 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:54:36.738483 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 01:54:48.746269 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:54:48.746227 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 01:54:57.643756 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:54:57.643718 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 01:55:03.750898 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:55:03.750817 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 01:55:11.242078 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:55:11.242044 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 01:55:15.541363 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:55:15.541298 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 01:56:04.903612 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:56:04.903573 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-9fd898bb-kcddr"] Jun 15 01:56:04.907102 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:56:04.907085 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9fd898bb-kcddr" Jun 15 01:56:04.910875 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:56:04.910815 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 15 01:56:04.911009 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:56:04.910874 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 15 01:56:04.911009 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:56:04.910960 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6xchh\"" Jun 15 01:56:04.915175 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:56:04.914948 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9fd898bb-kcddr"] Jun 15 01:56:04.962844 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:56:04.962818 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ad4b1d36-8c79-456b-b251-102d20445f55-oidc-ca\") pod \"authorino-9fd898bb-kcddr\" (UID: \"ad4b1d36-8c79-456b-b251-102d20445f55\") " pod="kuadrant-system/authorino-9fd898bb-kcddr" Jun 15 01:56:04.962952 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:56:04.962852 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad4b1d36-8c79-456b-b251-102d20445f55-tls-cert\") pod \"authorino-9fd898bb-kcddr\" (UID: \"ad4b1d36-8c79-456b-b251-102d20445f55\") " pod="kuadrant-system/authorino-9fd898bb-kcddr" Jun 15 01:56:04.962952 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:56:04.962875 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2r69\" (UniqueName: \"kubernetes.io/projected/ad4b1d36-8c79-456b-b251-102d20445f55-kube-api-access-v2r69\") pod \"authorino-9fd898bb-kcddr\" (UID: \"ad4b1d36-8c79-456b-b251-102d20445f55\") " pod="kuadrant-system/authorino-9fd898bb-kcddr" Jun 15 01:56:05.063681 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:56:05.063658 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ad4b1d36-8c79-456b-b251-102d20445f55-oidc-ca\") pod \"authorino-9fd898bb-kcddr\" (UID: \"ad4b1d36-8c79-456b-b251-102d20445f55\") " pod="kuadrant-system/authorino-9fd898bb-kcddr" Jun 15 01:56:05.063795 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:56:05.063693 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad4b1d36-8c79-456b-b251-102d20445f55-tls-cert\") pod \"authorino-9fd898bb-kcddr\" (UID: \"ad4b1d36-8c79-456b-b251-102d20445f55\") " pod="kuadrant-system/authorino-9fd898bb-kcddr" Jun 15 01:56:05.063795 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:56:05.063717 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2r69\" (UniqueName: \"kubernetes.io/projected/ad4b1d36-8c79-456b-b251-102d20445f55-kube-api-access-v2r69\") pod \"authorino-9fd898bb-kcddr\" (UID: \"ad4b1d36-8c79-456b-b251-102d20445f55\") " pod="kuadrant-system/authorino-9fd898bb-kcddr" Jun 15 01:56:05.064234 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:56:05.064215 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ad4b1d36-8c79-456b-b251-102d20445f55-oidc-ca\") pod \"authorino-9fd898bb-kcddr\" (UID: \"ad4b1d36-8c79-456b-b251-102d20445f55\") " pod="kuadrant-system/authorino-9fd898bb-kcddr" Jun 15 01:56:05.066218 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:56:05.066198 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad4b1d36-8c79-456b-b251-102d20445f55-tls-cert\") pod \"authorino-9fd898bb-kcddr\" (UID: \"ad4b1d36-8c79-456b-b251-102d20445f55\") " pod="kuadrant-system/authorino-9fd898bb-kcddr" Jun 15 01:56:05.073877 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:56:05.073858 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2r69\" (UniqueName: \"kubernetes.io/projected/ad4b1d36-8c79-456b-b251-102d20445f55-kube-api-access-v2r69\") pod \"authorino-9fd898bb-kcddr\" (UID: \"ad4b1d36-8c79-456b-b251-102d20445f55\") " pod="kuadrant-system/authorino-9fd898bb-kcddr" Jun 15 01:56:05.217918 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:56:05.217825 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9fd898bb-kcddr" Jun 15 01:56:05.353428 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:56:05.353400 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9fd898bb-kcddr"] Jun 15 01:56:05.354889 ip-10-0-132-124 kubenswrapper[2576]: W0615 01:56:05.354861 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad4b1d36_8c79_456b_b251_102d20445f55.slice/crio-e097dc4dfbf6c2755040e8da1ec4aa3be4b81cd5e69e2642a395ecd89a13ace8 WatchSource:0}: Error finding container e097dc4dfbf6c2755040e8da1ec4aa3be4b81cd5e69e2642a395ecd89a13ace8: Status 404 returned error can't find the container with id e097dc4dfbf6c2755040e8da1ec4aa3be4b81cd5e69e2642a395ecd89a13ace8 Jun 15 01:56:05.927170 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:56:05.927080 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9fd898bb-kcddr" event={"ID":"ad4b1d36-8c79-456b-b251-102d20445f55","Type":"ContainerStarted","Data":"769dc2774e3280a46afaa62f667490c20882905e4f07126002b2c8f593239838"} Jun 15 01:56:05.927170 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:56:05.927123 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9fd898bb-kcddr" event={"ID":"ad4b1d36-8c79-456b-b251-102d20445f55","Type":"ContainerStarted","Data":"e097dc4dfbf6c2755040e8da1ec4aa3be4b81cd5e69e2642a395ecd89a13ace8"} Jun 15 01:56:05.951112 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:56:05.951044 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-9fd898bb-kcddr" podStartSLOduration=1.654957511 podStartE2EDuration="1.951022156s" totalImagesPullingTime="296.064645ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:56:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:56:05.949519436 +0000 UTC m=+1044.308059833" watchObservedRunningTime="2026-06-15 01:56:05.951022156 +0000 UTC m=+1044.309562553" Jun 15 01:56:36.438166 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:56:36.438085 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 01:56:46.836562 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:56:46.836528 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 01:56:55.537590 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:56:55.537556 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 01:57:05.436795 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:57:05.436756 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 01:57:14.934276 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:57:14.934246 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 01:57:25.239632 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:57:25.239597 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 01:58:38.435481 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:58:38.435400 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 01:58:42.109160 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:58:42.109131 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-5qb7h_ee20262f-ced8-4d5c-8bf8-15fefc664812/console-operator/1.log" Jun 15 01:58:42.111319 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:58:42.111298 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-5qb7h_ee20262f-ced8-4d5c-8bf8-15fefc664812/console-operator/1.log" Jun 15 01:58:54.028419 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:58:54.028378 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 01:59:32.443658 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:59:32.443585 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 01:59:49.138239 ip-10-0-132-124 kubenswrapper[2576]: I0615 01:59:49.138201 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:00:00.144391 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:00:00.144354 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29691480-v8rh4"] Jun 15 02:00:00.148013 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:00:00.147992 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691480-v8rh4" Jun 15 02:00:00.150666 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:00:00.150642 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-rmwdg\"" Jun 15 02:00:00.162275 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:00:00.162249 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29691480-v8rh4"] Jun 15 02:00:00.237352 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:00:00.237313 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxnz2\" (UniqueName: \"kubernetes.io/projected/a06cf61e-217c-4f18-a4f5-3dee52b91663-kube-api-access-hxnz2\") pod \"maas-api-key-cleanup-29691480-v8rh4\" (UID: \"a06cf61e-217c-4f18-a4f5-3dee52b91663\") " pod="opendatahub/maas-api-key-cleanup-29691480-v8rh4" Jun 15 02:00:00.337854 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:00:00.337830 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxnz2\" (UniqueName: \"kubernetes.io/projected/a06cf61e-217c-4f18-a4f5-3dee52b91663-kube-api-access-hxnz2\") pod \"maas-api-key-cleanup-29691480-v8rh4\" (UID: \"a06cf61e-217c-4f18-a4f5-3dee52b91663\") " pod="opendatahub/maas-api-key-cleanup-29691480-v8rh4" Jun 15 02:00:00.346218 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:00:00.346198 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxnz2\" (UniqueName: \"kubernetes.io/projected/a06cf61e-217c-4f18-a4f5-3dee52b91663-kube-api-access-hxnz2\") pod \"maas-api-key-cleanup-29691480-v8rh4\" (UID: \"a06cf61e-217c-4f18-a4f5-3dee52b91663\") " pod="opendatahub/maas-api-key-cleanup-29691480-v8rh4" Jun 15 02:00:00.459998 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:00:00.459944 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691480-v8rh4" Jun 15 02:00:00.589054 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:00:00.589015 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29691480-v8rh4"] Jun 15 02:00:00.590518 ip-10-0-132-124 kubenswrapper[2576]: W0615 02:00:00.590476 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda06cf61e_217c_4f18_a4f5_3dee52b91663.slice/crio-1e0a3e88613d21614e7d695b99bb82a7bbe99b9414b389ab99b04d389fc760d7 WatchSource:0}: Error finding container 1e0a3e88613d21614e7d695b99bb82a7bbe99b9414b389ab99b04d389fc760d7: Status 404 returned error can't find the container with id 1e0a3e88613d21614e7d695b99bb82a7bbe99b9414b389ab99b04d389fc760d7 Jun 15 02:00:00.592501 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:00:00.592486 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 02:00:01.195594 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:00:01.195559 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691480-v8rh4" event={"ID":"a06cf61e-217c-4f18-a4f5-3dee52b91663","Type":"ContainerStarted","Data":"1e0a3e88613d21614e7d695b99bb82a7bbe99b9414b389ab99b04d389fc760d7"} Jun 15 02:00:03.341488 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:00:03.341452 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:00:19.934875 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:00:19.934835 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:01:00.012059 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:01:00.012007 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-29691480-v8rh4"] Jun 15 02:01:00.522639 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:01:00.522554 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691480-v8rh4" event={"ID":"a06cf61e-217c-4f18-a4f5-3dee52b91663","Type":"ContainerStarted","Data":"5c1ac8e973f8d4765a634d76cbf7ddb6ca6db81f4560a3c846d427e78a29d2e8"} Jun 15 02:01:00.522639 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:01:00.522576 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-key-cleanup-29691480-v8rh4" podUID="a06cf61e-217c-4f18-a4f5-3dee52b91663" containerName="cleanup" containerID="cri-o://5c1ac8e973f8d4765a634d76cbf7ddb6ca6db81f4560a3c846d427e78a29d2e8" gracePeriod=30 Jun 15 02:01:00.538575 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:01:00.538531 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29691480-v8rh4" podStartSLOduration=1.212133714 podStartE2EDuration="1m0.538516418s" totalImagesPullingTime="59.326382704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:01:00.536316272 +0000 UTC m=+1338.894856669" watchObservedRunningTime="2026-06-15 02:01:00.538516418 +0000 UTC m=+1338.897056813" Jun 15 02:01:00.971402 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:01:00.971380 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691480-v8rh4" Jun 15 02:01:01.031096 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:01:01.031069 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxnz2\" (UniqueName: \"kubernetes.io/projected/a06cf61e-217c-4f18-a4f5-3dee52b91663-kube-api-access-hxnz2\") pod \"a06cf61e-217c-4f18-a4f5-3dee52b91663\" (UID: \"a06cf61e-217c-4f18-a4f5-3dee52b91663\") " Jun 15 02:01:01.033289 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:01:01.033234 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a06cf61e-217c-4f18-a4f5-3dee52b91663-kube-api-access-hxnz2" (OuterVolumeSpecName: "kube-api-access-hxnz2") pod "a06cf61e-217c-4f18-a4f5-3dee52b91663" (UID: "a06cf61e-217c-4f18-a4f5-3dee52b91663"). InnerVolumeSpecName "kube-api-access-hxnz2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:01:01.133030 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:01:01.132992 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxnz2\" (UniqueName: \"kubernetes.io/projected/a06cf61e-217c-4f18-a4f5-3dee52b91663-kube-api-access-hxnz2\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 02:01:01.528950 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:01:01.528915 2576 generic.go:356] "Generic (PLEG): container finished" podID="a06cf61e-217c-4f18-a4f5-3dee52b91663" containerID="5c1ac8e973f8d4765a634d76cbf7ddb6ca6db81f4560a3c846d427e78a29d2e8" exitCode=0 Jun 15 02:01:01.529110 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:01:01.528963 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691480-v8rh4" Jun 15 02:01:01.529110 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:01:01.528998 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691480-v8rh4" event={"ID":"a06cf61e-217c-4f18-a4f5-3dee52b91663","Type":"ContainerDied","Data":"5c1ac8e973f8d4765a634d76cbf7ddb6ca6db81f4560a3c846d427e78a29d2e8"} Jun 15 02:01:01.529110 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:01:01.529054 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691480-v8rh4" event={"ID":"a06cf61e-217c-4f18-a4f5-3dee52b91663","Type":"ContainerDied","Data":"1e0a3e88613d21614e7d695b99bb82a7bbe99b9414b389ab99b04d389fc760d7"} Jun 15 02:01:01.529110 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:01:01.529078 2576 scope.go:117] "RemoveContainer" containerID="5c1ac8e973f8d4765a634d76cbf7ddb6ca6db81f4560a3c846d427e78a29d2e8" Jun 15 02:01:01.538823 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:01:01.538807 2576 scope.go:117] "RemoveContainer" containerID="5c1ac8e973f8d4765a634d76cbf7ddb6ca6db81f4560a3c846d427e78a29d2e8" Jun 15 02:01:01.539068 ip-10-0-132-124 kubenswrapper[2576]: E0615 02:01:01.539051 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c1ac8e973f8d4765a634d76cbf7ddb6ca6db81f4560a3c846d427e78a29d2e8\": container with ID starting with 5c1ac8e973f8d4765a634d76cbf7ddb6ca6db81f4560a3c846d427e78a29d2e8 not found: ID does not exist" containerID="5c1ac8e973f8d4765a634d76cbf7ddb6ca6db81f4560a3c846d427e78a29d2e8" Jun 15 02:01:01.539116 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:01:01.539074 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c1ac8e973f8d4765a634d76cbf7ddb6ca6db81f4560a3c846d427e78a29d2e8"} err="failed to get container status \"5c1ac8e973f8d4765a634d76cbf7ddb6ca6db81f4560a3c846d427e78a29d2e8\": rpc error: code = NotFound desc = could not find container \"5c1ac8e973f8d4765a634d76cbf7ddb6ca6db81f4560a3c846d427e78a29d2e8\": container with ID starting with 5c1ac8e973f8d4765a634d76cbf7ddb6ca6db81f4560a3c846d427e78a29d2e8 not found: ID does not exist" Jun 15 02:01:01.550655 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:01:01.550636 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-29691480-v8rh4"] Jun 15 02:01:01.556201 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:01:01.556181 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-29691480-v8rh4"] Jun 15 02:01:02.054543 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:01:02.054509 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a06cf61e-217c-4f18-a4f5-3dee52b91663" path="/var/lib/kubelet/pods/a06cf61e-217c-4f18-a4f5-3dee52b91663/volumes" Jun 15 02:01:18.832404 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:01:18.832371 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:01:27.827581 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:01:27.827545 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:01:44.546949 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:01:44.546907 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:01:53.139380 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:01:53.139332 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:02:10.437097 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:02:10.437060 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:02:18.434875 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:02:18.434844 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:02:51.339180 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:02:51.339126 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:03:00.139983 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:03:00.139942 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:03:08.431491 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:03:08.431454 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:03:16.535702 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:03:16.535661 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:03:25.033511 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:03:25.033473 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:03:42.153438 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:03:42.153411 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-5qb7h_ee20262f-ced8-4d5c-8bf8-15fefc664812/console-operator/1.log" Jun 15 02:03:42.155877 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:03:42.155856 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-5qb7h_ee20262f-ced8-4d5c-8bf8-15fefc664812/console-operator/1.log" Jun 15 02:03:50.640572 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:03:50.640536 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:04:02.635899 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:04:02.635819 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:04:49.036100 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:04:49.036065 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:04:56.938727 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:04:56.938695 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:05:16.031069 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:05:16.031034 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:05:24.540866 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:05:24.540827 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:05:33.640245 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:05:33.640158 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:05:42.433729 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:05:42.433694 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:05:51.136399 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:05:51.136361 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:05:59.438102 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:05:59.438061 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:06:08.635166 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:06:08.635107 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:06:17.231490 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:06:17.231449 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:06:25.344916 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:06:25.344882 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:06:33.635590 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:06:33.635542 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:07:35.318331 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:07:35.318247 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nsf2h"] Jun 15 02:07:35.318922 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:07:35.318487 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nsf2h" podUID="b73acb3e-c97e-4b35-9d13-e7ccec5185a5" containerName="manager" containerID="cri-o://42e29aa98a5d365a276bc8ff59abee85100550101a1d4716156de1e7795e43c2" gracePeriod=10 Jun 15 02:07:35.580934 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:07:35.580879 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nsf2h" Jun 15 02:07:35.663835 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:07:35.663804 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b73acb3e-c97e-4b35-9d13-e7ccec5185a5-extensions-socket-volume\") pod \"b73acb3e-c97e-4b35-9d13-e7ccec5185a5\" (UID: \"b73acb3e-c97e-4b35-9d13-e7ccec5185a5\") " Jun 15 02:07:35.663991 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:07:35.663848 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54zcj\" (UniqueName: \"kubernetes.io/projected/b73acb3e-c97e-4b35-9d13-e7ccec5185a5-kube-api-access-54zcj\") pod \"b73acb3e-c97e-4b35-9d13-e7ccec5185a5\" (UID: \"b73acb3e-c97e-4b35-9d13-e7ccec5185a5\") " Jun 15 02:07:35.664255 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:07:35.664226 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b73acb3e-c97e-4b35-9d13-e7ccec5185a5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b73acb3e-c97e-4b35-9d13-e7ccec5185a5" (UID: "b73acb3e-c97e-4b35-9d13-e7ccec5185a5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 02:07:35.665861 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:07:35.665840 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b73acb3e-c97e-4b35-9d13-e7ccec5185a5-kube-api-access-54zcj" (OuterVolumeSpecName: "kube-api-access-54zcj") pod "b73acb3e-c97e-4b35-9d13-e7ccec5185a5" (UID: "b73acb3e-c97e-4b35-9d13-e7ccec5185a5"). InnerVolumeSpecName "kube-api-access-54zcj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:07:35.687866 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:07:35.687836 2576 generic.go:356] "Generic (PLEG): container finished" podID="b73acb3e-c97e-4b35-9d13-e7ccec5185a5" containerID="42e29aa98a5d365a276bc8ff59abee85100550101a1d4716156de1e7795e43c2" exitCode=0 Jun 15 02:07:35.687991 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:07:35.687886 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nsf2h" Jun 15 02:07:35.687991 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:07:35.687921 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nsf2h" event={"ID":"b73acb3e-c97e-4b35-9d13-e7ccec5185a5","Type":"ContainerDied","Data":"42e29aa98a5d365a276bc8ff59abee85100550101a1d4716156de1e7795e43c2"} Jun 15 02:07:35.687991 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:07:35.687980 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nsf2h" event={"ID":"b73acb3e-c97e-4b35-9d13-e7ccec5185a5","Type":"ContainerDied","Data":"862df35baf94bc396c824e54c82600dd13a8ba7e7e1b65891b539637b93f7743"} Jun 15 02:07:35.688136 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:07:35.688007 2576 scope.go:117] "RemoveContainer" containerID="42e29aa98a5d365a276bc8ff59abee85100550101a1d4716156de1e7795e43c2" Jun 15 02:07:35.697907 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:07:35.697889 2576 scope.go:117] "RemoveContainer" containerID="42e29aa98a5d365a276bc8ff59abee85100550101a1d4716156de1e7795e43c2" Jun 15 02:07:35.698171 ip-10-0-132-124 kubenswrapper[2576]: E0615 02:07:35.698153 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42e29aa98a5d365a276bc8ff59abee85100550101a1d4716156de1e7795e43c2\": container with ID starting with 42e29aa98a5d365a276bc8ff59abee85100550101a1d4716156de1e7795e43c2 not found: ID does not exist" containerID="42e29aa98a5d365a276bc8ff59abee85100550101a1d4716156de1e7795e43c2" Jun 15 02:07:35.698220 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:07:35.698180 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42e29aa98a5d365a276bc8ff59abee85100550101a1d4716156de1e7795e43c2"} err="failed to get container status \"42e29aa98a5d365a276bc8ff59abee85100550101a1d4716156de1e7795e43c2\": rpc error: code = NotFound desc = could not find container \"42e29aa98a5d365a276bc8ff59abee85100550101a1d4716156de1e7795e43c2\": container with ID starting with 42e29aa98a5d365a276bc8ff59abee85100550101a1d4716156de1e7795e43c2 not found: ID does not exist" Jun 15 02:07:35.711169 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:07:35.711140 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nsf2h"] Jun 15 02:07:35.717105 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:07:35.717082 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nsf2h"] Jun 15 02:07:35.765109 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:07:35.765088 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b73acb3e-c97e-4b35-9d13-e7ccec5185a5-extensions-socket-volume\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 02:07:35.765109 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:07:35.765109 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54zcj\" (UniqueName: \"kubernetes.io/projected/b73acb3e-c97e-4b35-9d13-e7ccec5185a5-kube-api-access-54zcj\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 02:07:36.050881 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:07:36.050841 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b73acb3e-c97e-4b35-9d13-e7ccec5185a5" path="/var/lib/kubelet/pods/b73acb3e-c97e-4b35-9d13-e7ccec5185a5/volumes" Jun 15 02:08:36.440752 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:36.440712 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sd5sf"] Jun 15 02:08:36.441261 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:36.441241 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a06cf61e-217c-4f18-a4f5-3dee52b91663" containerName="cleanup" Jun 15 02:08:36.441359 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:36.441264 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a06cf61e-217c-4f18-a4f5-3dee52b91663" containerName="cleanup" Jun 15 02:08:36.441359 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:36.441283 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b73acb3e-c97e-4b35-9d13-e7ccec5185a5" containerName="manager" Jun 15 02:08:36.441359 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:36.441293 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b73acb3e-c97e-4b35-9d13-e7ccec5185a5" containerName="manager" Jun 15 02:08:36.441516 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:36.441435 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a06cf61e-217c-4f18-a4f5-3dee52b91663" containerName="cleanup" Jun 15 02:08:36.441516 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:36.441454 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b73acb3e-c97e-4b35-9d13-e7ccec5185a5" containerName="manager" Jun 15 02:08:36.444526 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:36.444505 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sd5sf" Jun 15 02:08:36.447401 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:36.447378 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zxjqs\"" Jun 15 02:08:36.457148 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:36.457123 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sd5sf"] Jun 15 02:08:36.535144 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:36.535106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ns74\" (UniqueName: \"kubernetes.io/projected/8d21b4ac-7076-4157-8a2d-031cfc85cc98-kube-api-access-9ns74\") pod \"kuadrant-operator-controller-manager-86878c769f-sd5sf\" (UID: \"8d21b4ac-7076-4157-8a2d-031cfc85cc98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sd5sf" Jun 15 02:08:36.535323 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:36.535198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d21b4ac-7076-4157-8a2d-031cfc85cc98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sd5sf\" (UID: \"8d21b4ac-7076-4157-8a2d-031cfc85cc98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sd5sf" Jun 15 02:08:36.635680 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:36.635646 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d21b4ac-7076-4157-8a2d-031cfc85cc98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sd5sf\" (UID: \"8d21b4ac-7076-4157-8a2d-031cfc85cc98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sd5sf" Jun 15 02:08:36.635870 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:36.635696 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ns74\" (UniqueName: \"kubernetes.io/projected/8d21b4ac-7076-4157-8a2d-031cfc85cc98-kube-api-access-9ns74\") pod \"kuadrant-operator-controller-manager-86878c769f-sd5sf\" (UID: \"8d21b4ac-7076-4157-8a2d-031cfc85cc98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sd5sf" Jun 15 02:08:36.636066 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:36.636041 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d21b4ac-7076-4157-8a2d-031cfc85cc98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sd5sf\" (UID: \"8d21b4ac-7076-4157-8a2d-031cfc85cc98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sd5sf" Jun 15 02:08:36.645294 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:36.645262 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ns74\" (UniqueName: \"kubernetes.io/projected/8d21b4ac-7076-4157-8a2d-031cfc85cc98-kube-api-access-9ns74\") pod \"kuadrant-operator-controller-manager-86878c769f-sd5sf\" (UID: \"8d21b4ac-7076-4157-8a2d-031cfc85cc98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sd5sf" Jun 15 02:08:36.757228 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:36.757191 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sd5sf" Jun 15 02:08:36.894284 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:36.894247 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sd5sf"] Jun 15 02:08:36.895517 ip-10-0-132-124 kubenswrapper[2576]: W0615 02:08:36.895491 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d21b4ac_7076_4157_8a2d_031cfc85cc98.slice/crio-049d2ea2054f8bb23e0e2de11a653520aeaed1a2b2215b45ebd54379f0c66317 WatchSource:0}: Error finding container 049d2ea2054f8bb23e0e2de11a653520aeaed1a2b2215b45ebd54379f0c66317: Status 404 returned error can't find the container with id 049d2ea2054f8bb23e0e2de11a653520aeaed1a2b2215b45ebd54379f0c66317 Jun 15 02:08:37.012350 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:37.012308 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sd5sf" event={"ID":"8d21b4ac-7076-4157-8a2d-031cfc85cc98","Type":"ContainerStarted","Data":"285f68f24681a1e74f3dab7479ddf50c022fef6a83d2be6b19162b134455f8f2"} Jun 15 02:08:37.012521 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:37.012384 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sd5sf" event={"ID":"8d21b4ac-7076-4157-8a2d-031cfc85cc98","Type":"ContainerStarted","Data":"049d2ea2054f8bb23e0e2de11a653520aeaed1a2b2215b45ebd54379f0c66317"} Jun 15 02:08:37.012521 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:37.012510 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sd5sf" Jun 15 02:08:37.034664 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:37.034619 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sd5sf" podStartSLOduration=1.034604305 podStartE2EDuration="1.034604305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:08:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:08:37.032548386 +0000 UTC m=+1795.391088784" watchObservedRunningTime="2026-06-15 02:08:37.034604305 +0000 UTC m=+1795.393144701" Jun 15 02:08:42.193780 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:42.193752 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-5qb7h_ee20262f-ced8-4d5c-8bf8-15fefc664812/console-operator/1.log" Jun 15 02:08:42.199402 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:42.199381 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-5qb7h_ee20262f-ced8-4d5c-8bf8-15fefc664812/console-operator/1.log" Jun 15 02:08:48.020908 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:48.020878 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sd5sf" Jun 15 02:08:56.540599 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:08:56.540559 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:09:01.143956 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:09:01.143919 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:09:26.830452 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:09:26.830413 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:09:31.736862 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:09:31.736829 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:09:38.639532 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:09:38.639492 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:09:49.438132 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:09:49.438099 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:09:57.842232 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:09:57.842193 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:10:08.535461 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:10:08.535379 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:10:17.440216 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:10:17.440180 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:10:27.345637 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:10:27.345601 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:10:36.537107 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:10:36.537069 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:10:46.738540 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:10:46.738508 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:10:56.333800 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:10:56.333760 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:11:00.737482 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:11:00.737450 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:11:29.235895 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:11:29.235861 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:12:12.143750 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:12:12.143718 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:12:21.036916 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:12:21.036881 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:12:29.337310 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:12:29.337270 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:12:37.833160 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:12:37.833123 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:12:46.733484 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:12:46.733453 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:12:59.236024 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:12:59.235982 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:13:08.136174 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:13:08.136092 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:13:13.630692 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:13:13.630657 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:13:20.529765 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:13:20.529730 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:13:28.330712 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:13:28.330676 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:13:36.942732 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:13:36.942700 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:13:42.235313 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:13:42.235288 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-5qb7h_ee20262f-ced8-4d5c-8bf8-15fefc664812/console-operator/1.log" Jun 15 02:13:42.241307 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:13:42.241280 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-5qb7h_ee20262f-ced8-4d5c-8bf8-15fefc664812/console-operator/1.log" Jun 15 02:13:47.341486 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:13:47.341455 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:14:05.440047 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:14:05.440015 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:14:14.026748 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:14:14.026718 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:14:22.436677 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:14:22.436637 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:14:31.333596 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:14:31.333519 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:14:48.227377 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:14:48.227324 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:14:56.436981 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:14:56.436949 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:15:00.137505 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:00.137476 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29691495-jtz55"] Jun 15 02:15:00.140842 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:00.140825 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691495-jtz55" Jun 15 02:15:00.143263 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:00.143239 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-rmwdg\"" Jun 15 02:15:00.155599 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:00.155579 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29691495-jtz55"] Jun 15 02:15:00.283624 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:00.283598 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwv7z\" (UniqueName: \"kubernetes.io/projected/d0cda4c5-3bf6-4dcd-a010-6c21f37882e0-kube-api-access-mwv7z\") pod \"maas-api-key-cleanup-29691495-jtz55\" (UID: \"d0cda4c5-3bf6-4dcd-a010-6c21f37882e0\") " pod="opendatahub/maas-api-key-cleanup-29691495-jtz55" Jun 15 02:15:00.384312 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:00.384289 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwv7z\" (UniqueName: \"kubernetes.io/projected/d0cda4c5-3bf6-4dcd-a010-6c21f37882e0-kube-api-access-mwv7z\") pod \"maas-api-key-cleanup-29691495-jtz55\" (UID: \"d0cda4c5-3bf6-4dcd-a010-6c21f37882e0\") " pod="opendatahub/maas-api-key-cleanup-29691495-jtz55" Jun 15 02:15:00.392892 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:00.392848 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwv7z\" (UniqueName: \"kubernetes.io/projected/d0cda4c5-3bf6-4dcd-a010-6c21f37882e0-kube-api-access-mwv7z\") pod \"maas-api-key-cleanup-29691495-jtz55\" (UID: \"d0cda4c5-3bf6-4dcd-a010-6c21f37882e0\") " pod="opendatahub/maas-api-key-cleanup-29691495-jtz55" Jun 15 02:15:00.450916 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:00.450897 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691495-jtz55" Jun 15 02:15:00.577273 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:00.577241 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29691495-jtz55"] Jun 15 02:15:00.578539 ip-10-0-132-124 kubenswrapper[2576]: W0615 02:15:00.578513 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0cda4c5_3bf6_4dcd_a010_6c21f37882e0.slice/crio-d3301b81a6ef7fb07eae1091b50bf0cbdc22f1f962283ebf6676cd20abd36ddf WatchSource:0}: Error finding container d3301b81a6ef7fb07eae1091b50bf0cbdc22f1f962283ebf6676cd20abd36ddf: Status 404 returned error can't find the container with id d3301b81a6ef7fb07eae1091b50bf0cbdc22f1f962283ebf6676cd20abd36ddf Jun 15 02:15:01.034807 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:01.034782 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691495-jtz55" event={"ID":"d0cda4c5-3bf6-4dcd-a010-6c21f37882e0","Type":"ContainerStarted","Data":"6e78742ed2528e961eddf8ae89df2cbe8233cce54379e9cb3027734645b40f99"} Jun 15 02:15:01.034923 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:01.034837 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691495-jtz55" event={"ID":"d0cda4c5-3bf6-4dcd-a010-6c21f37882e0","Type":"ContainerStarted","Data":"d3301b81a6ef7fb07eae1091b50bf0cbdc22f1f962283ebf6676cd20abd36ddf"} Jun 15 02:15:01.050121 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:01.050055 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29691495-jtz55" podStartSLOduration=1.050042079 podStartE2EDuration="1.050042079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:15:01.048284468 +0000 UTC m=+2179.406824854" watchObservedRunningTime="2026-06-15 02:15:01.050042079 +0000 UTC m=+2179.408582473" Jun 15 02:15:02.041641 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:02.041610 2576 generic.go:356] "Generic (PLEG): container finished" podID="d0cda4c5-3bf6-4dcd-a010-6c21f37882e0" containerID="6e78742ed2528e961eddf8ae89df2cbe8233cce54379e9cb3027734645b40f99" exitCode=0 Jun 15 02:15:02.041940 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:02.041690 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691495-jtz55" event={"ID":"d0cda4c5-3bf6-4dcd-a010-6c21f37882e0","Type":"ContainerDied","Data":"6e78742ed2528e961eddf8ae89df2cbe8233cce54379e9cb3027734645b40f99"} Jun 15 02:15:03.174539 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:03.174517 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691495-jtz55" Jun 15 02:15:03.308714 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:03.308653 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwv7z\" (UniqueName: \"kubernetes.io/projected/d0cda4c5-3bf6-4dcd-a010-6c21f37882e0-kube-api-access-mwv7z\") pod \"d0cda4c5-3bf6-4dcd-a010-6c21f37882e0\" (UID: \"d0cda4c5-3bf6-4dcd-a010-6c21f37882e0\") " Jun 15 02:15:03.310543 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:03.310516 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0cda4c5-3bf6-4dcd-a010-6c21f37882e0-kube-api-access-mwv7z" (OuterVolumeSpecName: "kube-api-access-mwv7z") pod "d0cda4c5-3bf6-4dcd-a010-6c21f37882e0" (UID: "d0cda4c5-3bf6-4dcd-a010-6c21f37882e0"). InnerVolumeSpecName "kube-api-access-mwv7z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:15:03.409650 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:03.409629 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwv7z\" (UniqueName: \"kubernetes.io/projected/d0cda4c5-3bf6-4dcd-a010-6c21f37882e0-kube-api-access-mwv7z\") on node \"ip-10-0-132-124.ec2.internal\" DevicePath \"\"" Jun 15 02:15:04.052913 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:04.052892 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691495-jtz55" Jun 15 02:15:04.053051 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:04.052952 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691495-jtz55" event={"ID":"d0cda4c5-3bf6-4dcd-a010-6c21f37882e0","Type":"ContainerDied","Data":"d3301b81a6ef7fb07eae1091b50bf0cbdc22f1f962283ebf6676cd20abd36ddf"} Jun 15 02:15:04.053051 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:04.053004 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3301b81a6ef7fb07eae1091b50bf0cbdc22f1f962283ebf6676cd20abd36ddf" Jun 15 02:15:05.136237 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:05.136207 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:15:14.031033 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:14.031000 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:15:22.734049 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:22.734016 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:15:31.030110 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:31.030071 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:15:39.933478 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:39.933439 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:15:50.829316 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:15:50.829276 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:16:00.031483 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:16:00.031444 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:16:11.039824 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:16:11.039742 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:16:20.238012 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:16:20.237978 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:16:25.428956 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:16:25.428918 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:16:32.737046 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:16:32.737008 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:16:38.134717 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:16:38.134683 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:16:52.531880 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:16:52.531846 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:17:01.237178 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:17:01.237143 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:17:10.737025 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:17:10.736988 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:17:15.942528 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:17:15.942491 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:17:40.337473 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:17:40.337425 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:17:52.839059 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:17:52.839009 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lmkk9"] Jun 15 02:18:25.900436 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:25.900400 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9fd898bb-kcddr_ad4b1d36-8c79-456b-b251-102d20445f55/authorino/0.log" Jun 15 02:18:30.414755 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:30.414727 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-845d6f7cf8-rblxg_26e3fc9a-0f55-4935-83ad-8ff2caa4ea49/nginx/0.log" Jun 15 02:18:30.874228 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:30.874209 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29691495-jtz55_d0cda4c5-3bf6-4dcd-a010-6c21f37882e0/cleanup/0.log" Jun 15 02:18:31.459688 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:31.459658 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d6d6cd49-p96xn_6d21dfe1-80aa-430f-a314-3160a701a3af/copy-manifests/0.log" Jun 15 02:18:31.466490 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:31.466465 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d6d6cd49-p96xn_6d21dfe1-80aa-430f-a314-3160a701a3af/manager/0.log" Jun 15 02:18:32.456994 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:32.456962 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5_4178e06a-cefa-487d-a93b-81cf3eacfeab/util/0.log" Jun 15 02:18:32.463582 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:32.463558 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5_4178e06a-cefa-487d-a93b-81cf3eacfeab/pull/0.log" Jun 15 02:18:32.470496 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:32.470481 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5_4178e06a-cefa-487d-a93b-81cf3eacfeab/extract/0.log" Jun 15 02:18:32.577013 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:32.576990 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4_0cdacc16-3c29-4d56-af54-1ae5e68aed54/util/0.log" Jun 15 02:18:32.584286 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:32.584264 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4_0cdacc16-3c29-4d56-af54-1ae5e68aed54/pull/0.log" Jun 15 02:18:32.591032 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:32.591014 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4_0cdacc16-3c29-4d56-af54-1ae5e68aed54/extract/0.log" Jun 15 02:18:32.697720 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:32.697701 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8_19162444-15cf-49df-89a8-b3ebfc8bb844/util/0.log" Jun 15 02:18:32.703768 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:32.703747 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8_19162444-15cf-49df-89a8-b3ebfc8bb844/pull/0.log" Jun 15 02:18:32.709980 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:32.709936 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8_19162444-15cf-49df-89a8-b3ebfc8bb844/extract/0.log" Jun 15 02:18:32.819258 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:32.819235 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq_b1c2733e-0151-4f43-8db1-51f245892a2d/util/0.log" Jun 15 02:18:32.826036 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:32.826012 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq_b1c2733e-0151-4f43-8db1-51f245892a2d/pull/0.log" Jun 15 02:18:32.832713 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:32.832690 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq_b1c2733e-0151-4f43-8db1-51f245892a2d/extract/0.log" Jun 15 02:18:32.945506 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:32.945479 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9fd898bb-kcddr_ad4b1d36-8c79-456b-b251-102d20445f55/authorino/0.log" Jun 15 02:18:33.068919 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:33.068849 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vkw8s_bc655a10-aae2-460e-9444-c7c2da271963/manager/0.log" Jun 15 02:18:33.407646 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:33.407615 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zsxg6_5c6196cc-b13a-4203-89e5-b75e7d981286/registry-server/0.log" Jun 15 02:18:33.524756 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:33.524728 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-sd5sf_8d21b4ac-7076-4157-8a2d-031cfc85cc98/manager/0.log" Jun 15 02:18:33.644642 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:33.644616 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-lmkk9_13adb24d-d4a9-4c1a-9c53-2b776bb523a3/limitador/0.log" Jun 15 02:18:34.094889 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:34.094863 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795w4mx9_f8ca1c08-3253-4628-b5e9-c7286f219fa9/istio-proxy/0.log" Jun 15 02:18:34.911249 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:34.911216 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-846697d79d-m7gkq_52b7be5b-ae33-4595-bcc6-54e125bd6de8/router/0.log" Jun 15 02:18:42.273100 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:42.273071 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-5qb7h_ee20262f-ced8-4d5c-8bf8-15fefc664812/console-operator/1.log" Jun 15 02:18:42.280115 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:42.280092 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-5qb7h_ee20262f-ced8-4d5c-8bf8-15fefc664812/console-operator/1.log" Jun 15 02:18:42.794093 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:42.794065 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-szg9h_1113a386-54ff-45c9-88c7-0696fd879022/global-pull-secret-syncer/0.log" Jun 15 02:18:42.924271 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:42.924246 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t9zjx_86bedf18-f8dd-48de-8aa0-bae474076aaf/konnectivity-agent/0.log" Jun 15 02:18:42.982171 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:42.982152 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-124.ec2.internal_fdbf0aa446b2930d878266db1bc6b1f0/haproxy/0.log" Jun 15 02:18:47.093485 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:47.093448 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5_4178e06a-cefa-487d-a93b-81cf3eacfeab/extract/0.log" Jun 15 02:18:47.119998 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:47.119960 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5_4178e06a-cefa-487d-a93b-81cf3eacfeab/util/0.log" Jun 15 02:18:47.144075 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:47.144053 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wg8l5_4178e06a-cefa-487d-a93b-81cf3eacfeab/pull/0.log" Jun 15 02:18:47.172750 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:47.172733 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4_0cdacc16-3c29-4d56-af54-1ae5e68aed54/extract/0.log" Jun 15 02:18:47.193763 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:47.193737 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4_0cdacc16-3c29-4d56-af54-1ae5e68aed54/util/0.log" Jun 15 02:18:47.221129 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:47.221103 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k79k4_0cdacc16-3c29-4d56-af54-1ae5e68aed54/pull/0.log" Jun 15 02:18:47.254444 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:47.254421 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8_19162444-15cf-49df-89a8-b3ebfc8bb844/extract/0.log" Jun 15 02:18:47.276165 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:47.276144 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8_19162444-15cf-49df-89a8-b3ebfc8bb844/util/0.log" Jun 15 02:18:47.298601 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:47.298583 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736x8x8_19162444-15cf-49df-89a8-b3ebfc8bb844/pull/0.log" Jun 15 02:18:47.328620 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:47.328600 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq_b1c2733e-0151-4f43-8db1-51f245892a2d/extract/0.log" Jun 15 02:18:47.351587 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:47.351538 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq_b1c2733e-0151-4f43-8db1-51f245892a2d/util/0.log" Jun 15 02:18:47.380383 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:47.380324 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16p5qq_b1c2733e-0151-4f43-8db1-51f245892a2d/pull/0.log" Jun 15 02:18:47.594450 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:47.594421 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9fd898bb-kcddr_ad4b1d36-8c79-456b-b251-102d20445f55/authorino/0.log" Jun 15 02:18:47.654635 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:47.654613 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vkw8s_bc655a10-aae2-460e-9444-c7c2da271963/manager/0.log" Jun 15 02:18:47.795445 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:47.795420 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zsxg6_5c6196cc-b13a-4203-89e5-b75e7d981286/registry-server/0.log" Jun 15 02:18:47.856165 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:47.856138 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-sd5sf_8d21b4ac-7076-4157-8a2d-031cfc85cc98/manager/0.log" Jun 15 02:18:47.877596 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:47.877577 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-lmkk9_13adb24d-d4a9-4c1a-9c53-2b776bb523a3/limitador/0.log" Jun 15 02:18:49.649623 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:49.649589 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0437bcd7-9567-49a6-a830-9563646b9351/alertmanager/0.log" Jun 15 02:18:49.672859 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:49.672839 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0437bcd7-9567-49a6-a830-9563646b9351/config-reloader/0.log" Jun 15 02:18:49.697871 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:49.697849 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0437bcd7-9567-49a6-a830-9563646b9351/kube-rbac-proxy-web/0.log" Jun 15 02:18:49.721332 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:49.721311 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0437bcd7-9567-49a6-a830-9563646b9351/kube-rbac-proxy/0.log" Jun 15 02:18:49.745155 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:49.745136 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0437bcd7-9567-49a6-a830-9563646b9351/kube-rbac-proxy-metric/0.log" Jun 15 02:18:49.770451 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:49.770429 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0437bcd7-9567-49a6-a830-9563646b9351/prom-label-proxy/0.log" Jun 15 02:18:49.803182 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:49.803134 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0437bcd7-9567-49a6-a830-9563646b9351/init-config-reloader/0.log" Jun 15 02:18:49.889415 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:49.889377 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-nwfhv_175a9244-1f1d-4e25-a173-563b58059b51/kube-state-metrics/0.log" Jun 15 02:18:49.911690 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:49.911623 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-nwfhv_175a9244-1f1d-4e25-a173-563b58059b51/kube-rbac-proxy-main/0.log" Jun 15 02:18:49.938049 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:49.938025 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-nwfhv_175a9244-1f1d-4e25-a173-563b58059b51/kube-rbac-proxy-self/0.log" Jun 15 02:18:49.969299 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:49.969279 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7489cfdbb8-wt8nh_2fca83c0-4883-4e87-b3fd-297939c9df6c/metrics-server/0.log" Jun 15 02:18:49.993619 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:49.993585 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-v8njn_60310176-0e9f-47ee-a166-ecf0eb9d99ad/monitoring-plugin/0.log" Jun 15 02:18:50.026542 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:50.026523 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-49dbg_88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb/node-exporter/0.log" Jun 15 02:18:50.048974 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:50.048955 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-49dbg_88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb/kube-rbac-proxy/0.log" Jun 15 02:18:50.073165 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:50.073147 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-49dbg_88ee4bf8-2b20-4894-b1ec-cdd9d2956aeb/init-textfile/0.log" Jun 15 02:18:50.681716 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:50.681687 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66647c668b-tf56t_d866a3d2-2075-4a7b-90c0-cb6e0fbe545c/telemeter-client/0.log" Jun 15 02:18:50.706211 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:50.706190 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66647c668b-tf56t_d866a3d2-2075-4a7b-90c0-cb6e0fbe545c/reload/0.log" Jun 15 02:18:50.732282 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:50.732265 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66647c668b-tf56t_d866a3d2-2075-4a7b-90c0-cb6e0fbe545c/kube-rbac-proxy/0.log" Jun 15 02:18:52.428703 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:52.428668 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-5fggm_451dde2a-7ed3-46cf-8b3c-ce96077ad565/networking-console-plugin/0.log" Jun 15 02:18:53.075278 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:53.075242 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-5qb7h_ee20262f-ced8-4d5c-8bf8-15fefc664812/console-operator/1.log" Jun 15 02:18:53.080437 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:53.080408 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-5qb7h_ee20262f-ced8-4d5c-8bf8-15fefc664812/console-operator/2.log" Jun 15 02:18:54.366069 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:54.366039 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-6hxg8_b1e1b881-33ed-4baf-bb43-39fa0b626035/volume-data-source-validator/0.log" Jun 15 02:18:54.830012 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:54.829982 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2jt7g/perf-node-gather-daemonset-rsznr"] Jun 15 02:18:54.830470 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:54.830449 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0cda4c5-3bf6-4dcd-a010-6c21f37882e0" containerName="cleanup" Jun 15 02:18:54.830470 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:54.830470 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0cda4c5-3bf6-4dcd-a010-6c21f37882e0" containerName="cleanup" Jun 15 02:18:54.830749 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:54.830557 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0cda4c5-3bf6-4dcd-a010-6c21f37882e0" containerName="cleanup" Jun 15 02:18:54.833802 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:54.833785 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-rsznr" Jun 15 02:18:54.836172 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:54.836153 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2jt7g\"/\"openshift-service-ca.crt\"" Jun 15 02:18:54.836284 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:54.836221 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2jt7g\"/\"kube-root-ca.crt\"" Jun 15 02:18:54.837369 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:54.837331 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2jt7g\"/\"default-dockercfg-kldtp\"" Jun 15 02:18:54.844531 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:54.844511 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2jt7g/perf-node-gather-daemonset-rsznr"] Jun 15 02:18:54.862470 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:54.862445 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/039b88e0-96ce-41c3-a5ff-ab11f859e136-proc\") pod \"perf-node-gather-daemonset-rsznr\" (UID: \"039b88e0-96ce-41c3-a5ff-ab11f859e136\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-rsznr" Jun 15 02:18:54.862577 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:54.862486 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/039b88e0-96ce-41c3-a5ff-ab11f859e136-sys\") pod \"perf-node-gather-daemonset-rsznr\" (UID: \"039b88e0-96ce-41c3-a5ff-ab11f859e136\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-rsznr" Jun 15 02:18:54.862577 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:54.862545 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/039b88e0-96ce-41c3-a5ff-ab11f859e136-podres\") pod \"perf-node-gather-daemonset-rsznr\" (UID: \"039b88e0-96ce-41c3-a5ff-ab11f859e136\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-rsznr" Jun 15 02:18:54.862703 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:54.862584 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96mk5\" (UniqueName: \"kubernetes.io/projected/039b88e0-96ce-41c3-a5ff-ab11f859e136-kube-api-access-96mk5\") pod \"perf-node-gather-daemonset-rsznr\" (UID: \"039b88e0-96ce-41c3-a5ff-ab11f859e136\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-rsznr" Jun 15 02:18:54.862703 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:54.862658 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/039b88e0-96ce-41c3-a5ff-ab11f859e136-lib-modules\") pod \"perf-node-gather-daemonset-rsznr\" (UID: \"039b88e0-96ce-41c3-a5ff-ab11f859e136\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-rsznr" Jun 15 02:18:54.963603 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:54.963580 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/039b88e0-96ce-41c3-a5ff-ab11f859e136-podres\") pod \"perf-node-gather-daemonset-rsznr\" (UID: \"039b88e0-96ce-41c3-a5ff-ab11f859e136\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-rsznr" Jun 15 02:18:54.963699 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:54.963614 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96mk5\" (UniqueName: \"kubernetes.io/projected/039b88e0-96ce-41c3-a5ff-ab11f859e136-kube-api-access-96mk5\") pod \"perf-node-gather-daemonset-rsznr\" (UID: \"039b88e0-96ce-41c3-a5ff-ab11f859e136\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-rsznr" Jun 15 02:18:54.963699 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:54.963680 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/039b88e0-96ce-41c3-a5ff-ab11f859e136-lib-modules\") pod \"perf-node-gather-daemonset-rsznr\" (UID: \"039b88e0-96ce-41c3-a5ff-ab11f859e136\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-rsznr" Jun 15 02:18:54.963813 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:54.963714 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/039b88e0-96ce-41c3-a5ff-ab11f859e136-proc\") pod \"perf-node-gather-daemonset-rsznr\" (UID: \"039b88e0-96ce-41c3-a5ff-ab11f859e136\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-rsznr" Jun 15 02:18:54.963813 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:54.963748 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/039b88e0-96ce-41c3-a5ff-ab11f859e136-podres\") pod \"perf-node-gather-daemonset-rsznr\" (UID: \"039b88e0-96ce-41c3-a5ff-ab11f859e136\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-rsznr" Jun 15 02:18:54.963813 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:54.963776 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/039b88e0-96ce-41c3-a5ff-ab11f859e136-proc\") pod \"perf-node-gather-daemonset-rsznr\" (UID: \"039b88e0-96ce-41c3-a5ff-ab11f859e136\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-rsznr" Jun 15 02:18:54.963813 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:54.963794 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/039b88e0-96ce-41c3-a5ff-ab11f859e136-sys\") pod \"perf-node-gather-daemonset-rsznr\" (UID: \"039b88e0-96ce-41c3-a5ff-ab11f859e136\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-rsznr" Jun 15 02:18:54.964021 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:54.963828 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/039b88e0-96ce-41c3-a5ff-ab11f859e136-lib-modules\") pod \"perf-node-gather-daemonset-rsznr\" (UID: \"039b88e0-96ce-41c3-a5ff-ab11f859e136\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-rsznr" Jun 15 02:18:54.964021 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:54.963866 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/039b88e0-96ce-41c3-a5ff-ab11f859e136-sys\") pod \"perf-node-gather-daemonset-rsznr\" (UID: \"039b88e0-96ce-41c3-a5ff-ab11f859e136\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-rsznr" Jun 15 02:18:54.971703 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:54.971682 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96mk5\" (UniqueName: \"kubernetes.io/projected/039b88e0-96ce-41c3-a5ff-ab11f859e136-kube-api-access-96mk5\") pod \"perf-node-gather-daemonset-rsznr\" (UID: \"039b88e0-96ce-41c3-a5ff-ab11f859e136\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-rsznr" Jun 15 02:18:55.144608 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:55.144585 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-rsznr" Jun 15 02:18:55.276435 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:55.276407 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2jt7g/perf-node-gather-daemonset-rsznr"] Jun 15 02:18:55.278226 ip-10-0-132-124 kubenswrapper[2576]: W0615 02:18:55.278193 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod039b88e0_96ce_41c3_a5ff_ab11f859e136.slice/crio-3625ea0d87c25bb7efc5a9dec6c471056c72accc2705da7d0e1ec3e2d567ca73 WatchSource:0}: Error finding container 3625ea0d87c25bb7efc5a9dec6c471056c72accc2705da7d0e1ec3e2d567ca73: Status 404 returned error can't find the container with id 3625ea0d87c25bb7efc5a9dec6c471056c72accc2705da7d0e1ec3e2d567ca73 Jun 15 02:18:55.342112 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:55.342084 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-rsznr" event={"ID":"039b88e0-96ce-41c3-a5ff-ab11f859e136","Type":"ContainerStarted","Data":"3625ea0d87c25bb7efc5a9dec6c471056c72accc2705da7d0e1ec3e2d567ca73"} Jun 15 02:18:55.608421 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:55.608323 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8wcmz_78c57d75-c63a-4a72-81f1-fe8285631a98/dns/0.log" Jun 15 02:18:55.630787 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:55.630771 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8wcmz_78c57d75-c63a-4a72-81f1-fe8285631a98/kube-rbac-proxy/0.log" Jun 15 02:18:55.776713 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:55.776693 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kqxqs_11c51e69-484c-4efa-bebe-0eb0ccf33029/dns-node-resolver/0.log" Jun 15 02:18:56.349928 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:56.349892 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-rsznr" event={"ID":"039b88e0-96ce-41c3-a5ff-ab11f859e136","Type":"ContainerStarted","Data":"1e5b597cfb5de7ee0b3d2da259a600ec4df74938b9279503d8a1f60fafa41788"} Jun 15 02:18:56.350129 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:56.350060 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-rsznr" Jun 15 02:18:56.366202 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:56.366117 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-rsznr" podStartSLOduration=2.3661015499999998 podStartE2EDuration="2.36610155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 02:18:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:18:56.363741168 +0000 UTC m=+2414.722281609" watchObservedRunningTime="2026-06-15 02:18:56.36610155 +0000 UTC m=+2414.724641946" Jun 15 02:18:56.485428 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:56.485395 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xqcdr_b842d4f5-5f7d-417a-9473-1271dc39b8eb/node-ca/0.log" Jun 15 02:18:57.423130 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:57.423097 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795w4mx9_f8ca1c08-3253-4628-b5e9-c7286f219fa9/istio-proxy/0.log" Jun 15 02:18:57.845891 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:57.845812 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-846697d79d-m7gkq_52b7be5b-ae33-4595-bcc6-54e125bd6de8/router/0.log" Jun 15 02:18:58.494174 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:58.494140 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nwmph_b00f4d8c-52d9-48c5-8a37-a69c3da3d450/serve-healthcheck-canary/0.log" Jun 15 02:18:59.226733 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:59.226700 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rddmj_15461201-5d5b-4459-96f1-555fe778d406/kube-rbac-proxy/0.log" Jun 15 02:18:59.246876 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:59.246855 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rddmj_15461201-5d5b-4459-96f1-555fe778d406/exporter/0.log" Jun 15 02:18:59.268977 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:18:59.268960 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rddmj_15461201-5d5b-4459-96f1-555fe778d406/extractor/0.log" Jun 15 02:19:01.450764 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:19:01.450689 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-845d6f7cf8-rblxg_26e3fc9a-0f55-4935-83ad-8ff2caa4ea49/nginx/0.log" Jun 15 02:19:01.673195 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:19:01.673169 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29691495-jtz55_d0cda4c5-3bf6-4dcd-a010-6c21f37882e0/cleanup/0.log" Jun 15 02:19:01.955628 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:19:01.955588 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d6d6cd49-p96xn_6d21dfe1-80aa-430f-a314-3160a701a3af/manager/0.log" Jun 15 02:19:01.978924 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:19:01.978898 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d6d6cd49-p96xn_6d21dfe1-80aa-430f-a314-3160a701a3af/copy-manifests/0.log" Jun 15 02:19:02.365981 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:19:02.365923 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-rsznr" Jun 15 02:19:03.746121 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:19:03.746102 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5cddd79ffb-ql59t_85e25c13-87c8-4abf-a5fb-7f6f3db79fd4/manager/0.log" Jun 15 02:19:07.887168 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:19:07.887131 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795w4mx9_f8ca1c08-3253-4628-b5e9-c7286f219fa9/istio-proxy/0.log" Jun 15 02:19:08.240410 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:19:08.240286 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-846697d79d-m7gkq_52b7be5b-ae33-4595-bcc6-54e125bd6de8/router/0.log" Jun 15 02:19:09.414532 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:19:09.414503 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795w4mx9_f8ca1c08-3253-4628-b5e9-c7286f219fa9/istio-proxy/0.log" Jun 15 02:19:09.757736 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:19:09.757652 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-846697d79d-m7gkq_52b7be5b-ae33-4595-bcc6-54e125bd6de8/router/0.log" Jun 15 02:19:10.938607 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:19:10.938520 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7gxl6_7c47a1e6-73c9-4bf5-ae77-06cb3d055991/kube-multus-additional-cni-plugins/0.log" Jun 15 02:19:10.962439 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:19:10.962408 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7gxl6_7c47a1e6-73c9-4bf5-ae77-06cb3d055991/egress-router-binary-copy/0.log" Jun 15 02:19:10.985039 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:19:10.985014 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7gxl6_7c47a1e6-73c9-4bf5-ae77-06cb3d055991/cni-plugins/0.log" Jun 15 02:19:11.006006 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:19:11.005985 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7gxl6_7c47a1e6-73c9-4bf5-ae77-06cb3d055991/bond-cni-plugin/0.log" Jun 15 02:19:11.027661 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:19:11.027640 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7gxl6_7c47a1e6-73c9-4bf5-ae77-06cb3d055991/routeoverride-cni/0.log" Jun 15 02:19:11.049293 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:19:11.049276 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7gxl6_7c47a1e6-73c9-4bf5-ae77-06cb3d055991/whereabouts-cni-bincopy/0.log" Jun 15 02:19:11.069708 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:19:11.069690 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7gxl6_7c47a1e6-73c9-4bf5-ae77-06cb3d055991/whereabouts-cni/0.log" Jun 15 02:19:11.417512 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:19:11.417486 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795w4mx9_f8ca1c08-3253-4628-b5e9-c7286f219fa9/istio-proxy/0.log" Jun 15 02:19:11.530740 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:19:11.530714 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xngcq_6060d82e-9d20-4244-b25e-ebbffe02c1aa/kube-multus/0.log" Jun 15 02:19:11.558133 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:19:11.558107 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-26h5n_2e027e5e-259c-4e7d-a90f-7dbf717f7701/network-metrics-daemon/0.log" Jun 15 02:19:11.602412 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:19:11.602388 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-26h5n_2e027e5e-259c-4e7d-a90f-7dbf717f7701/kube-rbac-proxy/0.log" Jun 15 02:19:11.773210 ip-10-0-132-124 kubenswrapper[2576]: I0615 02:19:11.773136 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-846697d79d-m7gkq_52b7be5b-ae33-4595-bcc6-54e125bd6de8/router/0.log"